DSXchange

Here is the closest thing I got for this, but it did not serve my purpose. (I am not a UNIX expert by the way) http://stackoverflow.com/questions/6081465/how-to-remove-carriage-returns-in-the-middle-of-a-line/36607027#36607027 1. Server jobs are no longer allowed in our company 2. From documentation...

We are migrating data from Access database to DataStage 8.7. Data is extracted in form of tab delimited .txt files from Access database. These files are read and loaded into Oracle database using DataStage We are facing problem with ^M within the fields. (^M at the end of the records is not an issue...

Thank you very much for your reply. The default values were missing for decimal columns and were manually updated in Records tab to resolve the issue. Marking this as resolved.

Thank you

Hi, We are using a CFF stage to read a EBCDIC file which is currently loaded in production using SQL loader correctly. The copybook received was imported into DataStage. Here is the copybook. 01 XD12. 10 XD12-BR-NUM PIC X(10). 10 XD12-CUST-NUM PIC X(20). 10 XD12-BUS-PHONE-EXT PIC S9(04) PACKED-DECIM...

Scratch space of the compute nodes, minimun 25 GB, must be a local disk, not NAS-mounted or NFS-mount. It seems like your job's scratch processing is all done on the head node. No wonder job takes longer to finish. It seems that it was a local disk before. But for better maintenance and performance...

Configuration File IIS-DSEE-DYNG0014 <Dynamic_grid.sh>Information: SEQFILE Host(s): xxx_ServerName: xxx_ServerName: { node "Conductor" { fastname "zzz_ServerName" pools "conductor" resource disk "/opt/<resource disk>" {pools ""} resource scratchdisk...

We are migrating jobs from 7.5.1 to 8.7 Grid env. Job Design Oracle Connector -> Sort (2 key columns) -> Transformer (record comparision, transformations and 4 links out) -> Funnel -> Remove duplicates (based on 4 columns) -> Sequential File Problem 1. Job processes about 120 million records and tak...

Thanks Ray. I changed the array size to 50, 100000 but the job aborted with the same error. When I ran from our 7.5.1 environment (has Oracle Enterprise stage) , the job aborted too, however it loaded all except 4 records into the Oracle table. One column had special characters in these 4 records. I...

The record count goes up drastically in the month end closure.

Experts Job Design Sequential file with schema file, RCP loading into Oracle table using Oracle connector Stage. Record Count: 2000 and Array Size: 500, Number of columns loaded: 100 with many date fields and max varchar size is 100 Error Ora_Load_Data,0: The OCI function OCIStmtExecute returned st...

This is a very unusual requirement. How about asking for a schema file for every source file you get? Is it possible? If yes, I believe, you can use schema file for metadata and RCP for column propagation. If not, you do not have a set pattern (consistent) of the problem to resolve. Hence it is not ...

Thank you. I used APT_NO_SORT_INSERTION and APT_NO_SORT_OPTIMIZATION. However, it still did not work as expected. In the interest of time, I had to fall back on the last resort to make the keys available to sort and later remove it from the script. It worked fine.

Thanks
DataStage Sterling

Kiran, I am not sure why you replaced the transformer. Assuming you have only one transformer with 10 columns + any constraints, 1. Make copy of the job 2. Remove the constraint and compile, if successful it means the problem is with constraint 3. Revert the copy of the job, remove 5 of the 10 colum...

What Andy suggested works perfectly. I had a similar situation in our migration from 7.5.1 to 8.7. The jobs compiled successfully in 7.5.1 but not in 8.7. I started by removing 80% of the columns and increasing it gradually until I finally found out the problem was with a transformation from null va...

Hi We are migrating from Datastage 7.5.1 to 8.7. Configuration 7.5.1 - 4node 8.7 - Grid 2x2 (APT_GRID_COMPUTENODES=2, APT_GRID_PARTITIONS=2) DataStage job design (unchanged in migration) Db -> sort -> transformer -> sequential file The requirement is to create a sorted output in the sequential file ...