Search found 504 matches
- Mon Jul 20, 2015 10:11 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Historization in Datastage Parallel job.
- Replies: 8
- Views: 5100
So? You are still outputting the same number rows that you input. So technically you are only ever performing one update per column per input row. (ie in your example 3 potential column updates per input row). You just apply each change in a stage variable. If you data is sorted and partitioned corr...
- Mon Jul 20, 2015 9:41 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Historization in Datastage Parallel job.
- Replies: 8
- Views: 5100
- Mon Jul 20, 2015 5:25 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Historization in Datastage Parallel job.
- Replies: 8
- Views: 5100
So I am assuming here that your update data should actually look like this: 3 updates on the key 55 Key COL_A COL_B COL_C time 55 456 3/07/2015 8:00 55 ghi 3/07/2015 9:00 55 jkl 3/07/2015 10:00 Personally - I interpret is as follows: What you are really doing is not an update but a delete/update the...
- Mon Jul 20, 2015 3:16 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Abnormal termination of stage, CLOBs, ODBC
- Replies: 9
- Views: 14226
There was a post earlier this month dealing with CLOBs, and the issue was something about the positioning of the the CLOB field. The issue suggested that the CLOB field had to be last field in the schema for the stage to work. Admittedly this was a DB2 issue on parallel, but when looking at the issu...
- Thu Jul 16, 2015 6:32 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Sorting big volume data
- Replies: 15
- Views: 10480
I made sort after filter and it decrease time of running job. Probably - most likely because you are sorting less data. Now I am planning to decrease columns in joins to use only needed and the rest i will send to the end of job usig copy. I also going to merge these two jobs in one job to avoid lo...
- Thu Jul 16, 2015 2:52 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Create new row for each location
- Replies: 5
- Views: 3238
If your input is variable as to the number of columns for location, but the first two identifier columns are static, then just use a transformer. Separate the first 2 columns using the field function. Get a count of the remaining delimiters and use the loop functionality to output a row for each del...
- Tue Jul 14, 2015 6:50 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Sorting big volume data
- Replies: 15
- Views: 10480
1. Data is coming from other job which is ended by dataset Is it possible to sort the data in the job that is creating that dataset? Can you sort the data in the previous job 4. At the beginning this one sort take a lot of time - it means kill:) Are you sure that it that first sort that is taking t...
- Mon Jul 13, 2015 9:55 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Converting exponential notation to integer
- Replies: 11
- Views: 12005
- Mon Jul 13, 2015 8:25 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Converting exponential notation to integer
- Replies: 11
- Views: 12005
- Mon Jul 13, 2015 7:11 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Converting exponential notation to integer
- Replies: 11
- Views: 12005
- Mon Jul 13, 2015 6:36 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Converting exponential notation to integer
- Replies: 11
- Views: 12005
- Mon Jul 13, 2015 5:56 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Converting exponential notation to integer
- Replies: 11
- Views: 12005
- Mon Jul 13, 2015 5:51 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Converting exponential notation to integer
- Replies: 11
- Views: 12005
- Mon Jul 13, 2015 3:40 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Sorting big volume data
- Replies: 15
- Views: 10480
Ok a few questions: 1. If your input is datasets, how are they populated? Is that data coming from a DB (ie can you easily sort your data prior to writing to the dataset?) 2. What is your filter actually doing? I assume it splits into different metrics of the AID? Else why are your steps 3 and 4 doi...
- Fri Jul 10, 2015 2:28 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: RCP - CDC Stage - Partitoning and Sorting
- Replies: 17
- Views: 10535