Search found 504 matches

by ShaneMuir
Mon Jul 20, 2015 10:11 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Historization in Datastage Parallel job.
Replies: 8
Views: 5100

So? You are still outputting the same number rows that you input. So technically you are only ever performing one update per column per input row. (ie in your example 3 potential column updates per input row). You just apply each change in a stage variable. If you data is sorted and partitioned corr...
by ShaneMuir
Mon Jul 20, 2015 9:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Historization in Datastage Parallel job.
Replies: 8
Views: 5100

I have tried using stage variable and storing the values in it then using the same stage varibale to pass the value if the value is null, but this is not working as i have not considered the key for the loop. No need for a loop Just partition your data on the "Key" field and sort your dat...
by ShaneMuir
Mon Jul 20, 2015 5:25 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Historization in Datastage Parallel job.
Replies: 8
Views: 5100

So I am assuming here that your update data should actually look like this: 3 updates on the key 55 Key COL_A COL_B COL_C time 55 456 3/07/2015 8:00 55 ghi 3/07/2015 9:00 55 jkl 3/07/2015 10:00 Personally - I interpret is as follows: What you are really doing is not an update but a delete/update the...
by ShaneMuir
Mon Jul 20, 2015 3:16 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Abnormal termination of stage, CLOBs, ODBC
Replies: 9
Views: 14226

There was a post earlier this month dealing with CLOBs, and the issue was something about the positioning of the the CLOB field. The issue suggested that the CLOB field had to be last field in the schema for the stage to work. Admittedly this was a DB2 issue on parallel, but when looking at the issu...
by ShaneMuir
Thu Jul 16, 2015 6:32 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sorting big volume data
Replies: 15
Views: 10480

I made sort after filter and it decrease time of running job. Probably - most likely because you are sorting less data. Now I am planning to decrease columns in joins to use only needed and the rest i will send to the end of job usig copy. I also going to merge these two jobs in one job to avoid lo...
by ShaneMuir
Thu Jul 16, 2015 2:52 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Create new row for each location
Replies: 5
Views: 3238

If your input is variable as to the number of columns for location, but the first two identifier columns are static, then just use a transformer. Separate the first 2 columns using the field function. Get a count of the remaining delimiters and use the loop functionality to output a row for each del...
by ShaneMuir
Tue Jul 14, 2015 6:50 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sorting big volume data
Replies: 15
Views: 10480

1. Data is coming from other job which is ended by dataset Is it possible to sort the data in the job that is creating that dataset? Can you sort the data in the previous job 4. At the beginning this one sort take a lot of time - it means kill:) Are you sure that it that first sort that is taking t...
by ShaneMuir
Mon Jul 13, 2015 9:55 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Converting exponential notation to integer
Replies: 11
Views: 12005

ArndW wrote:that is faster and easier to understand. ...
Excellent! And good to know that its faster.
by ShaneMuir
Mon Jul 13, 2015 8:25 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Converting exponential notation to integer
Replies: 11
Views: 12005

ArndW wrote:I can't find it in my documentation for the DecimalToString.
I am pretty sure its still there. It would be "suppress_zero"
by ShaneMuir
Mon Jul 13, 2015 7:11 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Converting exponential notation to integer
Replies: 11
Views: 12005

When did this happen. Did they remove the "suppress_zero" option?
by ShaneMuir
Mon Jul 13, 2015 6:36 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Converting exponential notation to integer
Replies: 11
Views: 12005

So you cannot just convert to dfloat to decimal, then decimal to string and suppress zeros?
by ShaneMuir
Mon Jul 13, 2015 5:56 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Converting exponential notation to integer
Replies: 11
Views: 12005

Failing that - doesn't the E represent the number of places to move the decimal?

So using the E as a delimiter split your values into the digit (the first part) and the exponential and just multiply them out?
6.4443433E7 = 6.4443433*10^7
by ShaneMuir
Mon Jul 13, 2015 5:51 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Converting exponential notation to integer
Replies: 11
Views: 12005

I assume that this cannot be done at source and/or target?
by ShaneMuir
Mon Jul 13, 2015 3:40 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sorting big volume data
Replies: 15
Views: 10480

Ok a few questions: 1. If your input is datasets, how are they populated? Is that data coming from a DB (ie can you easily sort your data prior to writing to the dataset?) 2. What is your filter actually doing? I assume it splits into different metrics of the AID? Else why are your steps 3 and 4 doi...
by ShaneMuir
Fri Jul 10, 2015 2:28 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: RCP - CDC Stage - Partitoning and Sorting
Replies: 17
Views: 10535

Can you just quickly explain how you are setting your key value field for both the DB and the Seq file?

Are you passing a set of column names from a parameter set?