Hi
One of the job in our project is compiling for 30mins , the jobs is not very complicated also
4 lookup stages
6 trasnformers
4 Oracle Connectors
and few other stages
Please suggest how can we reduce the compilation time
Thanks in advance
Search found 17 matches
- Wed Jun 13, 2012 11:58 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Regarding Compilation of job
- Replies: 2
- Views: 1477
- Thu Mar 31, 2011 10:38 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Regadring Date Conversion and Comparison
- Replies: 2
- Views: 2070
Regadring Date Conversion and Comparison
Hi I have input column having date value with char Datatype with value in the format (yymmdd) ex:110110 Now i need to compare with the job run date(which Iam passing as parameter in fomat yymmdd) whether the input date is greater than or equal to this date so when converting the input value using St...
- Wed Mar 16, 2011 12:49 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Difference betwwen dates
- Replies: 3
- Views: 2244
- Wed Mar 16, 2011 12:29 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Difference betwwen dates
- Replies: 3
- Views: 2244
Difference betwwen dates
Hi I will run my job on friday(ex :18/03/2011) .. i need to to take monday date (ex : 21/03/2011) and find the number of days between 01/01/1972 and the monday date for ref Date: 010172 Day: 00001 Date: 090472 Day: 00100 Date: 160311 Day: 14320 Please help me in implementing this Thanks Vidya
- Thu Mar 03, 2011 3:12 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Logic Implementation in Transfomer
- Replies: 7
- Views: 3644
- Thu Mar 03, 2011 12:44 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Logic Implementation in Transfomer
- Replies: 7
- Views: 3644
- Wed Mar 02, 2011 10:43 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Logic Implementation in Transfomer
- Replies: 7
- Views: 3644
Logic Implementation in Transfomer
Hi Though i have partioned (HASH) with transaction type ,iam geting duplicate batch id 's in parallel mode ex: Partition1 batchid partiotion2 batchid 100 1 200 1 100 1 300 2 400 2 500 3 please sugeeat Some other solution ???
- Wed Mar 02, 2011 2:17 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Logic Implementation in Transfomer
- Replies: 7
- Views: 3644
Logic Implementation in Transfomer
Hi I need create a batch id(001,002,003) for each transaction type (1234,459,3657).I have impelmented this in transformer by incrementing the batch id for change in transaction type Since my job in running on 2 nodes iam getting duplicate batch id's,when runed in Sequential mode it is fine Please le...
- Tue Mar 01, 2011 5:19 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Implemention of aggregate funtion SUM
- Replies: 6
- Views: 2813
Implemention of aggregate funtion SUM
Thanks Ray ..
Implemented working fn ..![Cool 8)](./images/smilies/icon_cool.gif)
Implemented working fn ..
![Cool 8)](./images/smilies/icon_cool.gif)
- Mon Feb 28, 2011 11:53 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Implemention of aggregate funtion SUM
- Replies: 6
- Views: 2813
Hi Ray Thanks for the early reply .. :) one last clarification .. :?: The key cloumn now i have for fork join is country code (ind,aus,nep) coming from aggrator output ,which will have duplicate values,so please can you let me know which type of join i need to perform (inner,left) iam also placing a...
- Mon Feb 28, 2011 10:24 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Implemention of aggregate funtion SUM
- Replies: 6
- Views: 2813
Implemention of aggregate funtion SUM
Hi ray, I just want to clarify one more thing,intially iam doing the lookup b/w source file and lookup file with 5 key cloumns. But for aggregation ,i just use one key column of the 5 key cloumns,so doing a fork join based on just one key , will this affect my logic flow Can i perform this without l...
- Mon Feb 28, 2011 4:20 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Implemention of aggregate funtion SUM
- Replies: 6
- Views: 2813
Implemention of aggregate funtion SUM
Hi All I need to sum the amounts(100,200,-300 etc) based on code(abc,def,gkt etc) key column,but i want this implementation to be done without using aggration stage Since using aggration stage,we cannot carry fwd remaining columns for further transformation. Though we can do self join after aggragat...
- Mon Feb 28, 2011 4:06 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: To Implement aagregate functionality without using aggregate
- Replies: 3
- Views: 3910
To Implement aagregate functionality without using aggregate
Hi All I need to sum the amounts(100,200,-300 etc) based on code(abc,def,gkt etc) key column,but i want this implementation to be done without using aggration stage Since using aggration stage,we cannot carry fwd remaining columns for further transformation.Though we can do self join after aggregati...
- Wed Feb 23, 2011 2:19 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Require more information on datastage 8.5 transformer stage
- Replies: 4
- Views: 7111
Require more information on datastage 8.5 transformer stage
In Datastage they hav introdces new features in transformer stage such as we can define loops that output multiple output rows from every input row or that aggregate multiple input rows into a single input row
i want to know how this is getting implemented
Thanks,
Vidya
i want to know how this is getting implemented
Thanks,
Vidya
- Wed Feb 23, 2011 1:59 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Remove Hexadecimal Characters in Datastage
- Replies: 3
- Views: 7289