Search found 143 matches
- Fri Jan 19, 2007 2:34 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Counts and sums in Datastage with out 'Aggregator' stage
- Replies: 21
- Views: 28039
Guru: could you please check my previous to previous post. I am not getting the output as you mentioned. thanks in advance. Yes you can. Add another stage variable say svSum. Put it after svCnt and before svPrevRow. Its derivation will be if input.key1:input:key2:input.key3 <> svPrevRow Then svSum E...
- Fri Jan 19, 2007 12:25 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Counts and sums in Datastage with out 'Aggregator' stage
- Replies: 21
- Views: 28039
Thank you. Is there any way that we can SUM the $amounts too in transformer.for example in the same above example we have 5th col. $amt. We need to SUM($amt) from keys '100,200,300' where Desc = 'er'. I would also suggest to go with Aggregator stage. Usage staging variable will almost takes same tim...
- Fri Jan 19, 2007 9:51 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Counts and sums in Datastage with out 'Aggregator' stage
- Replies: 21
- Views: 28039
I am getting an output as below.. key1,key2,key3,desc, Count ------------------------- 100,200,300,er,1 100,200,300,er,1 100,200,300,er,1 111,222,333,er,1 111,222,333,er,1 They had bad experiences with 'Agg' stage in 7.5.1 PX especially when dealing with 500 millions (or more) of data in each run.I ...
- Fri Jan 19, 2007 9:11 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Counts and sums in Datastage with out 'Aggregator' stage
- Replies: 21
- Views: 28039
thanks again for your time guru.. Input key1,key2,key3,desc ------------------- 100,200,300,er 100,200,300,er 100,200,300,er 111,222,333,er 111,222,333,er Output should be key1,key2,key3,count -------------------- 100,200,300,3 111,222,333,2 Input is coming from a table.There are a few other keys al...
- Fri Jan 19, 2007 8:27 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Counts and sums in Datastage with out 'Aggregator' stage
- Replies: 21
- Views: 28039
Did you check the embeded post in my previous reply? Vincent has given the complete code on how to get it done. thanks Guru. I checked the embedded post and tried to implement that logic. But in my case, I should not be writing each row to output but count them in a loop and write to output along w...
- Thu Jan 18, 2007 9:16 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Counts and sums in Datastage with out 'Aggregator' stage
- Replies: 21
- Views: 28039
thanks DSguru2B and Kumar. In real scenario, I have 8 columns to group by. And the data is like 500 mil. per each run. I have been trying with stage variables. But wondering how to retain previous key col values to check with incoming val. every time. I created 2 stage variables like svPrevRow and s...
- Thu Jan 18, 2007 4:04 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Counts and sums in Datastage with out 'Aggregator' stage
- Replies: 21
- Views: 28039
Counts and sums in Datastage with out 'Aggregator' stage
Hi all The scenario is as below. key1,key2,desc ------------------- a,b,emergency_room a,b,emergency_room a,b,emergency_room m,n,emergency_room m,n,emergency_room x,y,emergency_room output key1,key2,count ---------------- a,b,3 m,n,2 x,y,1 Can this be done in datastage? I was asked not use Aggregato...
- Fri Jan 05, 2007 5:08 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to generate multiple rows?
- Replies: 11
- Views: 3335
- Fri Jan 05, 2007 9:13 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to generate multiple rows?
- Replies: 11
- Views: 3335
source : 100 DAVE YAHOO 200 ANN MS 300 SCOTT ORACLE output 100 DAVE YAHOO 1 CHRONIC 100 DAVE YAHOO 2 HELTHY 100 DAVE YAHOO 3 CORDIAC 200 ANN MS 1 CHRONIC 200 ANN MS 2 HELTHY 200 ANN MS 3 CORDIAC 300 SCOTT ORACLE 1 CHRONIC 300 SCOTT ORACLE 2 HELTHY 300 SCOTT ORACLE 3 CORDIAC in this case below are st...
- Thu Jan 04, 2007 10:02 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to generate multiple rows?
- Replies: 11
- Views: 3335
Thank you all for your time. each row may be needed to copy more than thrice depending on case.But based on the case 'Number of Copies' I need to make is static(i.e 3/10/50..). If its '3', having 3 streams to feed 3 transformers sounds good. But if its '50', we probably may need better approach. 'xx...
- Thu Jan 04, 2007 9:20 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to generate multiple rows?
- Replies: 11
- Views: 3335
How to generate multiple rows?
Helo every one. I have a scenario as below... input(a FILE): col1 col2 col3 --------------------- 100 aa1 bb1 200 aa2 bb2 Output needed as (also a FILE) col1 col2 col3 col4 col5 ---------------------------- 100 aa1 bb1 xx1 yy1 100 aa1 bb1 xx2 yy2 100 aa1 bb1 xx3 yy3 200 aa2 bb2 xx1 yy1 200 aa2 bb2 x...
- Thu Dec 28, 2006 2:50 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Could not use Oracle_Enterprise Stage
- Replies: 4
- Views: 2242
- Thu Dec 28, 2006 10:04 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Could not use Oracle_Enterprise Stage
- Replies: 4
- Views: 2242
Could not use Oracle_Enterprise Stage
we are unable to use Oracle_Enterprise stage. job get aborted with below error msg. main_program: Error loading "orchoracle": Could not load "orchoracle": 0509-022 Cannot load module . 0509-026 System error: A file or directory in the path name does not exist.. Could not locate o...
- Thu Dec 28, 2006 9:49 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Could not check all operators
- Replies: 8
- Views: 5492
Re: Could not check all operators
are you using 'Generated SQL' or 'User Defined'? Are you using 'alias' names for col.? main_program: orchgeneral: loaded orchsort: loaded orchstats: loaded main_program: Returning step status of APT_StatusOk. main_program: Could not check all operators because of previous error(s) [api/step_rep.C:11...
- Mon Sep 18, 2006 4:35 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: USER DEFINED SQL FILE WITH DRS STAGE
- Replies: 28
- Views: 14817