Search found 143 matches

by anu123
Fri Jan 19, 2007 2:34 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Counts and sums in Datastage with out 'Aggregator' stage
Replies: 21
Views: 28039

Guru: could you please check my previous to previous post. I am not getting the output as you mentioned. thanks in advance. Yes you can. Add another stage variable say svSum. Put it after svCnt and before svPrevRow. Its derivation will be if input.key1:input:key2:input.key3 <> svPrevRow Then svSum E...
by anu123
Fri Jan 19, 2007 12:25 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Counts and sums in Datastage with out 'Aggregator' stage
Replies: 21
Views: 28039

Thank you. Is there any way that we can SUM the $amounts too in transformer.for example in the same above example we have 5th col. $amt. We need to SUM($amt) from keys '100,200,300' where Desc = 'er'. I would also suggest to go with Aggregator stage. Usage staging variable will almost takes same tim...
by anu123
Fri Jan 19, 2007 9:51 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Counts and sums in Datastage with out 'Aggregator' stage
Replies: 21
Views: 28039

I am getting an output as below.. key1,key2,key3,desc, Count ------------------------- 100,200,300,er,1 100,200,300,er,1 100,200,300,er,1 111,222,333,er,1 111,222,333,er,1 They had bad experiences with 'Agg' stage in 7.5.1 PX especially when dealing with 500 millions (or more) of data in each run.I ...
by anu123
Fri Jan 19, 2007 9:11 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Counts and sums in Datastage with out 'Aggregator' stage
Replies: 21
Views: 28039

thanks again for your time guru.. Input key1,key2,key3,desc ------------------- 100,200,300,er 100,200,300,er 100,200,300,er 111,222,333,er 111,222,333,er Output should be key1,key2,key3,count -------------------- 100,200,300,3 111,222,333,2 Input is coming from a table.There are a few other keys al...
by anu123
Fri Jan 19, 2007 8:27 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Counts and sums in Datastage with out 'Aggregator' stage
Replies: 21
Views: 28039

Did you check the embeded post in my previous reply? Vincent has given the complete code on how to get it done. thanks Guru. I checked the embedded post and tried to implement that logic. But in my case, I should not be writing each row to output but count them in a loop and write to output along w...
by anu123
Thu Jan 18, 2007 9:16 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Counts and sums in Datastage with out 'Aggregator' stage
Replies: 21
Views: 28039

thanks DSguru2B and Kumar. In real scenario, I have 8 columns to group by. And the data is like 500 mil. per each run. I have been trying with stage variables. But wondering how to retain previous key col values to check with incoming val. every time. I created 2 stage variables like svPrevRow and s...
by anu123
Thu Jan 18, 2007 4:04 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Counts and sums in Datastage with out 'Aggregator' stage
Replies: 21
Views: 28039

Counts and sums in Datastage with out 'Aggregator' stage

Hi all The scenario is as below. key1,key2,desc ------------------- a,b,emergency_room a,b,emergency_room a,b,emergency_room m,n,emergency_room m,n,emergency_room x,y,emergency_room output key1,key2,count ---------------- a,b,3 m,n,2 x,y,1 Can this be done in datastage? I was asked not use Aggregato...
by anu123
Fri Jan 05, 2007 5:08 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to generate multiple rows?
Replies: 11
Views: 3335

Thank you every one for your valuable time and suggessions.I will update you all once I am done with that.

thanks again..
chulett wrote:Or that. :lol:
by anu123
Fri Jan 05, 2007 9:13 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to generate multiple rows?
Replies: 11
Views: 3335

source : 100 DAVE YAHOO 200 ANN MS 300 SCOTT ORACLE output 100 DAVE YAHOO 1 CHRONIC 100 DAVE YAHOO 2 HELTHY 100 DAVE YAHOO 3 CORDIAC 200 ANN MS 1 CHRONIC 200 ANN MS 2 HELTHY 200 ANN MS 3 CORDIAC 300 SCOTT ORACLE 1 CHRONIC 300 SCOTT ORACLE 2 HELTHY 300 SCOTT ORACLE 3 CORDIAC in this case below are st...
by anu123
Thu Jan 04, 2007 10:02 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to generate multiple rows?
Replies: 11
Views: 3335

Thank you all for your time. each row may be needed to copy more than thrice depending on case.But based on the case 'Number of Copies' I need to make is static(i.e 3/10/50..). If its '3', having 3 streams to feed 3 transformers sounds good. But if its '50', we probably may need better approach. 'xx...
by anu123
Thu Jan 04, 2007 9:20 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to generate multiple rows?
Replies: 11
Views: 3335

How to generate multiple rows?

Helo every one. I have a scenario as below... input(a FILE): col1 col2 col3 --------------------- 100 aa1 bb1 200 aa2 bb2 Output needed as (also a FILE) col1 col2 col3 col4 col5 ---------------------------- 100 aa1 bb1 xx1 yy1 100 aa1 bb1 xx2 yy2 100 aa1 bb1 xx3 yy3 200 aa2 bb2 xx1 yy1 200 aa2 bb2 x...
by anu123
Thu Dec 28, 2006 2:50 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Could not use Oracle_Enterprise Stage
Replies: 4
Views: 2242

I checked the LIBPATH. 32 bit lib is at below dir.

/u01/app/oracle/product/9.2.0.6-64/lib32


thanks
lstsaur wrote:Anu,
Check where is your 32-bit lib in LD_LIBRARY_PATH?
by anu123
Thu Dec 28, 2006 10:04 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Could not use Oracle_Enterprise Stage
Replies: 4
Views: 2242

Could not use Oracle_Enterprise Stage

we are unable to use Oracle_Enterprise stage. job get aborted with below error msg. main_program: Error loading "orchoracle": Could not load "orchoracle": 0509-022 Cannot load module . 0509-026 System error: A file or directory in the path name does not exist.. Could not locate o...
by anu123
Thu Dec 28, 2006 9:49 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Could not check all operators
Replies: 8
Views: 5492

Re: Could not check all operators

are you using 'Generated SQL' or 'User Defined'? Are you using 'alias' names for col.? main_program: orchgeneral: loaded orchsort: loaded orchstats: loaded main_program: Returning step status of APT_StatusOk. main_program: Could not check all operators because of previous error(s) [api/step_rep.C:11...
by anu123
Mon Sep 18, 2006 4:35 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: USER DEFINED SQL FILE WITH DRS STAGE
Replies: 28
Views: 14817

kris007 wrote:In case you just missed it, I have posted it before your post. :wink:
I got it. Thank you very much.