Thanks for breif explanation of the logic..
I worry little bit abt performance ,how this logic will impact on 10 - 20 million records.
Once i implement this logic ,i'll share my results ...
i use 4 nodes config file..
Search found 7 matches
- Thu Oct 18, 2007 10:28 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Append Header and Trailer Record for each group
- Replies: 5
- Views: 3202
- Thu Oct 18, 2007 8:30 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Append Header and Trailer Record for each group
- Replies: 5
- Views: 3202
- Wed Oct 17, 2007 12:48 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Append Header and Trailer Record for each group
- Replies: 5
- Views: 3202
Append Header and Trailer Record for each group
Hi, I have a scenario like this reading data from a file and writing to a file Say for ex their are some 100 groups in a file and each group might have 50 records. And i need to append HDR record with seq no and TRL record with count of the records and sum of one column in that group Any Suggestions...
- Thu Sep 20, 2007 11:48 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Sparse Lookup
- Replies: 1
- Views: 1391
Sparse Lookup
Hi Folks, I know the sparse lookup purpose but i was curious abt the behaviour of sparse lkp on high volume of data. I mean the source file got 1 million records and the reference table(oracle) got almost 100 million records. For each source record their might be 10 to 100 lkp records in reference t...
- Mon Sep 17, 2007 3:17 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Node configuration
- Replies: 6
- Views: 2334
Say for ex If i want to use 100 GB for specific project ABC and i want to run all jobs in specific project ABC on 4 or 6 nodes for more performance. This is the way i'm following,please correct me if i doing some thing wrong or is their better way: 1.Create a config file for the Project ABC and usin...
- Wed Sep 12, 2007 11:05 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Node configuration
- Replies: 6
- Views: 2334
- Wed Sep 12, 2007 9:45 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Node configuration
- Replies: 6
- Views: 2334
Node configuration
Hi, we are trying to add more space to one of the project on a Aix server.Here our main goal is to utilize the new space or new mountpoint for this specific project in performance view. i mean do i have to edit the config file or just change the dataset or txt file path in environment level. Is thei...