Search found 7 matches

by rao_2004
Thu Oct 18, 2007 10:28 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Append Header and Trailer Record for each group
Replies: 5
Views: 3202

Thanks for breif explanation of the logic..
I worry little bit abt performance ,how this logic will impact on 10 - 20 million records.
Once i implement this logic ,i'll share my results ...
i use 4 nodes config file..
by rao_2004
Thu Oct 18, 2007 8:30 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Append Header and Trailer Record for each group
Replies: 5
Views: 3202

Can you explain me little bit briefly after sorting data..

Thanks
rao
by rao_2004
Wed Oct 17, 2007 12:48 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Append Header and Trailer Record for each group
Replies: 5
Views: 3202

Append Header and Trailer Record for each group

Hi, I have a scenario like this reading data from a file and writing to a file Say for ex their are some 100 groups in a file and each group might have 50 records. And i need to append HDR record with seq no and TRL record with count of the records and sum of one column in that group Any Suggestions...
by rao_2004
Thu Sep 20, 2007 11:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sparse Lookup
Replies: 1
Views: 1391

Sparse Lookup

Hi Folks, I know the sparse lookup purpose but i was curious abt the behaviour of sparse lkp on high volume of data. I mean the source file got 1 million records and the reference table(oracle) got almost 100 million records. For each source record their might be 10 to 100 lkp records in reference t...
by rao_2004
Mon Sep 17, 2007 3:17 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Node configuration
Replies: 6
Views: 2334

Say for ex If i want to use 100 GB for specific project ABC and i want to run all jobs in specific project ABC on 4 or 6 nodes for more performance. This is the way i'm following,please correct me if i doing some thing wrong or is their better way: 1.Create a config file for the Project ABC and usin...
by rao_2004
Wed Sep 12, 2007 11:05 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Node configuration
Replies: 6
Views: 2334

You mean,i have to to pass parameter $APT_CONFIG_FILE for all jobs that are developed for the project and point at the disk space.
by rao_2004
Wed Sep 12, 2007 9:45 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Node configuration
Replies: 6
Views: 2334

Node configuration

Hi, we are trying to add more space to one of the project on a Aix server.Here our main goal is to utilize the new space or new mountpoint for this specific project in performance view. i mean do i have to edit the config file or just change the dataset or txt file path in environment level. Is thei...