Search found 7 matches

by yogeshhd
Tue Feb 01, 2011 11:06 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: sort stage is taking too much of time
Replies: 7
Views: 7224

sort stage is taking too much of time

In my job I am using sort stages in primary and reference links which goes to the join stage. The Primary link and reference link both has huge data(oracle tables), primary link has around 15 million records and reference link has 35-40 million records. The job is running for more than 2 hours but t...
by yogeshhd
Mon Oct 18, 2010 11:50 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: need to concatenate multiple input columns into 1 output col
Replies: 3
Views: 3722

need to concatenate multiple input columns into 1 output col

need to concatenate multiple input columns into 1 output column for each record. I am reading data from xml sources, after reading data the requirement is to concatenate the input columns of a record to 1 column and store. I feel using transformer stage variable is expensive. Please suggest any alte...
by yogeshhd
Tue Sep 14, 2010 3:22 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to use MQ stage after XML stage
Replies: 1
Views: 1707

How to use MQ stage after XML stage

XML stage is generating xmls and storing in unix system in my job. Instead of storing in unix I want to directly send that file to message queue. I created a output link for the xml output stage and made as input to MQ stage but the job is not writing proper messages into the queue. Please let me kn...
by yogeshhd
Wed Sep 01, 2010 5:59 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How much big xml file a XML input stage can process
Replies: 4
Views: 2385

The files are of size 500 MB. I am passing xml file names with directory path to the xml input stage.
by yogeshhd
Wed Sep 01, 2010 5:11 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How much big xml file a XML input stage can process
Replies: 4
Views: 2385

How much big xml file a XML input stage can process

I am using XML input stage in a parallel job. I wanted to know how big xml file the xml input stage can handle? if some one has info on how this stage uses memory that would be helpful for me. thanks
by yogeshhd
Wed Jul 28, 2010 6:43 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to find memory utiliztion of a parallel job?
Replies: 6
Views: 3552

topas gives the statistics at the server level. I am much intereseted at the individual job.
by yogeshhd
Wed Jul 28, 2010 6:37 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to find memory utiliztion of a parallel job?
Replies: 6
Views: 3552

How to find memory utiliztion of a parallel job?

Do we have any unix commands to get the memory utilization of the jobs