Search found 11 matches

by mayurkb
Mon May 23, 2016 10:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Join stage not working in CDC parallel job
Replies: 6
Views: 5198

Thank you all for the inputs. I'll see if I find any books that puts out restrictions. I did look into EOW (end of wave) markers so I'm using ODBC stage which has an option to emit those waves or not and I've disabled that so that it does not interfere with main data and its EOW markers. I do not kn...
by mayurkb
Fri May 20, 2016 2:01 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Join stage not working in CDC parallel job
Replies: 6
Views: 5198

Join stage not working in CDC parallel job

We have a CDC parallel job running in continuous mirroring mode. We are using join stage to lookup extra information. The join stage pulls the data from the referenced table correctly for the first time. But for subsequent records, it does not pull anything from the referenced table. So with inner j...
by mayurkb
Thu May 05, 2016 10:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Error handling in a CDC job
Replies: 3
Views: 3010

Re: Error handling in a CDC job

No reply from anybody? Let me rephrase my question.
What is the best practice for handling errors in CDC parallel job?
by mayurkb
Fri Apr 29, 2016 12:14 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Error handling in a CDC job
Replies: 3
Views: 3010

Error handling in a CDC job

I'm going to have 2 always running CDC parallel jobs for real time ETL. I would like to get some inputs from members on apart from reject links, are there any other error handling functionalities available in the parallel jobs which would accomplish - 1. The job should not crash and should always st...
by mayurkb
Fri Apr 29, 2016 12:09 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: APT_BadAlloc: Heap allocation failed error in parallel job
Replies: 9
Views: 7512

I was able to fix these errors by reducing the xml column widths and reducing the size on following of job parameters.
$APT_DEFAULT_TRANSPORT_BLOCK_SIZE and $APT_MAX_TRANSPORT_BLOCK_SIZE.
by mayurkb
Tue Apr 05, 2016 12:52 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: APT_BadAlloc: Heap allocation failed error in parallel job
Replies: 9
Views: 7512

Thank you again. I meant what are my options if I'm running out of memory?
by mayurkb
Mon Apr 04, 2016 1:41 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: APT_BadAlloc: Heap allocation failed error in parallel job
Replies: 9
Views: 7512

Thank you.
How do I disable operator combination?
what are my options here?
by mayurkb
Mon Apr 04, 2016 11:20 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: APT_BadAlloc: Heap allocation failed error in parallel job
Replies: 9
Views: 7512

APT_BadAlloc: Heap allocation failed error in parallel job

I'm using lot of xml input stages in a parallel job. Currently I've 4 xml input stages but when I add 5th xmlinput stage, I get following error: _CombinedOperatorController(1),0: Caught exception from runLocally(): APT_BadAlloc: Heap allocation failed.. APT_CombinedOperatorController(1),0: The runLo...
by mayurkb
Mon Jan 18, 2016 8:25 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to output source non-xml columns from xml input stage
Replies: 5
Views: 2570

Thanks a lot! You are a lifesaver. Why is this feature not documented anywhere?
by mayurkb
Thu Jan 14, 2016 4:14 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to output source non-xml columns from xml input stage
Replies: 5
Views: 2570

How to output source non-xml columns from xml input stage

Hello, I'm new DataStage. I'm trying to figure out how can I get input columns that are not xml as part of output columns. Take the following scenario - Input has 2 columns - Key and SourceXML. SourceXml produces ~20 columns in the output. But I also want Key to be as output column. Is there anyway ...