Search found 21 matches

by lkthoma
Thu Sep 28, 2006 7:49 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Abnormal termination of stage hashed file detected
Replies: 12
Views: 5479

I just recently worked with DataStage support on an issue I was having much like this. What it turned out to be was a job level setting. IBM advised me at that in the Job Parameters option to look on the performance tab. Once there they had me un-check the 'use poject defaults' and select the 'enabl...
by lkthoma
Fri May 26, 2006 9:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Calling a Java Program from DataStage
Replies: 3
Views: 2111

Something I have done that is a bit cheesy is to call a unix script, and pass the variables into it. And then in the unix script, execute the java program.
by lkthoma
Fri May 26, 2006 9:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: where is the PATH variable value will be set in DataStage
Replies: 10
Views: 5792

You can also source the dsenv in the actual script you are executing in your before-routine.
by lkthoma
Fri May 26, 2006 9:35 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: PX job never completes
Replies: 5
Views: 1189

I did some more testing and it is a deadlock issue. It appears to be an issue that is a combination of how parallel jobs work in combination with bitmap indexes in oracle. I have no 'real' proof, but I believe that since my data is unique(according to its primary unique key) but many insert threads ...
by lkthoma
Thu May 25, 2006 2:29 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: PX job never completes
Replies: 5
Views: 1189

Thanks for the reply! It got me thinking about something and I found a solution. I'm not sure it's the best, but it works. I set the oracle commit level environment variable to '1'. It processed all 500k+ records in 17 minutes.
by lkthoma
Thu May 25, 2006 10:12 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: PX job never completes
Replies: 5
Views: 1189

PX job never completes

I have a very simple PX job: Oracle ---> Transformer ---> Oracle In the left oracle stage I am selecting a subset of a table, and in the right oracle stage I am inserting those records. The volume of data is not that large (approx. 500,000), but the job runs forever and never completes. I also get n...