Search found 8 matches

by donhoff
Thu Oct 25, 2007 8:35 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: orchestrate manual
Replies: 0
Views: 1070

orchestrate manual

hi, I am writing a customer stage but lack of the manuals of orchestrate. I searched through google and found a link in IBM website, but it requires a service id to download the manual.

Could anybody here provide an orchestrate manual?

Thanks a lot!
by donhoff
Sat Oct 13, 2007 1:09 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Run out of resources
Replies: 1
Views: 1009

Run out of resources

Hi, I am in a project which has about 400 jobs. All the jobs are parallel jobs. We organize these jobs into 20 sequence jobs. In each sequence job , the parallel jobs are arranged according to their dependency. The 20 sequence jobs are scheduled to run parallel. But then we find that when the 20 seq...
by donhoff
Mon Sep 24, 2007 3:59 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: how to upsert an oracle table with huge amount of data?
Replies: 2
Views: 1674

how to upsert an oracle table with huge amount of data?

Hi, I am upserting a oracle table. But the data volume is very huge. The incremental data was 100Million records, 50% are update and 50% are insert. Now I tried to bulk load it into a tmp table, then I used the merge sql. But the merge sql runs about 7 hours long. Is there any way that I could upser...
by donhoff
Tue Sep 18, 2007 9:14 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: how to beyond the filelimit in Unix using sequence file?
Replies: 9
Views: 3264

Re: how to beyond the filelimit in Unix using sequence file?

Default max size is 2G . your admin can make it what ever you want on a partition or they can create a file on multiple nodes that you can use for placing huge volume of data HTH Raghu M Hi, you said my admin can make it what ever I want on a partition. Does that mean the actual max file size can o...
by donhoff
Tue Sep 18, 2007 8:58 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: how to beyond the filelimit in Unix using sequence file?
Replies: 9
Views: 3264

Re: how to beyond the filelimit in Unix using sequence file?

Hi Contact your Unix admin on the file size . they can increase the limit on the file system that you are using. HTH Raghu M Hi, I developed a parallel job which extracted a huge amount of data and wrote them into a sequence file. But the file was so huge that it was beyond the unix file limit(2G)....
by donhoff
Tue Sep 18, 2007 8:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: how to beyond the filelimit in Unix using sequence file?
Replies: 9
Views: 3264

Yes, I tried to use fileset. But Fileset produced only 6 files for I have 6 partitions. It could not produce more files and so the job failed. All 6 files reached the 2G limit but there are still data not written to file. Is there any other solution? For example , some way that can produce 2G data f...
by donhoff
Tue Sep 18, 2007 4:12 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: how to beyond the filelimit in Unix using sequence file?
Replies: 9
Views: 3264

how to beyond the filelimit in Unix using sequence file?

Hi, I developed a parallel job which extracted a huge amount of data and wrote them into a sequence file. But the file was so huge that it was beyond the unix file limit(2G). So I want to write data in a list of files, such as filename_01,filename_02,.... The number of files depends upon the data. C...