Retrieving info from sequential file

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
krystlecsy
Participant
Posts: 50
Joined: Wed Jul 14, 2004 7:56 am

Retrieving info from sequential file

Post by krystlecsy »

An ETL job was developed to read from sequential file, which has 50,000 records. This job runs for about 1 1/2 hour and I would want to know is there a way to make the retrieval of data from the sequential file to be quicker?
roy
Participant
Posts: 2598
Joined: Wed Jul 30, 2003 2:05 am
Location: Israel

Post by roy »

Hi,
dont hold back info that might help you get a better reply!

more info:
1. what are you doing beside reading the file? (number of lookups, are there and how many complex derivations, Stage variables?...)
2. are you using local disks or storage?
3. how many nodes are configured?
4. is the job run in parallel ? (yea it an run sequencially)
5. how many columns are there in he file?
6. are you using NLS enabled version?
7. more specific platform info might help (OS, number of CPUs and such)
thees are the things that come to mind at the moment....

IHTH,
Roy R.
Time is money but when you don't have money time is all you can afford.

Search before posting:)

Join the DataStagers team effort at:
http://www.worldcommunitygrid.org
Image
Post Reply