Parallel Read from a FileSet or a DataSet

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
sathyanveshi
Participant
Posts: 66
Joined: Tue Dec 07, 2004 12:48 pm

Parallel Read from a FileSet or a DataSet

Post by sathyanveshi »

Hi,

I want to know is it possible to configure my DataStage EE to do a parallel read from a file or from a database? I know it's a weird question to ask whether a parallel read is possible from a database, but I need to know different options to optimise my loading strategy. So, please let me know whether a parallel read can is possible from a database.fileset/Dataset?

Cheers,
Mohan
T42
Participant
Posts: 499
Joined: Thu Nov 11, 2004 6:45 pm

Post by T42 »

A parallel read from the same sequential file within the same operator? No.

From the same sequential file within the same job? Possible. But it won't be faster.

From a Dataset file? Yes. It is already in parallel.
Post Reply