Sequential Files in Parallel Extender

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
poorna_76
Charter Member
Charter Member
Posts: 190
Joined: Thu Jul 08, 2004 10:42 am

Sequential Files in Parallel Extender

Post by poorna_76 »

Are there any disadvantages/known issues, if Sequential Files are used as intermediate files for large volume data in DataStage PX jobs?


Thanks in Advance.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

One word: SEQUENTIAL

It's a bottleneck. Also, data have to undergo export when being written and import being read.

Prefer Data Set, where none of the above apply. The operator generated by a Data Set stage is copy - which should speak volumes. Partitioning and sorting are preserved.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply