Sequential File - Readers Per Node

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
Nicole
Premium Member
Premium Member
Posts: 93
Joined: Mon Oct 22, 2007 12:55 pm
Location: Albany
Contact:

Sequential File - Readers Per Node

Post by Nicole »

I have an input file and I was trying to improve performance so I tried the 'Readers per node' property. Let's say for instance, I specify '4' Readers per Node - each time I run the file - if it is the same file, will it read the records in the same order every time?

I am asking because the job aborted and I need to identify the records which have already been loaded.

Thank you,

Nicole
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

It should read the same records every time. The first reader will read the first 25% of the lines from the file, the second reader will read the second 25% and so on. None of that really helps you to know where the restart point might be.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply