Page 1 of 1

Simultaneous reading of a dataset

Posted: Fri Oct 22, 2004 4:02 pm
by sswarup
Hi,
Can two independent jobs read one dataset simultaneously?

Posted: Fri Oct 22, 2004 4:33 pm
by ray.wurlod
Maybe, maybe not.

For a start, both jobs would have to run on exactly the same set of processing nodes. It may also be necessary to specify those in the same order (for example use the same configuration file for each job), so that the partitioning algorithm works the same way.

I don't imagine you would have any issues with locking, since both open the dataset for reading.

Why not try it, and let us know?

Posted: Thu Oct 28, 2004 9:12 am
by dsxdev
Hi

Rightly said by Ray it may be possible to read same Dataset by two different jobs if you specify same processing nodes This is necessary because Data in Dataset recides on Nodes.