Page 1 of 1
How to run a sequential file in parallel mode?
Posted: Tue Jun 03, 2008 9:34 pm
by adityavarma
Hi ,
How to run a sequential file in parallel mode ? in which mode will the sequential file run?
Thanks in Advance
Aditya
Posted: Tue Jun 03, 2008 9:52 pm
by ray.wurlod
Welcome aboard.
DataStage does not "run" files. Do you mean "read" or do you mean "write"? By default each operation is sequential. However parallel reading is possible.
Parallel writing to one file is prohibited, not by DataStage but by the operating system.
Posted: Tue Jun 03, 2008 9:55 pm
by devidotcom
You have an option of "Read from Multiple Nodes" or "Number of Readers per node".
Devi
Posted: Wed Jun 04, 2008 10:52 am
by Minhajuddin
It's funny that if "Number of readers per node" is set to "n" it doesn't run "n" readers per every node. It actually reads using "n" readers on just one node.
I guess the guys at Ascential didn't name it properly, It should have been "Number of readers per ONE node"
I know I am not answering the question, I was just amused when I found this behavior
Posted: Wed Jun 04, 2008 3:18 pm
by ray.wurlod
True if you have only one File property. Try it with two File properties.
Posted: Thu May 05, 2011 1:56 pm
by jassu
Will the delimited file also be read in parallel when the number of readers per node is set to a value > 1. I have seen the document specifying that this option is for fixed length file.
Re: How to run a sequential file in parallel mode?
Posted: Thu May 05, 2011 2:11 pm
by jseclen
There is a other way.
You split your input file in 4 small files (for example) and deinfe in the Sequential File stage the File Pattern = FileName*.
Assume your server has 4 nodes, when the job run each node read a one file and processing in parallel mode.