How to run a sequential file in parallel mode?

adityavarma · Post by **adityavarma** » Tue Jun 03, 2008 9:34 pm

Hi ,

How to run a sequential file in parallel mode ? in which mode will the sequential file run?

Thanks in Advance

Aditya

ray.wurlod · Post by **ray.wurlod** » Tue Jun 03, 2008 9:52 pm

Welcome aboard.

DataStage does not "run" files. Do you mean "read" or do you mean "write"? By default each operation is sequential. However parallel reading is possible.

Parallel writing to one file is prohibited, not by DataStage but by the operating system.

devidotcom · Post by **devidotcom** » Tue Jun 03, 2008 9:55 pm

You have an option of "Read from Multiple Nodes" or "Number of Readers per node".

Devi

Minhajuddin · Post by **Minhajuddin** » Wed Jun 04, 2008 10:52 am

It's funny that if "Number of readers per node" is set to "n" it doesn't run "n" readers per every node. It actually reads using "n" readers on just one node.
I guess the guys at Ascential didn't name it properly, It should have been "Number of readers per ONE node"

I know I am not answering the question, I was just amused when I found this behavior

ray.wurlod · Post by **ray.wurlod** » Wed Jun 04, 2008 3:18 pm

True if you have only one File property. Try it with two File properties.

jassu · Post by **jassu** » Thu May 05, 2011 1:56 pm

Will the delimited file also be read in parallel when the number of readers per node is set to a value > 1. I have seen the document specifying that this option is for fixed length file.

jseclen · Post by **jseclen** » Thu May 05, 2011 2:11 pm

There is a other way.

You split your input file in 4 small files (for example) and deinfe in the Sequential File stage the File Pattern = FileName*.

Assume your server has 4 nodes, when the job run each node read a one file and processing in parallel mode.

DSXchange

How to run a sequential file in parallel mode?

How to run a sequential file in parallel mode?

Re: How to run a sequential file in parallel mode?