Page 1 of 1

Splitting rows into multiple files

Posted: Thu Feb 01, 2007 11:04 pm
by rejith.ry
Hi,
I want to write each row in my inpu file to a seperate file. File name is one of the columns of the file. This can be achived using folder stage in server job. What is the alternative in parallel job?

Rejith

Posted: Thu Feb 01, 2007 11:08 pm
by ray.wurlod
Please delete the duplicate post.

How do you propose to manage all these files in a parallel execution environment, were you have no direct control over which row is processed on which node (because someone might run the job under a different configuration)?

Posted: Fri Feb 02, 2007 7:40 am
by DSguru2B
Do it outside DS. Like say in a shell script. I posted one a few months ago. Both here and "developerswork" (IBM's forum pages". Search for it. It will give you a very good idea of how to go about it.