Splitting to multiple files at runtime

[Django]

I have got a source text file as follows

Code: Select all

-------------------------------------------
TargetFileName DataCol1 DataCol2
--------------------------------------------
ABC.txt                1             2
ABC.txt                5             6
ABC.txt                11            12
ABC.txt                41            24
DAMMY.txt           12             23
DAMMY.txt           34             45
DAMMY.txt           24             99
... and so on...

The number of TargetFileName is variable

Now I want to create output files as per the TargetFileName column. Ie. One file named ABC.txt and one file named DAMMY.txt and so on each on which will have only the columns DataCol1 and DataCol2.

Note - The number of TargetFileName is variable... thats what has made me come to this forum...

[ray.wurlod]

Ok, then. Go for it.

[Django]

I need help here, please.

While reading a sequential file stage it allows to read from multiple files using pattern. What about while writing ?

[ray.wurlod]

Create a server job that reads your file and invokes UtilityRunJob() to run a generic job that takes the file name (and anything else needed) as a job parameter.

You could do the same with a job sequence (instead of a server job), if you read the file then convert the line terminators into a delimiter that the StartLoop activity can use. Within the loop is your generic job.

[Django]

After Job Sub-Routine : ExecSH

cd #SWorksOutputFilePath# ; awk -F, '{print > $2}' Sales.Imp ; awk -F, '{print > $2}' HistData.Imp

did it all

Col No. 2 in the file carries the filename.

Thanks to my collegue Gary ...

[Django]

Thanks to Ray's post. It made me explore various options...