Splitting input data into files

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
vij
Participant
Posts: 131
Joined: Fri Nov 17, 2006 12:43 am

Splitting input data into files

Post by vij »

Hi all,

I got a new requirement which says :

The input txt file from Unix box should be read by datastage and should be splitted in to multiple XML files based on the size of the data, for an eg., 256Kbytes.

Is it possible to achieve this from datastge? If so, please let me know.

Thanks in advance!!
sudeepmantri
Participant
Posts: 54
Joined: Wed Oct 25, 2006 11:07 pm
Location: Hyderabad

Re: Splitting input data into files

Post by sudeepmantri »

[Splitting of data can be done thru stages named as Head and Tail. U can Mention the Percentage of records that goes to one file and the rest goes to the other
kumar_s
Charter Member
Charter Member
Posts: 5245
Joined: Thu Jun 16, 2005 11:00 pm

Post by kumar_s »

Not based on size but can be done based on records in DS level.
Or you can use Split command in OS level and use DS to convert it into XML.
Impossible doesn't mean 'it is not possible' actually means... 'NOBODY HAS DONE IT SO FAR'
Post Reply