Splitting the file Logically

[vij]

Hi all,

I have a requirement which goes like this - A .txt file should be splitted (logically) based on the memory / size of the data and a hard coded value should be appended for each and every split and written into a output file.

To explain it more clearly- The input file which is more than 256KB for an example say 2560KB, should be read and when it crosses 256KB, a new line should be appended and then the next 256KB should be written to the same file followed by the same appended line, when it crosses 256KB, and so on..

Please let me know how to do this on DS.

Thanks!

[kumar_s]

You cannot split based on Size using DS. But you can make use of the OS command in DS. You can use "split" command with the size given as parameter in execute command activity, to split the files into several sub files. Later using FilePatter option available in sequential file, you can merge all the file or using Filter option, you can merge with new line concatinated to each file.

[DSguru2B]

You can also use awk to append lines. Its better to do number of lines then number of bytes.

[kumar_s]

If you know the whole file size and if you know what size you need to split into, you can as well use "Sample" stage with percentage values given.