auto split file

wuruima · Post by **wuruima** » Thu May 19, 2016 4:29 am

Hi

is there a function in the sequtialFile stage, to auto split file.

e.g.
I output records to the sequtial file. set the file's max record number is 1000000.
then the stage will help me to output F1.txt, F2.txt, F3.txt,etc. every file contains 1000000 records.

because the output file is about 30 million records, I don't hope to split it in another job, it takes time.

qt_ky · Post by **qt_ky** » Thu May 19, 2016 5:53 am

There is a feature but not on version 8. See this topic.

chulett · Post by **chulett** » Thu May 19, 2016 7:08 am

Lacking that, a couple of other thoughts for your version:

viewtopic.php?t=152792
viewtopic.php?t=146613

There are more out there, you're not the first to ask this question.