Page 1 of 1

auto split file

Posted: Thu May 19, 2016 4:29 am
by wuruima
Hi

is there a function in the sequtialFile stage, to auto split file.

e.g.
I output records to the sequtial file. set the file's max record number is 1000000.
then the stage will help me to output F1.txt, F2.txt, F3.txt,etc. every file contains 1000000 records.

because the output file is about 30 million records, I don't hope to split it in another job, it takes time.

Posted: Thu May 19, 2016 5:53 am
by qt_ky
There is a feature but not on version 8. See this topic.

Posted: Thu May 19, 2016 7:08 am
by chulett
Lacking that, a couple of other thoughts for your version:

viewtopic.php?t=152792
viewtopic.php?t=146613

There are more out there, you're not the first to ask this question.