Sequential File - Filter - Unix Sort -SequentialMode Problem

koti9 · Post by **koti9** » Wed Jul 08, 2015 2:39 pm

Hello all, I am planning to do unix sort in Sequential file filter,but Sequential file is by default read using Sequential Mode, wont that mess up my sorting done via unix?

chulett · Post by **chulett** » Wed Jul 08, 2015 3:01 pm

No. Or at least I don't see why it would. Once you leverage the filter, the stage is no longer reading the file itself. It runs your filter command which outputs data to stdout and the stage will consume this stream via stdin.

ArndW · Post by **ArndW** » Thu Jul 09, 2015 1:50 am

The only times that the UNIX sort and a subsequent DataStage sort might differ are with null handling (which can be specified in DataStage) and on sort order of non-single-byte characters and that is done by specifying the correct character set both in UNIX and within DataStage.

PaulVL · Post by **PaulVL** » Thu Jul 09, 2015 9:17 am

Also, unless you specify where your temp space is on the sort command, you'll be using /tmp. Please don't fill it up.

Any reason why you do not want to use the sort stage?