How to Sort the data in the Sequential Stage

[Ashish]

I know there is a filter property in the sequential stage but i dont know how to use that can someone give me the example.

[kumar_s]

Search on this forum will give your more insight.
The existing filter option enables you to use Unix command in it.
Say for example,
if you want to read a file in a sorted order use the filter option

Code: Select all

sort <filename>| [options]

And make the file name to dummy by pointing to /dev/null

[us1aslam1us]

Search on this forum will give your more insight.
The existing filter option enables you to use Unix command in it.
Say for example,
if you want to read a file in a sorted order use the filter option

Code: Select all

sort <filename>| [options]

And make the file name to dummy by pointing to /dev/null

Hi Kumar

Where do we have filter option?

Sam

[narasimha]

In the sequential file's General Tab, check the "Stage uses filter command"
The "Filter command" text box gets enabled in the Output tab.
Thats where you enter the required command.

[Perwezakh]

I know there is a filter property in the sequential stage but i dont know how to use that can someone give me the example.

You can use sort stage which is supplied by DS (remember this will be very slow if you are dealing with big file) or you can use CoSort (this is tool by which you can do sort, aggregate and many more things. If your company has this I can help you to setup script).
Let me know this helps you or not Ashish

[us1aslam1us]

In the sequential file's General Tab, check the "Stage uses filter command"
The "Filter command" text box gets enabled in the Output tab.
Thats where you enter the required command.

I thought we are talking about PX sequential file?

Sam

[thompsonp]

If we are talking PX (as that's the forum we're in) then the filter is an option that can be selected in the bottom right hand pane.

As its name suggests it is used to pass the data through a filter program.

If you want to sort the data coming from a sequential file use a sort stage, if it is being written to the sequential file use the appropriate collection method on the partitioning tab.