External filter stage

Sgiri1 · Post by **Sgiri1** » Fri Dec 12, 2008 9:48 am

how can i pass inputs to my job by calling a perl script in external filter stage.

ray.wurlod · Post by **ray.wurlod** » Fri Dec 12, 2008 12:13 pm

You can't. An External Filter stage requires both an input and an output link.

Try thinking about other stage types, perhaps an External Source stage.

Sgiri1 · Post by **Sgiri1** » Mon Dec 15, 2008 2:21 am

ray.wurlod wrote:You can't. An External Filter stage requires both an input and an output link.

Try thinking about other stage types, perhaps an External Source stage. ...

I have to filter the regular expressions using an external filter stage, and get the o/p in a sequential file stage. what type of script should i use to filter the regular expression from my i/p data and get the o/p in a sequential file.

ray.wurlod · Post by **ray.wurlod** » Mon Dec 15, 2008 2:56 pm

You confused me with "inputs to my job". Yes you can use an External Filter stage for this, or you can (if the source is a file) use the Filter command property of the Sequential File stage that reads the file, in which case stdout of the Filter command is read by the Sequential File stage rather than the file itself.