clarification on external filter

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
tostay2003
Participant
Posts: 97
Joined: Tue Feb 21, 2006 6:45 am

clarification on external filter

Post by tostay2003 »

Hi all,

I have few newbie questions.

PS: I don't have PX installed to verify (I am just going through documents)

a) external filter - can we write any unix command (rm/find/grep/awk/sed/cut...) etc?

b) Can I write unix scripts to process .ds files (just as txt files) and use external filter

c) Does external filter wrap the commands with osh command?



Thanks
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

The answers you seek are in the manual.

(a) There are restrictions on the commands that can be executed, but in summary the commands that are used must be "pipe safe".

(b) "*.ds" files are Data Set descriptor files. They are binary files. You should never attempt to process these with any UNIX command. The only commmand you should use with these files is orchadmin.

(c) There's no reason to do so. Therefore no. The command in the stage is, however, invoked via an Orchestrate operator (player process) which IS running osh.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply