Hi
I have a scenario . i have a Flat file . i want remove trailer an header and record and discard record which are lesser and greater than specified column . for that i have written unix script . i want use wrapped Stage in PX to call that unix script . but my problem is unix script creates file after removing trailer . header and lesser and greater than specified column . can i use wrapped stage to avoid creation of file instead directly pass to transformer stage . so can i use wrapped stage like passive stage .
Sanjay
Wrapped Stage
Moderators: chulett, rschirm, roy
-
ray.wurlod
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Surely the Wrapped stage will be called for every row processed?!
What you really want to do is to pre-process the file, perhaps in a before-job subroutine that executes an appropriate operating system command (or shell script). A before-job subroutine is executed exactly once.
What you really want to do is to pre-process the file, perhaps in a before-job subroutine that executes an appropriate operating system command (or shell script). A before-job subroutine is executed exactly once.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Hi ray
thanks for u reply . i wanted it read the file only once not 2 times . before job will read and put in file and file i have to read again with sequential File stage . i dont want that to happen . i want read just once that sequential file and wrapped stage should send the output to a trasformer.
Sanjay
thanks for u reply . i wanted it read the file only once not 2 times . before job will read and put in file and file i have to read again with sequential File stage . i dont want that to happen . i want read just once that sequential file and wrapped stage should send the output to a trasformer.
Sanjay
ray.wurlod wrote:Surely the Wrapped stage will be called for every row processed?!
What you really want to do is to pre-process the file, perhaps in a before-job subroutine that executes an appropriate operating system command (or shell script). A before-job subroutine is executed exactly once.
-
ray.wurlod
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
You have to create a script that puts its result onto stdout (to which the output link from the Wrapped stage is connected). Only in this way can you prevent a file from being created.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
You may want to look at the External Filter stage. Be aware that some of these stages require the data to move via stdin/stdout.
Another alternative is to just let the header and trailer records fall out the rejects link of the Sequential File stage, since the metadata probably won't match that of the regular rows. There are several options available for reject processing. Also be aware that the data for any rejected rows would be output in a single column.
Alan
Another alternative is to just let the header and trailer records fall out the rejects link of the Sequential File stage, since the metadata probably won't match that of the regular rows. There are several options available for reject processing. Also be aware that the data for any rejected rows would be output in a single column.
Alan