i would like know the purpose of name pipes sequential stage , i read the
help , did not get and an how to use it or where it exactly used.
any examples appreciated.
Thank you all.
named pipes
Moderators: chulett, rschirm, roy
Kollu,
a named pipe is rather like a sequential file, with the exception that the data is never actually written to disk. You have one writer and one reader (which are usually different processes) and a buffer which is in actuality the "pipe". Since the data is only found in memory it is not persistent and both processes get read or write errors when the other is no longer attached to the pipe.
There are a lot of places where pipes are used to great enhancements in speed. Just think of two separate DS jobs, where the output of one is used as the input of another; and the data is never needed again. Assuming 1 million rows using a table or sequential file would incur 2 million + Disk I/O operations whilst changing that to a pipe would just mean that the CPU has to process the actual data amount plus a bit of overhead for buffer management. The math is easy to do in this case.
a named pipe is rather like a sequential file, with the exception that the data is never actually written to disk. You have one writer and one reader (which are usually different processes) and a buffer which is in actuality the "pipe". Since the data is only found in memory it is not persistent and both processes get read or write errors when the other is no longer attached to the pipe.
There are a lot of places where pipes are used to great enhancements in speed. Just think of two separate DS jobs, where the output of one is used as the input of another; and the data is never needed again. Assuming 1 million rows using a table or sequential file would incur 2 million + Disk I/O operations whilst changing that to a pipe would just mean that the CPU has to process the actual data amount plus a bit of overhead for buffer management. The math is easy to do in this case.
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
-
- Participant
- Posts: 3337
- Joined: Mon Jan 17, 2005 4:49 am
- Location: United Kingdom
-
- Premium Member
- Posts: 614
- Joined: Fri Feb 06, 2004 3:59 pm
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Depending on your UNIX, a named pipe is created with a command such as mknod or mkfifo - check with your UNIX man pages.
(There's a lot of peripheral stuff you need to know to be a DataStage consultant, isn't there?!!)
(There's a lot of peripheral stuff you need to know to be a DataStage consultant, isn't there?!!)
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Premium Member
- Posts: 614
- Joined: Fri Feb 06, 2004 3:59 pm