Data File

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
pavan_test
Premium Member
Premium Member
Posts: 263
Joined: Fri Sep 23, 2005 6:49 am

Data File

Post by pavan_test »

I have a etl job which loads data into a oracle DB using sql loader (Load option within ORAcle EE stage). I am trying to find the sql loader data file generated by etl. can anyone suggest me where do I find this data file.

Thanks
Mark
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

It doesn't generate a .dat file like it does for the .ctl/.log/.bad files, it streams the data through a named pipe instead.
-craig

"You can never have too many knives" -- Logan Nine Fingers
pavan_test
Premium Member
Premium Member
Posts: 263
Joined: Fri Sep 23, 2005 6:49 am

Data File

Post by pavan_test »

Inside the generated control file ora.xxx.xxx.o.ctl file i found a data infile as ora.xxx.xxx.fifo.0 "FIX xxxx"

where do I find this fifo file.

Thanks
Mark
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

It's a named pipe so there's nothing to find, data wise. You get that, yes? And from what I recall it deletes it afterwards which is why you don't see it in the same location as the other files.
-craig

"You can never have too many knives" -- Logan Nine Fingers
pavan_test
Premium Member
Premium Member
Posts: 263
Joined: Fri Sep 23, 2005 6:49 am

Data File

Post by pavan_test »

i understand that etl will delete this file and it does not contain any data.

what is named pipe.

Thanks
Mark
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Why don't you research this, perhaps by a Google search?

It is a technique available in all operating systems for transferring data between a writer process and a reader process.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply