Multiple job has to write to a single file

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
Maximus_Jack
Premium Member
Premium Member
Posts: 139
Joined: Fri Apr 11, 2008 1:02 pm

Multiple job has to write to a single file

Post by Maximus_Jack »

Hi
I have a requirement where multiple instance of a job has to write to a single file, i tried with both sequential file and dataset,

with sequential file- Somehow the records are missing when the job finishes..

with dataset - Sometimes I'm getting an error as "Error updating
ORCHESTRATE File Dataset descriptor for" this, sometimes i dont even get an error and the records wont be available in the file

is there any other way where multiple jobs write to a single file

Datastage version : 8.7 Fix pack 1

MJ
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Simultaneously? No.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Maximus_Jack
Premium Member
Premium Member
Posts: 139
Joined: Fri Apr 11, 2008 1:02 pm

Post by Maximus_Jack »

thanks chullet..


strange... is there no way do it.. ?
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

It's not strange, it's the nature of sequential media which supports multiple readers but only a single writer. You'd need to sequence your jobs so they append their output.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Maximus_Jack
Premium Member
Premium Member
Posts: 139
Joined: Fri Apr 11, 2008 1:02 pm

Post by Maximus_Jack »

thanks...

but it should work for dataset isn't ?
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

No, because each segment file of a Data Set is a sequential file (same argument as before) and each parallel job has every segment file in the Data Set in use.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Maximus_Jack
Premium Member
Premium Member
Posts: 139
Joined: Fri Apr 11, 2008 1:02 pm

Post by Maximus_Jack »

thanks ray and chullet....
Post Reply