Can the same DataSet be loaded by two Parallely running jobs

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
sidharth
Participant
Posts: 19
Joined: Mon Nov 07, 2005 1:47 am

Can the same DataSet be loaded by two Parallely running jobs

Post by sidharth »

Hello All,
This is my first post in this forum. I am new to DataStage PX.
Thank You everyone for sharing your experience and views on Data Stage PX.

I have a query,

Can two Parallel jobs running parallely insert into the Same Data Set(Same Path, Same File Name, Append Mode)?
Will DataStage take care of locking and unlocking of datasets, or will it throw some error?

My Environment
--------------
* DataStage PX V7.5.1.A
* On AIX Unix Server

Thanks in advance for the explanation,

Regards,
Sidharth
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Hello Sidharth,

that is good question indeed! I've not tried it but am fairly sure that this won't work. Have you tried to see what happens when you do this?
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Welcome aboard. :D

A tantalizing question. Like Arnd it's not something I've attempted. Why not try it and let us know your findings?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
sidharth
Participant
Posts: 19
Joined: Mon Nov 07, 2005 1:47 am

Post by sidharth »

Hi,
I did check this from my end.
I created two similar DS jobs and put them both in a sequencer.
The Sequencer was run such that both the jobs started at the same time.
The sequencer got succedded in the run. The sequencer job log shows a warning that Job1 successded with a warning.
I checked the dataset content to find that it had only the records inserted by DS Job2. Records tried to be inserted by Job1 does not exist in the dataset.

I am not convinced with the outcome, so thought of getting this confirmed by DS Gurus.

Thanks,
Sidharth
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

You confirmed that it won't work to me. Thanks!
emma
Premium Member
Premium Member
Posts: 95
Joined: Fri Aug 08, 2003 10:30 am
Location: Montreal

Post by emma »

What is your Job1 warning ? Let us see what he's saying.
Thanks,
Emma
Post Reply