Independent Flows within Same Parallel Job

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
jerome_rajan
Premium Member
Premium Member
Posts: 376
Joined: Sat Jan 07, 2012 12:25 pm
Location: Piscataway

Independent Flows within Same Parallel Job

Post by jerome_rajan »

Was just wondering if it is possible to have independent flows within the same parallel job. Something like

Code: Select all

SEQ --- TXN ----DS

DS --- CP ----ORA
Both these flows would be within the same job. I understand that this is possible but what would the order of execution be in such a case.

Also, I would like to know if any one has encountered a requirement where you had to employ such a design.

Thanks in advance
Jerome
Data Integration Consultant at AWS
Connect With Me On LinkedIn

Life is really simple, but we insist on making it complicated.
jwiles
Premium Member
Premium Member
Posts: 1274
Joined: Sun Nov 14, 2004 8:50 pm
Contact:

Post by jwiles »

Order of execution: The two streams will execute at the same time as they are in the same job.

Regards,
- james wiles


All generalizations are false, including this one - Mark Twain.
jerome_rajan
Premium Member
Premium Member
Posts: 376
Joined: Sat Jan 07, 2012 12:25 pm
Location: Piscataway

Post by jerome_rajan »

I created a job that looks something like below

Code: Select all


                               SK1

        ROWGEN ----> SK2 -----> DS

SK1 creates the state file while SK2 generates the values. If like you said, both flows are executed at the same time, shouldn't the job have aborted due to the absence of the state file? How is it that everytime I run, the Sk1 creates the file first. Is it just a co-incidence?
Jerome
Data Integration Consultant at AWS
Connect With Me On LinkedIn

Life is really simple, but we insist on making it complicated.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

SK1 and ROWGEN start at the same time. SK2 can't start till the first buffer of rows arrives from ROWGEN. Not a coincidence at all.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
rameshrr3
Premium Member
Premium Member
Posts: 609
Joined: Mon May 10, 2004 3:32 am
Location: BRENTWOOD, TN

Post by rameshrr3 »

I have used 2 independent flows in a job design , sometimes with a common lookup data source, I usually see that job monitoring in director or performance stats in designer is disabled in these cases . Is that a known issue / 'feature'
Post Reply