Multiple Instance job and Passing Invocation ID

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
snt_ds
Premium Member
Premium Member
Posts: 280
Joined: Wed Oct 18, 2006 11:53 am
Location: Pune, India

Multiple Instance job and Passing Invocation ID

Post by snt_ds »

Hi,

I have a multiple instance dimension job, this job will have below jobs.
EXT
XFM
LOAD
SEQ
SEQ calls all the 3 jobs.
Invocation ID is passed to SEQ from the Script .

Target and Source table structures are same, Jobs are running fine and everything is working fine for the dimensions.

Now I'm having difficulty to load the FACT job.
In my fact jobs I do the lookup on Dimensions if record is not found I initiate Late arriving dimension records,
for this reason I need to run my dimension job from XFM ( No need to run the EXT).
In Fact I get the reject file which I need to use as source for my dimension XFM job.

How can I pass the Invocation ID to the job with the file name Ext_ABC.ds
ABC is my invocation ID for the Dimension jobs.

Thanks
Suresh
thamark
Premium Member
Premium Member
Posts: 43
Joined: Thu Jan 29, 2004 12:12 am
Location: US

Re: Multiple Instance job and Passing Invocation ID

Post by thamark »

snt_ds wrote:Hi,

How can I pass the Invocation ID to the job with the file name Ext_ABC.ds
ABC is my invocation ID for the Dimension jobs.

Thanks
Suresh
Suresh i had similar experience here is what i have done in that case.

For each dimension i created two sequence as follows

I created one sequence, which is normal run and it includes extract and other jobs in it.

Second one i created without the first extract job as part of sequence.

I will invoke the second sequence as part of the late arriving dimension logic from fact table processing.. I guess you would be able assign correct invocation id while doing it so..
Hmm i will fill this when ever i get one
kduke
Charter Member
Charter Member
Posts: 5227
Joined: Thu May 29, 2003 9:47 am
Location: Dallas, TX
Contact:

Post by kduke »

You need a parameter that matches your invocation ids. These should be known and not random.
Mamu Kim
JoshGeorge
Participant
Posts: 612
Joined: Thu May 03, 2007 4:59 am
Location: Melbourne

Post by JoshGeorge »

Use 'Nested_Condition' stage in SEQ which will call EXT or XFM as start job according to a parameter you pass to indicate if it has to run for dimension or fact. Your reject file name from fact loading can also be passed as a parameter or you can rename it according to requirement before calling SEQ. You can pass the same Invocation ID you used for dimension while you run fact also (Plenty of options).
Joshy George
<a href="http://www.linkedin.com/in/joshygeorge1" ><img src="http://www.linkedin.com/img/webpromo/bt ... _80x15.gif" width="80" height="15" border="0"></a>
Post Reply