Creating delay in a transformer ?

ady · Post by **ady** » Fri Dec 08, 2006 1:49 pm

Can we set a delay for a transformer so that other stages are executed before it?

<a href="http://img356.imageshack.us/my.php?image=contrie1.jpg" target="_blank"><img src="http://img356.imageshack.us/img356/8336/contrie1.th.jpg" border="0" alt="" /></a> Click on the thumbnail

In the job in the screen shot above, I want to execute the link collector(circled red) before the transformer (circled black).

Is it possible ?

DSguru2B · Post by **DSguru2B** » Fri Dec 08, 2006 1:54 pm

Not possible. Just split the job into two jobs. First job does the link collector part and the second one does the bottom part.

chulett · Post by **chulett** » Fri Dec 08, 2006 1:57 pm

Sure... possible.

Land the output of DSLink_50 to a flat file, then pick it back up from there before going on to Mr Black Circle.

ps. Be careful of the popups on that site, I just got one of those bogus 'Security' warnings.

I_Server_Whale · Post by **I_Server_Whale** » Fri Dec 08, 2006 2:05 pm

And that's because a sequential file has to be written completely before the processing proceeds to the next link.

Great Solution. Craig !

ady · Post by **ady** » Fri Dec 08, 2006 2:11 pm

:D , Yeah I think that would do it .... I got abt 100 colums to copy+paste now . is there any other stage i can use to save all the time ?

I'm gonna do the copy+paste anyway now

chulett · Post by **chulett** » Fri Dec 08, 2006 2:13 pm

Not need to copy & paste unless you are a masochist. All your metadata is there, why not just 'Save' then 'Load' inside the Sequential File stage?

I_Server_Whale · Post by **I_Server_Whale** » Fri Dec 08, 2006 2:16 pm

You need not copy and paste each of the 100 columns.

Just add a seq. file stage to DSLink_50 and save the meta-data on the input tab. Now load this saved metadata to the output tab of the seq.file. You are done !

Whale.

I_Server_Whale · Post by **I_Server_Whale** » Fri Dec 08, 2006 2:17 pm

Ahh !!! My slow fingers

ady · Post by **ady** » Fri Dec 08, 2006 3:02 pm

Didnt know that

! ..... I just typed everything. Anyways...

After i inserted the seq file the first time everything was fine , i got the perfect row count. But from the second run it gives the row count as 0.

Hmm ....

ady · Post by **ady** » Fri Dec 08, 2006 3:07 pm

I just removed the transformer after the link collector. , It works like magic again !! :D

I'll give it few more runs and let you guys know.

I_Server_Whale · Post by **I_Server_Whale** » Fri Dec 08, 2006 3:20 pm

beaditya wrote:Didnt know that ! ..... I just typed everything. Anyways...

After i inserted the seq file the first time everything was fine , i got the perfect row count. But from the second run it gives the row count as 0.

Hmm ....

Which row count? Which Link? Being elaborate helps !

ady · Post by **ady** » Fri Dec 08, 2006 3:26 pm

I was counting the output row count of "l_to_x" going from the linkcollector to the transformer. I gave the count function in the transformer x_ORA.

Now that i removed the transformer the job is working perfectly, there is a considerable delay.

Another issue solved @ DSX .... thnx