Page 1 of 1

Different Input layout but same target

Posted: Fri Sep 05, 2014 1:12 pm
by major
Hi all,

I have 2 different datasets with their own metadata , I have to do couple of lookups with DB stages and then insert into a same target table.

What is the best design so that this can be done in a single job instead of creating 2 jobs to load dataset to target table.

Thanks in advance
Major

Posted: Fri Sep 05, 2014 8:33 pm
by qt_ky
Modify and convert data types to match the target metadata, funnel the two sources, then to the lookups and load the target.

Posted: Mon Sep 08, 2014 10:05 am
by major
Hi ,

Thanks for the suggestion , but I forgot to mention that there is a dependency between 2 file loads , one file load has to be completed before proceeding with next one

Thanks
Major

Posted: Mon Sep 08, 2014 11:40 am
by qt_ky
What have you tried so far?

Posted: Tue Sep 09, 2014 8:34 am
by major
As of now I'm using 2 different jobs to load the target , but I'm looking to optimize them , and want to use 1 job..

No clue where to start from

Thanks
Major

Posted: Tue Sep 09, 2014 9:41 am
by chulett
Not sure that one job would be any more 'optimal' than two since the loads need to be done in a serial fashion, one after the other. I would think Eric's suggestion could still work as long as the input order is maintained.