Different Input layout but same target

major · Post by **major** » Fri Sep 05, 2014 1:12 pm

Hi all,

I have 2 different datasets with their own metadata , I have to do couple of lookups with DB stages and then insert into a same target table.

What is the best design so that this can be done in a single job instead of creating 2 jobs to load dataset to target table.

Thanks in advance
Major

qt_ky · Post by **qt_ky** » Fri Sep 05, 2014 8:33 pm

Modify and convert data types to match the target metadata, funnel the two sources, then to the lookups and load the target.

major · Post by **major** » Mon Sep 08, 2014 10:05 am

Hi ,

Thanks for the suggestion , but I forgot to mention that there is a dependency between 2 file loads , one file load has to be completed before proceeding with next one

Thanks
Major

qt_ky · Post by **qt_ky** » Mon Sep 08, 2014 11:40 am

What have you tried so far?

major · Post by **major** » Tue Sep 09, 2014 8:34 am

As of now I'm using 2 different jobs to load the target , but I'm looking to optimize them , and want to use 1 job..

No clue where to start from

Thanks
Major

chulett · Post by **chulett** » Tue Sep 09, 2014 9:41 am

Not sure that one job would be any more 'optimal' than two since the loads need to be done in a serial fashion, one after the other. I would think Eric's suggestion could still work as long as the input order is maintained.