Page 1 of 1

sharing database load job with different input columns

Posted: Tue Nov 23, 2010 1:04 am
by Aggie99
I have a simple job that flow like this.

odbc enterprise stage -> transform stage -> load to target table.

I have 10 tables with different columns to load to 10 target tables, using the above logic. There is not much happening in the transformer stage, except to add current date time. All the input columns are kept and stored in target tables.

Instead of creating 10 jobs, and change the input layout. I hope to use one common parallel job.

My questions are:

How can I handle the different input columns? Is there something like schema file option in database stage. I was not able to find it.

Please for your help.

Posted: Tue Nov 23, 2010 1:50 am
by ray.wurlod
Runtime Column Propagation should look after most of that for you provided that the target column names are the same as the source column names. And if they're not maybe you can create alias column names in the target table.