What does a generic job exactly means?

karthikgk0705 · Post by **karthikgk0705** » Wed Sep 05, 2007 5:13 am

Hi,
I have recently joined a new project.
As per our Design, all our jobs are generic jobs.
What does exactly generic jobs mean by? How are they different from normal DS jobs? We are using parallel jobs.
Also our input is the sequential file and we are specifying the schema file instead of loading the metadata.
As far as I know, specifying schema file over rides the properties of Format tab and Columns tab.
But in our jobs, we do load Format.
Why is that it is done?
Thanks in Advance.
karthik.

gateleys · Post by **gateleys** » Wed Sep 05, 2007 6:29 am

It seems that you are developing kind of templates that will be filled with details later. 'Generic' means general, not specific. So, your jobs are not for any specific task, but can be moulded into one if the detail specs are provided. For example, templates to handle SCDs, loads, etc.

gateleys · Post by **gateleys** » Wed Sep 05, 2007 6:33 am

But its a simple question that your manager should be able to answer.

karthikgk0705 · Post by **karthikgk0705** » Wed Sep 05, 2007 9:41 am

You people are much more friendlier than my manager....

gateleys · Post by **gateleys** » Wed Sep 05, 2007 9:55 am

karthikgk0705 wrote:

You people are much more friendlier than my manager....

I hope your manager (

) is not reading this post of yours.

BTW, did my earlier reponse address your query?

karthikgk0705 · Post by **karthikgk0705** » Wed Sep 05, 2007 9:37 pm

Yeah..sort of...
We are doing SCD changes in our jobs.
But does that means that we have to use generic jobs? Cant it be done using Normal jobs?
Also , u didnt answer for the 2nd part of my question.

VCInDSX · Post by **VCInDSX** » Thu Sep 06, 2007 8:52 am

From your description, i believe your "Original Designers" wanted to have one-job-does-all solution.
If you do a search on Runtime column propagation you will find a wealth of threads on this topic. I have pulled a few from my notes (when i was looking for similar information a few weeks ago...)
viewtopic.php?t=107818
viewtopic.php?t=110354
viewtopic.php?t=110304
viewtopic.php?t=109700

You should be able to understand pros and cons of using RCP from these discussions as well.

Good luck,

gateleys · Post by **gateleys** » Thu Sep 06, 2007 9:30 am

I think VCInDSX answered your question accurately. It seems your ETL is architected to use Runtime Column Propagation. Now since you have mentioned that you are using sequential files as input, you have been asked to use schema file so that the intermediate stages will have the metadata propagated to them during runtime.

DSXchange

What does a generic job exactly means?

What does a generic job exactly means?

Re: What does a generic job exactly means?

Re: What does a generic job exactly means?