Hi,
I have recently joined a new project.
As per our Design, all our jobs are generic jobs.
What does exactly generic jobs mean by? How are they different from normal DS jobs? We are using parallel jobs.
Also our input is the sequential file and we are specifying the schema file instead of loading the metadata.
As far as I know, specifying schema file over rides the properties of Format tab and Columns tab.
But in our jobs, we do load Format.
Why is that it is done?
Thanks in Advance.
karthik.
What does a generic job exactly means?
Moderators: chulett, rschirm, roy
-
- Premium Member
- Posts: 45
- Joined: Tue Aug 29, 2006 2:59 am
- Location: Bangalore
Re: What does a generic job exactly means?
It seems that you are developing kind of templates that will be filled with details later. 'Generic' means general, not specific. So, your jobs are not for any specific task, but can be moulded into one if the detail specs are provided. For example, templates to handle SCDs, loads, etc.
gateleys
Re: What does a generic job exactly means?
But its a simple question that your manager should be able to answer.
gateleys
-
- Premium Member
- Posts: 45
- Joined: Tue Aug 29, 2006 2:59 am
- Location: Bangalore
-
- Premium Member
- Posts: 45
- Joined: Tue Aug 29, 2006 2:59 am
- Location: Bangalore
From your description, i believe your "Original Designers" wanted to have one-job-does-all solution.
If you do a search on Runtime column propagation you will find a wealth of threads on this topic. I have pulled a few from my notes (when i was looking for similar information a few weeks ago...)
viewtopic.php?t=107818
viewtopic.php?t=110354
viewtopic.php?t=110304
viewtopic.php?t=109700
You should be able to understand pros and cons of using RCP from these discussions as well.
Good luck,
If you do a search on Runtime column propagation you will find a wealth of threads on this topic. I have pulled a few from my notes (when i was looking for similar information a few weeks ago...)
viewtopic.php?t=107818
viewtopic.php?t=110354
viewtopic.php?t=110304
viewtopic.php?t=109700
You should be able to understand pros and cons of using RCP from these discussions as well.
Good luck,
-V
I think VCInDSX answered your question accurately. It seems your ETL is architected to use Runtime Column Propagation. Now since you have mentioned that you are using sequential files as input, you have been asked to use schema file so that the intermediate stages will have the metadata propagated to them during runtime.
gateleys