Performance Issue In Job
Posted: Tue Feb 07, 2006 9:03 am
Hi All,
I have a requirement to add a column called Analog to the job flow, in this process i have two options 1) The source dataset is coming from another job which have column Analog and add the column in the input dataset and dragg the column up to the Target satge through the flow.
2) I can able to get this column in the flow by performing Inner join based on keys at the end before target dataset.
Like wise i have to implememt this logic in 10 jobs.
So, my question is which one is performance wise better if my data in millions, means dragging the Metadata through flow from source to Target (or) add a join and perform inner join based on keys before target stage.Please clarify.
Regards
Nagesh.[/b]
I have a requirement to add a column called Analog to the job flow, in this process i have two options 1) The source dataset is coming from another job which have column Analog and add the column in the input dataset and dragg the column up to the Target satge through the flow.
2) I can able to get this column in the flow by performing Inner join based on keys at the end before target dataset.
Like wise i have to implememt this logic in 10 jobs.
So, my question is which one is performance wise better if my data in millions, means dragging the Metadata through flow from source to Target (or) add a join and perform inner join based on keys before target stage.Please clarify.
Regards
Nagesh.[/b]