Hello Everybody,
I want know about the lookup stage.
In couple of jobs I'm using the lookup stage.
I have to do lookup on the table and if records not exist I have to do some transformation and load in to the target.
If records exist in the lookup table I have to ignore those records.
In lookup stage I'm giving the condition not meets DROP
and lookup failure is REJECT.
Capturing all the rejected records (New records) in dataset.
and using this dataset in other job and appling business logic and loading in target.
I want accomplish the above in a single job.
Is there any better way to do above job?
If any please suggest me.
Thanks
Nair
lookup stage
Moderators: chulett, rschirm, roy
Re: lookup stage
Dude
You can apply the same logic in one job, from the rejected file try placing a transform stage and try to place instance of the same target table and link them. I hope in this way you can accomplish the same in one job.
[quote="nair"]Hello Everybody,
I want know about the lookup stage.
In couple of jobs I'm using the lookup stage.
I have to do lookup on the table and if records not exist I have to do some transformation and load in to the target.
If records exist in the lookup table I have to ignore those records.
In lookup stage I'm giving the condition not meets DROP
and lookup failure is REJECT.
Capturing all the rejected records (New records) in dataset.
and using this dataset in other job and appling business logic and loading in target.
I want accomplish the above in a single job.
Is there any better way to do above job?
If any please suggest me.
Thanks
Nair[/quote]
You can apply the same logic in one job, from the rejected file try placing a transform stage and try to place instance of the same target table and link them. I hope in this way you can accomplish the same in one job.
[quote="nair"]Hello Everybody,
I want know about the lookup stage.
In couple of jobs I'm using the lookup stage.
I have to do lookup on the table and if records not exist I have to do some transformation and load in to the target.
If records exist in the lookup table I have to ignore those records.
In lookup stage I'm giving the condition not meets DROP
and lookup failure is REJECT.
Capturing all the rejected records (New records) in dataset.
and using this dataset in other job and appling business logic and loading in target.
I want accomplish the above in a single job.
Is there any better way to do above job?
If any please suggest me.
Thanks
Nair[/quote]
Data Mover