Link Ordering
Posted: Thu Oct 13, 2011 12:59 am
Hi All,
I need to implement SCD2 logic using datastage parallel job. We are using Netezza for storing data.
I am using Netezza Enterprise stage and ODBC connector stage for this design.
As Netezza is not very good at Updating records, I will be using following approach :
1. Check for src and target record, if there is a difference then
a. Delete existing record from target. (ODBC Connector)
b. Insert a new record with the same value as target with Active Indicator='N' (Netezza Enterprise stage)
c. Insert a new record with the updated values coming in source with Active Indicator ='Y' (Netezza Enterprise stage)
Now as Netezza Enterprise stage does not provide functionality of deleting one record while inserting, I will be using odbc connector stage for step (a).
Issue
My job performs step (b) and (c) first and then step (a). Which results in deleting all the records for that particular case.
I tried doing link ordering in Transformer, but of no use.
Is there a work around for that.
Any help will be much appreciated.
Thanks!
I need to implement SCD2 logic using datastage parallel job. We are using Netezza for storing data.
I am using Netezza Enterprise stage and ODBC connector stage for this design.
As Netezza is not very good at Updating records, I will be using following approach :
1. Check for src and target record, if there is a difference then
a. Delete existing record from target. (ODBC Connector)
b. Insert a new record with the same value as target with Active Indicator='N' (Netezza Enterprise stage)
c. Insert a new record with the updated values coming in source with Active Indicator ='Y' (Netezza Enterprise stage)
Now as Netezza Enterprise stage does not provide functionality of deleting one record while inserting, I will be using odbc connector stage for step (a).
Issue
My job performs step (b) and (c) first and then step (a). Which results in deleting all the records for that particular case.
I tried doing link ordering in Transformer, but of no use.
Is there a work around for that.
Any help will be much appreciated.
Thanks!