Page 1 of 1

Incremenatal loading reference data issue

Posted: Thu Mar 28, 2013 10:44 am
by pan
Hi
i am new to datastage ...
soure-sql server
target-oracle
datastage 8.7
unix environment

i am trying to load incrementally using chnage capture stage but i have a problem in refernece data(copy of target)..i am fetching letest data from source but after initial load when i tried to load the second load when the chnaged data records are zero(0)...the job deleting all the records from target...because it assuming no record coming from source(but all target records are looking up on source) so it is deleting all records from target..how can i avoid this without changing drop delete records to YES
because i need to extract delete records also


Thanks

Posted: Thu Mar 28, 2013 11:22 am
by prasannakumarkk
If it is a incremental load then the drop delete records should be set to zero.
because i need to extract delete records also
Which records you are mentioning about.
And you can have delete records seperated withhelp of a filter stage using the changeCode column in output link

Posted: Thu Mar 28, 2013 11:25 am
by pan
i need to fetch the inserted/updated/deleted records from source ..means those will come from chnage capture stage after comparing source and reference data(target data)....how can i do that incrementally

Posted: Tue Apr 02, 2013 12:38 am
by ds@tcs
Capture the delete change code records into a dataset. in the next job do look up with source and delete from target.