Delete record generation using change capture

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
Ragunathan Gunasekaran
Participant
Posts: 247
Joined: Mon Jan 22, 2007 11:33 pm

Delete record generation using change capture

Post by Ragunathan Gunasekaran »

Hi,
I am generating datasets for loading a type 2 dimension table.
The requirement is to capture the delete records from the change capture stage and using the delete record's key i have to update the dimensio table with an end date.

When i use the change capture stage, i was able to retrieve the records only from the after dataset and not the before dataset. i would like to get the records from the before dataset just because we can't have a delete record available in the after dataset.


Any clues please...?
Regards
Ragu
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

I'm not following your issue. You get 'deletes' for records that are in the before but not in the after. :?
-craig

"You can never have too many knives" -- Logan Nine Fingers
miwinter
Participant
Posts: 396
Joined: Thu Jun 22, 2006 7:00 am
Location: England, UK

Post by miwinter »

Me either... that description's a tad confusing :?
we can't have a delete record available in the after dataset
You can have a delete record in the change dataset, as it denotes that a record doesn't exist in the after dataset, in comparison to the before dataset. It shows the changes required on the before dataset to 'get to' the after dataset - the nature of how change capture operates. Moreover, the after dataset drives the change dataset, in metadata terms.
Mark Winter
<i>Nothing appeases a troubled mind more than <b>good</b> music</i>
Ragunathan Gunasekaran
Participant
Posts: 247
Joined: Mon Jan 22, 2007 11:33 pm

Post by Ragunathan Gunasekaran »

Sorry for the confusion. The problem was i was not able to get delete records out of the change capture..In the sense i was getting a null value for all th columns in the record which was designated as a delete record.

But on analysis i found that its not that change capture stage is causing problem but an subsequent lookup stage failure caused a null in the delete column ..


Sorry i haven't posted the complete design keeping in mind that i wouldn't have got problem due to other stages..


Thanks for the reply ... marking this topic to resolved now
Regards
Ragu
Post Reply