Records Reconcilition

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
foryou
Participant
Posts: 12
Joined: Thu Jun 23, 2005 1:47 am

Records Reconcilition

Post by foryou »

Hi Guys,

I am looking to build a job which can do the record reconciliation from source to target ie it can count the number of records pulled from source (oracle),
count the number of records rejected & count the number of records loaded into target (Oracle ) .

What' best practice to follow?

Anybody has got template?

Also tried to search the forum with words job/record reconciliation.
Are there any posts on it already on forum?

Shall appreciate any suggestions

Thanks
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Download ETLstats from Kim Duke's website - it's got all you want and more (unless you want some really arcane stuff).
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
kduke
Charter Member
Charter Member
Posts: 5227
Joined: Thu May 29, 2003 9:47 am
Location: Dallas, TX
Contact:

Post by kduke »

Do a search on completeness. This is a few jobs which are included in EtlStats. It will create source counts and target counts and run a report after every load showing the percentage of records which ended up in the target. It should pass any kind of audit. You can easily add revenue or other measures and show their percentage of completeness. We even used it to show completeness of our lookups on dimension tables. If you count the number of unknown keys used in your fact table on a given dimension then you know this completeness percentage.
Mamu Kim
Post Reply