How to Validate the data in Target files?

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
Developer9
Premium Member
Premium Member
Posts: 187
Joined: Thu Apr 14, 2011 5:10 pm

How to Validate the data in Target files?

Post by Developer9 »

Hi All,

I am using Datastage V7.5.2 ..

I Used the Chage capture stage to capture the changes in my source data.

OR

In general source >>>transformation>>>>target
(thosands rows) (thousands rows)


Transformation:

1.Data trasformation for Date fileds.


Qn:How to Validate the data in Target files ??

My Understanding:
If it is countable (like 10,20...)rows we can check source rows and corresponding target rows and validate whether particular record is transformed or not .

But here thousands of rows ..Is there any method to follow for validation.(Logic perfomed or not on particular row )???
SURA
Premium Member
Premium Member
Posts: 1229
Joined: Sat Jul 14, 2007 5:16 am
Location: Sydney

Re: How to Validate the data in Target files?

Post by SURA »

Asked: 1.Data trasformation for Date fileds.
What transformation are you trying to do?

Asked:Qn:How to Validate the data in Target files ??
What to validate?

DS User
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Start by specifying (on paper) what your validation rules are.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Developer9
Premium Member
Premium Member
Posts: 187
Joined: Thu Apr 14, 2011 5:10 pm

Re: How to Validate the data in Target files?

Post by Developer9 »

SURA wrote:Asked: 1.Data trasformation for Date fileds.
What transformation are you trying to do?
Re: For Example,I have some date fields present has Nullable as source so I want to give Default value in my target as 0000-00-00 if it is NULL
SURA wrote:Asked:Qn:How to Validate the data in Target files ??
What to validate?
Re: For Example:I have one field for Credit score ,I want to give a range for that suppose in the Increment of 200.say 0-200,201-400 like 701-900

For that I applied some logic in transformer.

Now I want to validate the records in my target corresponding to source.

Ex:check

for ID Say

000101000 credit score 252 >>>source
000101000 range 201-400 >>>target

like wise for all the records ..

Is there any way to perform check ???

Thank you
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Yes, though obviously separately for separate fields.

NullToValue() is probably sufficient for your first example.

The two ends of the range will be derived by simple arithmetic involving integer division by 200 and modulus operations.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply