CheckSum Stage in datastage

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
pkll
Participant
Posts: 73
Joined: Thu Oct 25, 2012 9:45 pm

CheckSum Stage in datastage

Post by pkll »

My Source is file and target is table.I need to compare a table records with records in a file to see if any field has changed. I am not sure if I should calculate the checksum then do the comparison. Please let me know how to use check sum stage.
Thank you in advance.
prasson_ibm
Premium Member
Premium Member
Posts: 536
Joined: Thu Oct 11, 2007 1:48 am
Location: Bangalore

Post by prasson_ibm »

Hi,
If fields are same,what are you going to do?

In case you want incremental load,you can checksum stage.
pkll
Participant
Posts: 73
Joined: Thu Oct 25, 2012 9:45 pm

Post by pkll »

Hi Prasoon,


I need to load the target table with only the new records I mean incremental load.I don't want to load every time the same records from source to target.If the new record or any updated record I need to load.Please let me know how to use the checksum stage
jerome_rajan
Premium Member
Premium Member
Posts: 376
Joined: Sat Jan 07, 2012 12:25 pm
Location: Piscataway

Post by jerome_rajan »

Hi,
I think the Change Capture Stage would serve your purpose. Suggest using the Checksum approach if you are dealing with huge reference data.
Jerome
Data Integration Consultant at AWS
Connect With Me On LinkedIn

Life is really simple, but we insist on making it complicated.
dsetlteam
Premium Member
Premium Member
Posts: 35
Joined: Mon Feb 10, 2014 10:14 pm
Location: USA

Post by dsetlteam »

Hi

Refer to "Checksum Stage" section of Chapter 6 in Parallel Job Developer's Guide to know about what the stage does and its properties.

Cheers!
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

You'll find it easier to use Change Capture or Difference stage.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
pkll
Participant
Posts: 73
Joined: Thu Oct 25, 2012 9:45 pm

checksum

Post by pkll »

Please let me know how to use the checksum stage.my requirement is to compare the source and target and if any new record found or any value updated then load the data into the target table.
pkll
Participant
Posts: 73
Joined: Thu Oct 25, 2012 9:45 pm

Re: checksum

Post by pkll »

Hi Ray,

I need to use checksum stage only.

Below is my example

Input
------
e_id,e_name,e_Add
11,kim,bris
22,jim,mel
33,pim,syd
44,lim,canb
55,pom,pth

Output Before_Loading
-----------
e_id,e_name,e_add
11,kim,syd
22,jim,canb
33,pim,syd
44,lim,canb
55,pom,pth

Out After_Loading
-----------
e_id,e_name,e_add
11,kim,bris
22,jim,mel
33,pim,syd
44,lim,canb
55,pom,pth
11,kim,syd
22,jim,canb
Last edited by pkll on Fri Feb 28, 2014 7:38 am, edited 1 time in total.
jerome_rajan
Premium Member
Premium Member
Posts: 376
Joined: Sat Jan 07, 2012 12:25 pm
Location: Piscataway

Post by jerome_rajan »

What have you tried? Did you read through the parallel developers guide?
Jerome
Data Integration Consultant at AWS
Connect With Me On LinkedIn

Life is really simple, but we insist on making it complicated.
pkll
Participant
Posts: 73
Joined: Thu Oct 25, 2012 9:45 pm

Post by pkll »

chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Re: checksum

Post by chulett »

pkll wrote:I need to use checksum stage only.
And why, pray tell, is that?
-craig

"You can never have too many knives" -- Logan Nine Fingers
pkll
Participant
Posts: 73
Joined: Thu Oct 25, 2012 9:45 pm

Re: checksum

Post by pkll »

We suggested to client changecapture stage.But client are interested on checksum stage...
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Odd... "client" should just care that the job works correctly and is efficient. These kind of situations where they dictate stuff like this is just silly to me and not something I would stand for. But maybe that's just me.
-craig

"You can never have too many knives" -- Logan Nine Fingers
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Resist stupid requirements.

The Checksum stage gives no additional information about what is different.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply