Page 1 of 1
CheckSum Stage in datastage
Posted: Fri Feb 28, 2014 2:29 am
by pkll
My Source is file and target is table.I need to compare a table records with records in a file to see if any field has changed. I am not sure if I should calculate the checksum then do the comparison. Please let me know how to use check sum stage.
Thank you in advance.
Posted: Fri Feb 28, 2014 2:53 am
by prasson_ibm
Hi,
If fields are same,what are you going to do?
In case you want incremental load,you can checksum stage.
Posted: Fri Feb 28, 2014 3:25 am
by pkll
Hi Prasoon,
I need to load the target table with only the new records I mean incremental load.I don't want to load every time the same records from source to target.If the new record or any updated record I need to load.Please let me know how to use the checksum stage
Posted: Fri Feb 28, 2014 4:00 am
by jerome_rajan
Hi,
I think the Change Capture Stage would serve your purpose. Suggest using the Checksum approach if you are dealing with huge reference data.
Posted: Fri Feb 28, 2014 4:06 am
by dsetlteam
Hi
Refer to "Checksum Stage" section of Chapter 6 in Parallel Job Developer's Guide to know about what the stage does and its properties.
Cheers!
Posted: Fri Feb 28, 2014 4:53 am
by ray.wurlod
You'll find it easier to use Change Capture or Difference stage.
checksum
Posted: Fri Feb 28, 2014 5:05 am
by pkll
Please let me know how to use the checksum stage.my requirement is to compare the source and target and if any new record found or any value updated then load the data into the target table.
Re: checksum
Posted: Fri Feb 28, 2014 7:12 am
by pkll
Hi Ray,
I need to use checksum stage only.
Below is my example
Input
------
e_id,e_name,e_Add
11,kim,bris
22,jim,mel
33,pim,syd
44,lim,canb
55,pom,pth
Output Before_Loading
-----------
e_id,e_name,e_add
11,kim,syd
22,jim,canb
33,pim,syd
44,lim,canb
55,pom,pth
Out After_Loading
-----------
e_id,e_name,e_add
11,kim,bris
22,jim,mel
33,pim,syd
44,lim,canb
55,pom,pth
11,kim,syd
22,jim,canb
Posted: Fri Feb 28, 2014 7:17 am
by jerome_rajan
What have you tried? Did you read through the parallel developers guide?
Posted: Fri Feb 28, 2014 7:36 am
by pkll
Re: checksum
Posted: Fri Feb 28, 2014 8:11 am
by chulett
pkll wrote:I need to use checksum stage only.
And why, pray tell, is that?
Re: checksum
Posted: Fri Feb 28, 2014 8:24 am
by pkll
We suggested to client changecapture stage.But client are interested on checksum stage...
Posted: Fri Feb 28, 2014 8:28 am
by chulett
Odd... "client" should just care that the job works correctly and is efficient. These kind of situations where they dictate stuff like this is just silly to me and not something I would stand for. But maybe that's just me.
Posted: Fri Feb 28, 2014 3:10 pm
by ray.wurlod
Resist stupid requirements.
The Checksum stage gives no additional information about what is different.