CheckSum Stage in datastage
Moderators: chulett, rschirm, roy
CheckSum Stage in datastage
My Source is file and target is table.I need to compare a table records with records in a file to see if any field has changed. I am not sure if I should calculate the checksum then do the comparison. Please let me know how to use check sum stage.
Thank you in advance.
Thank you in advance.
-
- Premium Member
- Posts: 536
- Joined: Thu Oct 11, 2007 1:48 am
- Location: Bangalore
Hi,
If fields are same,what are you going to do?
In case you want incremental load,you can checksum stage.
If fields are same,what are you going to do?
In case you want incremental load,you can checksum stage.
Thanks
Prasoon
ETL Consultant
LinkedIn :- http://www.linkedin.com/profile/view?id ... ab_pro_top
Blog:- http://dsshar.blogspot.com/
Prasoon
ETL Consultant
LinkedIn :- http://www.linkedin.com/profile/view?id ... ab_pro_top
Blog:- http://dsshar.blogspot.com/
-
- Premium Member
- Posts: 376
- Joined: Sat Jan 07, 2012 12:25 pm
- Location: Piscataway
Hi,
I think the Change Capture Stage would serve your purpose. Suggest using the Checksum approach if you are dealing with huge reference data.
I think the Change Capture Stage would serve your purpose. Suggest using the Checksum approach if you are dealing with huge reference data.
Jerome
Data Integration Consultant at AWS
Connect With Me On LinkedIn
Life is really simple, but we insist on making it complicated.
Data Integration Consultant at AWS
Connect With Me On LinkedIn
Life is really simple, but we insist on making it complicated.
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Re: checksum
Hi Ray,
I need to use checksum stage only.
Below is my example
Input
------
e_id,e_name,e_Add
11,kim,bris
22,jim,mel
33,pim,syd
44,lim,canb
55,pom,pth
Output Before_Loading
-----------
e_id,e_name,e_add
11,kim,syd
22,jim,canb
33,pim,syd
44,lim,canb
55,pom,pth
Out After_Loading
-----------
e_id,e_name,e_add
11,kim,bris
22,jim,mel
33,pim,syd
44,lim,canb
55,pom,pth
11,kim,syd
22,jim,canb
I need to use checksum stage only.
Below is my example
Input
------
e_id,e_name,e_Add
11,kim,bris
22,jim,mel
33,pim,syd
44,lim,canb
55,pom,pth
Output Before_Loading
-----------
e_id,e_name,e_add
11,kim,syd
22,jim,canb
33,pim,syd
44,lim,canb
55,pom,pth
Out After_Loading
-----------
e_id,e_name,e_add
11,kim,bris
22,jim,mel
33,pim,syd
44,lim,canb
55,pom,pth
11,kim,syd
22,jim,canb
Last edited by pkll on Fri Feb 28, 2014 7:38 am, edited 1 time in total.
-
- Premium Member
- Posts: 376
- Joined: Sat Jan 07, 2012 12:25 pm
- Location: Piscataway
What have you tried? Did you read through the parallel developers guide?
Jerome
Data Integration Consultant at AWS
Connect With Me On LinkedIn
Life is really simple, but we insist on making it complicated.
Data Integration Consultant at AWS
Connect With Me On LinkedIn
Life is really simple, but we insist on making it complicated.
In page 155 I read but not clear.
http://www.redbooks.ibm.com/redbooks/pdfs/sg247830.pdf
http://www.redbooks.ibm.com/redbooks/pdfs/sg247830.pdf
Re: checksum
And why, pray tell, is that?pkll wrote:I need to use checksum stage only.
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers
Re: checksum
We suggested to client changecapture stage.But client are interested on checksum stage...
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact: