Page 1 of 1

Hash partition not working in Join stage

Posted: Wed Dec 03, 2008 1:30 am
by wfis
Hi All,

I have a datastage job in which the i am fetching data from a Teradata Connector and second from Dataset.

I join the data using a join stage.

When I am partitioning the data using Hash/Sort method on both the input links, the join is not provioding the correct output.

But when I change the partition method to ENTIRE, the join stage works fine. I cant go for Entire partition as the Volume of data is supposed to be very huge.

Has anyone ever faced such issue before??? If so what can be the resolution as the workaround of ENTIRE does not seem good to me.

Please suggest.

Regards,
Amit

Posted: Wed Dec 03, 2008 5:14 am
by ray.wurlod
If the inputs are identically hash partitioned and sorted, then it will work. Therefore I must assume that there was some difference between the inputs in your case in how the partition and/or sort keys were specified.

Posted: Wed Dec 03, 2008 9:55 am
by wfis
ray.wurlod wrote:If the inputs are identically hash partitioned and sorted, then it will work. Therefore I must assume that there was some difference between the inputs in your case in how the partition and/or sort keys were specified.
We checked it many times, we did not have any discrepancy in the Hash/Sort order of the key columns in both of the links.

Still no Luck. Ultimately we tries the Entire method, where it worked...


What can be the reasonm for this???

Posted: Wed Dec 03, 2008 10:09 am
by Mike
As Ray said , if the keys are identical in both inputs, then it will work. Are the data types of the key columns exactly the same as well?

Mike

Re: Hash partition not working in Join stage

Posted: Tue Dec 09, 2008 6:39 am
by Shruthi
Hi Amit,

I'm also facing similar issue. How did u use entire partitioning?

My target is a DB2 table. When I give entire partition in join, it gives primary key violation.

Going mad with this... Please help!

Posted: Sat Dec 13, 2008 1:06 pm
by shershahkhan
If you are using the instage sort then try using a saparate sort stage before partioning, it worked in my case