Hi All,
I have a datastage job in which the i am fetching data from a Teradata Connector and second from Dataset.
I join the data using a join stage.
When I am partitioning the data using Hash/Sort method on both the input links, the join is not provioding the correct output.
But when I change the partition method to ENTIRE, the join stage works fine. I cant go for Entire partition as the Volume of data is supposed to be very huge.
Has anyone ever faced such issue before??? If so what can be the resolution as the workaround of ENTIRE does not seem good to me.
Please suggest.
Regards,
Amit
Hash partition not working in Join stage
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
If the inputs are identically hash partitioned and sorted, then it will work. Therefore I must assume that there was some difference between the inputs in your case in how the partition and/or sort keys were specified.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
We checked it many times, we did not have any discrepancy in the Hash/Sort order of the key columns in both of the links.ray.wurlod wrote:If the inputs are identically hash partitioned and sorted, then it will work. Therefore I must assume that there was some difference between the inputs in your case in how the partition and/or sort keys were specified.
Still no Luck. Ultimately we tries the Entire method, where it worked...
What can be the reasonm for this???
Re: Hash partition not working in Join stage
Hi Amit,
I'm also facing similar issue. How did u use entire partitioning?
My target is a DB2 table. When I give entire partition in join, it gives primary key violation.
Going mad with this... Please help!
I'm also facing similar issue. How did u use entire partitioning?
My target is a DB2 table. When I give entire partition in join, it gives primary key violation.
Going mad with this... Please help!
Shruthi
-
- Participant
- Posts: 64
- Joined: Fri Jan 25, 2008 4:41 am