Issue with Join Stage

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
chkumar.ds
Participant
Posts: 1
Joined: Sat May 07, 2011 9:45 am
Location: United States

Issue with Join Stage

Post by chkumar.ds »

I have a an issue with JOIN (Inner Join ) stage ,in my case i have 2 files where i use inner join and get the output for the matching records ...(did hash partition on the join keys ) .
in my case when i run the job :

in seqential mode it is giving me one output
in parallel mode (2node) it is giving me one output
in parallel mode ( 4node) it is giving me one output
in parallel mode (8 node) it is giving me one output ...

my question is does join stage generates different outputs for diiferent node config file's of the same design jobb.......

Please help me with the issue ...and i really appreciate your help and inputs ...
--
Thanks & Regards
Ch kumar
chkumar.ds@gmail.com
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

It looks to me like there's only one combination of keys that match. Any other nodes will be idle for this link.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
shivadrash
Participant
Posts: 8
Joined: Mon Jun 13, 2011 2:55 am
Location: india

Re: Issue with Join Stage

Post by shivadrash »

Hashing alone wont do. Sort them on the joining Keys,
Regards
Sivanandha
Post Reply