Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.
Moderators: chulett , rschirm , roy
dnat
Participant
Posts: 200 Joined: Thu Sep 06, 2007 2:06 am
Post
by dnat » Wed Jul 29, 2009 12:40 am
Hi
I am joining two sources(a file and a table) with one key and if there is no match, then i am joining the non-matched records with some other field of the table.
I am just using Auto-partition throughout the job.
The first join is working properly..but the second join is not..If it is a patrition problem it should affect both isnt it..
mandyli
Premium Member
Posts: 898 Joined: Wed May 26, 2004 10:45 pm
Location: Chicago
Post
by mandyli » Wed Jul 29, 2009 1:13 am
Hi,
How are collecting non matching records out of a join? Is there any provision in the Join stage to collect them? Please be more clear.
Thanks.
ArndW
Participant
Posts: 16318 Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:
Post
by ArndW » Wed Jul 29, 2009 1:17 am
Try running your job with a 1-node configuration and then with a 2-node configuration. If the results are different, then you have a partitioning problem that you need to correct.
keshav0307
Premium Member
Posts: 783 Joined: Mon Jan 16, 2006 10:17 pm
Location: Sydney, Australia
Post
by keshav0307 » Wed Jul 29, 2009 6:26 pm
have you checked the key checkbox?
can you use hash partition?
ddevdutt
Participant
Posts: 47 Joined: Wed Aug 22, 2007 2:38 pm
Post
by ddevdutt » Wed Jul 29, 2009 7:15 pm
The keys you partition on in the first join will be different from the keys you partition on in the second join.
What are the various stages in your job?
DD
Success is right around the corner
dnat
Participant
Posts: 200 Joined: Thu Sep 06, 2007 2:06 am
Post
by dnat » Fri Jul 31, 2009 1:27 am
I made the second join to run in sequential, but still some of the records are not joined properly.
Sainath.Srinivasan
Participant
Posts: 3337 Joined: Mon Jan 17, 2005 4:49 am
Location: United Kingdom
Post
by Sainath.Srinivasan » Fri Jul 31, 2009 2:17 am
Did you check the datatype, length etc of the joining columns ?
Is it a case sensitive match ?
What do the records which do not join have in common? Try to locate the keys of missing records in the counterpart source manually.
dnat
Participant
Posts: 200 Joined: Thu Sep 06, 2007 2:06 am
Post
by dnat » Fri Jul 31, 2009 3:32 am
It is a varchar field of length 13 on both the links. When i query it from the SQL i am getting an output, but when the join happens it doesnt match..It is a case insensitive match only.
Sreenivasulu
Premium Member
Posts: 892 Joined: Thu Oct 16, 2003 5:18 am
Post
by Sreenivasulu » Sun Aug 02, 2009 8:44 am
Some control characters might be appended to data in the database.
Use rtrim , ltrim on the data present in the database.
Then run the job.
Regards
Sreeni