Again Join Stage (Data Error)
Posted: Thu Jul 17, 2008 3:44 am
Hi,
Iam just Joining two Datasets with single Key column using JOIN stage. The Data has been verified for NULL, TRIM etc. The output of Join is giving 0 records but iam having 3matching records.
Iam getting the same three matching records in Backend Query, while using Lookup stage but whats the problem in Join stage.
I tried to change with sequential mode(JOIN Stage), then iam getting the matching records but i beleive this is not advisable coz of huge volume of Data. Am i right here...
One of my dataset having millions of records and another is having in thousands...
If i use Lookup stage for this scenario since it's working fine but in actual scenario the both Datasets is going to give Millions of records.
I tried giving partition but same problem like no HIT or few matching records is coming etc..
Awaiting for experts reply..
Thanks,
M Gopinath
Iam just Joining two Datasets with single Key column using JOIN stage. The Data has been verified for NULL, TRIM etc. The output of Join is giving 0 records but iam having 3matching records.
Iam getting the same three matching records in Backend Query, while using Lookup stage but whats the problem in Join stage.
I tried to change with sequential mode(JOIN Stage), then iam getting the matching records but i beleive this is not advisable coz of huge volume of Data. Am i right here...
One of my dataset having millions of records and another is having in thousands...
If i use Lookup stage for this scenario since it's working fine but in actual scenario the both Datasets is going to give Millions of records.
I tried giving partition but same problem like no HIT or few matching records is coming etc..
Awaiting for experts reply..
Thanks,
M Gopinath