Warning on Datastage parallel job on duplicate entry
Moderators: chulett, rschirm, roy
Warning on Datastage parallel job on duplicate entry
Recieved warning on ignoring duplicate entry at table ...no further warnings will be issued for this table.
Solution:
Made the one of the referance link in lookup stage for selecting multiple rows from link and warning has gone.
Query: Is there any impact of data flowed from link after selecting multiple rows from link or it is just removed warning and no impact on data which has been loaded from the link to target.
Solution:
Made the one of the referance link in lookup stage for selecting multiple rows from link and warning has gone.
Query: Is there any impact of data flowed from link after selecting multiple rows from link or it is just removed warning and no impact on data which has been loaded from the link to target.
Mayura
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
If you want one row being turned into multiple rows after the lookup, then the setting you used allows that to happen. If you do not want that, then either craft your lookup so it only returns a single row so no warning is thrown, or live with the warning as it throws away all of the 'extra' rows from the lookup.
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
-
- Premium Member
- Posts: 376
- Joined: Sat Jan 07, 2012 12:25 pm
- Location: Piscataway
On what basis did you check if there are duplicates? Is it not possible that there are multiple records for the same value of your lookup keys?
Jerome
Data Integration Consultant at AWS
Connect With Me On LinkedIn
Life is really simple, but we insist on making it complicated.
Data Integration Consultant at AWS
Connect With Me On LinkedIn
Life is really simple, but we insist on making it complicated.
I did used remove duplicate stage for the records on which warning coming out.
I used the same key column based on what data has been extracted or lookedup in lookup stage.
Is there any possiblity of line break or any junk character into file.
May be i will check data set data one more time..
But please suggestion is open.
I used the same key column based on what data has been extracted or lookedup in lookup stage.
Is there any possiblity of line break or any junk character into file.
May be i will check data set data one more time..
But please suggestion is open.
Mayura