We are trying to use SCD in a very simple job to generate type 2 lines for currencies if the description changes.
The first pass works and we get all the data into the target dimension table, the second pass aborts with the 'Input not sorted at record 18' error across all partitions.
What we have tried.
On input we have hash partitioned and sorted the reference and the source table.
We have done the same operation using a lookup and the data matches.
I feel I am so close but it might be a lot less effort to try and use a lookup with a change capture and copy routine. But I have to do 40 tables like this so I have to ensure the best method is used
Thanks
SCD fails to recognise key for update
Moderators: chulett, rschirm, roy
SCD fails to recognise key for update
Colin Larcombe
-------------------
Certified IBM Infosphere Datastage Developer
-------------------
Certified IBM Infosphere Datastage Developer
-
- Participant
- Posts: 152
- Joined: Mon Mar 07, 2011 6:16 am
Re: SCD fails to recognise key for update
I think in the SCD stage there are two types of functioning.
1. In build look up stage
2. Transformer stage.
First performs look up then performs transformation in the transformer.
So for the SCD stage always make the partition as auto.
Let me know if any other issue is there
1. In build look up stage
2. Transformer stage.
First performs look up then performs transformation in the transformer.
So for the SCD stage always make the partition as auto.
Let me know if any other issue is there
Soumya
-
- Participant
- Posts: 152
- Joined: Mon Mar 07, 2011 6:16 am