Hi All,
I developed a job with Oracle Connector as source ,then a lookup stage with 4 reference links out of which one link is a dummy lookup to populate a batch id and the other three come from a single oracle connector with a copy stage after that.The three reference links do not have any duplicates on the key column and the same reference key is looked up by three different stream keys.After the lookup I have plenty translations and transformations to do in transformer based on the lookedup values.When I run the job filtering a set of records (for e.g where itemid=xxx ) the output is as desired and when I remove the filter and run for the whole data the column values are scrambled.Only records with valid reference values are populated perfectly and others are populated with values which are not related to the field in anyway..When I run the job again ,the values populated in the previous run gets changed for the same columns though source data remains unchanged.
I tried separating the reference form copy stage to three individual reference stages and partitioning the data on the item field,the output was still not as expected.
Please suggest a way to troubleshoot this situation.
Different results in every run
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 134
- Joined: Tue Jun 15, 2010 2:10 am
- Location: Bangalore
Different results in every run
N.Srinivas
India.
India.
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
-
- Participant
- Posts: 134
- Joined: Tue Jun 15, 2010 2:10 am
- Location: Bangalore
Lookup is rght after the connector(source) .The connector is running in Sequential mode and I made Auto partition in lookup.When I tried parititioning the data on a field Item.I made hash partition on input and entire on the reference.The results were not as expected even in that case.
N.Srinivas
India.
India.
-
- Participant
- Posts: 134
- Joined: Tue Jun 15, 2010 2:10 am
- Location: Bangalore
-
- Participant
- Posts: 134
- Joined: Tue Jun 15, 2010 2:10 am
- Location: Bangalore