Hi everyone,
I have a column X that is being populated, in the transformer, after that value has been populated i need to take column X and compare it to another reference table, to populate another column. I tried this so far and i kept crashing datastage. After column x was done i sent that to a hash file and than to a transformer where that was compared to the reference table, than sent back to another hash file where i sent it to the final table but it kept on crashing because the table was already open. If anyone has any suggestion it is greatly appriacated. THANKS
insert data into table that is being populated
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 4
- Joined: Tue Mar 28, 2006 11:06 am
-
- Premium Member
- Posts: 108
- Joined: Sat Feb 05, 2005 6:52 pm
- Location: US
-
- Participant
- Posts: 20
- Joined: Mon Dec 05, 2005 8:07 pm
- Contact:
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
It's unhelpful not having the exact error message. Chances are that you're trying to do too much with two few stages, or even too few jobs, and perhaps getting locking issues in the database.
Staging the intermediate data, perhaps into a file as the previous poster suggested, is one way, but you can get by simply by streaming the result of the first lookup into a second Transformer stage in order to perform the second lookup.
If there may be repeats in the source data, use a hashed file to contain a copy of current rows from the target table. The hashed file can be updated without needing to touch the target table. There are plenty of descriptions of this technique on this forum. A Search will find them.
Staging the intermediate data, perhaps into a file as the previous poster suggested, is one way, but you can get by simply by streaming the result of the first lookup into a second Transformer stage in order to perform the second lookup.
If there may be repeats in the source data, use a hashed file to contain a copy of current rows from the target table. The hashed file can be updated without needing to touch the target table. There are plenty of descriptions of this technique on this forum. A Search will find them.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Participant
- Posts: 20
- Joined: Mon Dec 05, 2005 8:07 pm
- Contact:
rayray.wurlod wrote:It's unhelpful not having the exact error message. Chances are that you're trying to do too much with two few stages, or even too few jobs, and perhaps getting locking issues in the database.
Stag ...
i think he is loading the same table in the etl twice which is causing the etl job to hang!!!
KRIS