replacement for lookup stage
Moderators: chulett, rschirm, roy
-
- Premium Member
- Posts: 315
- Joined: Tue Oct 31, 2006 3:38 pm
replacement for lookup stage
i want to replace the values of 4 columns with other values......so iam using the original file as input to the lookupstage and the new values sequential file as a lookup file to the lookup stage. the file has 10million records. Datastage job is aborting saying that the space is not sufficient. i understand that since it has millions of records ......lookup stage dont allow it. but can anybody tell me the replacement for it...so that i can proceed...
thanks in advance......
thanks in advance......
-
- Premium Member
- Posts: 315
- Joined: Tue Oct 31, 2006 3:38 pm
i want to be more clear......what iam doing is a swap technique. i want to swap the 4 collumns. for example.....the values of columns at row 1 should be swapped with the values of columns at row 100.
I have generated some random rownumbers with a C++ routine equal to the number of the records in the file. for example:
1 1990
2 3028
3 56
4 898...........etc. so the values at row 1 should be swapped with row 1990 and so on.............
i dont think the join stage can do this? Am i right.
I have generated some random rownumbers with a C++ routine equal to the number of the records in the file. for example:
1 1990
2 3028
3 56
4 898...........etc. so the values at row 1 should be swapped with row 1990 and so on.............
i dont think the join stage can do this? Am i right.
You need to define a primary key so that a row can be found in a reference. Lookup, Join, Merge, heck even a database join, require you to identify how to connect rows. If you mean data is positional within the data file, then simply use the row number as the primary key and create a column to hold that value.
Kenneth Bland
Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle