Hi,
I have developed a job to load a voluminous table from one database to another. The number of rows is 23960000.
I have set the rows per transaction 10000.
the job aborted after loading 22890000.
How to design a job to load the remaining rows alone instead of running the job again.
Can we achieve this by query itself(DB is in Oracle 9i).
regards
Bharathi
Load the target from the row the Job gets aborted
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 1
- Joined: Thu May 12, 2005 12:23 am
- Location: Chennai
- Contact:
Bharathi,
the keyword you would use to search the forum is "checkpoint" and you will find numerous threads on different ways of doing this. As you have DS 6.x there are some new functionalities that are not available to you, but you still have a number of options.
If your input is always going to be in the same order then your checkpointing method can be quite easy, add a parameter such as RowToStart to your job, and in a transform just skip the row if @INROWNUM<=#RowToStart#. Default this to 0 and if you do need to do a re-run just enter the row number where the previous run aborted. This is more of a manual solution than an automated one.
the keyword you would use to search the forum is "checkpoint" and you will find numerous threads on different ways of doing this. As you have DS 6.x there are some new functionalities that are not available to you, but you still have a number of options.
If your input is always going to be in the same order then your checkpointing method can be quite easy, add a parameter such as RowToStart to your job, and in a transform just skip the row if @INROWNUM<=#RowToStart#. Default this to 0 and if you do need to do a re-run just enter the row number where the previous run aborted. This is more of a manual solution than an automated one.
-
- Charter Member
- Posts: 199
- Joined: Tue Jan 18, 2005 2:50 am
- Location: India
there are several discussion on this, search the forum.
use keyword like; restart, restartability...
some links:
1. viewtopic.php?t=93077&highlight=restart
2. viewtopic.php?t=91046&highlight=restart
use keyword like; restart, restartability...
some links:
1. viewtopic.php?t=93077&highlight=restart
2. viewtopic.php?t=91046&highlight=restart
Shantanu Choudhary