Load the target from the row the Job gets aborted

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
c.bharathiraja
Participant
Posts: 1
Joined: Thu May 12, 2005 12:23 am
Location: Chennai
Contact:

Load the target from the row the Job gets aborted

Post by c.bharathiraja »

Hi,

I have developed a job to load a voluminous table from one database to another. The number of rows is 23960000.
I have set the rows per transaction 10000.
the job aborted after loading 22890000.
How to design a job to load the remaining rows alone instead of running the job again.

Can we achieve this by query itself(DB is in Oracle 9i).

regards
Bharathi
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Bharathi,

the keyword you would use to search the forum is "checkpoint" and you will find numerous threads on different ways of doing this. As you have DS 6.x there are some new functionalities that are not available to you, but you still have a number of options.

If your input is always going to be in the same order then your checkpointing method can be quite easy, add a parameter such as RowToStart to your job, and in a transform just skip the row if @INROWNUM<=#RowToStart#. Default this to 0 and if you do need to do a re-run just enter the row number where the previous run aborted. This is more of a manual solution than an automated one.
talk2shaanc
Charter Member
Charter Member
Posts: 199
Joined: Tue Jan 18, 2005 2:50 am
Location: India

Post by talk2shaanc »

there are several discussion on this, search the forum.
use keyword like; restart, restartability...

some links:
1. viewtopic.php?t=93077&highlight=restart
2. viewtopic.php?t=91046&highlight=restart
Shantanu Choudhary
Post Reply