Need Help_ My jobs aborted in the middle of loading

aladap12 · Post by **aladap12** » Mon Jun 22, 2009 7:23 am

Hi,

I have an issue with my server job. I have one job that runs every day to load data into target file/table.
Job faild after loading some records in to target, ex..
assume that i have 100 records in my input, job failed after loading 37 records, next time i have to start loading from 38 record.

how would i achinve this using datastage.

Thanks
KR

Sainath.Srinivasan · Post by **Sainath.Srinivasan** » Mon Jun 22, 2009 7:30 am

Are you saying that it had happened or you want to prevent such happening?

Unless there is any metadata related information to locate records affected by current load, you cannot restart from failure.

Alternatively you can set the commit size to zero to ensure that it is everything or nothing.

There are other ways to do this but will involve using other objects.

chulett · Post by **chulett** » Mon Jun 22, 2009 7:30 am

Delete the 37 then rerun. Add a 'number of records to skip' job parameter and use that in a constraint.

ArndW · Post by **ArndW** » Mon Jun 22, 2009 7:31 am

Other options are to declare the whole load as one transaction, or to use UPSERT functionality.

Sainath.Srinivasan · Post by **Sainath.Srinivasan** » Mon Jun 22, 2009 7:33 am

Craig,

Being Server edition, I did think about deleting or including a constraint to skip 37.

But that is on the assumption that the target is direct load of source with no other dml or "prev-next" included.

chulett · Post by **chulett** » Mon Jun 22, 2009 9:23 am

True, we can just suggest general solutions since we don't know the specifics of the 'load' being done here. And the 'skip' solution requires a static source to ensure one run's 38th record is the same as every other run's 38th record.

aladap12 · Post by **aladap12** » Mon Jun 22, 2009 10:24 am

Sainath.Srinivasan wrote:Craig,

Being Server edition, I did think about deleting or including a constraint to skip 37.

But that is on the assumption that the target is direct load of source with no other dml or "prev-n ...

Sainath. since i am not a Premium member i can not view this content.. could you plase give me the answer again

Sainath.Srinivasan · Post by **Sainath.Srinivasan** » Mon Jun 22, 2009 1:23 pm

In short, if you take out the first 37 records from input, will the resulting flow work lead to full load?

Sainath.Srinivasan · Post by **Sainath.Srinivasan** » Mon Jun 22, 2009 1:23 pm

In short, if you take out the first 37 records from input, will the resulting flow work lead to full load?

chulett · Post by **chulett** » Mon Jun 22, 2009 1:26 pm

I actually meant to delete them from the target not the source and then rerun everything... but either way could work.