DSXchange

Hi DS Guys,

When I run the job, target table has loaded 102 records after that due to some problems job has been failed or Aborted. After solving the problem I want the to load the data from 103 record onwards (I dont want to load from 1st record).

I think you've to select the option at the target table as "Update and then Insert".This will update the existing rows and insert new rows...

DS gurus please correct me...

Short answer is "skip them". However - static source? Meaning when you rerun it, will the 103rd record in the second run be the same 103rd record from the first run?

How to skip the first 102 rows and moreover if I skip the rows, that job will can give good result. Please can provide the proper guidance in answer

Not a quick solution - you may try comparing the loaded records against the source and eliminate them. If upsert option does not work for you, have you tried using a transaction size of 0?

You "skip" them using a constraint in a transformer (@INROWNUM > X) but there's a lot more to it than that in the PX environment. And only you can say if it will "give good result" if you do that.

Did this really work?

"constraint in a transformer (@INROWNUM > X)"" if YES then its really good one....!

Yes/no/maybe. Remember that each Transformer stage instance (there are four if you are running in a four node configuration) keeps its own, separate, count.

Oh okay...thanks for the information.
in that case it wont be useful for me when restarting the job from the point of failure.