DSXchange

I have done a complete search with the subject but not able to resolve my issue. Can any one help me with a solution

I am facing fatal error with Link Partitioner stage. 2 Million records are processed every week but facing this issue today. Checked buffer size and timeout and showing as 1024 & 600 repectively. But not sure why I am getting this error.

Job design

Seq file -> LP -> LC -> Trans -> Seq file

Any help will be very much appreciated.

Are the two "link" stages actually doing anything in the job?

No. It just split the file into 3 and combine again as 1 file.

Why? If they've been added because someone thought they would magically improve performance, that's not what they are for. I'd suggest removing them from the job, 2 million records is not a large amount and I can't imagine turning off the troublesome buffering would make any kind of significant change in the 'performance' of the load. Other than just make it work all the time.

If the job design were ... LP -> Trans -> LC -> ... and the Transormer stage did some seriously heavy processing then the LP/LC could help performance, but as it is I don't see any point to it either.