DSXchange

Hi ,

I am having a job which consists of 5 lookup stages ,5 transformer stages,2 input datasets and one output dataset.One of the input datasets is having 5049590records and another one is having 0 records.

The job is throwing following run time error ;

Failure during execution of operator logic

Should I opt for job split and make two smaller jobs as the existing big job is highly resource consuming ? Or there may be other reasons for that particular error message?


Thanks and Regards

Avik Dasgupta

Yes, split the job. BTW is the data volume for lookup stages is huge or what. If yes...then do not use lookup stage else use join stage to do lookup.

HTH

Is that the complete error message? If not, can you post it unedited plus any other associated errors/warnings you are getting.

Check the stage variable conditions given in your transformer.

DS User

generally these errors come with some other warning/error messages as Craig mentioned. Post other warning/error messages.

As suggested by Craig, list out the warnings occurred during the execution.. So, that it can be easier to resolve the issue.
Also, you can validate all the Stage Variables, Constraints and Derivations of all the 5 Transformers, usually, you may find the issues over there it self.