DS Job is running running never ends

IBMDS4KK · Post by **IBMDS4KK** » Fri Dec 13, 2013 12:26 am

Hi DS Mates,

I am running one job which is having 2 stages, oracle connector and dataset. Fetching the data and placing in dataset. Instead of either finishing or aborting it was still running.

When I run that query using SQL Developer, it was taking 5 hrs to get the o/p. But in DS Job why this happens ?

Please suggest !

priyadarshikunal · Post by **priyadarshikunal** » Fri Dec 13, 2013 6:31 am

5 Hours to get the result for SQL developer? Either a very complex query is running on huge data or something is wrong.

SQL developer you might have got the first 50 records, as it does by default. DataStage will pull out all the records before it stops. Can you see the number of records getting increased in monitor?

IBMDS4KK · Post by **IBMDS4KK** » Fri Dec 13, 2013 9:14 pm

@priyadarshikunal :

In SQL Developer, until 5 hrs the query is run status and the count is 3.4 million.

In DS Job, record count is increasing while checking performance statistics but after reaching 3.2 million that's it. The same status showed by job in 22 hr. Then I killed the process.

Note : Interestingly, sometimes the job finished in 1 hr. But sometimes it was taking long time and hangs.

Kindly suggest!

priyadarshikunal · Post by **priyadarshikunal** » Mon Dec 16, 2013 6:10 am

can you run it after disabling operator combination?

This looks like some resource issue, you will have to do some detective work as does it hang at a particular time or the day? or some other kind of pattern to find out the root cause?