Dataset Getting hanged

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
bipul
Participant
Posts: 13
Joined: Mon Dec 29, 2003 9:52 am

Dataset Getting hanged

Post by bipul »

Hi Everyone,

I have one very peculiar problem.

In one of my jobs, I am creating a dataset. Though most of the time the dataset gets created perfectly (99%), but there are instance where the Dataset gets hanged.

What I mean by hanged is that the job does not come out. It's always show that it's in running state though all the source records have been read and processed, but the jobs does not get completed.

But, if I stop the job and then re-run the job, it works fine.

I am not very sure why is it behaving this way.

I would be very grateful, if anyone can guide me on this.

Thanks in advance.

Regards,

Bipul
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

What other stages do you have in your job? It is more likely "hanging" in one of those, particularly a database read, than in the dataset write. Have you checked the number of rows in the dataset when it hangs, and then compared it to the count when it runs without a problem?
bipul
Participant
Posts: 13
Joined: Mon Dec 29, 2003 9:52 am

Post by bipul »

Hi ArndW,

Besides Dataset, the other stages are

1)Sequential file
2) Lookupstage
3) Copy stage
4) filter stage
5) modify stage
6) join stage
7) transformer stage
and Viii) sort stage

There is no database stage in the job.

Yeah, I have checked the count. And in both the cases the counts are same.

Thanks & Regards,

Bipul
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Do you have an after-job subroutine? Also, if the counts are the same and the job is hanging, can you check to see if the UNIX processes associated with the job are still active? That would mean the job isn't really hanging but you are having an issue with updating the status.
bipul
Participant
Posts: 13
Joined: Mon Dec 29, 2003 9:52 am

Post by bipul »

There are no after-job subroutine.

And I am not very sure about the UNIX process id. I would check the same and let you know.
Post Reply