Hi Everyone,
I have one very peculiar problem.
In one of my jobs, I am creating a dataset. Though most of the time the dataset gets created perfectly (99%), but there are instance where the Dataset gets hanged.
What I mean by hanged is that the job does not come out. It's always show that it's in running state though all the source records have been read and processed, but the jobs does not get completed.
But, if I stop the job and then re-run the job, it works fine.
I am not very sure why is it behaving this way.
I would be very grateful, if anyone can guide me on this.
Thanks in advance.
Regards,
Bipul
Dataset Getting hanged
Moderators: chulett, rschirm, roy
What other stages do you have in your job? It is more likely "hanging" in one of those, particularly a database read, than in the dataset write. Have you checked the number of rows in the dataset when it hangs, and then compared it to the count when it runs without a problem?
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
Hi ArndW,
Besides Dataset, the other stages are
1)Sequential file
2) Lookupstage
3) Copy stage
4) filter stage
5) modify stage
6) join stage
7) transformer stage
and Viii) sort stage
There is no database stage in the job.
Yeah, I have checked the count. And in both the cases the counts are same.
Thanks & Regards,
Bipul
Besides Dataset, the other stages are
1)Sequential file
2) Lookupstage
3) Copy stage
4) filter stage
5) modify stage
6) join stage
7) transformer stage
and Viii) sort stage
There is no database stage in the job.
Yeah, I have checked the count. And in both the cases the counts are same.
Thanks & Regards,
Bipul
Do you have an after-job subroutine? Also, if the counts are the same and the job is hanging, can you check to see if the UNIX processes associated with the job are still active? That would mean the job isn't really hanging but you are having an issue with updating the status.
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>