Long running Jobs

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

DeepakMohanty
Participant
Posts: 8
Joined: Mon May 05, 2008 4:39 am
Location: Bangalore India

Long running Jobs

Post by DeepakMohanty »

We are using the db2 enterprise edition stage, to load data from a sequential file into the database. Write meathod is LOAD
The issue is when the source file is empty the jobs do not terminte. The sequential file does import zero records. But after that it just hangs. This happens to all jobs with empty source files. If anyone could help me out i would really appreciate it..
Thanks
--Deepak
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

That sounds like a bug, I have never seen anything like that. If you change the load method does the job still hang? Are these actual data sequential files or are they perhaps named pipes?
DeepakMohanty
Participant
Posts: 8
Joined: Mon May 05, 2008 4:39 am
Location: Bangalore India

Post by DeepakMohanty »

Hi,
We have sequential file.
When we change the write meathod from LOAD to Write.
Still its not working. Jobs are keeps on running.

Thanks
--Deepak
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

That is even odder. If you replace the DB2 output with a peek stage does the job still hang?
DeepakMohanty
Participant
Posts: 8
Joined: Mon May 05, 2008 4:39 am
Location: Bangalore India

Post by DeepakMohanty »

if we use peek or file as a target, job finishing, but if we use data base table its keep on running.

"we would like to talk on phone, if you are intrest please send your number to kunnal.deepak@gmail.com"
--Deepak
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

One of the powerful aspects of DSXchange is that anyone can search the collected posts to see if their error has already been encountered by others and what the solution might have been. By going off-line (be it by phone, e-mail or private messaging) this seamless history is broken and others cannot benefit.

I think that if your jobs run and complete correctly when the source file contains data but hangs when it does not is sufficient information for you to contact your support provider for assitance as it really does look like a bug.
DeepakMohanty
Participant
Posts: 8
Joined: Mon May 05, 2008 4:39 am
Location: Bangalore India

Post by DeepakMohanty »

Hi,
Problem we have some jobs having no records also running successfully,
But some having no records failing.

Can you let me know do u have ever face such situation if u had faced how u resolved that.

our environment is like that our DB is in one AIX box and Data stage in another box.

regards
--Deepak
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

No idea what could be causing your problem - unless your source file is a named pipe.
Minhajuddin
Participant
Posts: 467
Joined: Tue Mar 20, 2007 6:36 am
Location: Chennai
Contact:

Post by Minhajuddin »

If it's a bug. You can stop the job from running whenever the file has no lines. You would have to do this check before you trigger the job, But, it's just a workaround.
Minhajuddin

<a href="http://feeds.feedburner.com/~r/MyExperi ... ~6/2"><img src="http://feeds.feedburner.com/MyExperienc ... lrow.3.gif" alt="My experiences with this DLROW" border="0"></a>
DeepakMohanty
Participant
Posts: 8
Joined: Mon May 05, 2008 4:39 am
Location: Bangalore India

Post by DeepakMohanty »

How to do that
--Deepak
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

test -z filename
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
DeepakMohanty
Participant
Posts: 8
Joined: Mon May 05, 2008 4:39 am
Location: Bangalore India

Post by DeepakMohanty »

Hi,

What for this command?

How to use it in my problem?

Regards
Deepak
--Deepak
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Ray anwsered your question regarding how to find out if the source file is a named pipe. "ls -al" will also show a "p" in the attributes for pipes.
Minhajuddin
Participant
Posts: 467
Joined: Tue Mar 20, 2007 6:36 am
Location: Chennai
Contact:

Post by Minhajuddin »

In the sequence which controls the job which has your join, Do this:

>> Add an execute command stage and run the command test -s <file_name> in that command by pointing it to the file which is expected to be empty.

>>Add a Nested Condition activity and use a custom trigger which triggers the job with the join only when the output from the above command is zero.
Minhajuddin

<a href="http://feeds.feedburner.com/~r/MyExperi ... ~6/2"><img src="http://feeds.feedburner.com/MyExperienc ... lrow.3.gif" alt="My experiences with this DLROW" border="0"></a>
DeepakMohanty
Participant
Posts: 8
Joined: Mon May 05, 2008 4:39 am
Location: Bangalore India

Post by DeepakMohanty »

The file having one header column only.
--Deepak
Post Reply