DSXchange

HI Frnds -
I will explain you job -

1- lkp file -A
this lkp file A is used in several files and there is another graph that updates this lookup file ! Occasionally the writting lkp and read will occuer simultanesly in that case the jobs which are reading the LKP file is getting failed- and the error is SIGBUS (unix-error)
----
My Solutions :-
Create 2 files for LKP new and dat , over write new with dat.
still it fails
Ideas will be appreciated !

Explain the entire job. What you have supplied is insufficient for cogent diagnosis. SIGBUS is one of the standard UNIX signals; type man signal at a UNIX prompt to learn a little more about this particular signal.

In general, in parallel jobs, simultaneous write and read to the same object is not possible.

situation where one graph is rebuilding a lookup file, while another graph is reading from it. The graph that is reading from the lookup gets "killed" by the graph that replaces the lookup.

thanks in Adv

Standard medical advice: if it hurts, don't do it.

ray.wurlod wrote:Standard medical advice: if it hurts, don't do it. ...

what else you need ! I have explained the problem ?
Please let me , I will try my best..
we approch the forum hoping of some solutions .

ray.wurlod wrote: In general, in parallel jobs, simultaneous write and read to the same object is not possible.

I think Ray has given you the answer. Avoid that and you will be ok.

As I stated earlier, write and read of the same object in the same job is not supported in parallel jobs, in general. It is a blocking operation, which interferes with pipeline parallelism.

what ever the ray told ! that i know ..
I am asking if you get same problem how do you deal.









Problem to problem is not solution !

I never get the same problem, because I don't try to force DataStage to do anything illegal.

If datastage opens the lookup file when it is using it and doesn't close it until the job is complete you should be able to delete the file and the job using it should be fine until it closes the file. This would let you create the new file and datastage would happily use the filename which doesn't exist anymore until that program is done running. However, if you delete the file and datastage is opening and closing it you will have a problem.

Thanks for the reply!My question is
1- lkp A is using job1 as lookup
2- Job 2 writting the same file - lkp A.
--
scenario 1:-

Is there any way we can find the wheather JOb 1 is reading lkp-A.so that we can stop writting until it reading is finsihed and we can trigger the job2 to write the same file .

The unix command fuser can be used to determine whether a file is in use or not.

Thanks -

this what Im looking for !-
now we can apply a logic !

if file is in use
then
abort job2
else
run job2.

Ultramundane wrote:The unix command fuser can be used to determine whether a file is in use or not.