Page 1 of 1
tmp space
Posted: Mon Apr 21, 2008 1:22 pm
by dspxguy
hi, we got this error message in a server job
Code: Select all
chekstglink: ds_ipcopen() - Error in open(/tmp/ade.projecta.jobname.RecodeUnitCnts_tran-Combine.chekstglink) - No such file or directory
later on the job finished successfully. I checked the /tmp space and it was not full and there were no permission issues as well.
what was wrong?
appreciate your input.
Thanks
Posted: Mon Apr 21, 2008 1:24 pm
by kumar_s
What is the job design? Are you using any IPC stage or Link collector etc?
Posted: Mon Apr 21, 2008 1:56 pm
by dspxguy
Code: Select all
SeqFile --- Hash
|
xfm -------->xfm ------>xfm------->LinkPartitioner
| | |
| Hash Seq File
DB2 -------->Linkcoltr
|
DB2 -------->xfm
using link collector and link partitioner stages,
Posted: Mon Apr 21, 2008 2:06 pm
by kumar_s
Have you selected "Enable Row Buffer" at job property level to Inter Process?
Posted: Mon Apr 21, 2008 3:20 pm
by dspxguy
kumar_s wrote:Have you selected "Enable Row Buffer" at job property level to Inter Process? ...
yes
Posted: Mon Apr 21, 2008 4:47 pm
by ray.wurlod
Checking temp space "later" is of no value. You have to check it "during".
Posted: Mon Apr 21, 2008 5:02 pm
by dspxguy
Ray,
i totally agree with that statement.
i am just curious why did it run fine after the abort., maybe 1GB tmp space is not enough for the jobs..
Posted: Mon Apr 21, 2008 5:15 pm
by ray.wurlod
It may not be, as you say. For example if you are processing (sorting, maybe) 10GB of data, then 1GB of scratch space will possibly not be enough: definitely won't be enough if you only have 4GB of memory in the machine.
Posted: Wed Apr 30, 2008 9:44 am
by dspxguy
hi, thanks for the responses. another question,
what is the purpose of defining the varaiable TMPDIR in adminsitrator when we already use UVTEMP in uvconfig?
In some of our environments we have defined both and in some we are only using UVTEMP space.
is TMPDIR a backup space, like when scratch will be full then it will be used?
Thanks
Posted: Wed Apr 30, 2008 2:51 pm
by ray.wurlod
Yes, TMPDIR is the third option for scratch space in parallel jobs. UVTEMP is scratch space used by server jobs. Custom stages may use either, at the whim of their author.
Posted: Thu May 01, 2008 3:08 pm
by dspxguy
Thanks for the info,