Hi
My job getting aborted without any proper warning in the director. I did all I could to see the problem but nothing find wrong in job.
I observed that /tmp directory getting full suddnly from 80% 100% and when it reach 100% it is getting full. I am not directly creating /reading any file from /tmp directory. Also In my configuration file I mentioned the path of resource disk and scratch disk a differnt directory not /tmp. Then how it is getting full.
I logged in to putty as dsadm used and tried to create some files in the scratch /resource disk to verify I lost permission or not but nothing like that. I am able to create the files.Then how datastge is using /tmp. and ho wit is geting full.
Any help, Many thanks in advance.
/tmp getting full
Moderators: chulett, rschirm, roy
-
- Premium Member
- Posts: 238
- Joined: Fri Jul 25, 2008 8:55 am
Yea..there is a big file is creating and I doono why it is creating...ETLJOB wrote:What kind of files have been written into /tmp directory recently? Did you analyze that? I remember database related load statistics, log files based on your scheduler and many other log files also would go into the /tmp directory based on the environment settings.
the file name is "machineLog.8001.puxc8204.20100610114625"
and a part of file content is like this...
<?xml version="1.0" encoding="UTF-8" ?>
<machine_resource_output version="0.1" start_date="2010-06-10 11:46:25" framework_revision="IBM WebSphere DataStage Enterprise Edition 8.1.0.5040 ">
<machine_description>
<host name="puxc8204" domain=""/>
<platform name="AIX" compiler="" version="5.3"/>
<cpus count="8" model="PowerPC_POWER5 2096MHz"/>
<memory totalRAM="32768000" totalSwap="82575360"/>
</machine_description>
<layout delimeter="," sc
-
- Premium Member
- Posts: 238
- Joined: Fri Jul 25, 2008 8:55 am
-
- Premium Member
- Posts: 1735
- Joined: Thu Mar 01, 2007 5:44 am
- Location: Troy, MI
I consider this question for parallel as mentioned in description.
/tmp is used by lookup stage to create temporary files during execution, so either make it big enough to meet your lookup requirements or change the environment variable TMPDIR to a disk with more space. You also need to create a user defined environment variable called TEMPDIR and point it to a disk with more space (I use scratch disk location).
If /tmp is almost full you might also need to change TMPDIR variable in UVConfig file, dont forget to stop the datastage engine, regenerate the file and start the services again.
I think after changing these variables DataStage will not use this space for anything.
/tmp is used by lookup stage to create temporary files during execution, so either make it big enough to meet your lookup requirements or change the environment variable TMPDIR to a disk with more space. You also need to create a user defined environment variable called TEMPDIR and point it to a disk with more space (I use scratch disk location).
If /tmp is almost full you might also need to change TMPDIR variable in UVConfig file, dont forget to stop the datastage engine, regenerate the file and start the services again.
I think after changing these variables DataStage will not use this space for anything.
Priyadarshi Kunal
Genius may have its limitations, but stupidity is not thus handicapped.![Wink :wink:](./images/smilies/icon_wink.gif)
Genius may have its limitations, but stupidity is not thus handicapped.
![Wink :wink:](./images/smilies/icon_wink.gif)
-
- Premium Member
- Posts: 238
- Joined: Fri Jul 25, 2008 8:55 am
However, /tmp is really where stuff like that belongs on a UNIX server. If you are having space issues there, I would make sure of two things:
1) An appropriate amount of space has been allocated for it
2) Your SysAdmins are properly managing / pruning / culling files from there
Once you move files of that nature elsewhere, then you become responsible for cleaning up after any processes that fail to clean themselves up properly.
1) An appropriate amount of space has been allocated for it
2) Your SysAdmins are properly managing / pruning / culling files from there
Once you move files of that nature elsewhere, then you become responsible for cleaning up after any processes that fail to clean themselves up properly.
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers