Page 1 of 1

ade files created in the /tmp folder

Posted: Wed Sep 14, 2011 9:20 am
by prasanna_anbu
Hi,
As I don't want to use the /tmp, I have created a folder /etl/IS/Temp for processing the temp files.
But still I have seen some ade. files created in the temp folder, I have done the below changes but still I have faced this issue.

1) I have changed the /tmp path in the configuration files.
2) Changed the /tmp path in the UVconfig file
3) Disabled the resource tracker.

Please do the need ful.

Posted: Wed Sep 14, 2011 3:31 pm
by ray.wurlod
Check environment variables TMPDIR and, possibly, TEMP.

Posted: Wed Sep 14, 2011 8:35 pm
by qt_ky
Did you regenerate the .uvconfig file after changing the uvconfig file?

Posted: Mon Sep 19, 2011 8:51 am
by prasanna_anbu
qt_ky wrote:Did you regenerate the .uvconfig file after changing the uvconfig file?
Yes I regenarated it and changed the TMP_DIR value too but still these files created in the /tmp folder.

Posted: Mon Sep 19, 2011 1:38 pm
by qt_ky
Can you tell by the filenames if there's a certiain stage or activity that is creating files in /tmp?

Posted: Mon Sep 19, 2011 3:42 pm
by ray.wurlod
What is the value of UVTEMP in the uvconfig file?

If it's empty, then the engine will use /tmp for some of its temporary files.

Posted: Mon Sep 19, 2011 6:19 pm
by chulett
qt_ky wrote:Can you tell by the filenames if there's a certain stage or activity that is creating files in /tmp?
I'm not sure what Parallel processes would create ade files. I've seen them in the past generated from the shared memory segments RTI/ISD jobs use and also from Server jobs with IPC stages. Assuming something similar is happening here...

Posted: Tue Sep 20, 2011 8:26 am
by qt_ky
I see ade files under /tmp on version 8.5 that correspond with stage types. For example:

/tmp/ade.DS_project_name.ws_DS_job_name.1316215706774.isd_out

It would appear to be coming from the ISD Output stage. For every web service job (parallel jobs) and every ISD Input and Output stage, I have an ade* file in /tmp.

In this case however, it's a new server. We have not yet gone an changed any settings to move away from /tmp. For example, the uvconfig still has:

UVSPOOL /tmp
UVTEMP /tmp

It seems like I ran into this earlier with Lookup stage errors on a 7.x server where we had pointed everything away from /tmp, but I don't recall for sure, especially whether or not "ade" is in the file name under /tmp.

Posted: Tue Sep 20, 2011 2:53 pm
by ray.wurlod
"ade"is a generic identifier in DataStage. User shared memory segments have a key that begins with "adeb", hashed files have a magic number that begins with "adef", and so on. A different identifier is used when an -itag installation is performed.

Posted: Fri Sep 23, 2011 6:05 am
by prasanna_anbu
qt_ky wrote:I see ade files under /tmp on version 8.5 that correspond with stage types. For example:

/tmp/ade.DS_project_name.ws_DS_job_name.1316215706774.isd_out

It would appear to be coming from the ISD Output stage. For every web service job (parallel jobs) and every ISD Input and Output stage, I have an ade* file in /tmp.

In this case however, it's a new server. We have not yet gone an changed any settings to move away from /tmp. For example, the uvconfig still has:

UVSPOOL /tmp
UVTEMP /tmp

It seems like I ran into this earlier with Lookup stage errors on a 7.x server where we had pointed everything away from /tmp, but I don't recall for sure, especially whether or not "ade" is in the file name under /tmp.

I have changed above mentioned path in the UV config and regenarte it but still the files are created.

Posted: Sun Sep 25, 2011 8:49 pm
by qt_ky
What are the filenames under /tmp that shouldn't be there?