Page 1 of 1
scratch space
Posted: Wed Sep 06, 2006 1:43 pm
by samsuf2002
how to monitor the scratch space and how to increase the size
i am using sql server
can any one plz help me out
thanks
More information please about your question...
Posted: Wed Sep 06, 2006 1:53 pm
by jdmiceli
Howdy!
When you say 'scratch space', what exactly do you mean? If you mean you don't have enough room for all the files you are unloading or hashed files being created, then set up a directory structure on a different disk or set of disks and use parameters to refer to where you are creating your files. For example, create a parameter called 'dirHash' with a path like '/datastage/dev/projectname/r1/hash/' and the appropriate path on a disk somewhere. Obviously, I used Unix slashes; you may need to use Winblows whacks instead
Then, in the Hashed File Stage, when you name the file refer to it as '#dirHash#filename'. Some people prefer to leave the last slash outside of the parameter so it would be defined as '/datastage/dev/projectname/r1/hash' and the reference would be '#dirHash#/filename.
Hope this helps. If I didn't answer your question, please clarify what you are looking for and I'll try try again! :D
Bestest
Posted: Wed Sep 06, 2006 2:00 pm
by samsuf2002
when i am running th ejob i am getting error as scratch space full and my job is getting aborted. i got hint from dsxchange that we need to increase the scratch space but i dont know where i will find that option in data stage
Posted: Wed Sep 06, 2006 2:23 pm
by meena
Hi,
Check for "
scratchdisk" node in
APT_CONFIG_FILE environment variable pointing to configuration file. You can either increase the size or remove the limits in the configuration file.
Can you explain about you job(any lookup's/amount of data).
samsuf2002 wrote:when i am running th ejob i am getting error as scratch space full and my job is getting aborted. i got hint from dsxchange that we need to increase the scratch space but i dont know where i will find that option in data stage
Posted: Wed Sep 06, 2006 3:29 pm
by samsuf2002
hi meena
my job has 2 lookup and size of file is 40 gb .
Posted: Wed Sep 06, 2006 3:38 pm
by thumsup9
what is the memory avaialble , you can check with ulimit -a
Posted: Wed Sep 06, 2006 4:35 pm
by ray.wurlod
You could create a shell script that periodically executes du -s pathname on the scratch disk directories.
Yes, I know you're on Windows, but with 7.5x2 you have MKS Toolkit installed so you have access to all UNIX commands. Just remember to name the shell at the top of the script, and execute from a UNIX shell.
If you don't have 7.5x2 then you're not running parallel jobs on Windows.