scratch space

samsuf2002 · Post by **samsuf2002** » Wed Sep 06, 2006 1:43 pm

how to monitor the scratch space and how to increase the size
i am using sql server

can any one plz help me out
thanks

jdmiceli · Post by **jdmiceli** » Wed Sep 06, 2006 1:53 pm

Howdy!

When you say 'scratch space', what exactly do you mean? If you mean you don't have enough room for all the files you are unloading or hashed files being created, then set up a directory structure on a different disk or set of disks and use parameters to refer to where you are creating your files. For example, create a parameter called 'dirHash' with a path like '/datastage/dev/projectname/r1/hash/' and the appropriate path on a disk somewhere. Obviously, I used Unix slashes; you may need to use Winblows whacks instead

Then, in the Hashed File Stage, when you name the file refer to it as '#dirHash#filename'. Some people prefer to leave the last slash outside of the parameter so it would be defined as '/datastage/dev/projectname/r1/hash' and the reference would be '#dirHash#/filename.

Hope this helps. If I didn't answer your question, please clarify what you are looking for and I'll try try again! :D

Bestest

samsuf2002 · Post by **samsuf2002** » Wed Sep 06, 2006 2:00 pm

when i am running th ejob i am getting error as scratch space full and my job is getting aborted. i got hint from dsxchange that we need to increase the scratch space but i dont know where i will find that option in data stage

meena · Post by **meena** » Wed Sep 06, 2006 2:23 pm

Hi,
Check for "scratchdisk" node in APT_CONFIG_FILE environment variable pointing to configuration file. You can either increase the size or remove the limits in the configuration file.
Can you explain about you job(any lookup's/amount of data).

samsuf2002 wrote:when i am running th ejob i am getting error as scratch space full and my job is getting aborted. i got hint from dsxchange that we need to increase the scratch space but i dont know where i will find that option in data stage

samsuf2002 · Post by **samsuf2002** » Wed Sep 06, 2006 3:29 pm

hi meena
my job has 2 lookup and size of file is 40 gb .

thumsup9 · Post by **thumsup9** » Wed Sep 06, 2006 3:38 pm

what is the memory avaialble , you can check with ulimit -a

ray.wurlod · Post by **ray.wurlod** » Wed Sep 06, 2006 4:35 pm

You could create a shell script that periodically executes du -s pathname on the scratch disk directories.

Yes, I know you're on Windows, but with 7.5x2 you have MKS Toolkit installed so you have access to all UNIX commands. Just remember to name the shell at the top of the script, and execute from a UNIX shell.

If you don't have 7.5x2 then you're not running parallel jobs on Windows.

DSXchange

scratch space

scratch space

More information please about your question...