Scratchdisk requirement
Posted: Wed Jan 24, 2007 9:44 am
Hi,
We are looking at calculating the size of required scratchdisk for a new build. And one of the configuration suggestion documents states the following:
-------------------
The size of scratch/sort areas should be (X/N) + X*1.35 (or X*1.45)
where 'X' is the size of the largest data file
and 'N' is the number a ways expected that most jobs run in parallel
For example an 4GB input file, on an 8 way system. 4GB/8CPU + (4GB * 35%) = ~2GB for each scratch/sort space (.5 GB + 1.4 GB) per partition, 8 in this case.
-----------------------------
I notice that there is a discrepancy between the formula given and the example calculation. Does anyone know whether it should be X*0.35 or X*1.35. I wanted to check if anyone has run into this before.
Also, in your experience, how did you decide on the size of the scratchdisk?
Thanks,
yakiku.
We are looking at calculating the size of required scratchdisk for a new build. And one of the configuration suggestion documents states the following:
-------------------
The size of scratch/sort areas should be (X/N) + X*1.35 (or X*1.45)
where 'X' is the size of the largest data file
and 'N' is the number a ways expected that most jobs run in parallel
For example an 4GB input file, on an 8 way system. 4GB/8CPU + (4GB * 35%) = ~2GB for each scratch/sort space (.5 GB + 1.4 GB) per partition, 8 in this case.
-----------------------------
I notice that there is a discrepancy between the formula given and the example calculation. Does anyone know whether it should be X*0.35 or X*1.35. I wanted to check if anyone has run into this before.
Also, in your experience, how did you decide on the size of the scratchdisk?
Thanks,
yakiku.