Page 1 of 1

scratch disk Q

Posted: Tue Apr 01, 2008 3:44 pm
by just4u_sharath
i learnt that scratch disk has filesystems for temporary storage and resource disk has filesystems for permament storage. But i cannot understand difference between permanent and temporary. whenever we run a job all the data generated between source and target is temporary data. Now where is the point of permanent data on datastage.
how the resource disk and scratch disk is used?
I know for sorting we generally used scratch disk, and for what other operations this scratch disk is used? for what operaions resource disk is used?

Posted: Tue Apr 01, 2008 5:16 pm
by ray.wurlod
Simply, "permanent storage" means the data files of Data Sets, File Sets and Lookup File Sets. "Temporary storage" covers files created during (and removed after) certain processing, such as sorting. Any operator that needs more memory than it has been allocated will create temporary files on the scratch disk. By default - unless you specify a different location - some bulk loader "log" and "bad" files are also written to the scratch disk.

Posted: Wed Apr 02, 2008 7:14 am
by keshav0307
In datastage permanent and temporary. is like your hard disk and RAM memory in PC/laptop.
Resource disk is like the Temp directory in your PC, which is used to store some files temporarily but is in the hard disk(permanent Storage).
Calculation/processing is done in RAM (the temporary storage).
Reource disk is generally used in storing the datafiles of a dataset.
temprary files for some stages(like MLOAD), and may be many more..

Posted: Wed Apr 02, 2008 7:26 am
by sunayan_pal
ray.wurlod wrote:Simply, "permanent storage" means the data files of Data Sets, File Sets and Lookup File Sets. "Temporary storage" covers files created during (and removed after) certain processing, such as sorting. ...
let say in case of sorting and remove duplicate stage the intermediate/temporary data will be there in the RAM and then if needed in the drive ( scratch disc )
please correct if i am wrong.

Posted: Wed Apr 02, 2008 3:01 pm
by ray.wurlod
As a general rule you are correct.