datastage server occuping more space

[kennyapril]

My data stage server occupies more space when ever I run the jobs which results in disk space errors always

why is this happening?


can anyone provide a solution for this situation?

[kris007]

What is the error you are getting? There is no one particular solution to get rid of all the errors you are facing. Providing sample errors you are facing will help us help us.

[kennyapril]

Error writing table file opt/IBM/InformationServer/Server: No space left on device

this is the error which I see always

[kris007]

Does it happen in jobs with Join Stage or LookUp Stages? I saw the same error in the past when I was getting Cartesian products out of a join Stage due to bad data. The process ended up using all the space defined within the config file and ran out of space and eventually aborted. What is the volume of the data you are processing? Can you provide a sample job design or other specifications from the job that is failing?

[kennyapril]

Yes,I use lookup stages in my jobs and I get this error only at these stages.

After deleting some of the files in the server I get space and they run again with no errors,but later I get the same error.

The volume of data is around 1.5 million records.My jobs have lookup's used for databases and copy stages.

[ray.wurlod]

Change your configuration file to specify resource and scratch disk on other file systems where there is more space.

[kris007]

You can either split your jobs to use less number of stages or update your configuration file to point to a resource where there is enough space.

[Sreenivasulu]

You can run the jobs with constraints ( i.e with few records).
Once you are satisfied by the logic you can point to the resource which has more space (If there is no space in other resources then possibily the test or production may have space in other resources)


Regards
Sreeni

[ray.wurlod]

My data stage server occupies more space when ever I run the jobs which results in disk space errors always

why is this happening?


can anyone provide a solution for this situation?

OMG they've killed Kenny!

[kennyapril]

How do I change the configuration file?

I mean to say how to move its path?

[ray.wurlod]

In Designer, use Tools > Configuration

Open the default configuration file and save as a different name.

Edit the configuration file to specify different conditions. Save and check.