Page 1 of 1
datastage server occuping more space
Posted: Tue Aug 10, 2010 8:00 pm
by kennyapril
My data stage server occupies more space when ever I run the jobs which results in disk space errors always
why is this happening?
can anyone provide a solution for this situation?
Posted: Tue Aug 10, 2010 8:23 pm
by kris007
What is the error you are getting? There is no one particular solution to get rid of all the errors you are facing. Providing sample errors you are facing will help us help us.
Posted: Tue Aug 10, 2010 8:45 pm
by kennyapril
Error writing table file opt/IBM/InformationServer/Server: No space left on device
this is the error which I see always
Posted: Tue Aug 10, 2010 9:16 pm
by kris007
Does it happen in jobs with Join Stage or LookUp Stages? I saw the same error in the past when I was getting Cartesian products out of a join Stage due to bad data. The process ended up using all the space defined within the config file and ran out of space and eventually aborted. What is the volume of the data you are processing? Can you provide a sample job design or other specifications from the job that is failing?
Posted: Tue Aug 10, 2010 9:27 pm
by kennyapril
Yes,I use lookup stages in my jobs and I get this error only at these stages.
After deleting some of the files in the server I get space and they run again with no errors,but later I get the same error.
The volume of data is around 1.5 million records.My jobs have lookup's used for databases and copy stages.
Posted: Tue Aug 10, 2010 9:28 pm
by ray.wurlod
Change your configuration file to specify resource and scratch disk on other file systems where there is more space.
Posted: Tue Aug 10, 2010 9:32 pm
by kris007
You can either split your jobs to use less number of stages or update your configuration file to point to a resource where there is enough space.
Posted: Wed Aug 11, 2010 12:06 am
by Sreenivasulu
You can run the jobs with constraints ( i.e with few records).
Once you are satisfied by the logic you can point to the resource which has more space (If there is no space in other resources then possibily the test or production may have space in other resources)
Regards
Sreeni
Re: datastage server occuping more space
Posted: Wed Aug 11, 2010 1:29 am
by ray.wurlod
kennyapril wrote:My data stage server occupies more space when ever I run the jobs which results in disk space errors always
why is this happening?
can anyone provide a solution for this situation?
OMG they've killed Kenny!
Posted: Wed Aug 11, 2010 11:08 am
by kennyapril
How do I change the configuration file?
I mean to say how to move its path?
Posted: Wed Aug 11, 2010 7:25 pm
by ray.wurlod
In Designer, use Tools > Configuration
Open the default configuration file and save as a different name.
Edit the configuration file to specify different conditions. Save and check.