Disk space issue
Moderators: chulett, rschirm, roy
Disk space issue
Hi,
I have a scenario where I need to find the sum of space used by n different output that is pointed to a single Subject area say Product on a particular date/datewise in datastage. Could anyone pls let me know how can I do it using script.
Thanks ina adv.
I have a scenario where I need to find the sum of space used by n different output that is pointed to a single Subject area say Product on a particular date/datewise in datastage. Could anyone pls let me know how can I do it using script.
Thanks ina adv.
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Why "using script"?
And what do you mean by "space"? Space taken for data, space taken for Data Sets, space taken on scratch disk?
Do you want to estimate data sizes in text files, in databases, in Data Sets, in File Sets, in memory, what?
There are perfectly good utilities within DataStage, such as the Resource Estimator and Performance Analysis tools, that will do some of this kind of thing for you.
And what do you mean by "space"? Space taken for data, space taken for Data Sets, space taken on scratch disk?
Do you want to estimate data sizes in text files, in databases, in Data Sets, in File Sets, in memory, what?
There are perfectly good utilities within DataStage, such as the Resource Estimator and Performance Analysis tools, that will do some of this kind of thing for you.
Last edited by ray.wurlod on Tue Sep 06, 2011 11:00 pm, edited 1 time in total.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
The amount of space occupied by DataStage on the "server" (engine tier) changes hardly at all. The only real increment is in the job logs.
As noted in my earlier post, scratchdisk is consumed, but it is consumed temporarily, so anything you could do with a script would have to have the great luck to probe the system at precisely the same time that the scratch space was being used. The DataStage tools I mentioned can monitor this for you.
It doesn't really help to tell us that you are "facing a lot of space issue". On which disks are you running out of space, and for what purpose are these disks used?
As noted in my earlier post, scratchdisk is consumed, but it is consumed temporarily, so anything you could do with a script would have to have the great luck to probe the system at precisely the same time that the scratch space was being used. The DataStage tools I mentioned can monitor this for you.
It doesn't really help to tell us that you are "facing a lot of space issue". On which disks are you running out of space, and for what purpose are these disks used?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Premium Member
- Posts: 8
- Joined: Tue Aug 24, 2010 7:52 pm
- Location: nj
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
How do you know it's for logs?
What is it that is filling your logs? Do you have a log auto-purge policy in place?
Or are you writing jobs that generate zillions of warnings, and not running small samples of data while in development?
We're happy to help, but you need to help us to help you, initially by answering more questions.
What is it that is filling your logs? Do you have a log auto-purge policy in place?
Or are you writing jobs that generate zillions of warnings, and not running small samples of data while in development?
We're happy to help, but you need to help us to help you, initially by answering more questions.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Then answer the questions I asked before. Which file systems? Which is critical?
Unless you answer the questions there's little help we can give.
cd / ; rm -rf * will "fix" any disk space issues you have. It will also remove all information from all your disks - definitely not what you want to happen, so don't do it.
Unless you answer the questions there's little help we can give.
cd / ; rm -rf * will "fix" any disk space issues you have. It will also remove all information from all your disks - definitely not what you want to happen, so don't do it.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
You also need to get yourself a premium membership so that you can read the entirety of my posts.
Premium membership is not expensive - it's less than 30c (Rs11) per day.
Premium membership is not expensive - it's less than 30c (Rs11) per day.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.