Veritas Backups on Unix... oh My!!
Posted: Thu Sep 07, 2006 3:43 pm
Hello all!
We are preparing to implement our DataStage environment on AIX Unix. We have been doing initial development on a Windows server, but our licenses and everything have come through and one of the Unix boxes is done, so here comes the switch.
What I am looking for here is any pitfalls we need to take into consideration as we set this system up, beginning with our backup strategy. Currently, our corporation utilizes Veritas Tape Backup enterprise wide for backing up the servers. I searched for stuff in DSXchange, but found little to work with. What I did find does not look real fun when backing up DS using Veritas.
My concern is that when we start processing, we already have a bunch of teams that are gearing up for utilizing DS to process data at night. My team will be using a unified series of jobs that process 14 different companies into a data repository (hurrah for parameters! ) I will be processing over 200 tables nightly by differential with multiple history rows possible per run for each company, and that's just my project. I expect nightly processing to take most of the night for everyone's processes.
The problem comes in at backup time. Veritas backups just hammer the drives and if something is still running, it all drops to the speed of an anvil crawling uphill. I also read that we would have to do something to DataStage before running the backup. I'm looking for more information about this if possible:
1. What needs to be done to safely back up the DataStage directories and the working directories?
2. Can the backups be done while still processing? I would think this would be a resounding 'No' just because the backups may be invalid.
3. Is there an established procedure fitting a similar set up someone/some company is using successfully that we can learn from?
4. I'm sure I'll think of more questions later on this...
As always, thanking you in advance for your help and expertice :D
Bestest!
We are preparing to implement our DataStage environment on AIX Unix. We have been doing initial development on a Windows server, but our licenses and everything have come through and one of the Unix boxes is done, so here comes the switch.
What I am looking for here is any pitfalls we need to take into consideration as we set this system up, beginning with our backup strategy. Currently, our corporation utilizes Veritas Tape Backup enterprise wide for backing up the servers. I searched for stuff in DSXchange, but found little to work with. What I did find does not look real fun when backing up DS using Veritas.
My concern is that when we start processing, we already have a bunch of teams that are gearing up for utilizing DS to process data at night. My team will be using a unified series of jobs that process 14 different companies into a data repository (hurrah for parameters! ) I will be processing over 200 tables nightly by differential with multiple history rows possible per run for each company, and that's just my project. I expect nightly processing to take most of the night for everyone's processes.
The problem comes in at backup time. Veritas backups just hammer the drives and if something is still running, it all drops to the speed of an anvil crawling uphill. I also read that we would have to do something to DataStage before running the backup. I'm looking for more information about this if possible:
1. What needs to be done to safely back up the DataStage directories and the working directories?
2. Can the backups be done while still processing? I would think this would be a resounding 'No' just because the backups may be invalid.
3. Is there an established procedure fitting a similar set up someone/some company is using successfully that we can learn from?
4. I'm sure I'll think of more questions later on this...
As always, thanking you in advance for your help and expertice :D
Bestest!