Page 1 of 2

Can the DataStage jobs back-up be automated?

Posted: Mon Oct 02, 2006 9:25 am
by Shree0410
Hi all,

I have to take the back-up of all DataStage jobs from the project repository every week, this is a requirement of the client.

I can export the whole project at one shot, but the client want us to export by folder. This takes up more than an hour to carefully export all the jobs every monday.

Can anyone tell me if this can be scheduled to be done every monday or if this can be automated??

Thanks Guys!

Posted: Mon Oct 02, 2006 9:32 am
by kduke
Do a search for DataStageBackup.bat. This has been covered a lot. This is a script I downloaded from ADN which is no longer available. I have modifed it slightly. It is available on my tips page.

Posted: Mon Oct 02, 2006 9:34 am
by kduke
By the way I would backup develment every night. I would backup production once a week.

We usually backup at about 2 in the morning.

Posted: Mon Oct 02, 2006 3:00 pm
by ray.wurlod
Are you being paid by the hour? :lol:

Seriously, though, yes it can be automated; the script to which Kim referred is a good starting point.

An alternative - and maybe easier - is to back up the entire project then use a DSX cutter to create separate per-category DSX files. Do they require routines, table definitions, etc., also to be backed up as separate folders?

Re: Can the DataStage jobs back-up be automated?

Posted: Mon Jun 21, 2010 5:12 am
by Harini
Hi all,

Is there a Unix shell scripting solution to acheive this?

Thanks


Shree0410 wrote:Hi all,

I have to take the back-up of all DataStage jobs from the project repository every week, this is a requirement of the client.

I can export the whole project at one shot, but the client want us to export by folder. This takes up more than an hour to carefully export all the jobs every monday.

Can anyone tell me if this can be scheduled to be done every monday or if this can be automated??

Thanks Guys!

Posted: Mon Jun 21, 2010 6:56 am
by chulett
No because this kind of backup needs to happen on the client, hence the Windows batch file. There are more options available now if you are on the 8.x release, however.

Posted: Mon Jun 21, 2010 7:23 am
by asorrell
In release 8.1 after either the istool patch or Fix Pack 1 you can then use the istool command to backup your system. While it has the benefit of being very fast (it is a server-based command line backup) it has one drawback, namely that it cannot do a granular (item-specific) restore. To get a single item back you need to restore the image to a new project, then copy over the one item you need to restore. Of course with IS Manager you can just drag and drop that one item, which is easy enough.

I have requested a more granular restore mechanism from the product manager - they are looking into it.

Posted: Mon Jun 21, 2010 7:49 am
by kduke
The scripts I give away are all Windows based so far.

Posted: Mon Jun 21, 2010 8:25 am
by Harini
Thank you all. Yes i use 8.1, but am not sure whether istool patch is installed. I would give it a try if we are able to get it.

From a windows environment, I believe the following command would do the export for me if it is whole project.

C:\IBM\InformationServer\Clients\Classic\dscmdexport /D=servername /U=username /P=password /H=servername projectname D:\bkp1.dsx

If it is a spefic folder from which i have to export the jobs then, Kim's solution would do the job for me, isn't it?

Thanks

Posted: Mon Jun 21, 2010 9:04 am
by chulett
No, it's either one job or all jobs. You'll need another solution, perhaps something like the DSX Cutter posted here or an iterative loop, for category exports.

Posted: Tue Jun 22, 2010 11:24 pm
by Harini
chulett wrote:No, it's either one job or all jobs. You'll need another solution, perhaps something like the DSX Cutter posted here or an iterative loop, for category exports. ...
Craig,
Iterating the loop would give me a seperate dsx file or each job. But i would want all the jobs as a single dsx file. Is it possible to do that? Else i shall convey to my Lead that it is not possible.

Thanks

Posted: Wed Jun 23, 2010 1:17 am
by ray.wurlod
Harini wrote:But i would want all the jobs as a single dsx file. Is it possible to do that?
It is not possible. You could construct a single DSX file out of the individual job DSX files, which would involve removing the individual files' headers and creating a header for the combined file.

Posted: Wed Jun 23, 2010 4:02 am
by Harini
ray.wurlod wrote:
Harini wrote:But i would want all the jobs as a single dsx file. Is it possible to do that?
It is not possible. You could construct a single DSX file out of the individual job DSX files, w ...[/quo

:( It's a premium content..

Posted: Wed Jun 23, 2010 4:59 am
by ray.wurlod
Easily remedied. Here, for example.

Posted: Wed Jun 23, 2010 6:51 am
by chulett
It certainly is possible to simply append all of the individual exports into a single dsx without the need to remove all of the 'extra' header information. I haven't done this but seem to remember Uncle Kim does (or has) without issue. Would be simple enough to test, that's for sure.