How to move jobs from one project to another?

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

flashgordon
Premium Member
Premium Member
Posts: 99
Joined: Tue Aug 17, 2004 7:50 am
Location: Boulder, Colorado

experience with Unix level project copies

Post by flashgordon »

Hi,

I was always curious whether a Unix level backup/restore of a project would work. Ascential and Peoplesoft don't necessarily recommend unix level backups and restores of projects. I will share what happened to me when I was forced to do a Unix level backup and restore. This was on 7.5.x Datastage and 5.10 Generic_118833-36 sun4u sparc SUNW Solaris. I restored the project at the unix level. Initially everything looked very good when I signed in with Developer and Manager. All the jobs were visible and they would open and the stages would open. I did something smart and Datastage Manager backed the project up and that worked. Then I tried to compile jobs and got all kinds of wierd error messages. I am not a bit noodler so I restored the empty version of the project and then used Datastage Manager to restore the Project. This worked well. We lost our project hash tables but saved all our jobs. The fact that Unix level backups and restores don't work means to me that information about the Project must be stored in the Universe/DSEngine locations and this has to be in sync with what's in the Project directory. I agree with the guru's of this site that Datastage Manager is the way to backup and restore Datastage projects.

... Flash
Flash Gordon
Hyperborean Software Solution
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

There are three repair tools that need to be applied after an O/S restore.
  • VERIFY.SQL to repair the DataStage/SQL system tables.

    UV.ACCOUNT will need to be updated with the new project location.

    Each indexed hashed file in the project will need to be updated with the new location of its index directory (I_hashedfilename) using SET.INDEX.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Nisusmage
Premium Member
Premium Member
Posts: 103
Joined: Mon May 07, 2007 1:57 am

Post by Nisusmage »

I have similar problem.
We lost the whole environment but we still have the OS files.

I've reinstalled everything.

Is there a way to "recover" the projects and jobs from the OS Files?
Using DB.TOOLS and/or DB.REINDEX ALL ?

It was a new development server and it would save me so much time to recover those files. We've only got an old .dsx backup from last month.
~The simpliest solutions are always the best~
~Trick is to understand the complexity to implement simplicity~
Nisusmage
Premium Member
Premium Member
Posts: 103
Joined: Mon May 07, 2007 1:57 am

Post by Nisusmage »

I have similar problem.
We lost the whole environment but we still have the OS files.

I've reinstalled everything.

Is there a way to "recover" the projects and jobs from the OS Files?
Using DB.TOOLS and/or DB.REINDEX ALL ?

It was a new development server and it would save me so much time to recover those files. We've only got an old .dsx backup from last month.
~The simpliest solutions are always the best~
~Trick is to understand the complexity to implement simplicity~
Nisusmage
Premium Member
Premium Member
Posts: 103
Joined: Mon May 07, 2007 1:57 am

Post by Nisusmage »

ray.wurlod wrote:There are three repair tools that need to be applied after an O/S restore.
  • VERIFY.SQL to repair the DataStage/SQL system tables.

    UV.ACCOUNT will need to be updated with the new project loc ...
Ray.. Please help me here. I couldn't see the rest of your comment. What are the 3 tools to be used? VERIFY.SQL, UV.ACCONT and ..?

Thank you so much in advance for your help ..
~The simpliest solutions are always the best~
~Trick is to understand the complexity to implement simplicity~
Nisusmage
Premium Member
Premium Member
Posts: 103
Joined: Mon May 07, 2007 1:57 am

Post by Nisusmage »

ray.wurlod wrote:There are three repair tools that need to be applied after an O/S restore.
  • VERIFY.SQL to repair the DataStage/SQL system tables.

    UV.ACCOUNT will need to be updated with the new project loc ...
Ray.. Please help me here. I couldn't see the rest of your comment. What are the 3 tools to be used? VERIFY.SQL, UV.ACCONT and ..?

Thank you so much in advance for your help ..
~The simpliest solutions are always the best~
~Trick is to understand the complexity to implement simplicity~
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

For less than 30c per day you can purchase premium membership and be able to read the entirety of premium posters' contributions, as well as to have access to additional material for example in the Learning Center.

UV.ACCOUNT is a hashed file in the Administrator's account (UV).

VERIFY.SQL is a command in every account, though you need to be logged in with DBA privilege to the DataStage database to use it to effect repairs.

DS.REINDEX is another command that exists in every account. You need write permission to DataStage Repository objects as well as exclusive access to the project to use it.

In addition, because you are running version 8 (see other posts, private email, etc.) you will probably need to effect updates to the XMETA database. I am not (yet) capable of providing advice on what's needed for that - you will need to involve your support provider.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Nisusmage
Premium Member
Premium Member
Posts: 103
Joined: Mon May 07, 2007 1:57 am

Post by Nisusmage »

will do . . when I have time.

:)
~The simpliest solutions are always the best~
~Trick is to understand the complexity to implement simplicity~
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

What ever happened to "urgent"?
:roll:
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

What ever happened to "urgent"?
:roll:
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

No time for urgent! :wink:
-craig

"You can never have too many knives" -- Logan Nine Fingers
flashgordon
Premium Member
Premium Member
Posts: 99
Joined: Tue Aug 17, 2004 7:50 am
Location: Boulder, Colorado

Post by flashgordon »

Nimusage,

I'm curious. Your Datastage server failed completely but you still had the Unix versions of your project. That's what happened to us but I can't figure out why. You reinstall and have your old project. Is that what happened to you.

I want to encourage you to get a Premium membership. I got my large company whose name I can't give to pay for mine and I'm going to encourage the company to pay for others in our group. The guys that run this site are generally better and faster than than formal Peoplesoft and Datastage support. I have both Peoplesoft and Datastage formal support and these guys are better than all but 10% of the formal support people. Datastage has some specialists who can be more expert than the dsxchange people in a specific topic but overall the guys/gals? on dsxchange are the best in terms of support. I put in a fairly serious question one Saturday night, not expecting to get a reply until Monday morning and they just happened to answer it that night, no sla, but this happens a lot. Try getting that kind of service from Ascential or Peoplesoft. $100 is very reasonable. If money is an issue I would seriously suggest lowering the formal support you are getting and putting some money into this.

... Flash
Flash Gordon
Hyperborean Software Solution
flashgordon
Premium Member
Premium Member
Posts: 99
Joined: Tue Aug 17, 2004 7:50 am
Location: Boulder, Colorado

Post by flashgordon »

Nimusage,

I'm curious. Your Datastage server failed completely but you still had the Unix versions of your project. That's what happened to us but I can't figure out why. You reinstall and have your old project. Is that what happened to you.

I want to encourage you to get a Premium membership. I got my large company whose name I can't give to pay for mine and I'm going to encourage the company to pay for others in our group. The guys that run this site are generally better and faster than than formal Peoplesoft and Datastage support. I have both Peoplesoft and Datastage formal support and these guys are better than all but 10% of the formal support people. Datastage has some specialists who can be more expert than the dsxchange people in a specific topic but overall the guys/gals? on dsxchange are the best in terms of support. I put in a fairly serious question one Saturday night, not expecting to get a reply until Monday morning and they just happened to answer it that night, no sla, but this happens a lot. Try getting that kind of service from Ascential or Peoplesoft. $100 is very reasonable. If money is an issue I would seriously suggest lowering the formal support you are getting and putting some money into this.

... Flash
Flash Gordon
Hyperborean Software Solution
Nisusmage
Premium Member
Premium Member
Posts: 103
Joined: Mon May 07, 2007 1:57 am

Post by Nisusmage »

I'm also trying to get my company to pay for it, but it's end of year and it's got to go through a whole process. It's not the money issue, it's just getting it signed off.

What happened was we install DB2 FP3, and it seemed to sever the connection between DS and DB2. But we not sure how or why. So we tried to recover the DB2 databases and due to our lack of knowledge with the administration we totalled the environment.

So we backed up DB2 an we reinstalled everything from sctach. We have windows 2k3 server. After the reinstall I tried everything to recover the jobs, but it seems that DS8 isn't that simple. I pretty much did everything this forum said to recover these jobs but nothing is working.

I have the Folders with all the jobs and an backup of the XMETA db2 database.
~The simpliest solutions are always the best~
~Trick is to understand the complexity to implement simplicity~
Nisusmage
Premium Member
Premium Member
Posts: 103
Joined: Mon May 07, 2007 1:57 am

Post by Nisusmage »

I'm also trying to get my company to pay for it, but it's end of year and it's got to go through a whole process. It's not the money issue, it's just getting it signed off.

What happened was we install DB2 FP3, and it seemed to sever the connection between DS and DB2. But we not sure how or why. So we tried to recover the DB2 databases and due to our lack of knowledge with the administration we totalled the environment.

So we backed up DB2 an we reinstalled everything from sctach. We have windows 2k3 server. After the reinstall I tried everything to recover the jobs, but it seems that DS8 isn't that simple. I pretty much did everything this forum said to recover these jobs but nothing is working.

I have the Folders with all the jobs and an backup of the XMETA db2 database.
~The simpliest solutions are always the best~
~Trick is to understand the complexity to implement simplicity~
Post Reply