MOVING DS JOBS

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
nag0143
Premium Member
Premium Member
Posts: 159
Joined: Fri Nov 14, 2003 1:05 am

MOVING DS JOBS

Post by nag0143 »

I have done all the development in R3DEV AND NOW I NEED TO MOVE ALL THESE JOBS TO R3QA ..... DO I NEED TO CHANGE THE PATH IN ALLTHE JOBS BUT THERE ARE HUNDEREDS OF JOBS ..... IS THERE ANY OTHER WAY ...EASY WAY....
kcbland
Participant
Posts: 5208
Joined: Wed Jan 15, 2003 8:56 am
Location: Lutz, FL
Contact:

Post by kcbland »

Are you talking about a hardcode directory path in the job designs, in places such as the sequential file name?

The answer was use a job parameter that is switchable according to the environment you're in, and pass the value in using job control. The next answer is embed the default value along with the job parameter. Then, use a mass parameter default update utility like Parameter Manager to mass deploy a default change.

If you didn't use a parameter, then you have few options. You could text search/replace inside the .dsx file the change.
Kenneth Bland

Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
nag0143
Premium Member
Premium Member
Posts: 159
Joined: Fri Nov 14, 2003 1:05 am

Post by nag0143 »

Thanks kc...since i guess its too late to use parameters i can do mass change by find/replace on .dsx..
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

At this point it is not too late as everything is still in your dev project. Bite the bullet and modify the jobs to use Job Parameters for anything that could change from environment to environment.

What are you going to do when this rolls to production? Do this all over again? What about the maintenance of these jobs? Constantly re-edit the dsx to make all of the appropriate changes? :? Don't even think about it. Go back and make the change, there will be some pain now but you'll be much happier later.
-craig

"You can never have too many knives" -- Logan Nine Fingers
kcbland
Participant
Posts: 5208
Joined: Wed Jan 15, 2003 8:56 am
Location: Lutz, FL
Contact:

Post by kcbland »

You can tell that I must be sick because I didn't lecture. Thanks Craig! :)
Kenneth Bland

Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Another vote for "do it now". There'll never be a better time. There was, but it's gone.
Parameters buy you insurance against things that may change over time or between environments, such as pathnames, data source names, passwords, WHERE condition constants.
Best practice is to have default values point to your development environment (so you can't accidentally damage your production environment), and to have default values for passwords not being valid passwords at all (so that anyone using the system must provide a valid password).
And make sure you use Encrypted as the type for password parameters, and Pathname as the type for pathname parameters. In the second case it means you automatically get a browser when being prompted for the pathname. I've also found that a List type for data source names provides a measure of idiot-proofing too.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
peterbaun
Premium Member
Premium Member
Posts: 93
Joined: Thu Jul 10, 2003 5:27 am
Location: Denmark
Contact:

Post by peterbaun »

Hi -

Not that my input has anything to do with this matter - it is just a curiousity. Even though you use encrypted for the parameter containing the password you can easily decrypt it by making a job with
some source --> transformer --> flat file
(having at least one row going through this transformer) and enter the password parameter in a derivation field. It will acutally write the encrypted password in readable letters (at least in DS version 5 and 6 havent had the opportunity to test this in version 7).

Regards
Peter
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

peterbaun wrote:Hi -

Not that my input has anything to do with this matter - it is just a curiousity. Even though you use encrypted for the parameter containing the password you can easily decrypt it by making a job with
some source --> transformer --> flat file
(having at least one row going through this transformer) and enter the password parameter in a derivation field. It will acutally write the encrypted password in readable letters (at least in DS version 5 and 6 havent had the opportunity to test this in version 7).

Regards
Peter
Ssssshhh!!! :)
It's a known issue.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Teej
Participant
Posts: 677
Joined: Fri Aug 08, 2003 9:26 am
Location: USA

Post by Teej »

Another known issue:

You use Oracle in PX for 6.x? Just for fun, check out the scratch directories, and look for ora*.par files. Whoops, password is visible.

Haven't test it with 7.0.1 to see if they fixed my open issue.

-T.J.
Developer of DataStage Parallel Engine (Orchestrate).
ogmios
Participant
Posts: 659
Joined: Tue Mar 11, 2003 3:40 pm

Post by ogmios »

Teej wrote:Another known issue:

You use Oracle in PX for 6.x? Just for fun, check out the scratch directories, and look for ora*.par files. Whoops, password is visible.

Haven't test it with 7.0.1 to see if they fixed my open issue.

-T.J.
The DB2 Bulk Load Stage has the same problem, on the other hand since it's so easy to decrypt DataStage encryption I sometimes wonder why I bother encrypting passwords.

Ogmios
Post Reply