Run Time (Parameterize) Metadata

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
dsnk
Premium Member
Premium Member
Posts: 10
Joined: Fri Jun 15, 2012 12:11 am
Location: USA

Run Time (Parameterize) Metadata

Post by dsnk »

I have a requirement to unload data from n number of tables (say 50) from one Environment (say PROD) and insert into the tables in other environment (say COB).

For that unlike developing 50 DS jobs with each table metadata included in each of these individual jobs, is there any way to use a single job with Metadata applied at runtime (parameter to source table and target table satges in DS Job) for each of these 50 different tables.

Please advice to reduce my effort of developing 50 DS jobs.

Thank you so much in advance
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

I don't have time for much of an answer but yes - you can certainly do that with a "generic" job and many people here have done exactly that. You'll also find multiple conversations on the topic. At a high level it involves the use of schema files and runtime column propagation, aka RCP.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Mike
Premium Member
Premium Member
Posts: 1021
Joined: Sun Mar 03, 2002 6:01 pm
Location: Tampa, FL

Post by Mike »

Talk to your DBA. They do that sort of stuff all the time.

If you really want to do it with DataStage, then Craig has given you the usual approach.

As it seems you are coming from an Ab Initio background, the use of schema files and RCP with generic jobs is similar in concept to Abi's meta programming.

Mike
jerome_rajan
Premium Member
Premium Member
Posts: 376
Joined: Sat Jan 07, 2012 12:25 pm
Location: Piscataway

Post by jerome_rajan »

This might help you. Has been discussed many times
Jerome
Data Integration Consultant at AWS
Connect With Me On LinkedIn

Life is really simple, but we insist on making it complicated.
vamsi.4a6
Participant
Posts: 334
Joined: Sun Jan 22, 2012 7:06 am
Contact:

Post by vamsi.4a6 »

I think this link will help you

http://www.isecor.com/drupal6/node/163
Post Reply