handle different metadata using a single job?

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
vij
Participant
Posts: 131
Joined: Fri Nov 17, 2006 12:43 am

handle different metadata using a single job?

Post by vij »

I have a requirement to create a job which can handle 3 different files, each one of them has different metadata and writes the data to Oracle tables?

Any help on this is highly appreciated.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

What's wrong with writing three separate jobs each with correct metadata?

Otherwise investigate an approach that uses Runtime Column Propagation.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
sureshbabu
Participant
Posts: 11
Joined: Fri May 29, 2009 9:54 pm
Location: hyd

Re: handle different metadata using a single job?

Post by sureshbabu »

hi,

use schema file , and pass as dynamica parmetter
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

... and on the database side of the job?!!
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Althaf6553
Participant
Posts: 64
Joined: Wed Sep 26, 2007 6:52 am
Location: Syracuse ,NY

Post by Althaf6553 »

Try this appraoach
1> Import meta data of this sequential files into repository
2> Go to job and enable run time column propgation.Parameterize file name and table name.Enable run time column propogation in the general tab of properties window
3> Build a sequence job having 2 star loop activties and a job activity
In one start loop activity give sequential file name list and in the other the table name list (same as what is in repository) .Use list loop functinality of the start loop activity stage
4> run the job activity with in these 2 loops for file name pass Loop Activity1.Counter value and for the table name as Loop Activity2.Counter value .In the trigger give unconditional(Place the end loop appropriately)

This sequence will populate data from three different files into three different tables
Althaf
samyamkrishna
Premium Member
Premium Member
Posts: 258
Joined: Tue Jul 04, 2006 10:35 pm
Location: Toronto

Post by samyamkrishna »

use three seq file stage then use three modify stage or transformer stage to get them into same metadata,then funnel all the records and send to the database .....
naveen.p
Participant
Posts: 55
Joined: Sat Nov 21, 2009 5:19 am
Location: Chennai

Post by naveen.p »

Hi,

1. Create a three Schema Files for the three sequential files.
2. Parameterize the schema file and File Name Property.
3. Enable the Runtime Column Propogation at the Job Level.
4. Parameterize the Database Stage.
5. Enable the Multi-Instance Option at the Job Level (In case if the job is executed parallely).
6. Execute the Job using the required parameters.

Note: The above steps will be useful if there are no transformations to be applied on the data.

Any Suggestions is appreciated.

Naveen
Post Reply