I have a requirement to create a job which can handle 3 different files, each one of them has different metadata and writes the data to Oracle tables?
Any help on this is highly appreciated.
handle different metadata using a single job?
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
-
- Participant
- Posts: 11
- Joined: Fri May 29, 2009 9:54 pm
- Location: hyd
Re: handle different metadata using a single job?
hi,
use schema file , and pass as dynamica parmetter
use schema file , and pass as dynamica parmetter
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
-
- Participant
- Posts: 64
- Joined: Wed Sep 26, 2007 6:52 am
- Location: Syracuse ,NY
Try this appraoach
1> Import meta data of this sequential files into repository
2> Go to job and enable run time column propgation.Parameterize file name and table name.Enable run time column propogation in the general tab of properties window
3> Build a sequence job having 2 star loop activties and a job activity
In one start loop activity give sequential file name list and in the other the table name list (same as what is in repository) .Use list loop functinality of the start loop activity stage
4> run the job activity with in these 2 loops for file name pass Loop Activity1.Counter value and for the table name as Loop Activity2.Counter value .In the trigger give unconditional(Place the end loop appropriately)
This sequence will populate data from three different files into three different tables
1> Import meta data of this sequential files into repository
2> Go to job and enable run time column propgation.Parameterize file name and table name.Enable run time column propogation in the general tab of properties window
3> Build a sequence job having 2 star loop activties and a job activity
In one start loop activity give sequential file name list and in the other the table name list (same as what is in repository) .Use list loop functinality of the start loop activity stage
4> run the job activity with in these 2 loops for file name pass Loop Activity1.Counter value and for the table name as Loop Activity2.Counter value .In the trigger give unconditional(Place the end loop appropriately)
This sequence will populate data from three different files into three different tables
Althaf
-
- Premium Member
- Posts: 258
- Joined: Tue Jul 04, 2006 10:35 pm
- Location: Toronto
Hi,
1. Create a three Schema Files for the three sequential files.
2. Parameterize the schema file and File Name Property.
3. Enable the Runtime Column Propogation at the Job Level.
4. Parameterize the Database Stage.
5. Enable the Multi-Instance Option at the Job Level (In case if the job is executed parallely).
6. Execute the Job using the required parameters.
Note: The above steps will be useful if there are no transformations to be applied on the data.
Any Suggestions is appreciated.
Naveen
1. Create a three Schema Files for the three sequential files.
2. Parameterize the schema file and File Name Property.
3. Enable the Runtime Column Propogation at the Job Level.
4. Parameterize the Database Stage.
5. Enable the Multi-Instance Option at the Job Level (In case if the job is executed parallely).
6. Execute the Job using the required parameters.
Note: The above steps will be useful if there are no transformations to be applied on the data.
Any Suggestions is appreciated.
Naveen