Execute Same Job with 3 files?

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
shivakumar
Participant
Posts: 31
Joined: Wed Mar 17, 2004 3:33 am

Execute Same Job with 3 files?

Post by shivakumar »

Hi ,

My requirement is I am getting 3 source files with same meta data and I have to design one job in that I have to load these files one after the other.In the Target table I have to append the Seconefile Data to the first file and so on..

While reading the first file if i encounters any problem then I have to read from the second file and so on..

I have to dsign this in one job......

Can any one help me regarding this?

Thanks and Regards
Siva
vijayrc
Participant
Posts: 197
Joined: Sun Apr 02, 2006 10:31 am
Location: NJ

Re: Execute Same Job with 3 files?

Post by vijayrc »

shivakumar wrote:Hi ,

My requirement is I am getting 3 source files with same meta data and I have to design one job in that I have to load these files one after the other.In the Target table I have to append the Seconefile Data to the first file and so on..

While reading the first file if i encounters any problem then I have to read from the second file and so on..

I have to dsign this in one job......

Can any one help me regarding this?

Thanks and Regards
Siva
Funnel the three files in the order you wish, by choosing the funnel option as Sequence, so that the data from the first file is done first, followed by second, and then the third. Between the file and funnel, you can have a transformer so that any errors in the files are bypassed...Hope this is what you look for and it helps.
DSguru2B
Charter Member
Charter Member
Posts: 6854
Joined: Wed Feb 09, 2005 3:44 pm
Location: Houston, TX

Post by DSguru2B »

You can also go for a single sequential file stage as source. make the job multiple instance and run each instance with the three source files one after the other.
Creativity is allowing yourself to make mistakes. Art is knowing which ones to keep.
JoshGeorge
Participant
Posts: 612
Joined: Thu May 03, 2007 4:59 am
Location: Melbourne

Re: Execute Same Job with 3 files?

Post by JoshGeorge »

Designing one job and as noted calling it as multiple instance thrice will be the best option. If you try to read all the files in one job and if one of the file is having any problem in reading then your whole job will fail, which you do not want to happen.
shivakumar wrote:While reading the first file if i encounters any problem then I have to read from the second file and so on..
I have to dsign this in one job......
Joshy George
<a href="http://www.linkedin.com/in/joshygeorge1" ><img src="http://www.linkedin.com/img/webpromo/bt ... _80x15.gif" width="80" height="15" border="0"></a>
keshav0307
Premium Member
Premium Member
Posts: 783
Joined: Mon Jan 16, 2006 10:17 pm
Location: Sydney, Australia

Post by keshav0307 »

then you clearify your requirement,
if the 1st file is loaded halfway, will you rollback the data from this file, or you will continue with next file.

if you want to continue then you can do it in a single job,
Post Reply