Page 1 of 1
How to design job
Posted: Mon Jun 30, 2008 1:40 am
by Vengadeshwaran v.j
Multiple files containing customer data comes from 10 countries. Each file contains exactly the same format. The same customer may exist in each file. But target should have only one record. The files may come any time. So it is possible that two files need to be processed simultaneously
1.In This Situation What are the job designs issues that you need to consider
2. How you would handle the flow of jobs
Posted: Mon Jun 30, 2008 2:07 am
by keshav0307
you can design a single job and run it on multiple instances.
i had similar requirement where 120 different applications sending data file, but in same format.
on target you can use upsert method to load.
also you can find many way to to it, if you search in this forum.
Posted: Mon Jun 30, 2008 2:14 am
by ArndW
Can you not read all the files together and merge/sort them in your job?
Posted: Mon Jun 30, 2008 2:17 am
by keshav0307
oops forgot to mention that i had requirement to validate each file individually. but still we manage to design the jobs to process multiple files in a single job/sequence in single run.
Posted: Mon Jun 30, 2008 2:24 am
by ArndW
Process the files inidividually and write the data into a DataSet using "append", then process the DataSet in a final job.