Multiple files containing customer data comes from 10 countries. Each file contains exactly the same format. The same customer may exist in each file. But target should have only one record. The files may come any time. So it is possible that two files need to be processed simultaneously
1.In This Situation What are the job designs issues that you need to consider
2. How you would handle the flow of jobs
How to design job
Moderators: chulett, rschirm, roy
-
- Premium Member
- Posts: 783
- Joined: Mon Jan 16, 2006 10:17 pm
- Location: Sydney, Australia
Can you not read all the files together and merge/sort them in your job?
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
-
- Premium Member
- Posts: 783
- Joined: Mon Jan 16, 2006 10:17 pm
- Location: Sydney, Australia
Process the files inidividually and write the data into a DataSet using "append", then process the DataSet in a final job.
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>