Processing datasets

[just4u_sharath]

Hello Guys,
I have a requirement.
1. First job creates data sets and places them in to a folder.
2. second job loads these data sets in to table.
3. when a next data sets arrives it should be processed after the current load completes.
4. Once the data set completed loading it should be moved to archive folder.

Any idea's on best way to design is appreciated.

thanks

[ray.wurlod]

What happens on the second and subsequent iterations? That is, how are you planning to handle the archive folder? I ask this because the data files of Data Sets are not stored a folder, as you seem to think. Only the descriptor file is stored at the pathname used in the Data Set stage. Do you plan to create a new Data Set each iteration, perhaps with the date as part of the name of its descriptor file? Or do you plan to append to the existing archive Data Set?