Parallel loading from ASCII Files

chowmunyee · Post by **chowmunyee** » Thu Aug 03, 2006 1:15 am

Hi,

i have 3 countries which is in ascii files (more than millions records) but i concern on the performance of the job. Can i run 3 files ( each file per country) parallel in server job?

im thinking of the solution is using on multiple instances. Is it this is only approach that i can develop?

loveojha2 · Post by **loveojha2** » Thu Aug 03, 2006 1:23 am

im thinking of the solution is using on multiple instances. Is it this is only approach that i can develop?

Yes this is the only external parallellism that you can introduce.

If you want it within job itself, you can think of having it through the different paths for the 3 countries or explicit use of link partitioner can be used.

loveojha2 · Post by **loveojha2** » Thu Aug 03, 2006 1:44 am

Oops I misread your post, the files are all different!!!

You can create three separate links from the Sequential File Stage (or three separate stages) reading from the 3 different files and can load into the target (assuming its a table) (If its a sequential file then you can not load the data in parallel).