Page 1 of 1

Parallel loading from ASCII Files

Posted: Thu Aug 03, 2006 1:15 am
by chowmunyee
Hi,

i have 3 countries which is in ascii files (more than millions records) but i concern on the performance of the job. Can i run 3 files ( each file per country) parallel in server job?

im thinking of the solution is using on multiple instances. Is it this is only approach that i can develop?

Posted: Thu Aug 03, 2006 1:23 am
by loveojha2
im thinking of the solution is using on multiple instances. Is it this is only approach that i can develop?
Yes this is the only external parallellism that you can introduce.

If you want it within job itself, you can think of having it through the different paths for the 3 countries or explicit use of link partitioner can be used.

Posted: Thu Aug 03, 2006 1:44 am
by loveojha2
Oops I misread your post, the files are all different!!!

You can create three separate links from the Sequential File Stage (or three separate stages) reading from the 3 different files and can load into the target (assuming its a table) (If its a sequential file then you can not load the data in parallel).