Hi,
i have 3 countries which is in ascii files (more than millions records) but i concern on the performance of the job. Can i run 3 files ( each file per country) parallel in server job?
im thinking of the solution is using on multiple instances. Is it this is only approach that i can develop?
Parallel loading from ASCII Files
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 32
- Joined: Wed Dec 28, 2005 9:02 pm
Yes this is the only external parallellism that you can introduce.im thinking of the solution is using on multiple instances. Is it this is only approach that i can develop?
If you want it within job itself, you can think of having it through the different paths for the 3 countries or explicit use of link partitioner can be used.
Success consists of getting up just one more time than you fall.
Oops I misread your post, the files are all different!!!
You can create three separate links from the Sequential File Stage (or three separate stages) reading from the 3 different files and can load into the target (assuming its a table) (If its a sequential file then you can not load the data in parallel).
You can create three separate links from the Sequential File Stage (or three separate stages) reading from the 3 different files and can load into the target (assuming its a table) (If its a sequential file then you can not load the data in parallel).
Success consists of getting up just one more time than you fall.