Hi,
I have mutiple comma seperated files.
They vary in thier structure.
I have to read them all and place them into the necessary tables.
My problem is I have ended up writing 10 server job for the 10 input files I have. I have connected all these 10 jobs using job sequence.
But I guess this a wrong way of programming.
Is there any work around.
Thankx in advance
Multiple file mutiple tables
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 33
- Joined: Sun Jun 24, 2007 9:46 pm
If the files and the tables have different structures then you will need 10 jobs to do this, or perhaps you could combine what you now have in 10 jobs into 1 job and skip using the job sequence {but that doesn't change much}.
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
-
- Participant
- Posts: 33
- Joined: Sun Jun 24, 2007 9:46 pm
-
- Participant
- Posts: 33
- Joined: Sun Jun 24, 2007 9:46 pm
-
- Participant
- Posts: 33
- Joined: Sun Jun 24, 2007 9:46 pm
[cheech]U's not here man...[/chong]
No, I simply answered the original quoted question. Are you doing something wrong? No. Ten jobs to process ten different files is perfectly fine.
Just how 'different' are these different file layouts? If the differences are fairly minor, then perhaps you can cut back on the number of jobs. Or you can create one job that reads all records as a single large string and then, based on what it finds in the first X characters, decides what format it is seeing and you split the string up accordingly inside the job. Personally, I don't see the point in doing anything like that. Use ten jobs.
Server, parallel, doesn't matter - there really isn't anything magical about either product that will let you process multiple completely different file layouts in a 'single job' without a great deal of 'manual' effort.
No, I simply answered the original quoted question. Are you doing something wrong? No. Ten jobs to process ten different files is perfectly fine.
Just how 'different' are these different file layouts? If the differences are fairly minor, then perhaps you can cut back on the number of jobs. Or you can create one job that reads all records as a single large string and then, based on what it finds in the first X characters, decides what format it is seeing and you split the string up accordingly inside the job. Personally, I don't see the point in doing anything like that. Use ten jobs.
Server, parallel, doesn't matter - there really isn't anything magical about either product that will let you process multiple completely different file layouts in a 'single job' without a great deal of 'manual' effort.
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers
-
- Participant
- Posts: 33
- Joined: Sun Jun 24, 2007 9:46 pm