extraction and loading
Posted: Thu Dec 20, 2007 6:56 pm
Hi,
here in our project we are extracting data from zip files and then validating the data then actually we need to write this data into Netezza database. But in the jobs already developed what they have done is they are writing data into a sequential file and the in another job they are writing from sequential to Netezza. And they are using a sequencer in between these jobs. i.e this is another sequencer job.
When I asked mu collegue she told that you should not do extraction and loading in the same job. Is this correct. In commonsence I am unable to agree this. Because you are writing into a text file is also some sort of loading, what I understood.
Can Gurus can give me any explanation. Please tell where I can find guidelines in designing jobs.
Thanks
Kavuri
here in our project we are extracting data from zip files and then validating the data then actually we need to write this data into Netezza database. But in the jobs already developed what they have done is they are writing data into a sequential file and the in another job they are writing from sequential to Netezza. And they are using a sequencer in between these jobs. i.e this is another sequencer job.
When I asked mu collegue she told that you should not do extraction and loading in the same job. Is this correct. In commonsence I am unable to agree this. Because you are writing into a text file is also some sort of loading, what I understood.
Can Gurus can give me any explanation. Please tell where I can find guidelines in designing jobs.
Thanks
Kavuri