Page 1 of 1

Incremental Load

Posted: Thu Dec 22, 2005 12:41 pm
by seeta
Hi
I want to load more records for the same job next day what I want to do to increase the records for next run.
Is there any way to increase the load for next run

Thanks

Re: Incremental Load

Posted: Thu Dec 22, 2005 1:11 pm
by kwwilliams
More information will help you get a better answer. What are you loading from, a file stage, an Oracle stage? What are you loading to and what would you like the criteria to be for increasing the number of records loaded (date, key ) ?

Re: Incremental Load

Posted: Thu Dec 22, 2005 4:18 pm
by nivas
Hi

The answer simply is pass more records. Please post topic with more clarity.

thanks
Nivas
kwwilliams wrote:I want to do to increase the records for next run.
Is there any way to increase the load for next run

Posted: Thu Dec 22, 2005 5:18 pm
by seeta
I am loding from seqential file stage to oracle database,I am loading data comming from source.
I want to increase the load data by date

Posted: Thu Dec 22, 2005 5:57 pm
by ArndW
I want to increase the load data by dateseeta,

your question is still unintelligible. We understand you are loading from a sequeuntial file to an oracle database. But what does
I want to increase the load data by date
mean in this context? You want to increate the value of a date column? You want to add data every day (and what is stopping you?)?

Posted: Thu Dec 22, 2005 7:11 pm
by ameyvaidya
From what i could figure out from the subject/replies...

Requirement:

How do I do Incremental loads?

Source:Sequential file
Target: Oracle database.
Update frequency: daily

Questions that need to be answered:

How is the sequential file created? Is a new file every cycle containing the changed/updated records or is it like a complete dump of the source?

How will the update timestamp be provided in the source sequential file? Is it a part of the header or as a column for every record?

Possible helpful links:

DsXchange Search results:
<a href="viewtopic.php?t=93060&highlight=increme ... ">First</a>
<a href="viewtopic.php?t=96868&highlight=increme ... >Second</a>
<a href="viewtopic.php?t=86234&highlight=increme ... ">Third</a>

<a href="http://blogs.ittoolbox.com/bi/websphere ... p">Vincent McBurney's Blog: Incremental Loads save the day</a>
<a href="http://wiki.ittoolbox.com/index.php/HOW ... b">Vincent McBurney's Howto DataStage: perform change data capture in an ETL job</a>

Posted: Thu Dec 22, 2005 7:32 pm
by kwwilliams
Seeta asked the question. I just in trying to get more data out of him about his problem made some suggestions about the kind of informatino that would be helpful. Right now I know Sequential file is the source and that is all.

Sorry if I created confusion in trying to get more information. Original question are subsequent post from SEETA are the only ones that provide any insight into his problem.