Page 1 of 1

Incremental loding and Incremental load

Posted: Thu May 24, 2007 5:11 am
by georgesebastian
Hi Every one,

I would kindly like to know,

What is incremental loding?
Can all the loading which will increment or update the target can be considered as incremental loading.
So in that case In Datawarehousing we always go for incremental loading.

One more question.

What is incremental load?
Is that the data which has been inserted or updated in to a table with in a particular period can be called as the incremental load.

Thanks & Regards
George Sebastian

Re: Incremental loding and Incremental load

Posted: Thu May 24, 2007 5:47 am
by priyadarshikunal
georgesebastian wrote:Hi Every one,

I would kindly like to know,

What is incremental loding?
Can all the loading which will increment or update the target can be considered as incremental loading.
So in that case In Datawarehousing we always go for incremental loading.

One more question.

What is incremental load?
Is that the data which has been inserted or updated in to a table with in a particular period can be called as the incremental load.

Thanks & Regards
George Sebastian
yes, you are right up to some extent;

If you only update the existing rows of a database Its not exactly Incremental load.

Posted: Thu May 24, 2007 6:24 am
by georgesebastian
Thanks Priyadarshi Kunal,

Can somebody adorn this topic a bit more

Thanks
George Sebastian

Posted: Thu May 24, 2007 6:42 am
by chulett
Google, or use your favoritve search engine. All kinds of discussions out there in the wild for the reading, not sure why someone should bang in all that information here. :?

Our friend Vincent has a blog entry on the subject from a DataStage perspective. Give that a read.

And I don't really see any need to differentiate between 'loads' and 'loading' in this context.

Posted: Thu May 24, 2007 2:50 pm
by ray.wurlod
About the only differentiation that I believe is relevant is the one between initial load and incremental load (meaning any subsequent load to a non-empty structure). An initial load typically processes a far larger volume of data than a subsequent load, and is unlikely to require that anything be updated (that is, it can run as pure insert).

Posted: Thu May 24, 2007 10:51 pm
by georgesebastian
Hi all,

Search has threw light on these areas

Full Load is the entire data dump load taking place the very first time.

Gradually to synchronize the target data with source data,
there are further 2 techniques:-

1.Refresh load - Where the existing data is truncated and reloaded completely.
2.Incremental - Where delta or difference between target and source data is dumped at regular intervals. Timsetamp for previous delta load has to be maintained.

Thanks for all your precious time
George