Now, with that in mind, I have quite a large data amount of Data to move into a Data Warehouse environment. After the first Bulk load of all the current data, I don't want to be wasteful in dumping data, cleaning out, and reloading.
I want to discuss the best strategy for continual data loading.
The strategy I hoping to implement is the following:
The floor is Open for discussion.1) Bulk Load Once Off. Obviously for the initial staring point of data.
2) Incremental Nighly Loads of the days new records or updated records that have changed, using a "DateChange" field strategy, since the last load.