First run:
Source: 30 million rows
Target : 30 million rows
After first run from second time on wards I have to delete 2013 records on target and insert 2013 records.
I designed job like
Oracle connector -----> Oracle connector
Source side:
select *
from *****
where year =2013
On target side
Write mode: Bulk load
Table Action: Append
Run Before and after sql statements: YES
Before SQL Statement : Delete from ***** where year=2013
I'm thinking that's about as best as it gets if those are literally your requirements - every day a full refresh of all records for that year. I assume there are records for other years in the table?
-craig
"You can never have too many knives" -- Logan Nine Fingers
Yes Chulett,
It contains records with all years. On Target side can I use bulk load and before sql statement or Delete and then insert ? Whats the difference between these two?
You wouldn't be able to bulk load if you went the delete and insert route as that turns every insert into two operations - first a transactional delete and then the insert. Better to 'bulk' delete and then bulk load.
-craig
"You can never have too many knives" -- Logan Nine Fingers