Insert/Update Oracle table in CDC job?
Posted: Sun Apr 02, 2017 8:36 pm
Hi All,
We are trying to build a new data warehouse, i am currently doing POC, we will have multiple tables in warehouse, we will build CDC job for every table to capture the data changes. In every CDC job i am planning to capture inserts into a dataset & edits into another data set. Next i planned to build couple of jobs, one for loading inserts into Oracle table & another for updating Oracle table.
Now my question, instead of inserting/updating data in separate jobs, can i do these tasks in CDC job itself. If i perform insert/update in CDC job, i hope it improve jobs performance because i don't need to run(build) insert/update jobs for every table. Please let me know if this method is recommended & also let me know what kind of issues i may face in long run.
Some additional information, in CDC jobs we are doing CDC, joining few reference tables & find key max value. Each table may have rows between 1 million to 2 millions.
Greatly appreciate any help, thanks in advance.
We are trying to build a new data warehouse, i am currently doing POC, we will have multiple tables in warehouse, we will build CDC job for every table to capture the data changes. In every CDC job i am planning to capture inserts into a dataset & edits into another data set. Next i planned to build couple of jobs, one for loading inserts into Oracle table & another for updating Oracle table.
Now my question, instead of inserting/updating data in separate jobs, can i do these tasks in CDC job itself. If i perform insert/update in CDC job, i hope it improve jobs performance because i don't need to run(build) insert/update jobs for every table. Please let me know if this method is recommended & also let me know what kind of issues i may face in long run.
Some additional information, in CDC jobs we are doing CDC, joining few reference tables & find key max value. Each table may have rows between 1 million to 2 millions.
Greatly appreciate any help, thanks in advance.