Change Data Capture is just one component of the ETL process. However, it is worthy of discussion by itself, because if implemented correctly it can significantly reduce load times and simplify the follow on ETL process.

Typically Change Data Capture (CDC) is associated with database journaling. If the source tables are journaled, RODIN can Capture the journal images and Apply them to a target table, which can be a staging table to feed into the ETL process, however you can also feed the captured data direclty into an ETL process to achieve real-time load of your data waehouse. Both local and remote journals are supported.

RODIN can perform CDC in real-time (or near real-time), capturing journal images as they are written, or in batch at the end of the day. Furthermore, you can specify to capture detailed changes (every before and after image), or to consolidate multiple changes down to a single resulting image.

For tables such as master files (Customer, Product etc), CDC can significantly reduce the load times. Instead of the ETL process needing to scan every row looking for changes, the captured data consists of only new, changed or deleted rows – with flags to indicate the change type.

Besides loading your data warehouse, there may also be other uses for RODIN CDC in your organization. Create an audit trail for tables with sensitive data, or track down program bugs in your applications.

RODIN CDC is  highly efficient. easily handling very high data volumes and a large number of tables.