directory

  • SqlServer CDC and CT differences
  • CDC configuration for SqlServer
  • Process for Configuring Synchronization
  • Pit 1: foreign key association of the primary child table
  • Pit 2: Synchronizes the main table and automatically generates multiple sub-tables
  • summary

The old and new data of the system need to be synchronized, but the table structure of the two systems is very different, so we decided to use StreamSet to complete data synchronization, i.e. SqlServer and MySql synchronization.

SqlServer CDC and CT differences

StreamSets provides CDC and Change Tracking, both of which are used to capture data changes from SqlServer. CDC focuses on replica replication, and Change Tracking (CT) should be a streamlined version that only supports table monitoring with digital primary keys and does not support composite primary keys.

  1. If the application needs information about all the changes made and an intermediate value for the changed data, CDC may be appropriate rather than CT.
  2. The CDC is captured using an asynchronous process that reads the transaction log; CT is synchronized with DML operations and does not need to read transaction logs;
  3. CDC contains a history of changes, CT only stores rows but does not capture changed data;

The above said CT by digital primary key monitoring, actually is StreamSets