What Is CDM?
Cloud Data Migration (CDM) implements data mobility by enabling batch data migration among homogeneous and heterogeneous data sources. It supports on-premises and cloud file systems, relational databases, data warehouses, NoSQL, big data, and object storage.
Based on the distributed computing framework and the concurrent processing technology, CDM helps you migrate massive sets of data stably and efficiently. You can migrate data online and quickly construct a desired data structure.
- Table/file/entire DB migration
Tables or files can be migrated in batches. An entire database can be migrated between homogeneous and heterogeneous databases. A job can migrate hundreds of tables.
- Incremental data migration
CDM supports incremental migration of files, relational databases, and HBase/CloudTable, as well as with WHERE clauses and macro variables of date and time.
- Migration in transaction mode
When a CDM job fails to be executed, CDM rolls back the data to the state before the job starts and automatically deletes data from the destination table.
- Field conversion
CDM supports field conversion functions, such as anonymization, character string operations, and date operations.
- File encryption and decryption
When files are migrated to a file system, CDM can encrypt the files written to the cloud.
- MD5 verification
MD5 verification is supported to check the file consistency from end to end and output verification result.
- Dirty data archiving
CDM can archive the data that fails to be processed during migration, filtered out, converted, or not compliant with cleaning rules to dirty data logs. The threshold for dirty data ratio can be set to determine whether a task is successful.