Fast Sync

Fast Sync is one of the Replication Methods that is functionally identical to Full Table replication but Fast Sync is bypassing the Singer Specification for optimised performance. Primary use case of Fast Sync is initial sync or to resync large tables with hundreds of millions of rows where singer component would usually be running for long hours or sometimes for days.

Warning

Important: Fast Sync is not a selectable replication method in the YAML configuration. PipelineWise detects automatically when Fast Sync gives better performance than the singer components and uses it whenever it’s possible.

Fast Sync exists only between the following tap and target components:

Fast Sync supported Tap to Target combinations

Tap

Target

Tap MySQL

-> Target Snowflake

Tap PostgreSQL

-> Target Snowflake

Tap S3 CSV

-> Target Snowflake

Tap MongoDB

-> Target Snowflake

Tap MySQL

-> Target Redshift

Tap PostgreSQL

-> Target Redshift

Tap S3 CSV

-> Target Redshift

Tap MySQL

-> Target Postgres

Tap PostgreSQL

-> Target Postgres

Tap S3 CSV

-> Target Postgres

Tap MongoDB

-> Target Postgres

Tap MySQL

-> Target Bigquery

Tap PostgreSQL

-> Target Bigquery

Tap S3 CSV

-> Target Bigquery

Tap MongoDB

-> Target Bigquery