Google Cloud Storage
real-time ingestion
TwinCommit applies changes to Google Cloud Storage with exactly-once, commit-ordered semantics from any of 9 log-based sources, including Oracle, MySQL, SQL Server and Db2. Iceberg and Delta tables in GCS for BigLake, BigQuery and Dataproc.
Google Cloud Storage
Google Cloud Storage · BigLake metastore · Dataproc
- ✓Storage Object Admin on the bucket
- ✓BigLake Admin for catalog registration (optional)
- ✓Workload identity or a service-account key
Apply
How TwinCommit writes to GCS
Changes land as Apache Iceberg, Delta Lake or Parquet tables with one atomic commit per micro-batch. Iceberg tables register in the BigLake metastore so BigQuery can query them in place.
GCS target docs →GCS connector FAQ
Which GCS versions does TwinCommit support?
+
Google Cloud Storage · BigLake metastore · Dataproc.
How does TwinCommit write to GCS?
+
Changes land as Apache Iceberg, Delta Lake or Parquet tables with one atomic commit per micro-batch. Iceberg tables register in the BigLake metastore so BigQuery can query them in place.
Replicate your first table in five minutes.
Download the free Developer edition, or have one of our replication engineers walk you through a migration plan.