Parallelizing MySQL Snapshots
How Materialize parallelized MySQL table snapshotting for a 2.2B-row, 2.45TB table, from primary key partitioning and prefix probing to MySQL collation pitfalls, bringing a 30-hour snapshot down to 3...
How Materialize parallelized MySQL table snapshotting for a 2.2B-row, 2.45TB table, from primary key partitioning and prefix probing to MySQL collation pitfalls, bringing a 30-hour snapshot down to 3...
A linearizable metadata log for Materialize, built on PostgreSQL READ COMMITTED isolation, with 3x write throughput and a Lean 4 proof.
Materialize is moving beyond kernel paging to an application-managed buffer pool, keeping hot data in memory and serving sequential and batched work from disk.