Skip to main content

How Discord Migrated Trillions of Messages to ScyllaDB

Published Date

Learn why and how Discord’s persistence team recently completed their most ambitious migration yet: moving their massive set of trillions of messages from Cassandra to ScyllaDB. Bo Ingram, Senior Software Engineer at Discord, provides a technical look, including:

  • Their reasons for moving from Apache Cassandra to ScyllaDB
  • Their strategy for migrating trillions of messages
  • How they designed a new storage topology – using a hybrid-RAID1 architecture – for extremely low latency on GCP
  • The role of their existing Rust messages service, new Rust data service library, and new Rust data migrator in this project
  • What they’ve achieved so far, lessons learned, and what they’re tackling next