Byte-Sized Design

Byte-Sized Design

Twitter Made Searching Scalable Before Elon Musk

Doing Everything on One Cluster Doesn't Work

Byte-Sized Design's avatar
Byte-Sized Design
Apr 02, 2023
∙ Paid

TLDR;

Twitter struggled using Elasticsearch and letting that cluster handle everything. This was a problem handling tons of traffic and doing large backfill operations.

The simple way they fixed this …

Keep reading with a 7-day free trial

Subscribe to Byte-Sized Design to keep reading this post and get 7 days of free access to the full post archives.

Already a paid subscriber? Sign in
© 2025 Byte-Sized Design · Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture