How X finds ~200 candidate posts from billions in milliseconds — Thunder keeps in-network posts in memory, while Phoenix Retrieval uses a two-tower transformer to discover out-of-network content via embedding similarity search.
How X built a reusable, trait-based pipeline framework in Rust that separates orchestration from business logic — with clever error handling that prioritizes availability over correctness.