Horizontal Scaling

Problem

One server handles: 5,000 requests/sec You need: 50,000 requests/sec Eventually making one machine bigger stops being practical.

Solution — Horizontal Scaling

Run more instances. 
        ┌→ Server
Traffic → Server
        → Server
        └→ Server
Core idea: horizontal scaling increases capacity by adding machines or instances.