How should our rate limiter behave in production?
A rate limiter sits in front of every request. To avoid becoming a bottleneck, it must be: