Rate limiting is a traffic-management technique that controls the number of requests a client may make to a service within a defined time window, rejecting or queuing excess requests. It protects backend resources from overload, enforces fair usage and quota policies, and mitigates abuse such as brute-force and denial-of-service attacks. Commonly implemented at API gateways using token-bucket or sliding-window algorithms, it is a core mechanism for the resilience and stability of networked systems.
- Rate Limiting caps how many requests a client can make to a service within a time window, shedding or queuing the excess. It is enforced at the API Gateway and within API Management to protect resources and uphold Resilience and Security.
Overview
- Rate limiting transforms an unbounded stream of incoming requests into a controlled flow that backend services can sustain, trading a small fraction of rejected traffic for overall stability.
- Algorithms differ in how they account for time. Token-bucket and leaky-bucket smooth bursts, while fixed- and sliding-window counters give precise per-interval ceilings. The choice trades burst tolerance against accuracy.
- Limits are typically scoped per client, per API key, or per endpoint, and are paired with informative responses so well-behaved callers can back off and retry, supporting graceful Fault Tolerance.
Mechanisms
- Token bucket: tokens refill at a fixed rate and each request consumes one, permitting controlled bursts.
- Sliding window: request timestamps within a moving interval are counted for precise enforcement.
- Distributed counters: shared state, often in a cache, coordinates limits across Microservices replicas.
- Response signalling: status codes and retry hints let clients adapt, complementing Load Balancing.
Applications
- Protecting public APIs through an API Gateway from overload and scraping.
- Enforcing tiered quotas in API Management for monetised access.
- Mitigating brute-force and denial-of-service abuse as a Security control.
- Preserving Scalability of shared backend services under spiky demand.
Provenance
SAC-CG Agent Ontology
The Semantic Agent Communication Community Group’s draft Agent Ontology (version 0.4.0, not a W3C Recommendation) declares RateLimit in its execution-context module as “a constraint on the frequency of an action or request”.1 This is narrower than the live page, which describes a traffic-management technique enforced at a gateway. The ontology defines only the constraint, not the enforcement algorithm.
An ExecutionEnvironment carries it through the property hasRateLimit. Two positive-integer properties describe an instance: maxRequests and perSeconds, giving a count per time window.1 visionGraph places it under Resource Constraint and relates it to the Execution Environment in which the limit applies and to Execution Budget, its monetary sibling.
Footnotes
-
Semantic Agent Communication Community Group, “Execution Context Ontology” (Agent Ontology, CC BY 4.0). https://github.com/s-agent-comm/agent-ontology/blob/750e06d276dd568313a6c03c4e78203887d3fa4b/ontologies/execution-context.ttl ↩ ↩2