Coursera Plus Annual is 50% Off — Ends June 17.

Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

CodeSignal

Throttling API Requests

via CodeSignal

Go to class Write review

Overview

Throttling manages high request volumes by controlling how requests are processed when thresholds are exceeded. Unlike rate limiting, which rejects excess requests outright, throttling uses strategies like delays, token buckets, and queues to manage traffic flow. This keeps your API responsive and stable during traffic spikes.

Syllabus

  • Unit 1: Implementing Delay Throttling
    • Adding Logging to Throttling Middleware
    • Add Maximum Wait Time to Delay Throttle Middleware
    • Adding Throttle Feedback Headers
  • Unit 2: Throttling and Token Bucket
    • Implement Exponential Backoff Retry for Token Bucket Throttling
    • Implementing Token Bucket Replenishment
    • Implement Token Bucket Middleware with Exponential Backoff
  • Unit 3: Queue Based Throttling
    • Building the Queue Foundation for Request Throttling
    • Add Timeout Handling to Queue Throttle Middleware
    • Implementing Queue-Based Request Processing
    • Implement Queue Throttle Middleware
    • Implementing Queue-Based Request Throttling
  • Unit 4: Tiered Token Bucket Throttling
    • Rate Limit Headers and Error Handling
    • Implement Tiered Token Bucket Throttling

Reviews

Start your review of Throttling API Requests

Go to class

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free
Someone learning on their laptop while sitting on the floor.