advanced

Design a Multi-Cloud API Gateway

Design a unified API gateway that abstracts provider-specific cloud APIs (AWS, GCP, Azure) behind a single interface. The system normalizes requests, routes based on cost/latency/availability policies, handles credential management per provider, and provides unified monitoring, billing aggregation, and automatic failover when a provider degrades.

Suggested time: 45 minutes

Loading the workspace...

About this problem

A multi-cloud API gateway provides a single normalized API layer that lets applications interact with compute, storage, and database services across AWS, GCP, and Azure without knowing which provider handles the request. Companies like Spotify, Netflix, and major banks adopt multi-cloud strategies to avoid vendor lock-in, optimize costs, and maintain availability even when an entire cloud provider goes down.

What your design needs to cover

  • Unified API for compute, storage, and database

  • Request translation

  • Policy-based routing

  • Cross-provider failover

  • Real-time cost comparison

  • Credential management

Key challenges the editorial covers

Learn from other designs

Related problems

Guides