API Gateway in Google Cloud: The Front Door for Your Backend Services

API Gateway in Google Cloud: The Front Door for Your Backend Services

A complete, intermediate-level guide to Google Cloud's managed API Gateway: how it is built, how requests travel through it, how it protects your services, and when to choose it over other options.

Picture a large office building with dozens of departments: accounts, shipping, customer support, legal. If every visitor wandered the corridors looking for the right room, chaos would follow. Doors would be tried at random, some visitors would reach rooms they should never enter, and nobody would know who came or went. So buildings have a reception desk. The receptionist checks who you are, tells you where to go, limits how many people enter at once, and writes everything in a visitor log. API Gateway in Google Cloud is that reception desk for your software. Your backend services stay quietly at work in their rooms, while one well-guarded front door handles identity checks, traffic control and record keeping for everyone knocking from the outside.

1The Problem: Why APIs Need a Front Door

Before meeting the product, it helps to feel the pain it removes.

What an API actually is

An API, short for application programming interface, is a set of agreed rules that lets one piece of software ask another piece of software to do something. When a mobile banking app shows your balance, it does not read the bank’s database directly. It sends a request to an API, which checks the request, fetches the balance and sends back an answer. The API is the polite, controlled doorway between two programs.

Modern systems are built from many small services instead of one giant program. One service handles orders, another handles payments, another handles product search. Each of these services may expose its own API. Over time a company may have dozens or even hundreds of them, written by different teams, in different languages, running on different platforms.

Simple Analogy

Imagine a shopping mall where every shop has its own entrance, its own security guard and its own rules for opening hours. Shoppers would need to learn every shop’s rules separately. A mall with one main entrance and one shared security desk is far easier for everybody.

What goes wrong without a shared front door

If every team builds its own protection, the same chores are repeated again and again: checking identities, limiting traffic, recording logs, handling errors. Some teams will do them well and some will forget. A single missed check can leave a service open to the whole internet. Clients also suffer, because they must remember a different address and a different login method for each service.

Pain 1

Inconsistent security

Each service does its own login checks, so quality varies and gaps appear.

Pain 2

No traffic control

One noisy client can flood a small service and slow it for everybody else.

Pain 3

Scattered visibility

Logs and metrics live in many places, so nobody sees the whole picture.

Pain 4

Tight coupling

Clients hard-code the address of each backend, so moving a service breaks every client.

Pain 5

Duplicated effort

Every team rebuilds the same plumbing instead of focusing on business features.

!
Common Misconception

Some people think a gateway is only about speed. It is mostly about control: who may enter, how much they may do, and what gets recorded. Speed is a side effect, not the main goal.

2What Is API Gateway in Google Cloud?

A managed service that gives your backends one consistent, protected public face.

The core definition

API Gateway is a fully managed Google Cloud service that provides secure access to your backend services through a consistent REST API, no matter how each service is implemented. You describe your API in a specification file, upload it, and deploy it to a gateway. Clients then call the gateway, and the gateway forwards allowed requests to your real services. Google runs the gateway infrastructure, handles hosting, logging, monitoring and traffic management, and integrates the whole thing with the rest of Google Cloud.

The word managed matters here. You do not create virtual machines, install proxy software, patch operating systems or plan capacity for the gateway. You provide the description of your API, and Google provides the machinery that enforces it.

Simple Analogy

Think of renting a fully staffed reception desk in a managed office tower. You tell the building manager the rules for visitors, and the staff, the desk and the cleaning are all handled for you.

What it does for you

Job 1

Single entry point

Clients talk to one stable address while backends can change behind it.

Job 2

Authentication

It checks API keys, tokens and Google identities before requests reach your code.

Job 3

Quotas and limits

It can cap how many calls a client may make in a period.

Job 4

Routing

It sends each path to the right backend service.

Job 5

Observability

It records request logs and tracks latency, traffic and errors.

Where it sits among Google’s API tools

Google Cloud offers several products for managing APIs, and beginners often mix them up. API Gateway is the lightweight, serverless-friendly choice, aimed mainly at protecting backends such as Cloud Run services and Cloud Run functions. Cloud Endpoints is a related product where you run the proxy yourself. Apigee is a much larger platform for full API lifecycle management, developer portals and monetization. A later chapter compares them in detail.

i
Practical Tip

If your main question is how to put authentication, quotas and logging in front of a few serverless services without running anything yourself, API Gateway is usually the first product to examine.

3Core Concepts: API, API Config and Gateway

Three words you must understand clearly, because everything else builds on them.

The three building blocks

People new to API Gateway often confuse its three main resources, because the names sound alike. Each plays a different role, and understanding the difference makes everything else easier to follow.

Resource 1

API

The top-level container for your API in Google Cloud. It is a named home that holds all versions of the configuration over time.

Resource 2

API config

One uploaded version of your API specification, including backends, paths and security rules. Think of it as a saved snapshot of the rules.

Resource 3

Gateway

The running, publicly reachable endpoint that serves traffic using one chosen API config in one region.

Simple Analogy

The API is a recipe book. Each API config is one written edition of a recipe. The gateway is the kitchen that is cooking from one specific edition right now. You can write new editions at any time, but the kitchen only changes when you tell it to switch.

Why the API config is treated as a snapshot

When you upload a specification, Google creates an API config from it. You then deploy that config to a gateway. If you need to change the rules, you do not edit the live config. Instead you create a new API config and point the gateway at it. This design gives you a clear history of what was deployed, makes it easy to roll back by pointing the gateway at an older config, and avoids half-applied changes.

The gateway is regional

A gateway lives in a specific Google Cloud region and receives its own hostname under a Google-managed domain. Clients call that hostname. Because the gateway is a regional resource, you choose a region that suits your users and your backends, ideally close to both, to keep delays small.

i
Memory Trick

API is the folder, API config is the document inside the folder, and gateway is the printer that prints one chosen document for the public.

!
Common Mistake

Creating a new API config and forgetting to update the gateway. The new config exists, but the gateway keeps serving the old one until it is told to switch.

4Architecture and How a Request Flows

Following one request from the client to the backend and back.

The big picture

At its heart, the gateway is a smart proxy sitting between clients and backends. A proxy is a middleman that receives a request on behalf of someone else and passes it along. The Google Cloud gateway is built on the same proxy technology family used by Cloud Endpoints, which is an Envoy-based proxy designed to work with Google’s service management and service control systems. You never see or manage that proxy, but knowing it exists explains why the features behave like those of Cloud Endpoints, including the shared authentication syntax.

flowchart LR
    A[Mobile app] --> G[API Gateway]
    B[Web app] --> G
    C[Partner system] --> G
    G --> R[Cloud Run service]
    G --> F[Cloud Run function]
    G --> E[App Engine service]
    G -.-> L[Logging and Monitoring]
        
FIG 1 — Many clients, one gateway, several backends

The journey of one request

1

Client sends a request

An app calls the gateway’s hostname and a path such as the one for listing orders, including its credential, like an API key or token.

2

Gateway matches the path

The gateway looks up the path and method in the deployed API config to find the matching operation and its rules.

3

Security check

The gateway validates the credential against the security rules for that operation. If it fails, the client receives an error and the backend never sees the call.

4

Quota check

If the operation has a quota, the gateway checks whether this client is still within its allowance.

5

Forward to the backend

The gateway sends the request to the backend address configured for that operation, attaching its own identity when the backend requires one.

6

Return and record

The backend’s answer travels back through the gateway to the client, while the gateway records logs and updates its metrics.

sequenceDiagram
    participant Client
    participant GW as API Gateway
    participant Backend
    participant Obs as Logging and Monitoring
    Client->>GW: Request with credential
    GW->>GW: Match path, check credential and quota
    alt Check fails
        GW-->>Client: Error response
    else Check passes
        GW->>Backend: Forward request with gateway identity
        Backend-->>GW: Response
        GW-->>Client: Response
    end
    GW->>Obs: Write logs and metrics
        
FIG 2 — Request flow through the gateway
i
Why This Matters

Because checks happen at the gateway, bad requests are rejected before they consume backend resources. That protects both your security and your budget.

5The Backends Behind the Gateway

The gateway is the front desk, but real work happens in the rooms behind it.

Serverless-first design

Google’s documentation names Cloud Run functions, Cloud Run and the App Engine standard environment as options for implementing the services behind the gateway. These are all serverless platforms, meaning Google manages the servers and scales them automatically. The pairing makes sense: a managed front door for managed backends means almost nothing for your team to operate.

Backend 1

Cloud Run

Runs containers that scale up and down automatically, including down to zero. A flexible home for most modern services.

Backend 2

Cloud Run functions

Runs small single-purpose pieces of code triggered by requests. Good for simple endpoints.

Backend 3

App Engine standard

A platform for web applications where Google handles servers and scaling.

Backends can change without breaking clients

One of the biggest gifts of a gateway is that the public API stays stable while the backend changes. Today a path might be served by a Cloud Run function. Next year the team may rewrite it as a container and move it to Cloud Run. Clients keep calling the same address, because only the backend address inside the API config changed.

Simple Analogy

A restaurant can change its kitchen staff, equipment or even the building behind the scenes, while customers still order from the same menu at the same counter.

Each backend has its own door lock

A key design idea is that your backend should not be open to the whole internet. For serverless backends, you can require callers to present a valid Google identity. The gateway then uses its own service account, which is a special non-human identity, to prove who it is whenever it calls the backend. The result is a double lock: clients must satisfy the gateway, and only the gateway may satisfy the backend.

!
Security Warning

If a backend remains publicly callable, anyone who discovers its direct address can bypass every rule set at the gateway. Always lock the backend so only the gateway’s identity can invoke it.

flowchart LR
    I[Internet client] -->|API key or token| G[API Gateway]
    G -->|Gateway service account identity| B[Private backend]
    I -.->|Direct call is denied| B
        
FIG 3 — Double lock: gateway checks clients, backend checks the gateway

6The OpenAPI Specification: Your Blueprint

Everything the gateway knows about your API comes from one descriptive document.

What OpenAPI is

OpenAPI is a widely used standard format for describing an HTTP API in a plain text file. The file lists each path, each allowed method such as GET or POST, what inputs are accepted, what answers are returned, and how clients must authenticate. Because the format is standard, many tools can read it, from documentation generators to testing tools.

With API Gateway, this file does double duty. It documents your API, and it also configures the gateway. Google-specific extension fields inside the file tell the gateway where each operation’s backend lives, how to authenticate to it, and how quotas should work.

Simple Analogy

The specification is like an architect’s blueprint that is also the construction order. The same drawing explains the building to visitors and tells the builders exactly what to build.

OpenAPI 2.0 and 3.x

API Gateway was originally built around OpenAPI 2.0, often still called Swagger. Google’s documentation describes defining a deployed API as an OpenAPI 2.0 specification that names the backend entry point, request and response formats and the authentication mechanism. More recently, support for OpenAPI 3.x has been documented as well, with its own page of feature limitations and its own set of Google extensions. Newer capabilities, such as exposing operations to AI agents through the Model Context Protocol, are described only for OpenAPI 3.0.x and 3.1.x, not for 2.0.

AspectOpenAPI 2.0OpenAPI 3.x
Maturity in API GatewayThe original, long-established formatDocumented with its own limitations and extensions page
Newer agent-related featuresNot supportedRequired for the MCP capability
Multiple filesCheck current documentationAllowed, within a stated total size and file-count limit
Best choice for new projectsOnly if you must stay on 2.0Usually preferred, after reading its limitations

Features that are accepted but not enforced

This is an important detail that surprises many teams. The gateway accepts certain definitions in your file but does not actually enforce them. Documentation notes that OAuth scopes listed in security definitions are accepted but never checked. Likewise, details such as whether a parameter is required, or what format an array has, are accepted but requests are forwarded to your backend regardless. In other words, the gateway is not a full request validator. Your backend must still validate its own inputs.

!
Common Mistake

Assuming that marking a parameter as required in the specification will block requests that omit it. It will not. Always validate inputs inside the backend service.

Other limits worth knowing

Limit 1

Whole path segments only

Path templates must cover complete segments, such as an item identifier. Partial-segment patterns with fixed prefixes or suffixes are rejected.

Limit 2

No outside references

References to types outside the document, including external web addresses, are rejected, so keep your definitions self-contained.

Limit 3

No custom ports in hosts

Custom ports in the host or server address are not allowed.

Limit 4

Alias limit

A document may contain at most 200 YAML alias nodes, which matters for heavily reused definitions.

Limit 5

Defined security only

Every security requirement must match a declared security definition, or the specification is rejected.

i
Practical Tip

Limits and supported versions evolve. Before designing around a feature, read the current limitations page for the specification version you plan to use.

7Authentication: Proving Who You Are

The gateway checks credentials so your backends do not each have to.

Authentication versus authorization

Two similar words cause constant confusion. Authentication answers the question who are you. Authorization answers the question what are you allowed to do. A hotel clerk who checks your passport is authenticating you. The key card that opens only your room is authorization. The gateway is strong at the first and can contribute to the second, while fine-grained permissions inside your business logic usually remain the job of your backend.

Supported credential types

API Gateway uses the same authentication syntax as Cloud Endpoints. Documentation lists API keys, Google authentication methods using service accounts, and Google ID tokens among the options, and the OpenAPI pages also describe OAuth2-style and JSON Web Token validation through the security definitions in the specification.

Method 1

API keys

A simple secret string that identifies the calling project or app. Good for identifying and metering callers, but weak as proof of a person’s identity.

Method 2

Service account credentials

A machine identity, used by one backend or system to call another securely without any human login.

Method 3

Google ID tokens

Signed tokens that prove a Google identity, useful for callers inside Google Cloud or those signed in with Google.

Method 4

JWT from another provider

A JSON Web Token issued by an identity provider you trust. The gateway verifies its signature and basic claims.

Simple Analogy

An API key is like a membership card number: it says which club you belong to, but anyone holding the card can use it. A signed token is more like a government ID with a photo and a tamper-proof seal.

How a JWT is checked

A JSON Web Token, or JWT, is a small signed package of claims, such as who issued it, who it is for and when it expires. The gateway checks that the signature is genuine using the issuer’s published public keys, that the token has not expired, and that the audience matches what the specification expects. If any check fails, the request is rejected before reaching your backend.

Combining requirements

Security rules can be combined, but the documentation lists specific restrictions. For API keys, alternatives, meaning either-or rules, that involve an API key are not supported, though requiring both an API key and an OAuth2 token together is supported. For OAuth2, either-or rules across different schemes are supported, while both-together rules across different OAuth2 schemes are not. An empty security requirement can make an API key optional, but not OAuth. These details sound fussy, yet they decide whether a design is possible, so check them early.

CombinationSupport (per documentation reviewed)
API key AND OAuth2 tokenSupported
API key OR another schemeNot supported
OAuth2 scheme A OR OAuth2 scheme BSupported
OAuth2 scheme A AND OAuth2 scheme BNot supported
Optional API key via empty requirementSupported
Optional OAuth via empty requirementNot supported
ANTI-PATTERN-01 Avoid
Problem

Relying on an API key alone to protect an API that exposes personal or financial data.

Why It’s Harmful

API keys identify an application, not a person, and they are easily copied if embedded in a mobile app or web page. Anyone who extracts the key gains the same access.

Correct Approach

Use API keys to identify and meter callers, and add a signed token to prove the identity of the user or service for sensitive operations.

8Quotas, Rate Limiting and API Keys

Protecting your backends from overload, accidents and unfair use.

Why limits matter

Even honest clients cause trouble. A bug in a mobile app might send the same request in a loop. A partner might run a huge nightly import. A single hungry client can drain capacity and slow every other customer. A quota is a promise about fairness: each caller may make only a defined number of calls in a defined period, and calls beyond that are politely refused.

Simple Analogy

A buffet that says two plates per guest per hour keeps the food available for everyone. Without the rule, a few guests could empty the tables before others are served.

How quotas work in this family of products

The gateway shares its quota model with Cloud Endpoints. You define named metrics in the specification, set limits on those metrics, and then tell each operation how much of a metric each call consumes. Heavy operations can be set to cost more than light ones. Limits are measured against the identity of the caller, which is normally derived from the API key, which is why quotas and API keys appear together so often.

1

Define a metric

Give a name and a display label to the thing you want to count, such as read requests.

2

Set a limit

Choose the allowed number per minute, per project, or per another measurement window.

3

Attach cost to operations

Decide how much each call to each operation consumes, so expensive calls drain the allowance faster.

4

Require keys for identification

Mark operations as needing an API key so the gateway knows which caller to charge.

Managing API keys

API keys are created and managed in your Google Cloud project, and you can restrict each key so it works only with the intended API. Documentation also notes that you can share your API through the console so other developers can enable it and generate their own keys. Good key hygiene matters: rotate keys regularly, restrict their scope, and never commit them into public code repositories.

!
Common Mistake

Treating quotas as a security feature. Quotas limit volume, but they do not prove identity. A stolen key still works until its quota runs out.

Fair
Each caller gets a share
Safe
Backends avoid overload
Predictable
Costs stay under control

9Securing the Path to the Backend

A locked front door is useless if the back door stands open.

The gateway’s own identity

When the gateway calls a backend, it does so as a service account, a non-human identity that Google Cloud uses for programs. You choose which service account the gateway runs as, and you grant that account permission to call your backends. For example, you might give it only the permission to invoke a particular Cloud Run service, and nothing else. This is the principle of least privilege: give the smallest set of permissions that still lets the job work.

Simple Analogy

A building’s receptionist gets a key card that opens only the mailroom and the visitor lounge, not the vault and not the server room.

Layers of protection

Layer 1

Client authentication

The gateway verifies keys, tokens or Google identities before anything else happens.

Layer 2

Quota control

Calls beyond a caller’s allowance are refused before reaching the backend.

Layer 3

Backend identity check

The backend accepts calls only from the gateway’s service account.

Layer 4

Encrypted transport

Calls use HTTPS so data cannot be read while traveling.

Layer 5

Application validation

The backend still validates inputs and enforces business permissions.

Defense in depth

Security experts like layered defenses, because any single layer can have a hole. The gateway handles the outer layers well. But the gateway does not see inside your business rules, so your backend must still check whether this particular user may see this particular record. Treat the gateway as a strong outer wall, not as the only wall.

i
Design Hint

Give each backend its own narrowly scoped permission for the gateway’s service account, instead of granting broad project-wide roles. If one backend is ever misconfigured, the damage stays small.

ANTI-PATTERN-02 Avoid
Problem

Leaving backend services open to unauthenticated calls from the internet because the gateway is already in front.

Why It’s Harmful

Anyone who finds the backend’s direct address can skip authentication, quotas and logging entirely.

Correct Approach

Require authenticated invocation on the backend and allow only the gateway’s service account to call it.

10Routing and Request Handling

Deciding which backend answers which request, and how the address is built.

Mapping public paths to backend addresses

Each operation in your specification carries information about its backend: the address to call, and how the public path should be translated into the backend path. Two translation styles are common. In one, the public path is appended to a fixed backend address, so a call to the gateway’s orders path becomes a call to the same path on the backend. In the other, every call goes to one constant backend address, which suits single-function backends that decide what to do themselves.

Style 1

Append the path

The gateway adds the client’s path to the backend base address. Best when the backend has real routes like a normal web service.

Style 2

Constant address

Every request goes to one fixed backend address. Best for a single function that handles many cases internally.

One gateway, many backends

A single API config can send different paths to different backends. The orders path may go to a Cloud Run service, the reports path to a function, and an older legacy path to App Engine. To the client, it all looks like one coherent API, which is exactly the point.

flowchart TD
    C[Client] --> G[API Gateway]
    G -->|orders paths| A[Cloud Run orders service]
    G -->|reports paths| B[Cloud Run function reports]
    G -->|legacy paths| D[App Engine legacy app]
        
FIG 4 — Path-based routing to several backends

Timeouts and other behavior

Each backend can be given a deadline, which is how long the gateway will wait before giving up. A sensible deadline protects clients from hanging forever and protects the gateway from piling up stuck requests. Choose a deadline slightly longer than the backend’s normal worst-case time, so genuine slow calls succeed but runaway calls are cut off.

i
Practical Tip

Keep your public paths clean and stable, and hide backend details inside the configuration. Clients should never need to know which platform serves a path.

!
Check Before You Plan

Some web behaviors, such as handling of cross-origin browser requests, may need extra care at the gateway. Test browser-based clients early rather than discovering issues at launch.

11The Deployment Lifecycle and Versioning

From a text file on your laptop to a live public endpoint.

1

Prepare the backends

Deploy the services the gateway will call, and note their addresses and the identities that may invoke them.

2

Write the specification

Describe paths, methods, security rules, backend addresses and quotas in the OpenAPI document.

3

Create the API

Create the named API container in your Google Cloud project.

4

Create an API config

Upload the specification. Google validates it and rejects documents that break the rules described earlier.

5

Create or update the gateway

Choose a region and attach the config. The gateway receives a public hostname and starts serving.

6

Test and observe

Call the gateway with and without valid credentials, confirm the right errors appear, and check the logs.

flowchart LR
    S[OpenAPI file v1] --> C1[API config v1]
    S2[OpenAPI file v2] --> C2[API config v2]
    C1 --> G[Gateway]
    C2 -.->|switch when ready| G
        
FIG 5 — Configs are snapshots; the gateway points to one at a time

Updating safely

Because configs are snapshots, you update by creating a new config and pointing the gateway at it. If something goes wrong, point the gateway back at the previous config. This gives you a simple and dependable rollback story. Name your configs with meaningful labels, such as a version number or a date, so the history is readable.

Versioning the public API

The API config version is a deployment concept. It is not the same as the version of your API as clients see it. If you need to make a change that breaks existing clients, such as removing a field, publish it under a new public path or version, and keep the old one alive until clients move. Many teams include a version label in the path, for example a prefix that marks the first or second generation of the API.

i
Automation Hint

Store the specification in version control, review changes like any other code, and deploy through an automated pipeline. That makes every public change traceable and repeatable.

12Monitoring, Logging and Metrics

You cannot protect or improve what you cannot see.

What the gateway records

API Gateway logs information about requests and responses and tracks measurements such as latency, traffic and errors. These records flow into Google Cloud’s observability tools, where you can search logs, chart metrics and set up alerts. Because every call passes through the gateway, it is an ideal place to watch the health of your whole API surface from a single viewpoint.

Signal 1

Request count

How many calls arrive, per path, per method and per caller. Reveals popularity and sudden spikes.

Signal 2

Latency

How long calls take. Rising delays warn of slow backends or overloaded services.

Signal 3

Error rates

Client errors suggest bad credentials or bad requests, while server errors suggest backend trouble.

Signal 4

Quota usage

How close callers are to their limits, which helps plan fair allowances.

Signal 5

Request logs

Individual call records for investigating one customer’s problem or a security incident.

Reading error codes

Status codes beginning with four usually mean the client did something wrong: a missing or invalid credential, a forbidden action, a path that does not exist, or a quota that has run out. Codes beginning with five usually mean something on the server side failed, such as a backend that is down or too slow. When errors rise, the first question is always whether they are the fours or the fives, because the fix belongs to a different team in each case.

Simple Analogy

A reception desk logbook shows who arrived, when, and who was turned away. If many visitors are turned away for missing badges, you fix the badge process. If many are delayed because a department is slow, you fix that department.

Alerts that earn their keep

Good alerts are few and meaningful. Alert when the share of server errors passes a threshold for several minutes, when delays rise well above normal, or when traffic suddenly drops, since a sudden silence can mean clients cannot reach you at all. Avoid alerting on every single error, because constant noise trains people to ignore alarms.

i
Practical Tip

Build one dashboard that shows gateway traffic, latency and error rates next to the matching backend metrics. When something breaks, you can instantly see whether the gateway or the backend is the source.

13New Direction: Exposing APIs to AI Agents

The gateway is learning to speak the language of AI tools.

What the Model Context Protocol is

AI agents are programs, often powered by large language models, that can decide to call tools to get things done. To make that work smoothly, the industry created the Model Context Protocol, or MCP, a common way for agents to discover which tools exist and to call them. Normally, offering your service to agents means building and running a separate MCP server, which is extra work and extra security surface.

Turning REST operations into tools

In September 2026, Google announced a public preview that lets API Gateway act as a remote MCP server. You mark your OpenAPI 3.0.x or 3.1.x specification to enable the feature, describe each operation you want to expose with a tool name and a helpful description, and deploy as usual. The gateway then serves the MCP protocol at a dedicated path, and it translates each tool call into the matching ordinary REST request. Because the call passes through the usual machinery, your existing authentication, quotas and logging continue to apply.

Simple Analogy

Your restaurant already has a kitchen and a menu. MCP is like adding a translator at the door who lets visitors from another country order from the same menu in their own language, without hiring a second kitchen.

sequenceDiagram
    participant Agent as AI agent
    participant GW as API Gateway
    participant API as Backend REST service
    Agent->>GW: Discover available tools
    GW-->>Agent: List of tools
    Agent->>GW: Call a tool with arguments
    GW->>API: Translate into REST request
    API-->>GW: REST response
    GW-->>Agent: Tool result
        
FIG 6 — Agent calls become ordinary REST calls behind the gateway

Points to remember

Note 1

Public preview status

The capability was announced as a public preview. Expect changes, and read current documentation before depending on it.

Note 2

OpenAPI 3.x only

The feature is described for OpenAPI 3.0.x and 3.1.x specifications, and not for 2.0.

Note 3

Descriptions drive behavior

Language models choose tools based on their descriptions, so write clearly when and why each tool should be used.

Note 4

Discovery security

Listing tools is open by default. For production, require a signed token for that step, because API keys cannot secure it.

Note 5

Stated limits

Documented limits include a cap of one thousand tools per gateway, no exposure of operations with empty responses, and incomplete display of deeply nested schemas.

!
Safety Warning

Exposing an operation to an agent means software, not a human, may decide when to call it. Only expose operations whose side effects you are comfortable with, and keep destructive actions behind strong authentication.

A related feature: model routing

The documentation also describes a separate model routing capability for directing traffic to AI models. It cannot be combined with the MCP feature in the same API config. Because this area is moving quickly, treat it as something to verify in the current documentation rather than assume details.

14API Gateway Compared with Related Options

Choosing the right tool saves months of regret.

The family of Google Cloud API products

Option 1

API Gateway

Managed, lightweight front door focused on serverless backends, with authentication, quotas and monitoring.

Option 2

Cloud Endpoints

A related product where you deploy and run the proxy yourself next to your service, giving more control and more work.

Option 3

Apigee

A full API management platform with developer portals, advanced policies, analytics and monetization for large API programs.

Option 4

Load balancer

Distributes traffic and can front services, but does not by itself provide API-specific features like keys and quotas.

QuestionAPI GatewayCloud EndpointsApigee
Who runs the proxyGoogle, fully managedYouGoogle or hybrid, as a platform
Best backendsServerless servicesServices on Kubernetes, VMs or similarAlmost anything
Setup effortLowMediumHigher
Developer portal and monetizationLimitedLimitedStrong
Best forSmall and medium API frontsTeams wanting proxy controlLarge enterprise API programs

A simple way to choose

Choose API Gateway when

Your backends are serverless, you want authentication, quotas and logging with very little operations work, and you do not need a full developer portal.

Choose Cloud Endpoints when

Your services run on your own infrastructure and you want the proxy to sit right next to each one under your control.

Choose Apigee when

You run a large, strategic API program with many consumers, need advanced traffic policies, analytics, a developer portal or revenue from API usage.

“Pick the lightest gateway that still covers your real needs, and move up only when a genuine need appears.”
i
Practical Tip

Product capabilities and recommendations evolve. Before a major decision, read Google’s current comparison guidance and confirm that the features you rely on exist in the product you choose.

15Design Patterns That Work Well

Proven ways of arranging gateways and backends.

Single front door pattern

All external clients use one gateway hostname. Backends are reachable only through it. This is the simplest and most common arrangement, and it gives one place to enforce rules and watch traffic.

Backend for frontend pattern

Different client types, such as mobile apps and partner systems, get separate gateways or separate path groups, each shaped to what that audience needs, with different quotas and credentials.

Strangler pattern for legacy migration

A legacy system sits behind the gateway. Piece by piece, individual paths are rerouted to new services, until the old system serves nothing and can be retired. Clients never notice the change.

Environment separation pattern

Development, testing and production each get their own gateway and their own backends, with their own keys. Mistakes in testing cannot touch production.

Regional placement pattern

Gateways are placed in the regions closest to users and backends, to reduce delay. Multiple regional gateways can serve users in different parts of the world.

flowchart LR
    C[Clients] --> G[API Gateway]
    G -->|new paths| N[New services]
    G -->|remaining paths| L[Legacy system]
    L -.->|shrinks over time| N
        
FIG 7 — Strangler pattern: move paths to new services gradually

Anti-patterns to avoid

ANTI-PATTERN-03 Avoid
Problem

Putting heavy business logic, data transformation and orchestration inside the gateway layer.

Why It’s Harmful

The gateway becomes a fragile, hard-to-test mini application. Logic spread between the gateway and backends confuses ownership and slows change.

Correct Approach

Keep the gateway thin: identity, limits, routing and logging. Put business rules in backend services where they can be tested and versioned.

ANTI-PATTERN-04 Avoid
Problem

Sharing one gateway across unrelated teams with a single huge specification that everyone edits.

Why It’s Harmful

Every change risks breaking someone else’s API, and deployments become slow negotiations between teams.

Correct Approach

Give independent product areas their own API and gateway, or clearly split ownership of path groups and review changes together.

16Advantages and Trade-offs

An honest look at strengths and limits.

Advantages

  • Fully managed, so there are no proxy servers to patch or scale
  • Consistent authentication in front of many backends
  • Built-in quotas and API key support for fair use
  • Natural fit with Cloud Run, Cloud Run functions and App Engine
  • Central logs, latency and error metrics in one place
  • Immutable configs make rollback simple
  • Growing support for exposing APIs to AI agents

Disadvantages / Trade-offs

  • Not a full request validator, since many definitions are accepted but not enforced
  • Some security combinations are not supported
  • Specification restrictions, such as whole-segment paths and no external references
  • Lighter feature set than a full platform like Apigee, for example for developer portals
  • Regional resource, so global designs need multiple gateways
  • Preview features may change before they become stable

Reading the trade-offs correctly

The gateway trades breadth for simplicity. It does a focused set of jobs, and does them without asking you to run anything. If your needs fit inside that set, you gain speed and calm. If your needs grow beyond it, you may eventually move some APIs to a bigger platform, and the clean separation between gateway and backend makes that move easier than it would otherwise be.

17Best Practices and Common Mistakes

Habits that keep gateways safe, simple and dependable.

Best practices

Practice 1

Specification in version control

Treat the OpenAPI file as source code, reviewed and deployed automatically.

Practice 2

Lock every backend

Require authenticated calls and allow only the gateway’s service account.

Practice 3

Least privilege

Give the gateway’s identity only the permissions it truly needs.

Practice 4

Validate in the backend

Do not rely on the gateway to enforce parameter rules or scopes.

Practice 5

Use stable public paths

Keep client-facing addresses steady even when backends change.

Practice 6

Label configs clearly

Use version or date labels so rollbacks are quick and obvious.

Practice 7

Alert on meaningful signals

Watch server error rate, latency and sudden traffic drops.

Practice 8

Separate environments

Use distinct gateways, backends and keys for testing and production.

Common mistakes

!
Mistake 1

Embedding API keys in public web pages or mobile apps and treating them as secrets. Anyone can extract them.

!
Mistake 2

Forgetting that a new API config does nothing until the gateway is updated to use it.

!
Mistake 3

Designing around security combinations that the product does not support, and discovering it only at deployment time.

!
Mistake 4

Skipping end-to-end tests with and without valid credentials, so a misconfigured rule goes unnoticed until real users arrive.

!
Mistake 5

Setting backend deadlines too short or too long, causing either false failures or clients that hang.

18Real-World Scenarios

Seeing the gateway in familiar situations makes the ideas stick.

A mobile app for an online grocery store

The app talks to one gateway hostname for products, carts and orders. Behind it, each area is a small Cloud Run service. The gateway checks tokens, limits abusive clients and records every call, while the team ships new backend versions without app updates.

A partner integration for a logistics company

Delivery partners receive API keys with set quotas, so one partner’s nightly bulk upload cannot starve the others. The company can see usage per partner from the logs and discuss limits with real numbers.

A bank modernizing a legacy system

Old services stay behind the gateway while new ones are built. Path by path, traffic moves to the new services. Customers never see a change of address, and the gateway’s logs help prove that each cutover went smoothly.

A startup exposing a small public API

A tiny team publishes a handful of functions as a public API for developers. The gateway gives them keys, quotas and monitoring without hiring anyone to run proxy servers.

A company opening tools to AI assistants

A support team already has a REST API for looking up orders and refund status. By enabling the agent feature on a gateway, assistants can discover and call those operations through the same authentication and logging, without a separate server being built.

1
Public entry point
Many
Backends behind it
0
Proxy servers for you to run

19Cost Thinking and Planning Checklist

Understanding what you pay for, and what to prepare before you start.

How to think about cost

API Gateway pricing is based on usage, mainly the number of calls that pass through the gateway, and exact rates and any free allowances can change, so check the official pricing page before estimating. Remember that the gateway is only part of the bill. Your backends, such as Cloud Run services, have their own costs, and so do logging and network traffic. A fair comparison with alternatives should include the staff time saved by not running a proxy yourself.

i
Money Tip

Rejecting bad requests at the gateway also saves money, because blocked calls never wake up or consume your backends.

A planning checklist

1

List your APIs and audiences

Know who calls what: mobile apps, partners, internal teams, or agents, since each may need different credentials and limits.

2

Choose the specification version

Read the limitations for that version and confirm every feature you need is available.

3

Design security

Decide how clients prove identity, which operations need tokens, and how backends will trust only the gateway.

4

Set quotas and deadlines

Pick fair limits per caller and sensible timeouts per backend.

5

Pick region and environments

Place gateways near users and backends, and plan separate environments for testing and production.

6

Plan observability and rollback

Prepare dashboards, alerts and a clear rollback routine before the first real user arrives.

20Frequently Asked Questions

Q1Is API Gateway the same as Cloud Endpoints?

No. They share authentication syntax and related technology, but API Gateway is fully managed by Google, while with Cloud Endpoints you deploy and operate the proxy yourself.

Q2Does the gateway store my data?

The gateway is a pass-through layer for requests. It records logs and metrics about calls, but your application data lives in your own backends and databases.

Q3Can one gateway front several different backends?

Yes. A single API config can send different paths to different backends, such as Cloud Run services, functions or App Engine apps.

Q4Will the gateway reject a request that omits a required parameter?

Not necessarily. Documentation says required flags and similar definitions are accepted but not enforced, so the backend must validate its own inputs.

Q5Are OAuth scopes enforced by the gateway?

Scopes may appear in the specification, but they are accepted without being checked. Enforce fine-grained permissions in your backend.

Q6How do I roll back a bad change?

Point the gateway back to the previous API config. Because configs are saved snapshots, this is quick and low risk.

Q7Is an API key enough to secure my API?

Usually not for sensitive data. Keys identify applications, not people, and are easy to copy. Combine them with signed tokens when identity matters.

Q8Can I use OpenAPI 3 with API Gateway?

Yes, OpenAPI 3.x support is documented along with its own limitations and extensions. Newer agent features are described only for 3.0.x and 3.1.x.

Q9What is the MCP feature, and is it ready for production?

It lets the gateway expose REST operations as tools for AI agents. It was announced as a public preview in September 2026, so check current documentation and test carefully before relying on it.

Q10When should I choose Apigee instead?

Choose it when you need a full API management platform, such as developer portals, advanced policies, deep analytics or monetization, for a large API program.

Q11Is the gateway global?

A gateway is deployed in a specific region. For users spread around the world, you can deploy gateways in several regions.

Q12Do I still need to secure my backends?

Yes. Require authenticated calls on the backend and allow only the gateway’s service account, so nobody can bypass the gateway.

21Summary and Key Takeaways

API Gateway in Google Cloud gives your backend services a single, well-guarded public face. You describe your API in an OpenAPI specification, store it as an API config, and deploy it to a regional gateway that checks credentials, enforces quotas, routes requests, and records everything. It pairs naturally with serverless backends, keeps your public addresses stable while the services behind them evolve, and now reaches into the world of AI agents through its preview support for exposing operations as tools. Its strength is focused simplicity, and its limits, such as unenforced parameter definitions and restricted security combinations, mean that your backends must still validate inputs and enforce business permissions. Used as a thin, well-configured outer wall, it saves effort and improves safety. Always confirm current features, limits and pricing in the official documentation before committing to a design.

Key Takeaways

  • One managed front door — clients call one stable address while Google runs the gateway infrastructure for you.
  • API, API config, gateway — the API is the container, each config is a saved snapshot of rules, and the gateway serves one chosen config in one region.
  • The specification is the blueprint — OpenAPI describes paths, security and backends, but some definitions are accepted without being enforced.
  • Layered security — verify clients at the gateway, lock backends to the gateway’s identity, and still validate inside the backend.
  • Quotas protect fairness — use keys and limits to identify callers and prevent overload, but never treat them as proof of identity.
  • Observe everything — logs, latency and error metrics at the gateway give one clear view of your whole API surface.
  • Choose the lightest tool that fits — API Gateway for simple managed fronts, Cloud Endpoints for self-run proxies, Apigee for full API programs.