Measurements

Numbers we measured ourselves.

Every figure on this page comes from a run we did, on a stated date, with the raw data published next to it. When we repeat a run, the new figure is added and the old one stays, marked as superseded.

Measured 5 October 2026

OpenAPI and Swagger specifications to MCP tools

How many public OpenAPI specifications convert into MCP tools?

Gatana converted 299 of 300 randomly selected public OpenAPI and Swagger specifications sampled from apis.guru into MCP tools (99.7%), and every operation became a tool. The one failure is a webhook specification with no paths. The median input schema per tool is 1,424 bytes. Measured on 5 October 2026.

 First runAfter the fix
Specifications converted262 of 300 (87.3%)299 of 300 (99.7%)
Swagger 2.0121 of 122122 of 122
OpenAPI 3.x141 of 178177 of 178
Tools generated6,96410,834
Largest specificationNetBox, 386 toolsGitHub REST API, 845 tools
Conversion time per specification, median (maximum)0.2 s (8 s)0.15 s (3.7 s)
Input schema per tool, median11,276 bytes1,424 bytes
Input schema per tool, 90th percentile94,668 bytes4,808 bytes
Tool names over 64 charactersnot counted84 of 10,834 (0.8%)

How we measured it

A sample of 300 specifications from apis.guru (122 Swagger 2.0, 178 OpenAPI 3.x, seed 20261005), each created as an OpenAPI server in one Gatana organization through the public API, the tools refreshed and read back. The first run converted 262. All but one of the 38 failures were defects in our converter, fixed the same day; the table shows both runs.

Full write-up: We Converted 300 Public OpenAPI Specs to MCP Tools. Here Is What Broke.
Raw data: CSV, 300 rows: the sample, both result sets, schema sizes and the error texts

Measured 7 October 2026

Latency added by the gateway

How much latency does the Gatana gateway add to a tool call?

Gatana added 6.6 ms per tool call in our test on 7 October 2026, after a release that keeps the caller lookups in the gateway process for 30 seconds, with the gateway and the upstream server on MCP revision 2026-07-28. Against a 2025-era upstream the same build added 9.6 ms. Measured on a Hetzner machine with an AMD Ryzen™ 5 3600, warm sequential calls inside one cluster.

MeasurementRun 1Run 2Run 3
Direct echo, public hostname, median1.5 ms1.4 ms1.5 ms
Through the gateway to echo, 2026-07-28 upstream, median7.9 ms8.3 ms8.1 ms
Through the gateway to echo, 2026-07-28 upstream, 95th percentile26.1 ms21.0 ms46.0 ms
Through the gateway to echo, 2026-07-28 upstream, 99th percentile38.2 ms38.5 ms65.5 ms
Gateway median minus direct median6.4 ms6.9 ms6.6 ms
Through the gateway to echo, 2025-era upstream, median12.2 ms10.9 ms10.5 ms
Successful built-in call with no upstream, median6.9 ms7.1 ms7.5 ms

How we measured it

21,900 successful timed calls from a probe inside the same cluster as the gateway and echo MCP server, hosted on Hetzner with an AMD Ryzen™ 5 3600 processor. Three interleaved repetitions used kept-alive connections and 20 warm-up calls per run. Every gateway path ran with a 2025-era client and with a 2026-07-28 client, against an upstream recorded as 2025-era and against the same echo server recorded as 2026-07-28. The estimate is the median of the three differences between the gateway median and the direct public median of the same client era: 6.4, 6.9 and 6.6 ms for the all-2026 path, 10.7, 9.6 and 9.2 ms with a 2025-era upstream. It is not a percentile of individual request overhead or a concurrent-load test.

Full write-up: How Much Latency Does an MCP Gateway Add? 6.6 Milliseconds in Our Latest Test.
Raw data: JSON: all 27 runs, percentiles, hardware, both protocol eras, and the overhead calculation

Measured 7 October 2026, superseded by a later run the same day

Latency added by the gateway

How much latency does the Gatana gateway add to a tool call?

Gatana added 9.5 ms per tool call in our test on 7 October 2026, with the gateway and the upstream server on MCP revision 2026-07-28, which has no per-call handshake. Against a 2025-era upstream the same build added 13.5 ms. Measured on a Hetzner machine with an AMD Ryzen™ 5 3600, warm sequential calls inside one cluster.

MeasurementRun 1Run 2Run 3
Direct echo, public hostname, median1.4 ms1.4 ms1.5 ms
Through the gateway to echo, 2026-07-28 upstream, median10.9 ms10.7 ms11.1 ms
Through the gateway to echo, 2026-07-28 upstream, 95th percentile22.7 ms21.6 ms23.4 ms
Through the gateway to echo, 2026-07-28 upstream, 99th percentile35.8 ms30.8 ms55.0 ms
Gateway median minus direct median9.5 ms9.3 ms9.6 ms
Through the gateway to echo, 2025-era upstream, median14.9 ms14.3 ms15.0 ms
Successful built-in call with no upstream, median10.0 ms11.0 ms10.4 ms

How we measured it

21,900 successful timed calls from a probe inside the same cluster as the gateway and echo MCP server, hosted on Hetzner with an AMD Ryzen™ 5 3600 processor. Three interleaved repetitions used kept-alive connections and 20 warm-up calls per run. Every gateway path ran with a 2025-era client and with a 2026-07-28 client, against an upstream recorded as 2025-era and against the same echo server recorded as 2026-07-28. The estimate is the median of the three differences between the gateway median and the direct public median of the same client era: 9.5, 9.3 and 9.6 ms for the all-2026 path, 13.5, 13.1 and 13.6 ms with a 2025-era upstream. It is not a percentile of individual request overhead or a concurrent-load test.

Full write-up: How Much Latency Does an MCP Gateway Add? 9.5 Milliseconds in Our Latest Test.
Raw data: JSON: all 27 runs, percentiles, hardware, both protocol eras, and the overhead calculation

Measured 7 October 2026, superseded by a later run the same day

Latency added by the gateway

How much latency does the Gatana gateway add to a tool call?

Gatana added about 14 ms per tool call in our test on 7 October 2026. Gatana was deployed on a Hetzner dedicated machine with an AMD Ryzen™ 5 3600 processor. Across three paired runs, the added latency estimate was 13.4 ms. The gateway path had a 14.8 ms median against 1.4 ms direct. These are warm sequential calls inside one cluster.

MeasurementRun 1Run 2Run 3
Direct echo, public hostname, median1.4 ms1.5 ms1.4 ms
Through the gateway to echo, median15.8 ms14.4 ms14.8 ms
Through the gateway to echo, 95th percentile44.4 ms33.4 ms35.9 ms
Through the gateway to echo, 99th percentile96.6 ms96.2 ms73.9 ms
Gateway median minus direct median14.4 ms12.9 ms13.4 ms
Successful built-in call with no upstream, median10.8 ms9.7 ms9.8 ms

How we measured it

8,400 successful timed calls from a probe inside the same cluster as the gateway and echo MCP server, hosted on Hetzner with an AMD Ryzen™ 5 3600 processor. Three interleaved repetitions used kept-alive connections and 20 warm-up calls per run. Each repetition had 1,000 direct public echo calls, 1,000 gateway echo calls, 500 successful skills_list_skills calls, and 300 direct internal echo calls. The overhead estimate is the median of the three differences between gateway and direct public path medians: 14.4, 12.9, and 13.4 ms. It is not a percentile of individual request overhead or a concurrent-load test.

Full write-up: How Much Latency Does an MCP Gateway Add? About 14 Milliseconds in Our Latest Test.
Raw data: JSON: all 12 runs, percentiles, hardware, and the overhead calculation

Measured 5 October 2026, superseded by the run of 7 October 2026

Latency added by the gateway

How much latency does the Gatana gateway add to a tool call?

A tool call through the Gatana gateway took 30.3 ms at the median against 1.4 ms for the same call made directly, so the gateway adds about 29 ms for authentication, authorization, tool resolution and the audit record. A real tool call takes 1.0 s at the median, so the overhead is about 3%. Measured on 5 October 2026.

PathMorning, median (95th pct.)Afternoon after the change, median (95th pct.)
Direct to the server, public hostname1.2 to 1.4 ms (1.7 to 1.8 ms)1.2 to 1.4 ms (1.6 to 1.7 ms)
Through the gateway to the same server53.4 to 53.8 ms (64.8 to 66.9 ms)30.3 to 31.2 ms (37.4 to 41.9 ms)
Through the gateway, built-in tool with no upstream server45.6 ms (57.0 ms)21.9 ms (27.3 ms)
Gateway overhead per callabout 52 msabout 29 ms
Share of a real tool call (1.0 s median, 2.8 s 90th pct.)5% at the median3% at the median, 1% at the 90th percentile

How we measured it

10,800 tool calls from a probe pod to an echo MCP server in the same cluster as a gateway, over one kept-alive connection after 20 warm-up calls, direct and through the gateway. Measured in the morning and again after a change to the gateway's per-call path the same afternoon. The real-call baseline is the audit log of one customer organization, used with its consent.

Full write-up: How Much Latency Does an MCP Gateway Add? We Measured Ours: 52 Milliseconds, Then 29.
Raw data: JSON: every run with its percentiles, morning and afternoon

Measured 5 October 2026

Code mode against direct tool calls

How many tokens does code mode save against direct tool calls?

On two tasks with more data than a model should hold in context, code mode used 4 to 44 times fewer prompt tokens than direct tool calls (30,458 against 1.33 million on the largest task) and 17 to 51 times less wall time. At Claude Opus 5.5 prices the largest task saves 7.73 USD per run. The data stays in the sandbox; only the result reaches the model. Measured on 5 October 2026 with DeepSeek-V4.1-Flash.

TaskModeCorrectPrompt tokens (median)Seconds (median)USD per run, DeepSeekUSD per run, Claude Opus 5.5 prices
Revenue by region, 10,000 ordersDirect2 of 51,330,4606170.3897.88
Code mode5 of 530,458120.0030.15
Word counts, 40 documentsDirect0 of 5242,6303180.1032.32
Code mode5 of 559,153190.0060.27
Five largest of 500 filesDirect5 of 531,11060.0060.14
Code mode5 of 517,67090.0030.09

How we measured it

A synthetic server with four data tools (10,000 orders, 500 files, 40 documents of 65,000 words) and three tasks with answers known in advance. DeepSeek-V4.1-Flash at temperature 0 ran each task five times with the four tools exposed directly and five times through Gatana's two code mode tools, 30 runs in all. Correctness was checked against ground truth computed outside the model. The DeepSeek cost is at DeepSeek list prices. The Claude Opus 5.5 cost prices the median prompt and completion tokens of each task at list prices, 4 USD per million input tokens and 20 USD per million output tokens, with no cache discount.

Full write-up: Code Mode vs. Direct Tool Calls: The Same Three Tasks, Five Times Each
Raw data: JSON: all 30 runs with tokens, tool calls, time and the answer given

How we measure

  • Every figure has a date. Software changes, and a number without a date is a claim. The gateway latency figure changed within one day.
  • The raw data is published next to the figure, as CSV or JSON, so anyone can check the arithmetic or repeat the run.
  • We measure Gatana, not competitors. The direct-call figures are the baseline, not a rival product.
  • Customer data appears only as aggregates, with the organization's consent, never per record.
  • A repeated run does not overwrite the old one. The old figure stays on this page, marked as superseded, with the date of the new run.

Reading this with a script or an agent?

The same figures are published as Markdown at gatana.ai/measurements.md.

Your team, AI Ready.

Free for up to five users. A 14-day Pro trial for larger teams, no credit card. Or talk to us about running Gatana on your own infrastructure.