UTC
Medium

vLLM: extract_hidden_states speculative decoding crashes server on any request with penalty parameters

CVE-2026-44223 · GHSA-83vm-p52w-f9pw · published 2026-05-06 · updated 2026-06-08

Severity
Medium
CVSS score
6.5
Chance of exploitation (EPSS)
0.37%
Fixed in
0.20.0
  • Exploitation Public proof of concept
  • Automatable No
  • Technical impact Partial
  • CISA SSVC
What it is

Any vLLM deployment between v0.18.0 and v0.19.1 (inclusive) configured with extracthiddenstates speculative decoding is affected. A single API request containing any penalty parameter immediately and permanently crashes the EngineCore process, resulting in complete loss of service availability.

What to do

Upgrade vllm to 0.20.0 or later. If you start it from an MCP config with npx or uvx, pin that version so an old cached copy is not used.

Fixed in PR #38610, first included in vLLM v0.20.0. The fix slices the return value to sampledtokenids[:, :1], ensuring the correct (batch_size, 1) shape regardless of the rejection sampler's output dimensions.

If you cannot upgrade yet

Upgrade to vLLM v0.20.0 or later. If upgrading is not possible, avoid using extracthiddenstates as the speculative decoding method on affected versions. Alternatively, reject or strip penalty parameters (repetitionpenalty, frequencypenalty, presence_penalty) from incoming requests at an API gateway before they reach vLLM.

Affected
PackageRegistryAffectedFixed in
vllmPyPI>= 0.18.0, < 0.20.00.20.0

The impact, patch and workaround text comes from the advisory, shortened (GitHub Advisory Database, CC BY 4.0). Proof-of-concept and reproduction sections and code are left out; the original advisory has them.

Sources: GitHub Advisory Database, reviewed and malware advisories (CC BY 4.0, https://github.com/advisories); advisories published by Cursor (https://github.com/cursor/cursor/security/advisories); advisories published by OpenClaw (https://github.com/openclaw/openclaw/security/advisories); advisories published by vLLM (https://github.com/vllm-project/vllm/security/advisories); advisories published by Open WebUI (https://github.com/open-webui/open-webui/security/advisories); advisories published by n8n (https://github.com/n8n-io/n8n/security/advisories); advisories published by Flowise (https://github.com/FlowiseAI/Flowise/security/advisories); advisories published by Langflow (https://github.com/langflow-ai/langflow/security/advisories); advisories published by the MCP Python SDK project (https://github.com/modelcontextprotocol/python-sdk/security/advisories); advisories published by MLflow (https://github.com/mlflow/mlflow/security/advisories); CISA Known Exploited Vulnerabilities catalog (CC0). Data as of 2026-11-22. ShieldMap describes how each problem works and how to fix it; it does not publish exploit code. Report a correction to [email protected].