vLLM is a high-throughput and memory-efficient inference and serving engine for LLMs. When vLLM is configured to use Mooncake, unsafe deserialization exposed directly over ZMQ/TCP on all network interfaces will allow attackers to execute remote code on distributed hosts. This is a remote code execution vulnerability impacting any deployments using Mooncake to distribute KV across distributed hosts. This vulnerability is fixed in 0.8.0.
The product deserializes untrusted data without sufficiently ensuring that the resulting data will be valid.
| Link | Tags |
|---|---|
| https://github.com/vllm-project/vllm/security/advisories/GHSA-x3m8-f7g5-qhm7 | vendor advisory |
| https://github.com/vllm-project/vllm/pull/14228 | issue tracking vendor advisory |
| https://github.com/vllm-project/vllm/commit/288ca110f68d23909728627d3100e5a8db820aa2 | patch |