资讯
Meet Switchyard: A Rust Proxy and Library That Routes and Translates LLM Traffic Across OpenAI and Anthropic APIs
📌 概要
NVIDIA开源Switchyard，一个Apache-2.0协议的Rust代理与库，用于LLM流量路由。它将请求解码为供应商中立类型，支持透传、随机、LLM分类器和阶段路由等算法，并把响应翻译回客户端格式，使Claude Code或Codex CLI无需改动即可对接vLLM、NIM或Ollama。项目目前处于pre-alpha阶段，尚不可用于生产环境。
⚡ 关键要点
- ▸NVIDIA发布开源Rust代理Switchyard，统一路由OpenAI与Anthropic格式的LLM流量
- ▸支持passthrough、随机、LLM分类器、stage-router等多种路由算法
- ▸可让Claude Code、Codex CLI等客户端无缝对接vLLM、NIM、Ollama后端
- ▸项目为pre-alpha阶段，明确不建议生产使用
NVIDIA has released Switchyard, an Apache-2.0 Rust proxy and library for LLM traffic. It decodes requests into provider-neutral types, routes them with passthrough, random, LLM-classifier, or stage-router algorithms, and translates responses back into the client's format, so Claude Code or Codex CLI can run against vLLM, NIM, or Ollama unchanged. The project is pre-alpha and not for production.
The post Meet Switchyard: A Rust Proxy and Library That Routes and Translates LLM Traffic Across OpenAI and Anthropic APIs appeared first on MarkTechPost.