Chisle
The coding-agent plugin that bills 52% of a bare model across 20 live tasks. Terse persona + tool-output compressor + context diet.
翻訳待ち
A programmable Mixture-of-Models router for heterogeneous LLM inference
翻訳待ち
開発ツールGo · PythonGitHub @vllm-project自分でインストール所有者未確認
Paste into Claude or ChatGPT for installation instructions suited to your environment.
Have you tried it? One tap is enough. No sign-in needed.
Loading the full README. The saved excerpt is shown below.
Make Your Mixture-of-Models Programmable.
vLLM Semantic Router is a programmable routing layer for building Mixture-of-Models systems across heterogeneous LLM infrastructure. It evaluates request signals, user preferences, and application policies to select—or compose—the right model path for each request.
Use it to improve quality, cost, latency, privacy, and safety without hard-coding routing logic into applications.
For pip, uv, or agent-driven installation, see the Installation Guide.
Try the online playground at.
• Username: [email protected]
• Password: vllm-sr-readRead the full README ↗The full README is unavailable right now. Read it at the original link. The saved excerpt is shown below.
Make Your Mixture-of-Models Programmable.
vLLM Semantic Router is a programmable routing layer for building Mixture-of-Models systems across heterogeneous LLM infrastructure. It evaluates request signals, user preferences, and application policies to select—or compose—the right model path for each request.
Use it to improve quality, cost, latency, privacy, and safety without hard-coding routing logic into applications.
For pip, uv, or agent-driven installation, see the Installation Guide.
Try the online playground at.
• Username: [email protected]
• Password: vllm-sr-readRead the full README ↗