Chisle
The coding-agent plugin that bills 52% of a bare model across 20 live tasks. Terse persona + tool-output compressor + context diet.
翻訳待ち
TokenSpeed is a speed-of-light LLM inference engine designed from first principles for agentic workloads, with a compiler-backed modeling mechanism for parallelism, a high performance scheduler, a saf
翻訳待ち
開発ツールPython · C++GitHub @lightseekorgオンライン所有者未確認
Have you tried it? One tap is enough. No sign-in needed.
TokenSpeed is a speed-of-light LLM inference engine.
翻訳待ち
Loading the full README. The saved excerpt is shown below.
TokenSpeed is a speed-of-light LLM inference engine designed for agentic workloads, with TensorRT-LLM-level performance and vLLM-level usability. Our goal is to be the most performant inference engine for production agentic workloads.Read the full README ↗The full README is unavailable right now. Read it at the original link. The saved excerpt is shown below.
TokenSpeed is a speed-of-light LLM inference engine designed for agentic workloads, with TensorRT-LLM-level performance and vLLM-level usability. Our goal is to be the most performant inference engine for production agentic workloads.Read the full README ↗