LlamaStash

介紹

Zero-overhead, terminal-native local-LLM runtime manager. Launches, supervises, and routes local models behind one OpenAI-compatible endpoint.

翻譯準備中

取自儲存庫 README

README

正在載入完整 README。 以下為已儲存的摘錄。

Zero-overhead, terminal-native local-LLM manager. A fast TUI and CLI with init wizard for managing local LLMs. One Rust binary that's a TUI, a CLI, a daemon, and an OpenAI-compatible proxy. llama.cpp is the direct, zero-overhead default backend (vs raw llama-server), plus Lemonade for NPU / multi-engine inference, vLLM and SGLang for safetensors, and a generic backend that runs any other OpenAI-compatible server you declare in config, like ds4 for DeepSeek-V4. See benchmarks.