Pion

介绍

Pion — the memory engine for AI inference

翻译准备中

取自仓库 README

README

正在加载完整 README。 以下为已保存的摘录。

Pion — The Memory Engine for AI Inference 📚 Documentation: doc/index.md — full reference. Pion remembers what your model already read: prefill a long prompt once, and every later request, from any process and even after a crash, starts at the first new token. It is a memory engine for AI inference — one small Mojo binary that holds the prompt's K/V cache, and the rest of a model's working memory, and serves it over the Redis wire.