Chisle
The coding-agent plugin that bills 52% of a bare model across 20 live tasks. Terse persona + tool-output compressor + context diet.
翻訳待ち
No updates detected yet. GitHub releases will appear here.
LLM speculative inference server for heterogeneous hardware & consumer GPUs
翻訳待ち
Loading the full README. The saved excerpt is shown below.
Speculative inference for heterogeneous machines and consumer GPUs. Custom kernels, speculative prefill and decoding, tuned for each model and hardware target. Model links open the exact weights used [README 설치·사용 부분 발췌] Quick Start With Docker Prebuilt images on GHCR track main. Mount the weights and serve the OpenAI-compatible API on :8000.Read the full README ↗
The full README is unavailable right now. Read it at the original link. The saved excerpt is shown below.
Speculative inference for heterogeneous machines and consumer GPUs. Custom kernels, speculative prefill and decoding, tuned for each model and hardware target. Model links open the exact weights used [README 설치·사용 부분 발췌] Quick Start With Docker Prebuilt images on GHCR track main. Mount the weights and serve the OpenAI-compatible API on :8000.Read the full README ↗