Evalution
Evalution is a local-first development tool. Maintain your prompts directly in your codebase, and
use the web playground to edit parameters, switch models, and see results in real
time, so what you test is exactly what ships.
📖 Documentation: evalut.io/n/docs
Features
- 🔍 Auto-discovery — scans your project for
.prompt.ts files
- 🔄 Always in sync — edit prompts in the UI or directly in the source files; they always stay in sync
- 🎯 Type-safe — full TypeScript support with parameter inference
- 🔌 Multi-provider — Vercel AI SDK is fully supported, or wire up a different SDK adapter
- 📊 Tracing — traces for your prompt runs populate in realtime
- 🤖 MCP server —
npx evalution mcp lets coding agents run prompts, query traces with SQL, annotate them, and build datasets
- 🧩 Extensible — swap in your own prompt sources, SDK adapters, and trace backends
Getting started
Run this in the root of your project:
npx evalution
Requires Node.js 22.18.0 or higher.
See the documentation for more detailed guidance.
Development
- Install dependencies:
npm install
- Run server and client against the evalution check out:
npm run dev
- Run against a different path:
npm run dev:server -- ui <path>
npm run dev:client
Other useful commands:
npm test — run unit tests (npm run test:coverage for coverage)npm run test:ui — run Playwright component testsnpm run typecheck — type-check the projectnpm run docs — regenerate the API referencenpm run build — build the server and client
License
AGPL
