AI Agent Testing and Evaluation

AI agent testing and evaluation that turns unpredictable agents into reliable production systems, with simulations, evals, observability, and governance.

Developer toolsTypeScript · GherkinGitHub @langwatchOnlineOwner unconfirmed

Visit project GitHub

Have you tried it? One tap is enough. No sign-in needed.

Availability: Online; 30-day uptime 99.1%
Latest code update: Oct 27; Active repository
Latest version: langwatch-3.21.0; Oct 22
Contributors: 36; Forks 420
License: License information
This summarizes common license conditions. Check the repository LICENSE, per-file notices, and additional terms for actual conditions.
Information shown for this project
GitHub auto-detection · main repository license
Apache-2.0
Provided license information ↗
Repository observations do not verify all per-file terms, multiple licenses, or dependencies.
Information at the observation time · Last successful collection Oct 27, 03:35 · Last failed collection Sep 20, 01:53 (Korea time)
Check LICENSE in the repository ↗
Common license comparison
The listed licenses allow commercial use when their conditions are met. Check originals for multiple, custom, or unidentified licenses. Scroll the table horizontally on narrow screens.
Commercial use, modification/redistribution, source obligations, and key conditions of common licenses. Names link to official texts.
License · original Commercial use Modification / redistribution Source obligations Key conditions
MIT ↗ Allowed Allowed No source distribution obligation Keep copyright and permission notices in copies/substantial portions
Apache-2.0 ↗ Allowed Allowed No source distribution obligation Keep license, relevant notices and NOTICE; mark modifications. Includes patent grants and termination on patent litigation
BSD-2-Clause ↗ Allowed Allowed No source distribution obligation Keep copyright, conditions and disclaimers in source or binary documentation/materials
BSD-3-Clause ↗ Allowed Allowed No source distribution obligation BSD-2 terms, plus no use of copyright holder/contributor names for endorsement without permission
ISC ↗ Allowed Allowed No source distribution obligation Keep copyright and permission notices in all copies
GPL-2.0 ↗ Allowed Allowed under GPL terms Provide corresponding source for the program/derivatives when distributing Distribute under GPL; keep copyright, license and change notices. Mere aggregation is excluded
GPL-3.0 ↗ Allowed Allowed under GPL terms Provide corresponding source for the program/derivatives when distributing Distribute under GPL; retain notices and mark modifications. Patent terms; provide modified-version installation information for covered consumer products
LGPL-2.1 ↗ Allowed Allowed under LGPL terms Provide source for the library/modifications when distributing the library Apps may link under other licenses; allow library replacement/relinking and reverse engineering to debug modifications
LGPL-3.0 ↗ Allowed Allowed under LGPL terms Provide source for the library/modifications when distributing the library Apps may link under other licenses; ensure replacement, relinking and reverse engineering for debugging modifications; provide installation information for covered products
MPL-2.0 ↗ Allowed Allowed under MPL terms Provide source for MPL-covered files and modifications when distributing Retain MPL and notices at file level; separate files without MPL code may use other licenses
AGPL-3.0 ↗ Allowed Allowed under AGPL terms Provide corresponding source when distributing; offer remote users of modified versions free source access Distribution terms similar to GPL-3.0, plus source-access instructions for network users of modified programs
Unlicense ↗ Allowed Allowed No source distribution obligation Dedicate copyright to the public domain; check the original and limits permitted by law
CC0-1.0 ↗ Allowed Allowed No source distribution obligation Waive copyright and related rights, with fallback permission if ineffective; excludes patents and trademarks
For GPL/LGPL/AGPL, -only permits that version only; -or-later allows that or a later version. Do not infer later-version permission from a label without a version and suffix. Source obligations apply to recipients/users under the terms and do not always require publishing to the entire internet.
GitHub license detection and display guide ↗; GitHub auto-detection · Previous observation · Collected Oct 27
Listed on nomorevibe: Sep 13; Repository created September 2023
Valid visits · last 7 days: 1; Unique 1

Languages

TypeScript 77.1%
Gherkin 9.7%
Go 8.7%
Python and others 4.5%

Updates24 in the last 30 days

All

Oct 22langwatch-3.21.0GitHub release ↗
Oct 22mcp-server: v2.2.0GitHub release ↗
Oct 22v3.21.0GitHub release ↗

AI Agent Testing and Evaluation

AI agent testing and evaluation that turns unpredictable agents into reliable production systems, with simulations, evals, observability, and governance.

Developer toolsTypeScript · GherkinGitHub @langwatchOnlineOwner unconfirmed

Visit project GitHub

Have you tried it? One tap is enough. No sign-in needed.

Availability: Online; 30-day uptime 99.1%
Latest code update: Oct 27; Active repository
Latest version: langwatch-3.21.0; Oct 22
Contributors: 36; Forks 420
License: License information
This summarizes common license conditions. Check the repository LICENSE, per-file notices, and additional terms for actual conditions.
Information shown for this project
GitHub auto-detection · main repository license
Apache-2.0
Provided license information ↗
Repository observations do not verify all per-file terms, multiple licenses, or dependencies.
Information at the observation time · Last successful collection Oct 27, 03:35 · Last failed collection Sep 20, 01:53 (Korea time)
Check LICENSE in the repository ↗
Common license comparison
The listed licenses allow commercial use when their conditions are met. Check originals for multiple, custom, or unidentified licenses. Scroll the table horizontally on narrow screens.
Commercial use, modification/redistribution, source obligations, and key conditions of common licenses. Names link to official texts.
License · original Commercial use Modification / redistribution Source obligations Key conditions
MIT ↗ Allowed Allowed No source distribution obligation Keep copyright and permission notices in copies/substantial portions
Apache-2.0 ↗ Allowed Allowed No source distribution obligation Keep license, relevant notices and NOTICE; mark modifications. Includes patent grants and termination on patent litigation
BSD-2-Clause ↗ Allowed Allowed No source distribution obligation Keep copyright, conditions and disclaimers in source or binary documentation/materials
BSD-3-Clause ↗ Allowed Allowed No source distribution obligation BSD-2 terms, plus no use of copyright holder/contributor names for endorsement without permission
ISC ↗ Allowed Allowed No source distribution obligation Keep copyright and permission notices in all copies
GPL-2.0 ↗ Allowed Allowed under GPL terms Provide corresponding source for the program/derivatives when distributing Distribute under GPL; keep copyright, license and change notices. Mere aggregation is excluded
GPL-3.0 ↗ Allowed Allowed under GPL terms Provide corresponding source for the program/derivatives when distributing Distribute under GPL; retain notices and mark modifications. Patent terms; provide modified-version installation information for covered consumer products
LGPL-2.1 ↗ Allowed Allowed under LGPL terms Provide source for the library/modifications when distributing the library Apps may link under other licenses; allow library replacement/relinking and reverse engineering to debug modifications
LGPL-3.0 ↗ Allowed Allowed under LGPL terms Provide source for the library/modifications when distributing the library Apps may link under other licenses; ensure replacement, relinking and reverse engineering for debugging modifications; provide installation information for covered products
MPL-2.0 ↗ Allowed Allowed under MPL terms Provide source for MPL-covered files and modifications when distributing Retain MPL and notices at file level; separate files without MPL code may use other licenses
AGPL-3.0 ↗ Allowed Allowed under AGPL terms Provide corresponding source when distributing; offer remote users of modified versions free source access Distribution terms similar to GPL-3.0, plus source-access instructions for network users of modified programs
Unlicense ↗ Allowed Allowed No source distribution obligation Dedicate copyright to the public domain; check the original and limits permitted by law
CC0-1.0 ↗ Allowed Allowed No source distribution obligation Waive copyright and related rights, with fallback permission if ineffective; excludes patents and trademarks
For GPL/LGPL/AGPL, -only permits that version only; -or-later allows that or a later version. Do not infer later-version permission from a label without a version and suffix. Source obligations apply to recipients/users under the terms and do not always require publishing to the entire internet.
GitHub license detection and display guide ↗; GitHub auto-detection · Previous observation · Collected Oct 27
Listed on nomorevibe: Sep 13; Repository created September 2023
Valid visits · last 7 days: 1; Unique 1

Languages

TypeScript 77.1%
Gherkin 9.7%
Go 8.7%
Python and others 4.5%

Updates24 in the last 30 days

All

Oct 22langwatch-3.21.0GitHub release ↗
Oct 22mcp-server: v2.2.0GitHub release ↗
Oct 22v3.21.0GitHub release ↗

README

LangWatch is the open-source platform for AI in production: trace, test, route and govern every LLM call in your company, from the agents you build to the coding assistants your engineers use. LangWatch is Apache 2.0. View docs.

Get started

LangWatch Cloud

Track your coding agents

npx langwatch claude  # or codex, copilot, opencode, ...

Self-host

npx @langwatch/server

Only Node.js 24 or newer required (macOS or glibc Linux). For production, see Self-hosting LangWatch.

Demo

What you get

LLM Ops: Observability · Agent Testing · Evaluations · Prompt Management
Coding Agents: sessions, cost per pull request and per team, privacy controls
AI Gateway: one OpenAI and Anthropic compatible endpoint, virtual keys, budgets, routing
AI Governance: every AI tool in the company, who uses it, anomaly rules

Things you can do with LangWatch

Create simulation tests for evaluating or benchmarking your agents and voice agents
Measure the cost per PR and optimize your Claude Code usage to get your weekly limits to last twice as long
Create virtual keys with budgets to hand out to your customers or employees
Find out that 40% of the Copilot Studio subscriptions are not actually being used at your company and cancel them

Integrations

Coding assistants: Claude Code · Codex · GitHub Copilot · opencode · Cursor · MCP server · more

Frameworks: LangChain · LangGraph · Vercel AI SDK · Mastra · CrewAI · Google ADK · DSPy · OpenTelemetry · more

Model providers: OpenAI · Anthropic · Azure OpenAI · Vertex AI · Bedrock · more

Governance sources: Copilot Studio · Claude Cowork · Anthropic and OpenAI compliance APIs · Workato · Databricks Genie · OpenTelemetry and S3 audit feeds · more

No-code platforms: LangFlow · Flowise · n8n · more

Contributing

Read CONTRIBUTING.md, then make quickstart. Bugs and feature requests go in GitHub issues, questions in Discord.

License

Apache 2.0. The enterprise modules under enterprise/ need a commercial license in production, and the SDKs are MIT. See Editions and licensing and LICENSE.md.

Security

GDPR compliant and ISO 27001 certified. Report vulnerabilities to [email protected].

Read the full README ↗

README

Loading the full README. The saved excerpt is shown below.

Read the full README ↗

AI Agent Testing and Evaluation

License information

Information shown for this project

Common license comparison

Languages

Updates24 in the last 30 days

AI Agent Testing and Evaluation

License information

Information shown for this project

Common license comparison

Languages

Updates24 in the last 30 days

Comments

Introduction

README

Get started

LangWatch Cloud

Track your coding agents

Self-host

Demo

What you get

Things you can do with LangWatch

Integrations

Contributing

License

Security

README

README

Get started

LangWatch Cloud

Track your coding agents

Self-host

Demo

What you get

Things you can do with LangWatch

Integrations

Contributing

License

Security

Commercial use, modification/redistribution, source obligations, and key conditions of common licenses. Names link to official texts.
License · original	Commercial use	Modification / redistribution	Source obligations	Key conditions
MIT ↗	Allowed	Allowed	No source distribution obligation	Keep copyright and permission notices in copies/substantial portions
Apache-2.0 ↗	Allowed	Allowed	No source distribution obligation	Keep license, relevant notices and NOTICE; mark modifications. Includes patent grants and termination on patent litigation
BSD-2-Clause ↗	Allowed	Allowed	No source distribution obligation	Keep copyright, conditions and disclaimers in source or binary documentation/materials
BSD-3-Clause ↗	Allowed	Allowed	No source distribution obligation	BSD-2 terms, plus no use of copyright holder/contributor names for endorsement without permission
ISC ↗	Allowed	Allowed	No source distribution obligation	Keep copyright and permission notices in all copies
GPL-2.0 ↗	Allowed	Allowed under GPL terms	Provide corresponding source for the program/derivatives when distributing	Distribute under GPL; keep copyright, license and change notices. Mere aggregation is excluded
GPL-3.0 ↗	Allowed	Allowed under GPL terms	Provide corresponding source for the program/derivatives when distributing	Distribute under GPL; retain notices and mark modifications. Patent terms; provide modified-version installation information for covered consumer products
LGPL-2.1 ↗	Allowed	Allowed under LGPL terms	Provide source for the library/modifications when distributing the library	Apps may link under other licenses; allow library replacement/relinking and reverse engineering to debug modifications
LGPL-3.0 ↗	Allowed	Allowed under LGPL terms	Provide source for the library/modifications when distributing the library	Apps may link under other licenses; ensure replacement, relinking and reverse engineering for debugging modifications; provide installation information for covered products
MPL-2.0 ↗	Allowed	Allowed under MPL terms	Provide source for MPL-covered files and modifications when distributing	Retain MPL and notices at file level; separate files without MPL code may use other licenses
AGPL-3.0 ↗	Allowed	Allowed under AGPL terms	Provide corresponding source when distributing; offer remote users of modified versions free source access	Distribution terms similar to GPL-3.0, plus source-access instructions for network users of modified programs
Unlicense ↗	Allowed	Allowed	No source distribution obligation	Dedicate copyright to the public domain; check the original and limits permitted by law
CC0-1.0 ↗	Allowed	Allowed	No source distribution obligation	Waive copyright and related rights, with fallback permission if ineffective; excludes patents and trademarks

Commercial use, modification/redistribution, source obligations, and key conditions of common licenses. Names link to official texts.
License · original	Commercial use	Modification / redistribution	Source obligations	Key conditions
MIT ↗	Allowed	Allowed	No source distribution obligation	Keep copyright and permission notices in copies/substantial portions
Apache-2.0 ↗	Allowed	Allowed	No source distribution obligation	Keep license, relevant notices and NOTICE; mark modifications. Includes patent grants and termination on patent litigation
BSD-2-Clause ↗	Allowed	Allowed	No source distribution obligation	Keep copyright, conditions and disclaimers in source or binary documentation/materials
BSD-3-Clause ↗	Allowed	Allowed	No source distribution obligation	BSD-2 terms, plus no use of copyright holder/contributor names for endorsement without permission
ISC ↗	Allowed	Allowed	No source distribution obligation	Keep copyright and permission notices in all copies
GPL-2.0 ↗	Allowed	Allowed under GPL terms	Provide corresponding source for the program/derivatives when distributing	Distribute under GPL; keep copyright, license and change notices. Mere aggregation is excluded
GPL-3.0 ↗	Allowed	Allowed under GPL terms	Provide corresponding source for the program/derivatives when distributing	Distribute under GPL; retain notices and mark modifications. Patent terms; provide modified-version installation information for covered consumer products
LGPL-2.1 ↗	Allowed	Allowed under LGPL terms	Provide source for the library/modifications when distributing the library	Apps may link under other licenses; allow library replacement/relinking and reverse engineering to debug modifications
LGPL-3.0 ↗	Allowed	Allowed under LGPL terms	Provide source for the library/modifications when distributing the library	Apps may link under other licenses; ensure replacement, relinking and reverse engineering for debugging modifications; provide installation information for covered products
MPL-2.0 ↗	Allowed	Allowed under MPL terms	Provide source for MPL-covered files and modifications when distributing	Retain MPL and notices at file level; separate files without MPL code may use other licenses
AGPL-3.0 ↗	Allowed	Allowed under AGPL terms	Provide corresponding source when distributing; offer remote users of modified versions free source access	Distribution terms similar to GPL-3.0, plus source-access instructions for network users of modified programs
Unlicense ↗	Allowed	Allowed	No source distribution obligation	Dedicate copyright to the public domain; check the original and limits permitted by law
CC0-1.0 ↗	Allowed	Allowed	No source distribution obligation	Waive copyright and related rights, with fallback permission if ineffective; excludes patents and trademarks

AI Agent Testing and Evaluation

Languages

Updates24 in the last 30 days

Trending in Developer tools

AI Agent Testing and Evaluation

Languages

Updates24 in the last 30 days

Trending in Developer tools

Comments

Introduction

README

Get started

LangWatch Cloud

Track your coding agents

Self-host

Demo

What you get

Things you can do with LangWatch

Integrations

Contributing

License

Security

README

README

Get started

LangWatch Cloud

Track your coding agents

Self-host

Demo

What you get

Things you can do with LangWatch

Integrations

Contributing

License

Security