Generated Computers
Locals: an Apple Silicon engine that runs local LLMs up to 3x faster. A product of Generated Computers.
翻譯準備中
個人 GitHub 帳號下公開儲存庫的擁有者可以登入並驗證所有權,自行管理介紹,無需管理員核准。
登入並產生驗證檔案,在 30 分鐘內將其提交至此儲存庫的預設分支。其他分支或分叉儲存庫中的檔案無效。然後在下方檢查檔案,即可無需管理員核准直接管理專案。請保留檔案以維持管理權限。
如需登入,將前往登入頁面。登入後請回到此處,再次點擊所選的驗證按鈕。
在專案資料夾中執行 /nomorevibe verify,即可驗證所有權並自行管理介紹。
一分鐘完成驗證Agent harness framework
翻譯準備中
取自儲存庫 README
正在載入完整 README。
檢視完整 README ↗Agents that survive the crash.
A durable actor runtime for Python agents. Every agent gets an inbox, a journal and one turn at a time. If a worker dies mid-turn, the journal survives and nothing runs twice; with PostgreSQL, another worker can take over its queue. Drop the connection and the client resumes from its cursor. Serve it to any ACP client.
Website · Documentation · Upgrade to 2.0
Install name tantra-harness, import name tantra. A process-wide Runtime owns providers, stores, tools, hooks, permissions, skills, memory, compaction, telemetry, actor tasks, and writer connections.
| Command | Adds |
|---|---|
pip install tantra-harness | Core runtime and shell tools |
pip install "tantra-harness[web]" | Brave web search and web fetch |
pip install "tantra-harness[doc]" | PDF and Word document reading |
pip install "tantra-harness[postgres]" | PostgreSQL storage |
pip install "tantra-harness[telemetry]" | OpenTelemetry tracing |
npm install tantra-acp-client | TypeScript ACP client |
The unrelated PyPI project tantra installs the same import name. Do not install both projects in one environment.
import asyncio
from uuid import uuid4
from tantra import Agent, OpenAICompatible, Runtime, SQLiteStore
from tantra.extratools.web import web_search
class Researcher(Agent):
model = "gpt-5"
prompt = "Answer with current, sourced information."
tools = [web_search(api_key=BRAVE_API_KEY)]
async def main() -> None:
store = SQLiteStore("sessions.db")
await store.setup()
runtime = Runtime(
OpenAICompatible("https://api.openai.com/v1", OPENAI_API_KEY),
store,
[Researcher],
)
root_id = await runtime.create(Researcher)
async with runtime.connect(root_id, writable=True) as connection:
result = await connection.prompt(
"What changed in Python 3.13?",
command_id=uuid4(),
)
print(result.text)
await runtime.aclose()
asyncio.run(main())
Connection.prompt() accepts a durable command and waits for its terminal result. For streaming, call send() and iterate the connection. Reconnect with the last scalar seq as after; use Runtime.events() for a child journal. Command IDs are UUIDs and make acceptance idempotent.
Subagents are independent actors. Models use the injected spawn, status, send, and cancel_agent tools; no parent stream merges child events. Each completed child turn delivers its final message to the parent as a reply, and the child stays reusable. Human asks and approval-gated tools are root-only.
Compaction is opt-in with Runtime(compactor=PruneThenSummarize()). Configured runtimes budget the complete provider request, preserve system and tool definitions, and compact each actor independently.
For multi-process deployments, pair PostgresStore with the optional PostgresCoordinator for leased execution ownership, fenced writes, command forwarding, and takeover recovery. The default remains single-process.
tantra.acp serves a Runtime over an ACP v2–inspired protocol plus the tantra profile, on stdio or WebSocket. AcpServer.websocket() returns a raw ASGI endpoint; this example mounts it in Starlette and runs with pip install starlette "uvicorn[standard]" and uvicorn app:app. It reuses Researcher and OPENAI_API_KEY from above. authenticate(asgi_scope) stands for the application's own check of the WebSocket handshake; when bind raises PermissionError, the socket closes with 1008 before it is accepted.
from contextlib import asynccontextmanager
from starlette.applications import Starlette
from starlette.routing import WebSocketRoute
from tantra import OpenAICompatible, Runtime, SQLiteStore
from tantra.acp import AcpAccess, AcpAuth, AcpServer
async def bind(asgi_scope) -> AcpAuth:
user = await authenticate(asgi_scope)
if user is None:
raise PermissionError
return AcpAuth(principal=user.id, submitted_by=user.id)
async def scope(auth: AcpAuth, meta) -> dict[str, str]:
return {"user": auth.principal}
async def policy(access: AcpAccess) -> bool:
return access.root.metadata.get("user") == access.auth.principal
@asynccontextmanager
async def lifespan(app: Starlette):
store = SQLiteStore("sessions.db")
await store.setup()
runtime = Runtime(
OpenAICompatible("https://api.openai.com/v1", OPENAI_API_KEY),
store,
[Researcher],
)
await runtime.start()
server = AcpServer(runtime, agent=Researcher, scope=scope, policy=policy, name="researcher")
endpoint = server.websocket(bind=bind, allowed_origins={"https://app.example"})
route = WebSocketRoute("/acp", endpoint)
app.router.routes.append(route)
try:
yield
finally:
app.router.routes.remove(route)
await endpoint.aclose()
await runtime.aclose()
app = Starlette(lifespan=lifespan)
tantra-acp-client is the TypeScript client. It owns cursors, command IDs, writer state and reconnects:
import { TantraAcpClient } from "tantra-acp-client";
const client = new TantraAcpClient({
url: async () => `wss://app.example/acp?ticket=${await ticket()}`,
onUpdate: (sessionId, update) => reducer.apply(sessionId, update),
onRequest: (request) => asks.show(request),
});
await client.connect();
const { sessionId } = await client.newSession();
const { messageId } = await client.prompt(sessionId, [{ type: "text", text: "What changed in Python 3.13?" }]);
The tantra profile adds what durable, shared sessions need:
_meta.tantra.cursor, and a reconnecting client resumes each session after its last applied cursor.commandId becomes the Runtime command ID, so a retry is accepted once and answers the same messageId.See the documentation, the 2.0 upgrade guide, the ACP server reference, and the coordinator setup guide.
apps/sarathi is the repository's interactive web application.
Apache-2.0