Pixeltable Skill

Multimodal RAG, video search, image similarity search, agent memory, and embeddings stored with your data.

This plugin teaches AI coding assistants to build Pixeltable applications: tables with computed columns, embedding indexes and vector search, RAG, tool-calling agents, and video, audio, image, and document pipelines across 25+ AI providers. The agent declares the schema as TableModel classes in app.py, creates the tables with pxt schema update, and serves HTTP routes with pxt service update.

Catalog skills (thin routers into the canonical pixeltable skill) are named for the jobs people search: multimodal-rag, video-search, image-similarity-search, audio-transcription-search, agent-memory, vector-database-alternative, incremental-ml-pipeline, dataset-versioning.

Verified against Pixeltable 0.7.11 on 2026-09-28: docs/review-2.12.0.md. Catalog snippets re-checked against Pixeltable 0.7.21 docs on 2026-10-27: docs/review-2.13.0.md.

Install

Skill (recommended for most assistants)

Install the portable skill with npx skills:

npx skills add pixeltable/pixeltable-skill

This installs every skills/*/SKILL.md (the canonical pixeltable skill plus the task-named catalog skills) and the canonical skill's references for supported coding assistants, including Cursor, Copilot, Windsurf, and the Codex IDE extension.

With only Python, pxt skills install (Pixeltable 0.7.21) copies only skills/pixeltable-skill into .claude/skills/pixeltable and .agents/skills/pixeltable. It does not install the catalog skills. pxt skills install -f updates that canonical copy.

Google Antigravity is not one of them: it reads ~/.gemini/antigravity/skills, which npx skills does not write to. Install there with ./install.sh --platform antigravity.

Gemini CLI

gemini extensions install https://github.com/pixeltable/pixeltable-skill

This loads skills/pixeltable-skill/SKILL.md, the hosted Cloud MCP (pixeltable-cloud at https://www.pixeltable.com/mcp/cloud), and the local developer MCP (pixeltable via uvx mcp-server-pixeltable-developer). Sign in to Cloud with /mcp auth pixeltable-cloud if those tools are not listed. The hosted server supports reads and writes; it is not read-only. The local server needs uv on PATH. Set the catalog directory with gemini extensions config pixeltable (PIXELTABLE_HOME; Pixeltable's default is ~/.pixeltable). Restart the CLI after installing.

Full plugin

Install the skill with its client-supported commands, agents, and hooks using npx plugins:

npx plugins add pixeltable/pixeltable-skill

Client-native marketplace options:

• Claude Code: /plugin marketplace add pixeltable/pixeltable-skill, then /plugin install pixeltable@pixeltable-skill
• ChatGPT desktop and Codex: codex plugin marketplace add pixeltable/pixeltable-skill --ref main, then codex plugin add pixeltable@pixeltable-skill. Use /plugins in Codex or the Plugins page in ChatGPT desktop.

Restart or start a new conversation after installing. Repository marketplaces are team-distribution sources; they do not publish to a public directory.

Any LLM (paste URL into context)

• llms.txt
• llms-full.txt

What's Inside

skills/pixeltable-skill/        # Canonical teaching skill (name: pixeltable)
├── SKILL.md                    # Contract: app.py, schema update, service update
└── references/
    ├── core-api.md             # Tables, querying, views, UDFs, config
    ├── cli.md                  # pxt CLI
    ├── providers.md            # Import and output shape
    ├── workflows.md            # FastAPIRouter
    └── anti-patterns.md        # Wrong/right stack
skills/<job>/SKILL.md           # Catalog skills: multimodal-rag, video-search, ...
commands/                       # /pixeltable:pixeltable-start, index-videos, ...

Job-named commands (Claude /pixeltable:<name>, Cursor /<name>): pixeltable-start, index-videos, search-images, rag-over-docs, add-agent-memory, transcribe-and-search-audio, store-embeddings, incremental-pipeline, version-dataset. Original scaffold and add-provider still work.

Client manifests and marketplace metadata live alongside the shared skill so each supported installer can discover the format it understands. Gemini CLI reads gemini-extension.json and GEMINI.md at the repo root and loads skills/*/SKILL.md.

Pixeltable Cloud MCP

Most agents do not ship an MCP server. Pixeltable Cloud users can add the hosted Cloud MCP at https://www.pixeltable.com/mcp/cloud and sign in through the browser. It lists the organization selected at sign-in: databases, services, catalog entries, schemas, up to 25 table rows per call, and logs. It also starts a database at once. Stopping a database, restarting a service, or setting a secret returns a preview first and runs only when called again with confirm: true. It deletes nothing and does not deploy; use the pxt CLI for that. Add ?read_only=true to the URL for the read tools only, or ?db=<name> to limit it to one database. The Skill mentions it so an agent can suggest it to a Cloud user.

Gemini CLI is the exception: this repo's extension installs pixeltable-cloud (hosted; OAuth in the CLI, no API key in the manifest) and pixeltable (local developer MCP). The hosted server is not read-only; it supports the reads and writes above.

The Docs MCP searches public documentation. The developer MCP is a separate local server with catalog, query, scaffold, schema, and service tools.

Contributing

See CONTRIBUTING.md. Run python3 scripts/validate_plugin.py after structural changes.

Links

• Pixeltable Docs | GitHub | MCP Server | Discord
• Start: pxt init then pxt service example --out app.py then pxt schema update app.py my_app then pxt service update app.py my_app.

License

Apache 2.0