Linux desktop control over MCP — AT-SPI, GNOME Shell, Wayland portals, ydotool
翻訳待ち
開発ツールRust · JavaScriptGitHub @agent-sh自分でインストール所有者未確認
Paste into Claude or ChatGPT for installation instructions suited to your environment.
Have you tried it? One tap is enough. No sign-in needed.
The maker's introduction consists of the line above. Read the repository README for more details. Repository README ↗
Loading the full README.
Read the full README ↗Running open models for your company? Tiyuvta helps with model choice, deployment and optimization, and fine-tuning on your hardware or cloud account.
computer-use-linux gives AI agents real, structured control of a local Linux desktop: semantic AT-SPI accessibility trees, bounded screenshots, compositor-aware window targeting, Wayland/X11 input synthesis, and single-round-trip post-action verification across GNOME, KDE Plasma/KWin, Hyprland, niri, COSMIC, i3, Sway, labwc and other wlroots compositors, and X11/EWMH, plus a click-through on-screen activity indicator on GNOME and on Wayland compositors with wlr-layer-shell.
Pick the setup that matches your agent or shell workflow:
| Host / workflow | Install command |
|---|---|
| Claude Code (plugin + skill) | claude plugin marketplace add agent-sh/computer-use-linux && claude plugin install computer-use-linux@computer-use-linux |
| Codex CLI (plugin + skill) | codex plugin marketplace add agent-sh/computer-use-linux && codex plugin add computer-use-linux@computer-use-linux |
| Pi Coding Agent (native lazy-loaded tools) | pi install npm:@agent-sh/computer-use-linux |
| Hermes Agent (CLI + skill + MCP server) | npm install -g @agent-sh/computer-use-linux && hermes skills tap add agent-sh/computer-use-linux && hermes skills install agent-sh/computer-use-linux/computer-use-linux && hermes mcp add computer-use-linux --command computer-use-linux --args mcp |
| CLI + any stdio MCP client (npm) | npm install -g @agent-sh/computer-use-linux |
| CLI + system setup from source | git clone https://github.com/agent-sh/computer-use-linux && cd computer-use-linux && ./install.sh |
Rust crate (crates.io) | cargo install computer-use-linux |
Verify desktop readiness from the shell (after installing the CLI on PATH via npm install -g @agent-sh/computer-use-linux, ./install.sh, or cargo install computer-use-linux):
computer-use-linux doctor | jq .readiness
computer-use-linux setup # enable AT-SPI accessibility bridge if needed
computer-use-linux setup-window-targeting # install GNOME Wayland window-control extension if needed
Plugin-only or Pi-only installs: The Claude Code / Codex plugin launcher and
pi installmanage private cached binaries and do not addcomputer-use-linuxtoPATH. Either run the MCPdoctor/setup_accessibility/setup_window_targetingtools (orcomputer_use_linux_doctorin Pi) directly from your agent, or also install the CLI above when you want shell subcommands onPATH.
The Rust crate is published as computer-use-linux and the npm package as @agent-sh/computer-use-linux. Prebuilt x86_64 and aarch64 Linux binaries ship with the latest release. They need glibc 2.28 or newer: RHEL 8 and its rebuilds, Debian 10, Ubuntu 20.04, and anything later. On an older system, build from source with cargo install computer-use-linux.
Need an isolated desktop where the agent never touches your real mouse, keyboard, or focused window? Use the sibling project
agent-workspace-linuxalongside this one.
computer-use-linux is a Rust MCP server and CLI for Linux desktop control. It ships three binaries: the main computer-use-linux server/CLI, the computer-use-linux-cosmic Wayland toplevel helper for COSMIC, and the computer-use-linux-indicator click-through activity overlay. Any MCP host (Claude Code, Codex CLI, Codex Desktop's Linux build, Pi Coding Agent, Hermes Agent, Claude Desktop, or your own client) can spawn it to inspect accessibility trees, list and focus windows, take screenshots, click, drag, scroll, type, and invoke semantic accessibility actions.
Most computer-use MCP servers are macOS-only (they lean on AppKit, AXUIElement, CGEvent). The few that target Linux either drive xdotool against an X11 root window or shell out to OCR over screenshots. It differs in five ways:
This is the beginning of the README. Read the rest at the original. Read the full README ↗