Исследования
На что смотрели, прежде чем действовать: вопрос, что нашли и на чём это стоит.
How can an agent use and check interactive tools without a person at the keyboard?
Programs open themselves to agents through MCP, an open standard - creative programs (Blender, Photoshop, GIMP, Aseprite) already do. For terminal programs, MCP servers run them in a pseudo-terminal, send keys, wait on the screen and read it through a terminal model - the descendants of expect (1990); the ones found are Python. Testing tools write scenes with expectations on the screen (tui-test) or turn scripts into recordings (vhs). Rust has the pieces: pseudo-terminals, a terminal emulator as a library, and MCP's official SDK. Graphical programs are reached through AT-SPI or their own connectors.
- Model Context Protocol - Anthropic and contributors, 2024 An open standard through which a program offers its tools to any agent; the way to open our tools to agents beyond the command line.
- The official Rust SDK for MCP (rmcp) - Model Context Protocol, 2025 MCP servers in Rust - our language for what ships.
- Photoshop MCP server - loonghao, 2025 A whole graphical program opened to agents through its own API: the connector way for GUIs.
- Expect - Don Libes, 1990 Drive an interactive program by waiting for what it prints and answering: the idea every terminal driver descends from.
- Interactive terminal MCP servers (tmux- and PTY-based) - vitjas; smartcli, 2025 Start a program in a pseudo-terminal, send keys, wait on the screen, read it through a real terminal model - so a highlighted row is known, not guessed. Python, so the design and not the code is taken.
- tui-test: end-to-end testing for terminal applications - Microsoft, 2024 Scenes with expectations on the screen, run as tests - the shape of our scenes.
- VHS: terminal recordings from scripts - Charm, 2022 A written script of keys becomes a recording and screenshots - evidence a person can look at.
- portable-pty - Wez Furlong (WezTerm), 2019 Pseudo-terminals in Rust, the program's side of the driver.
- vt100: a terminal emulator as a library - Jesse Luehrs, 2019 The screen as cells in Rust: what the driver reads.
- AT-SPI: the Linux accessibility interface - GNOME and freedesktop, 2001 Graphical programs expose their widgets to assistive tools; the later way in for GUIs.
2026-11-11
How can an agent see and use the web pages it builds?
The same closed door as with interactive programs: an agent builds the observatory's pages but sees them only through screenshots. Playwright's MCP server lets an agent drive a real browser and read the page's accessibility tree; Chrome DevTools MCP lets it inspect the live page. Screenshots stay for looking; the tree is for checking and acting.
- Playwright MCP server - Microsoft, 2025 An agent drives a real browser through MCP and reads the page's accessibility tree - structure, not only pixels.
- Chrome DevTools MCP - Google, 2025 An agent inspects a live page: its tree, console, network and performance.
2026-11-11