Open Commons ObservatoryEnglish·Русский

Исследования

На что смотрели, прежде чем действовать: вопрос, что нашли и на чём это стоит.

How can an agent use and check interactive tools without a person at the keyboard?

Programs open themselves to agents through MCP, an open standard - creative programs (Blender, Photoshop, GIMP, Aseprite) already do. For terminal programs, MCP servers run them in a pseudo-terminal, send keys, wait on the screen and read it through a terminal model - the descendants of expect (1990); the ones found are Python. Testing tools write scenes with expectations on the screen (tui-test) or turn scripts into recordings (vhs). Rust has the pieces: pseudo-terminals, a terminal emulator as a library, and MCP's official SDK. Graphical programs are reached through AT-SPI or their own connectors.

2026-11-11

How can an agent see and use the web pages it builds?

The same closed door as with interactive programs: an agent builds the observatory's pages but sees them only through screenshots. Playwright's MCP server lets an agent drive a real browser and read the page's accessibility tree; Chrome DevTools MCP lets it inspect the live page. Screenshots stay for looking; the tree is for checking and acting.

  • Playwright MCP server - Microsoft, 2025 An agent drives a real browser through MCP and reads the page's accessibility tree - structure, not only pixels.
  • Chrome DevTools MCP - Google, 2025 An agent inspects a live page: its tree, console, network and performance.

2026-11-11