AI agents
@ingcreators/annot-mcp is a Model Context Protocol stdio server
that exposes the Annot headless annotator as agent-callable
tools. Drop into Claude Desktop / Claude Code / Cursor /
Continue (or any other MCP client) and an AI agent can compose
Annot with @playwright/mcp + GitHub MCP into autonomous
browser-driven workflows:
- Bug-report autopilot — agent navigates to a staging URL, identifies a broken element, files a GitHub issue with an annotated screenshot in one conversation turn.
- Visual-diff PR review — agent screenshots the same page on two branches, posts the diff with changed regions highlighted.
- Locator-first annotation —
{ type: "rect", locator: "button:has-text('Submit')", intent: "error" }in a single MCP call; the server captures the URL, resolves the locator, renders the annotation. - Living product docs flow —
annot_draft_screen_spec+annot_propose_drift_fixes+annot_translate_screen_speclet the agent author + maintain the.mdxsource of truth the docs site + screen-specifications spreadsheet are generated from.
Three things to know first
Section titled “Three things to know first”- The server runs locally — no network round-trip to a hosted service, no auth. Cloud-hosted MCP is out of scope at v1.
- The DSL is shared with the rest of Annot. The same
BboxAnnotationshape (rect/circle/arrow/text/callout/rawwith theintentshorthand) that@ingcreators/annot-playwrightaccepts is what agents produce on MCP tool calls. Browser-driving agents add locator-flavour variants. @playwright/mcpis a partner, not a competitor. For single-shot capture,annot_annotate_urlis the simplest path. For multi-step browser flows (sign-in, click, wait, then capture), drive the browser through@playwright/mcpand feed the screenshot bytes toannot_annotate_screenshot.
Where to next
Section titled “Where to next”| If you want to … | Read |
|---|---|
| Wire Claude Desktop / Claude Code to the server | Install |
| Learn every tool’s schema | Tools reference |
| Understand the annotation DSL | DSL reference |
| See a one-turn bug-report transcript | Recipe: agent bug report |
| Drive the living-product-docs flow | Recipe: living product docs |