Skip to content

AI agents

@ingcreators/annot-mcp is a Model Context Protocol stdio server that exposes the Annot headless annotator as agent-callable tools. Drop into Claude Desktop / Claude Code / Cursor / Continue (or any other MCP client) and an AI agent can compose Annot with @playwright/mcp + GitHub MCP into autonomous browser-driven workflows:

  • Bug-report autopilot — agent navigates to a staging URL, identifies a broken element, files a GitHub issue with an annotated screenshot in one conversation turn.
  • Visual-diff PR review — agent screenshots the same page on two branches, posts the diff with changed regions highlighted.
  • Locator-first annotation{ type: "rect", locator: "button:has-text('Submit')", intent: "error" } in a single MCP call; the server captures the URL, resolves the locator, renders the annotation.
  • Living product docs flowannot_draft_screen_spec + annot_propose_drift_fixes + annot_translate_screen_spec let the agent author + maintain the .mdx source of truth the docs site + screen-specifications spreadsheet are generated from.
  1. The server runs locally — no network round-trip to a hosted service, no auth. Cloud-hosted MCP is out of scope at v1.
  2. The DSL is shared with the rest of Annot. The same BboxAnnotation shape (rect / circle / arrow / text / callout / raw with the intent shorthand) that @ingcreators/annot-playwright accepts is what agents produce on MCP tool calls. Browser-driving agents add locator-flavour variants.
  3. @playwright/mcp is a partner, not a competitor. For single-shot capture, annot_annotate_url is the simplest path. For multi-step browser flows (sign-in, click, wait, then capture), drive the browser through @playwright/mcp and feed the screenshot bytes to annot_annotate_screenshot.
If you want to …Read
Wire Claude Desktop / Claude Code to the serverInstall
Learn every tool’s schemaTools reference
Understand the annotation DSLDSL reference
See a one-turn bug-report transcriptRecipe: agent bug report
Drive the living-product-docs flowRecipe: living product docs