Skip to content

Releases

oab-computer 0.12.0

Choose a tag to compare

@github-actions github-actions released this 16 Nov 02:12
2f9b821

OpenAB Computer 0.12.0 renames the agent from oab-instance-mcp to oab-computer. This is a breaking change for hosts that run the old name.
A first-run permission wizard sets up the Mac. Tailnet access is opt-in for a plain app launch, but the package and script installers turn it on (see the upgrade notes).
Playwright MCP is no longer exposed on a tailnet port, and browser_* tools go through a router with a managed Playwright tier.
Playwright installs on demand from the wizard, with every download checked against hashes built into the signed app.

Highlights

  • Rename to OpenAB Computer / oab-computer. The executable is now oab-computer and the bundle id is dev.openab.computer. The LaunchAgent label and the install, config, Application Support and log paths use the new name too. The old agent is not removed automatically, and the installer warns when it finds one. The token file is copied from the old location when the new one is missing.
  • First-run permission wizard. It uses a light window and walks through Accessibility, Screen Recording and an optional Full Disk Access page.
  • Tailnet access is opt-in for a plain app launch. The app never creates the :8444 tailnet mapping on its own and refuses to overwrite one it did not make. You turn it on from the wizard's tailnet page (shown when a Tailscale login is detected) or the menu, and "Turn Off Tailnet Access" in the menu removes it. The package and script installers, however, run tailscale serve for :8444 during install, so after an install the Mac is already reachable on the tailnet at :8444. A bearer token and an allowed Tailscale login are still required. The menu has a new Network section.
  • README documents every bound port. See "Network interfaces and ports".
  • Playwright MCP stays on loopback (issue #115). The installer no longer creates a tailnet mapping for it, so it can no longer bypass the app's login check and token.
  • browser_* router with a managed Playwright tier. The managed tier talks to Playwright over stdio, so it opens no listener. External listeners are used only after explicit trust. The app terminates the whole process tree on quit.
  • Wizard "Browser tools" page. The on-demand Playwright install is pre-checked: about 249 MB to download and about 842 MB of free disk. It installs Node, @playwright/mcp and Chromium. Every download is checked against a hash manifest embedded in the signed app. Files go under ~/Library/Application Support/oab-computer/playwright. It uses its own browser profile, not your Chrome or Safari. Uncheck it to skip, and install later from the menu.
  • Playwright menu items. The menu can install, update and remove Playwright, and open the sign-in window.
  • Docs. New ADR and requirements documents for browser tiers: docs/adr/browser-tiers.md and docs/requirements/browser-tiers.md.

Upgrade notes

  • Hosts running the old-named agent (oab-instance-mcp) need a reinstall. The installer warns about the old agent and does not remove it.
  • On macOS, grant Screen Recording and Accessibility again, because the bundle id changed.
  • Linux hands nodes get the new binary names, but not the browser wizard. The Linux installer for the Playwright tier is tracked in #119.
  • The package installer turns on the tailnet mapping on :8444 (a bearer token and an allowed Tailscale login are still required); use the wizard tailnet page or the menu to turn it off.

Known follow-ups

  • #122: router follow-ups from the PR #121 review
  • #125: managed Playwright tier follow-ups from the PR #123 review
  • #128: use the installed Chrome as a fallback when the downloaded Chromium is refused
  • #129: wizard tests do not cover the production wiring

Decisions

  • No Chrome extension.
  • agent-browser (#124) is not app-managed for now.

Full list of changes

  • ci: add PR bot review workflow by @chaodu-agent in #111
  • feat: permission wizard and first-run launch for OpenAB Computer 0.12.0 by @chaodu-agent in #112
  • docs: README network interfaces and ports by @chaodu-agent in #113
  • feat: tailnet opt-in page and menu fixes for OpenAB Computer by @chaodu-agent in #110
  • feat: Network section in the menu bar and README update by @chaodu-agent in #114
  • fix: keep Playwright MCP on loopback, no tailnet mapping (#115) by @chaodu-agent in #116
  • feat!: rename oab-instance-mcp to oab-computer (breaking, 0.12.0) by @chaodu-agent in #117
  • docs: browser_* tiers ADR and requirements (#118) by @chaodu-agent in #120
  • feat: browser tool router and external Playwright tier (phase 1, PR 1) by @chaodu-agent in #121
  • feat: stdio MCP client and managed Playwright tier (browser tiers phase 1, PR 2) by @chaodu-agent in #123
  • feat: on-demand Playwright installer, embedded pins and release check (PR 1 of 2) by @chaodu-agent in #126
  • feat: wizard Browser tools page, Playwright menu items and sign-in window (PR 2 of 2) by @chaodu-agent in #127

Full Changelog: v0.11.0...v0.12.0

oab-computer 0.11.0

Choose a tag to compare

@github-actions github-actions released this 12 Nov 06:18
4056125

What's Changed

Full Changelog: v0.10.1...v0.11.0

oab-computer 0.10.1

Choose a tag to compare

@github-actions github-actions released this 10 Nov 01:00
4dc0ce7

Fix: ui_action inside sheets (#98)

ui_action now works on controls inside sheets (save/confirm dialogs) and similar containers (#98, fixed in #99).

Linux

Linux is unchanged.

What's Changed

Full Changelog: v0.10.0...v0.10.1

oab-computer 0.10.0

Choose a tag to compare

@github-actions github-actions released this 09 Nov 20:12
bf8ec71

New macOS tool: ui_action (#96, refs #67)

ui_action acts on a node from a ui_snapshot result through the macOS Accessibility API. An agent can press a native-app button or fill a field without moving the cursor and, by default, without bringing the app to the front.

  • Target. Pass the snapshot_id and ref from a recent ui_snapshot (the last 4 snapshots are kept, 5 minutes each). Before acting, the ref is re-checked: same process, same role, still in the same window. If anything changed, the call fails with stale ref: … take a new ui_snapshot; it never guesses a replacement.
  • Actions. press, set_value (string, number or bool; replaces the whole value), focus, show_menu, confirm and cancel, plus increment and decrement. An element that does not support the action is refused, with the list of actions it does support.
  • No cursor movement. The tool never synthesizes mouse or keyboard events. activate: true brings the app and window to the front first, which show_menu, menu-bar items of a background app, and focus before key typing often need. Drags stay on mouse.
  • owner only, like mouse and key, and it needs the Accessibility permission. It is not in observe.
  • Secure fields. set_value works on password fields, and the value is never read back, logged or returned (post_state reports masked: true). Through a switchboard (--switchboard), set_value on a secure field is refused by default, because the switchboard can write call arguments to its audit log. To allow it, write allow to ~/.config/oab-instance-mcp/switchboard.secure-set-value and re-run the installer (it passes --switchboard-allow-secure-set-value). A direct /mcp connection and openab-pty reverse attach are unaffected.
  • ui_snapshot gains include_menu_bar (default false) so menu items get refs. Its default output is unchanged.

Switchboard operators: upgrade to openab-sb v0.2.2

openab-sb releases before v0.2.2 write tool arguments to audit.jsonl in full, so set_value values (and key text, as before) end up there in plain text. v0.2.2 replaces secret-bearing argument values with a redaction marker (openabdev/openab-sb#16). Upgrade the switchboard before sending anything sensitive through ui_action, and consider rotating an audit file written by an older version. On an older switchboard, set audit_args = false or keep the secure set_value opt-in off.

Linux

Linux is unchanged. The Linux hands node does not serve ui_action or ui_snapshot; AT-SPI versions are planned (#67 stays open for them).

What's Changed

Full Changelog: v0.9.0...v0.10.0

oab-computer 0.9.0

Choose a tag to compare

@github-actions github-actions released this 09 Nov 01:22
7fdf8ff

⚠ Breaking: tool profiles are now observe and owner (#92, fixes #59)

There are now two tool profiles on macOS and Linux. desktop is removed.

Profile Tools Shell-equivalent
observe (the default) sys_info and screenshot only no
owner every local tool (shell, input, osascript, ui_snapshot, background jobs) and every browser tool yes
  • A POST /attach without a profile now gets observe on macOS too. Linux already did.
  • Unknown names, including sandbox, return 400 {"error":"profile must be one of [owner, observe]"} on both platforms.
  • Grant JSON (POST /attach, GET /attach, GET /attach/{id}) always carries requested_profile, and carries warning when desktop was mapped. Both fields are additive.
  • On a reverse attach under observe, a long exec, osascript or bash call is now reported as an unknown tool, like any other hidden tool.

Upgrading from 0.8.x

Up to 0.8.4 there were three profiles: owner, desktop and observe. desktop hid the exec* tools and allowed 15 browser tools, but it was still shell-equivalent through the GUI. Nothing in the upgrade grants owner: every old desktop input runs as observe, and the change is reported to the granter.

Input Before After
POST /attach {"profile":"desktop"} a desktop grant 202, runs as observe. The grant JSON has "profile":"observe", "requested_profile":"desktop" and a warning. The daemon log and the audit file record the mapping
POST /attach without profile macOS desktop, Linux observe observe on both
POST /attach with sandbox or any other unknown name 400 (two different messages) 400 profile must be one of [owner, observe] on both
A grant stored as desktop (macOS ~/Library/Application Support/oab-instance-mcp/grants.json, Linux grants.json) resumed as desktop kept and re-dialled under its id, as observe. GET /attach shows profile: observe, requested_profile: desktop and the warning. The file is rewritten with profile: observe and the requested name
A grant stored as sandbox or an unknown name dropped dropped (unchanged, #46)
macOS --switchboard-profile desktop (a flag in the LaunchAgent plist) desktop serves observe, prints the warning to the agent log, and logs switchboard: dialling … as observe (requested desktop). Any other unknown value still exits with status 64
macOS ~/.config/oab-instance-mcp/switchboard.profile containing desktop copied into the plist the installer writes --switchboard-profile observe and prints a warning. It does not edit your file
Linux environment and config no profile setting exists nothing to migrate

The warning text is the same on both platforms:

The desktop profile was removed (openab-computer#59). This grant runs as observe: sys_info and screenshot only. Grant owner explicitly for shell and browser access.

A stored row loads as the narrower of profile and requested_profile, so a hand-edited {"profile":"owner","requested_profile":"desktop"} still loads as observe.

Audit file. Every mapping is also appended as one JSON line ("event":"profile_mapped", with source = attach, resume or, on macOS, switchboard) to a mode-600 audit file: macOS ~/Library/Application Support/oab-instance-mcp/audit.jsonl, Linux ~/.local/state/oab-instance-mcp/audit.jsonl ($XDG_STATE_HOME if set; override with MCP_AUDIT_FILE, or MCP_AUDIT_FILE=off to disable). A write failure is logged and never blocks a grant. A resumed desktop grant writes a resume record on every restart while it lives.

Operator steps

  • Existing desktop grants (for example a session lent from OpenAB Connect or OpenAB Remote) resume as observe after the upgrade, so the agent sees only sys_info and screenshot. To restore shell or browser access, grant owner explicitly: pick Owner in OpenAB Connect or OpenAB Remote, or send POST /attach with "profile":"owner". The new grant replaces the old one for the same runtime and session. Until Connect and Remote are updated, picking "Desktop" there gets observe, and the apps do not show the warning.
  • Switchboard with switchboard.profile = desktop. Installing 0.9.0 with the .pkg or install-prebuilt.sh writes --switchboard-profile observe into the LaunchAgent plist and prints the warning. Switchboard callers then see only sys_info and screenshot from that computer; a caller allowed browser_* tools loses them. /mcp and /attach are unaffected.
    • To stay at observe and silence the warning, write observe to ~/.config/oab-instance-mcp/switchboard.profile.
    • To restore browser and input access, write owner there and re-run the installer. The flag lives in the plist, so restarting the agent alone does not apply it. Under owner the computer also exposes exec*, so the switchboard's per-caller allowlist becomes the only limit. To check, look for switchboard: dialling … as owner in the agent log.
  • Rolling back to 0.8.x keeps migrated grants at observe: the old daemon reads profile: observe and ignores the extra field. The grants file version stays 1.

Full details: docs/tool-profiles.md → Upgrading from 0.8.x (#59).

New macOS tool: ui_snapshot (#93, refs #67)

ui_snapshot returns the accessibility tree of a native macOS app's window, read-only: roles, titles, values and frames, with frames in the same display points that screenshot and mouse use. Use it for native apps, browser_snapshot for web pages, and screenshot + mouse for custom-drawn content.

  • It targets the frontmost app's focused window by default. app (bundle id or name), pid, window and all_windows choose another target. Depth, node count and time are capped (max_depth, max_nodes, timeout_ms).
  • It is owner-only, because it reads text a screenshot does not show (scrolled-out rows, collapsed content, other windows).
  • It needs the Accessibility permission for the app.
  • Linux does not have it yet; an AT-SPI version is planned (#67).

The macOS app now shows as "OpenAB Computer" (#94)

Finder, System Settings and the menu bar now show the app as OpenAB Computer instead of oab-instance-mcp. Only the displayed name changes. The bundle id dev.openab.instance-mcp, the executable and .app file name, the LaunchAgent label, the config, log and state paths, and the release asset names are unchanged, so existing Full Disk Access, Screen Recording and Accessibility grants are kept. Older docs call the app oab-instance-mcp.

Linux installer fix (#91, fixes #90)

scripts/install-linux.sh no longer runs bash while writing oab-instance-mcp.service: the backticks in a comment of the unit-file heredoc are now escaped. Installer flags, paths, units and the upgrade path are unchanged. A new CI job checks every unit the installer writes.

Linux

The Linux hands node's behaviour changes only through the profile change above (#92): the shared 400 message, desktop mapped to observe, requested_profile/warning in grant JSON, stored desktop grants resuming as observe, and the audit file. The installer fix (#91) is the only other Linux change; the rest is tests.

What's Changed

Full Changelog: v0.8.4...v0.9.0

oab-computer 0.8.4

Choose a tag to compare

@github-actions github-actions released this 07 Nov 03:50
1f3a2d0

⚠ Behaviour change: Linux /mcp now keeps session state (#88)

The Linux hands node's /mcp endpoint now tracks MCP sessions the way macOS does:

  • An unknown Mcp-Session-Id returns 404.
  • DELETE /mcp ends the session.
  • A non-JSON Content-Type returns 415.
  • A malformed request body returns 400.

Linux /mcp clients that skip initialize, or that reuse a stale session id, must now run initialize first and send the session id it returns.

Linux MCP wire matches macOS (#88, fixes #78)

  • initialize negotiates protocol version 2025-06-18.
  • ping returns {}.
  • JSON-RPC errors use the standard codes: -32700 (parse error), -32600 (invalid request) and -32602 (invalid params).
  • Shared conformance vectors (conformance/mcp_wire_vectors.json, conformance/mcp_http_vectors.json) are checked by both the Swift and the Linux test suites.

macOS: no functional change since 0.8.3. The app and pkg are rebuilt only for the version number.

What's Changed

Full Changelog: v0.8.3...v0.8.4

oab-computer 0.8.3

Choose a tag to compare

@github-actions github-actions released this 07 Nov 01:41
2106068

⚠️ Behaviour change: Linux bare POST /attach defaults to observe (#86, refs #59)

On the Linux hands node, a POST /attach that sends no profile now gets the observe profile. Up to 0.8.2 it got owner. Any caller that relied on the implicit owner must now pass "profile": "owner" explicitly. macOS defaults are unchanged.

Linux additions

  • Background jobs (#83): new tools exec_start, exec_poll, exec_list and exec_cancel run long work in the background and poll for it, so a call no longer has to stay open for the whole job. They are available only on the owner profile.
  • In-process JPEG screenshots (#82): screenshot encodes JPEG in process and accepts quality, scale and region, matching the macOS arguments. A 1080p capture is about 50 KB as JPEG, against about 2 MB as PNG.

Fixes

  • wss:// dials no longer panic: the Linux node now installs the rustls ring crypto provider at startup (#85, fixes #66).
  • Linux sys_info.agent.version and MCP serverInfo.version report the release version, taken from the tag at build time, instead of the crate version (#76, fixes #74). The release workflow checks with scripts/release-version.sh that the tag, the Swift version and the version the Linux binary reports all match.

Tests and docs

  • Tests for the spawn-failure reply and the idle/busy read switch (#77, #75).
  • Conformance docs pin the contract points from the #79 cold read (#84).

macOS: no functional change since 0.8.2. The app and pkg are rebuilt only for the version number.

What's Changed

  • fix(linux): report the release version from the tag, not the crate version by @chaodu-agent in #76
  • test(linux): cover the spawn-failure reply and the idle/busy read switch by @chaodu-agent in #77
  • docs(conformance): pin the contract points from the #79 cold read by @chaodu-agent in #84
  • fix(linux): install the rustls ring provider so wss:// dials do not panic (#66) by @chaodu-agent in #85
  • fix(linux): bare POST /attach defaults to observe, not owner by @chaodu-agent in #86
  • feat(linux): in-process JPEG for screenshot, with region and the Swift arguments (#32 item 5) by @chaodu-agent in #82
  • feat(linux): background jobs exec_start/exec_poll/exec_list/exec_cancel (#32 item 4) by @chaodu-agent in #83
  • chore: bump to 0.8.3 by @chaodu-agent in #87

Full Changelog: v0.8.2...v0.8.3

oab-computer 0.8.2

Choose a tag to compare

@github-actions github-actions released this 05 Nov 11:40
eaf235b

Linux hands node liveness fix (#72, fixes #70)

The Linux hands node (linux-{arm64,amd64} tarballs) no longer gets dropped when a bash call runs for a long time. Before this release it answered frames inline, so a call longer than about 60–80 s kept it from answering the runtime's pings and the runtime evicted the attach. This is the Linux port of the macOS fix that shipped in 0.8.1 (#69).

  • Each frame is answered on its own thread, so runtime pings get a reply while a tool call is still running.
  • It sends its own ping every 15 s.
  • After a 4011 close (liveness timeout) it redials. Backoff resets only after a connection stays up 60 s.
  • On a reverse attach, bash refuses timeout_secs above 100 s and points to running long work in the background. Local /mcp keeps the 600 s ceiling.
  • When the attach closes or the grant is revoked, bash calls still running are cancelled and their process group is killed.
  • initialize now returns instructions: keep calls under about 60 s and run long work in the background.

macOS: no change since 0.8.1. The app and pkg are rebuilt only for the version number.

What's Changed

Full Changelog: v0.8.1...v0.8.2

oab-computer 0.8.1

Choose a tag to compare

@github-actions github-actions released this 05 Nov 00:15
3c8696b

Reverse-attach liveness fix (#69, fixes #68)

A reverse-attached Mac no longer gets dropped when a tool call runs for a long time (for example exec "sleep 1500"). Before this release instance-mcp handled frames one at a time, so a tool call longer than about 60–80 s kept it from answering the runtime's pings and the runtime closed the attach.

  • instance-mcp keeps receiving frames, and answering pings, while a tool call is still running.
  • It sends its own ping every 15 s.
  • After a 4011 close (liveness timeout) it redials instead of stopping.
  • On openab-pty attaches, exec and osascript cap timeout_secs at 100 s.

Pair this with the openab-pty runtime change in openabdev/openab-pty#87, which closes a dead attach with 4011 LIVENESS_TIMEOUT and reports last_detach_reason in instance_status.

Not fixed yet: the Linux hands port (linux-{arm64,amd64} tarballs) still drops during long bash calls. That is tracked in #70.

What's Changed

  • chore(ci): re-enable markdownlint MD022/MD032/MD060 and run OsascriptToolTests by @chaodu-agent in #60
  • docs: Oracle Cloud reference architecture for instance-mcp by @thepagent in #58
  • docs(readme): present product as OpenAB Computer during rename by @chaodu-agent in #64
  • docs, ci: fix three LOW follow-ups from #58 and #60 by @chaodu-agent in #61
  • docs(readme): fix rename banner and repository links by @chaodu-agent in #65
  • test(conformance): wire MCP fixtures, reverse-attach negatives, parity checklist by @chaodu-agent in #62
  • fix(reverse-attach): answer runtime pings during long tool calls (liveness) by @chaodu-agent in #69
  • chore: bump to 0.8.1 (reverse-attach liveness fix) by @chaodu-agent in #71

New Contributors

Full Changelog: v0.8.0...v0.8.1

oab-computer 0.8.0

Choose a tag to compare

@github-actions github-actions released this 03 Oct 16:19
f456d04

What's Changed

  • fix(profile): classify every tool; boundary tests fail on unclassified ones by @chaodu-agent in #48
  • docs(profiles): tool classification + observe/prompt-injection note by @chaodu-agent in #49
  • docs: 'no egress' → no tailnet egress; internet egress is open by default by @chaodu-agent in #50
  • ci: require a #openab-pty Discord discussion link on community PRs by @chaodu-agent in #51
  • feat: switchboard mode (dial openab-sb /vm/attach) by @chaodu-agent in #53
  • chore: bump to 0.8.0 (switchboard mode) by @chaodu-agent in #54

Full Changelog: v0.7.0...v0.8.0