Repository navigation
Releases
oab-computer 0.12.0
OpenAB Computer 0.12.0 renames the agent from oab-instance-mcp to oab-computer. This is a breaking change for hosts that run the old name.
A first-run permission wizard sets up the Mac. Tailnet access is opt-in for a plain app launch, but the package and script installers turn it on (see the upgrade notes).
Playwright MCP is no longer exposed on a tailnet port, and browser_* tools go through a router with a managed Playwright tier.
Playwright installs on demand from the wizard, with every download checked against hashes built into the signed app.
Highlights
- Rename to OpenAB Computer /
oab-computer. The executable is nowoab-computerand the bundle id isdev.openab.computer. The LaunchAgent label and the install, config, Application Support and log paths use the new name too. The old agent is not removed automatically, and the installer warns when it finds one. The token file is copied from the old location when the new one is missing. - First-run permission wizard. It uses a light window and walks through Accessibility, Screen Recording and an optional Full Disk Access page.
- Tailnet access is opt-in for a plain app launch. The app never creates the
:8444tailnet mapping on its own and refuses to overwrite one it did not make. You turn it on from the wizard's tailnet page (shown when a Tailscale login is detected) or the menu, and "Turn Off Tailnet Access" in the menu removes it. The package and script installers, however, runtailscale servefor:8444during install, so after an install the Mac is already reachable on the tailnet at:8444. A bearer token and an allowed Tailscale login are still required. The menu has a new Network section. - README documents every bound port. See "Network interfaces and ports".
- Playwright MCP stays on loopback (issue #115). The installer no longer creates a tailnet mapping for it, so it can no longer bypass the app's login check and token.
browser_*router with a managed Playwright tier. The managed tier talks to Playwright over stdio, so it opens no listener. External listeners are used only after explicit trust. The app terminates the whole process tree on quit.- Wizard "Browser tools" page. The on-demand Playwright install is pre-checked: about 249 MB to download and about 842 MB of free disk. It installs Node,
@playwright/mcpand Chromium. Every download is checked against a hash manifest embedded in the signed app. Files go under~/Library/Application Support/oab-computer/playwright. It uses its own browser profile, not your Chrome or Safari. Uncheck it to skip, and install later from the menu. - Playwright menu items. The menu can install, update and remove Playwright, and open the sign-in window.
- Docs. New ADR and requirements documents for browser tiers:
docs/adr/browser-tiers.mdanddocs/requirements/browser-tiers.md.
Upgrade notes
- Hosts running the old-named agent (
oab-instance-mcp) need a reinstall. The installer warns about the old agent and does not remove it. - On macOS, grant Screen Recording and Accessibility again, because the bundle id changed.
- Linux hands nodes get the new binary names, but not the browser wizard. The Linux installer for the Playwright tier is tracked in #119.
- The package installer turns on the tailnet mapping on :8444 (a bearer token and an allowed Tailscale login are still required); use the wizard tailnet page or the menu to turn it off.
Known follow-ups
- #122: router follow-ups from the PR #121 review
- #125: managed Playwright tier follow-ups from the PR #123 review
- #128: use the installed Chrome as a fallback when the downloaded Chromium is refused
- #129: wizard tests do not cover the production wiring
Decisions
- No Chrome extension.
- agent-browser (#124) is not app-managed for now.
Full list of changes
- ci: add PR bot review workflow by @chaodu-agent in #111
- feat: permission wizard and first-run launch for OpenAB Computer 0.12.0 by @chaodu-agent in #112
- docs: README network interfaces and ports by @chaodu-agent in #113
- feat: tailnet opt-in page and menu fixes for OpenAB Computer by @chaodu-agent in #110
- feat: Network section in the menu bar and README update by @chaodu-agent in #114
- fix: keep Playwright MCP on loopback, no tailnet mapping (#115) by @chaodu-agent in #116
- feat!: rename oab-instance-mcp to oab-computer (breaking, 0.12.0) by @chaodu-agent in #117
- docs: browser_* tiers ADR and requirements (#118) by @chaodu-agent in #120
- feat: browser tool router and external Playwright tier (phase 1, PR 1) by @chaodu-agent in #121
- feat: stdio MCP client and managed Playwright tier (browser tiers phase 1, PR 2) by @chaodu-agent in #123
- feat: on-demand Playwright installer, embedded pins and release check (PR 1 of 2) by @chaodu-agent in #126
- feat: wizard Browser tools page, Playwright menu items and sign-in window (PR 2 of 2) by @chaodu-agent in #127
Full Changelog: v0.11.0...v0.12.0
oab-computer 0.11.0
What's Changed
- chore: title GitHub Releases "oab-computer " by @chaodu-agent in #104
- docs: mark Linux AT-SPI ui_snapshot/ui_action as deferred (#102) by @chaodu-agent in #103
- test: tolerate second-boundary drift in expires_in_secs smoke check by @chaodu-agent in #105
- docs: restructure README; move detail to docs/ by @chaodu-agent in #106
- docs: add an overview illustration to the README by @chaodu-agent in #107
- feat: menu bar configures and monitors the switchboard; shows reverse-attach grants by @chaodu-agent in #108
- chore: bump to 0.11.0 by @chaodu-agent in #109
Full Changelog: v0.10.1...v0.11.0
oab-computer 0.10.1
Fix: ui_action inside sheets (#98)
ui_action now works on controls inside sheets (save/confirm dialogs) and similar containers (#98, fixed in #99).
Linux
Linux is unchanged.
What's Changed
- fix: ui_action accepts controls inside a sheet (#98) by @chaodu-agent in #99
- chore: bump to 0.10.1 by @chaodu-agent in #100
Full Changelog: v0.10.0...v0.10.1
oab-computer 0.10.0
New macOS tool: ui_action (#96, refs #67)
ui_action acts on a node from a ui_snapshot result through the macOS Accessibility API. An agent can press a native-app button or fill a field without moving the cursor and, by default, without bringing the app to the front.
- Target. Pass the
snapshot_idandreffrom a recentui_snapshot(the last 4 snapshots are kept, 5 minutes each). Before acting, the ref is re-checked: same process, same role, still in the same window. If anything changed, the call fails withstale ref: … take a new ui_snapshot; it never guesses a replacement. - Actions.
press,set_value(string, number or bool; replaces the whole value),focus,show_menu,confirmandcancel, plusincrementanddecrement. An element that does not support the action is refused, with the list of actions it does support. - No cursor movement. The tool never synthesizes mouse or keyboard events.
activate: truebrings the app and window to the front first, whichshow_menu, menu-bar items of a background app, andfocusbeforekeytyping often need. Drags stay onmouse. owneronly, likemouseandkey, and it needs the Accessibility permission. It is not inobserve.- Secure fields.
set_valueworks on password fields, and the value is never read back, logged or returned (post_statereportsmasked: true). Through a switchboard (--switchboard),set_valueon a secure field is refused by default, because the switchboard can write call arguments to its audit log. To allow it, writeallowto~/.config/oab-instance-mcp/switchboard.secure-set-valueand re-run the installer (it passes--switchboard-allow-secure-set-value). A direct/mcpconnection and openab-pty reverse attach are unaffected. ui_snapshotgainsinclude_menu_bar(defaultfalse) so menu items get refs. Its default output is unchanged.
Switchboard operators: upgrade to openab-sb v0.2.2
openab-sb releases before v0.2.2 write tool arguments to audit.jsonl in full, so set_value values (and key text, as before) end up there in plain text. v0.2.2 replaces secret-bearing argument values with a redaction marker (openabdev/openab-sb#16). Upgrade the switchboard before sending anything sensitive through ui_action, and consider rotating an audit file written by an older version. On an older switchboard, set audit_args = false or keep the secure set_value opt-in off.
Linux
Linux is unchanged. The Linux hands node does not serve ui_action or ui_snapshot; AT-SPI versions are planned (#67 stays open for them).
What's Changed
- feat: ui_action, act on a ui_snapshot ref without moving the cursor (#67 phase 2) by @chaodu-agent in #96
- chore: bump to 0.10.0 by @chaodu-agent in #97
Full Changelog: v0.9.0...v0.10.0
oab-computer 0.9.0
⚠ Breaking: tool profiles are now observe and owner (#92, fixes #59)
There are now two tool profiles on macOS and Linux. desktop is removed.
| Profile | Tools | Shell-equivalent |
|---|---|---|
observe (the default) |
sys_info and screenshot only |
no |
owner |
every local tool (shell, input, osascript, ui_snapshot, background jobs) and every browser tool |
yes |
- A
POST /attachwithout a profile now getsobserveon macOS too. Linux already did. - Unknown names, including
sandbox, return400 {"error":"profile must be one of [owner, observe]"}on both platforms. - Grant JSON (
POST /attach,GET /attach,GET /attach/{id}) always carriesrequested_profile, and carrieswarningwhendesktopwas mapped. Both fields are additive. - On a reverse attach under
observe, a longexec,osascriptorbashcall is now reported as an unknown tool, like any other hidden tool.
Upgrading from 0.8.x
Up to 0.8.4 there were three profiles: owner, desktop and observe. desktop hid the exec* tools and allowed 15 browser tools, but it was still shell-equivalent through the GUI. Nothing in the upgrade grants owner: every old desktop input runs as observe, and the change is reported to the granter.
| Input | Before | After |
|---|---|---|
POST /attach {"profile":"desktop"} |
a desktop grant |
202, runs as observe. The grant JSON has "profile":"observe", "requested_profile":"desktop" and a warning. The daemon log and the audit file record the mapping |
POST /attach without profile |
macOS desktop, Linux observe |
observe on both |
POST /attach with sandbox or any other unknown name |
400 (two different messages) | 400 profile must be one of [owner, observe] on both |
A grant stored as desktop (macOS ~/Library/Application Support/oab-instance-mcp/grants.json, Linux grants.json) |
resumed as desktop |
kept and re-dialled under its id, as observe. GET /attach shows profile: observe, requested_profile: desktop and the warning. The file is rewritten with profile: observe and the requested name |
A grant stored as sandbox or an unknown name |
dropped | dropped (unchanged, #46) |
macOS --switchboard-profile desktop (a flag in the LaunchAgent plist) |
desktop |
serves observe, prints the warning to the agent log, and logs switchboard: dialling … as observe (requested desktop). Any other unknown value still exits with status 64 |
macOS ~/.config/oab-instance-mcp/switchboard.profile containing desktop |
copied into the plist | the installer writes --switchboard-profile observe and prints a warning. It does not edit your file |
| Linux environment and config | no profile setting exists | nothing to migrate |
The warning text is the same on both platforms:
The
desktopprofile was removed (openab-computer#59). This grant runs asobserve: sys_info and screenshot only. Grantownerexplicitly for shell and browser access.
A stored row loads as the narrower of profile and requested_profile, so a hand-edited {"profile":"owner","requested_profile":"desktop"} still loads as observe.
Audit file. Every mapping is also appended as one JSON line ("event":"profile_mapped", with source = attach, resume or, on macOS, switchboard) to a mode-600 audit file: macOS ~/Library/Application Support/oab-instance-mcp/audit.jsonl, Linux ~/.local/state/oab-instance-mcp/audit.jsonl ($XDG_STATE_HOME if set; override with MCP_AUDIT_FILE, or MCP_AUDIT_FILE=off to disable). A write failure is logged and never blocks a grant. A resumed desktop grant writes a resume record on every restart while it lives.
Operator steps
- Existing
desktopgrants (for example a session lent from OpenAB Connect or OpenAB Remote) resume asobserveafter the upgrade, so the agent sees onlysys_infoandscreenshot. To restore shell or browser access, grantownerexplicitly: pick Owner in OpenAB Connect or OpenAB Remote, or sendPOST /attachwith"profile":"owner". The new grant replaces the old one for the same runtime and session. Until Connect and Remote are updated, picking "Desktop" there getsobserve, and the apps do not show thewarning. - Switchboard with
switchboard.profile=desktop. Installing 0.9.0 with the.pkgorinstall-prebuilt.shwrites--switchboard-profile observeinto the LaunchAgent plist and prints the warning. Switchboard callers then see onlysys_infoandscreenshotfrom that computer; a caller allowedbrowser_*tools loses them./mcpand/attachare unaffected.- To stay at
observeand silence the warning, writeobserveto~/.config/oab-instance-mcp/switchboard.profile. - To restore browser and input access, write
ownerthere and re-run the installer. The flag lives in the plist, so restarting the agent alone does not apply it. Underownerthe computer also exposesexec*, so the switchboard's per-caller allowlist becomes the only limit. To check, look forswitchboard: dialling … as ownerin the agent log.
- To stay at
- Rolling back to 0.8.x keeps migrated grants at
observe: the old daemon readsprofile: observeand ignores the extra field. The grants fileversionstays 1.
Full details: docs/tool-profiles.md → Upgrading from 0.8.x (#59).
New macOS tool: ui_snapshot (#93, refs #67)
ui_snapshot returns the accessibility tree of a native macOS app's window, read-only: roles, titles, values and frames, with frames in the same display points that screenshot and mouse use. Use it for native apps, browser_snapshot for web pages, and screenshot + mouse for custom-drawn content.
- It targets the frontmost app's focused window by default.
app(bundle id or name),pid,windowandall_windowschoose another target. Depth, node count and time are capped (max_depth,max_nodes,timeout_ms). - It is
owner-only, because it reads text a screenshot does not show (scrolled-out rows, collapsed content, other windows). - It needs the Accessibility permission for the app.
- Linux does not have it yet; an AT-SPI version is planned (#67).
The macOS app now shows as "OpenAB Computer" (#94)
Finder, System Settings and the menu bar now show the app as OpenAB Computer instead of oab-instance-mcp. Only the displayed name changes. The bundle id dev.openab.instance-mcp, the executable and .app file name, the LaunchAgent label, the config, log and state paths, and the release asset names are unchanged, so existing Full Disk Access, Screen Recording and Accessibility grants are kept. Older docs call the app oab-instance-mcp.
Linux installer fix (#91, fixes #90)
scripts/install-linux.sh no longer runs bash while writing oab-instance-mcp.service: the backticks in a comment of the unit-file heredoc are now escaped. Installer flags, paths, units and the upgrade path are unchanged. A new CI job checks every unit the installer writes.
Linux
The Linux hands node's behaviour changes only through the profile change above (#92): the shared 400 message, desktop mapped to observe, requested_profile/warning in grant JSON, stored desktop grants resuming as observe, and the audit file. The installer fix (#91) is the only other Linux change; the rest is tests.
What's Changed
- fix(install-linux): escape the backticks in the unit-file heredoc by @chaodu-agent in #91
- feat!: collapse tool profiles to observe and owner by @chaodu-agent in #92
- feat: ui_snapshot, a read-only accessibility tree for native macOS apps (#67 phase 1) by @chaodu-agent in #93
- feat: show the installed app as "OpenAB Computer" by @chaodu-agent in #94
- chore: bump to 0.9.0 by @chaodu-agent in #95
Full Changelog: v0.8.4...v0.9.0
oab-computer 0.8.4
⚠ Behaviour change: Linux /mcp now keeps session state (#88)
The Linux hands node's /mcp endpoint now tracks MCP sessions the way macOS does:
- An unknown
Mcp-Session-Idreturns 404. DELETE /mcpends the session.- A non-JSON
Content-Typereturns 415. - A malformed request body returns 400.
Linux /mcp clients that skip initialize, or that reuse a stale session id, must now run initialize first and send the session id it returns.
Linux MCP wire matches macOS (#88, fixes #78)
initializenegotiates protocol version2025-06-18.pingreturns{}.- JSON-RPC errors use the standard codes: -32700 (parse error), -32600 (invalid request) and -32602 (invalid params).
- Shared conformance vectors (
conformance/mcp_wire_vectors.json,conformance/mcp_http_vectors.json) are checked by both the Swift and the Linux test suites.
macOS: no functional change since 0.8.3. The app and pkg are rebuilt only for the version number.
What's Changed
- fix(linux): match the Swift MCP wire and /mcp HTTP behaviour (#78) by @chaodu-agent in #88
- chore: bump to 0.8.4 by @chaodu-agent in #89
Full Changelog: v0.8.3...v0.8.4
oab-computer 0.8.3
⚠️ Behaviour change: Linux bare POST /attach defaults to observe (#86, refs #59)
On the Linux hands node, a POST /attach that sends no profile now gets the observe profile. Up to 0.8.2 it got owner. Any caller that relied on the implicit owner must now pass "profile": "owner" explicitly. macOS defaults are unchanged.
Linux additions
- Background jobs (#83): new tools
exec_start,exec_poll,exec_listandexec_cancelrun long work in the background and poll for it, so a call no longer has to stay open for the whole job. They are available only on theownerprofile. - In-process JPEG screenshots (#82):
screenshotencodes JPEG in process and acceptsquality,scaleandregion, matching the macOS arguments. A 1080p capture is about 50 KB as JPEG, against about 2 MB as PNG.
Fixes
wss://dials no longer panic: the Linux node now installs the rustlsringcrypto provider at startup (#85, fixes #66).- Linux
sys_info.agent.versionand MCPserverInfo.versionreport the release version, taken from the tag at build time, instead of the crate version (#76, fixes #74). The release workflow checks withscripts/release-version.shthat the tag, the Swift version and the version the Linux binary reports all match.
Tests and docs
- Tests for the spawn-failure reply and the idle/busy read switch (#77, #75).
- Conformance docs pin the contract points from the #79 cold read (#84).
macOS: no functional change since 0.8.2. The app and pkg are rebuilt only for the version number.
What's Changed
- fix(linux): report the release version from the tag, not the crate version by @chaodu-agent in #76
- test(linux): cover the spawn-failure reply and the idle/busy read switch by @chaodu-agent in #77
- docs(conformance): pin the contract points from the #79 cold read by @chaodu-agent in #84
- fix(linux): install the rustls ring provider so wss:// dials do not panic (#66) by @chaodu-agent in #85
- fix(linux): bare POST /attach defaults to observe, not owner by @chaodu-agent in #86
- feat(linux): in-process JPEG for screenshot, with region and the Swift arguments (#32 item 5) by @chaodu-agent in #82
- feat(linux): background jobs exec_start/exec_poll/exec_list/exec_cancel (#32 item 4) by @chaodu-agent in #83
- chore: bump to 0.8.3 by @chaodu-agent in #87
Full Changelog: v0.8.2...v0.8.3
oab-computer 0.8.2
Linux hands node liveness fix (#72, fixes #70)
The Linux hands node (linux-{arm64,amd64} tarballs) no longer gets dropped when a bash call runs for a long time. Before this release it answered frames inline, so a call longer than about 60–80 s kept it from answering the runtime's pings and the runtime evicted the attach. This is the Linux port of the macOS fix that shipped in 0.8.1 (#69).
- Each frame is answered on its own thread, so runtime pings get a reply while a tool call is still running.
- It sends its own ping every 15 s.
- After a
4011close (liveness timeout) it redials. Backoff resets only after a connection stays up 60 s. - On a reverse attach,
bashrefusestimeout_secsabove 100 s and points to running long work in the background. Local/mcpkeeps the 600 s ceiling. - When the attach closes or the grant is revoked,
bashcalls still running are cancelled and their process group is killed. initializenow returns instructions: keep calls under about 60 s and run long work in the background.
macOS: no change since 0.8.1. The app and pkg are rebuilt only for the version number.
What's Changed
- fix(linux): answer runtime pings during long tool calls (liveness) by @chaodu-agent in #72
- chore: bump to 0.8.2 (Linux liveness fix) by @chaodu-agent in #73
Full Changelog: v0.8.1...v0.8.2
oab-computer 0.8.1
Reverse-attach liveness fix (#69, fixes #68)
A reverse-attached Mac no longer gets dropped when a tool call runs for a long time (for example exec "sleep 1500"). Before this release instance-mcp handled frames one at a time, so a tool call longer than about 60–80 s kept it from answering the runtime's pings and the runtime closed the attach.
- instance-mcp keeps receiving frames, and answering pings, while a tool call is still running.
- It sends its own ping every 15 s.
- After a
4011close (liveness timeout) it redials instead of stopping. - On openab-pty attaches,
execandosascriptcaptimeout_secsat 100 s.
Pair this with the openab-pty runtime change in openabdev/openab-pty#87, which closes a dead attach with 4011 LIVENESS_TIMEOUT and reports last_detach_reason in instance_status.
Not fixed yet: the Linux hands port (linux-{arm64,amd64} tarballs) still drops during long bash calls. That is tracked in #70.
What's Changed
- chore(ci): re-enable markdownlint MD022/MD032/MD060 and run OsascriptToolTests by @chaodu-agent in #60
- docs: Oracle Cloud reference architecture for instance-mcp by @thepagent in #58
- docs(readme): present product as OpenAB Computer during rename by @chaodu-agent in #64
- docs, ci: fix three LOW follow-ups from #58 and #60 by @chaodu-agent in #61
- docs(readme): fix rename banner and repository links by @chaodu-agent in #65
- test(conformance): wire MCP fixtures, reverse-attach negatives, parity checklist by @chaodu-agent in #62
- fix(reverse-attach): answer runtime pings during long tool calls (liveness) by @chaodu-agent in #69
- chore: bump to 0.8.1 (reverse-attach liveness fix) by @chaodu-agent in #71
New Contributors
- @thepagent made their first contribution in #58
Full Changelog: v0.8.0...v0.8.1
oab-computer 0.8.0
What's Changed
- fix(profile): classify every tool; boundary tests fail on unclassified ones by @chaodu-agent in #48
- docs(profiles): tool classification + observe/prompt-injection note by @chaodu-agent in #49
- docs: 'no egress' → no tailnet egress; internet egress is open by default by @chaodu-agent in #50
- ci: require a #openab-pty Discord discussion link on community PRs by @chaodu-agent in #51
- feat: switchboard mode (dial openab-sb /vm/attach) by @chaodu-agent in #53
- chore: bump to 0.8.0 (switchboard mode) by @chaodu-agent in #54
Full Changelog: v0.7.0...v0.8.0