You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Linux hands node: ui_snapshot and ui_action via AT-SPI (deferred) #102
Split out of #67, which delivered both tools on macOS: ui_snapshot (0.9.0, #93) and ui_action (0.10.0, #96, with the sheet fix #98/#99 in 0.10.1).
Status: deferred. We'll pick this up when a Linux hands node actually needs it. Until then, Linux callers use screenshot + mouse/key, and browser_snapshot for web pages.
Scope when picked up
ui_snapshot on the Rust Linux port (poc/reverse-attach-linux) over AT-SPI (D-Bus), with the same output contract as macOS: role, name, value, states, frame in screenshot coordinates, a per-snapshot ref and snapshot_id, node/depth limits, a deadline, truncated/timed_out, and secure (password) fields masked.
ui_action(snapshot_id, ref, action) via AT-SPI Action/EditableText/Component: press, set_value, focus. Stale refs are refused, the cursor never moves, it is owner-only, and secure values are never logged. A switchboard secure set_value refusal applies, as on macOS.
Evaluate AT-SPI coverage on our wlroots seats (labwc/sway): which toolkits expose a usable tree (GTK, Qt, Electron/Chromium with accessibility enabled), and whether coordinates match the grim screenshot space.
Activity
docs: mark Linux AT-SPI ui_snapshot/ui_action as deferred (#102) (#103)
docs: add Features section to README
docs: restructure README; move detail to docs/ (#106)