daniel.w
/
AnyBot
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
AnyBot/src
History
王性驊 a3e71aa22e Drilled the box's screen path end to end on the real box, and fixed what the drill caught 
box_real_usage_drill (ignored) drives the whole path on a page that reports what really landed:
one batch fills and sends a form (six steps, Chinese typing, 1.6 s), a bare-x/y click on a canvas
lands 1 px off its target, a drag ends where it was pointed, scrolling reveals a field that is
then clicked and typed by number, and the same spot clicked twice says so. Every step is timed:
look 477 ms, steps 650-880 ms.

Caught: the a11y tree is exposed after the screen settles (measured 0.2-0.35 s behind a scroll),
so a list read in parallel with the picture can miss a control the picture already shows.
box_look now starts the capture in the background and gives the a11y read 0.18 s before running;
the parallel capture pays for it, and a scrolled-in field is in the list every run.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
 		2026-11-06 09:58:07 +08:00
..
app Bots do a planned sequence in one step; the box's screen settles by what it shows; no login is ever the only copy 2026-11-06 09:47:37 +08:00
agent.rs Bots click by number: every control on the screen is boxed and numbered, on every computer 2026-11-06 00:47:01 +08:00
app.rs Bots do a planned sequence in one step; the box's screen settles by what it shows; no login is ever the only copy 2026-11-06 09:47:37 +08:00
appctl.rs The bots' computer never sleeps; a server brain doesn't work on the server; the computer choice lives in the side panel; bots default to their own computer 2026-11-05 17:07:04 +08:00
attach.rs The bots' computer never sleeps; a server brain doesn't work on the server; the computer choice lives in the side panel; bots default to their own computer 2026-11-05 17:07:04 +08:00
avatar.rs AnyBot: first commit of the working desktop app 2026-11-04 16:51:51 +08:00
axread.rs Mac permissions: ask at most every ten minutes; one fixed signing key keeps them across updates; open apps by their shown name 2026-11-05 16:57:44 +08:00
botbrowser.rs Every computer goes by its own name; a server brain works on the computer the person uses 2026-11-05 16:47:28 +08:00
browser.rs AnyBot: first commit of the working desktop app 2026-11-04 16:51:51 +08:00
channels.rs Routines follow the clock in each timezone; channels resume where they stopped; pages find checks the bot 2026-11-05 15:48:22 +08:00
cloudbox.rs Drilled the box's screen path end to end on the real box, and fixed what the drill caught 2026-11-06 09:58:07 +08:00
computer.rs Bots do a planned sequence in one step; the box's screen settles by what it shows; no login is ever the only copy 2026-11-06 09:47:37 +08:00
desk.rs Bots click by number: every control on the screen is boxed and numbered, on every computer 2026-11-06 00:47:01 +08:00
desktop.rs Bots click by number: every control on the screen is boxed and numbered, on every computer 2026-11-06 00:47:01 +08:00
diagram.rs AnyBot: first commit of the working desktop app 2026-11-04 16:51:51 +08:00
egress.rs Remote: per-IP login lock, egress peers and timeouts narrowed; brain-mirror link covered by tests 2026-11-05 15:48:20 +08:00
httpd.rs Remove what nothing uses and keep one copy of what was written several times 2026-11-05 23:21:47 +08:00
i18n.rs Replies in Traditional Chinese when that is the setting; a cloud brain's browser is the person's 2026-11-05 14:46:42 +08:00
i18n_table.rs 需要處理: a bot hands a step to the person with its computer's live screen in the chat; the window fills to the top; the 電腦 card and viewer keep their text in place 2026-11-05 17:29:55 +08:00
icons.rs Remove what nothing uses and keep one copy of what was written several times 2026-11-05 23:21:47 +08:00
macapps.rs Docker calls time out; the box has a VNC key, limits and sandboxed files; X11/Wayland eyes and hands stop leaking 2026-11-05 15:48:22 +08:00
main.rs Bots click by number: every control on the screen is boxed and numbered, on every computer 2026-11-06 00:47:01 +08:00
marks.rs Bots click by number: every control on the screen is boxed and numbered, on every computer 2026-11-06 00:47:01 +08:00
mcp.rs Compaction keeps tool pairs; MCP locks per server; the chosen computer needs whole words to move 2026-11-05 15:48:20 +08:00
memory.rs Every computer goes by its own name; a server brain works on the computer the person uses 2026-11-05 16:47:28 +08:00
mic.rs Demo recording keeps its last events off the UI thread; dialogs, screensaver probe and installer traps fixed 2026-11-05 15:48:22 +08:00
model.rs Every computer goes by its own name; a server brain works on the computer the person uses 2026-11-05 16:47:28 +08:00
notify.rs Texture caches capped; big previews decode off the UI thread; helper processes reaped 2026-11-05 15:48:22 +08:00
pages.rs Routines follow the clock in each timezone; channels resume where they stopped; pages find checks the bot 2026-11-05 15:48:22 +08:00
phone.rs Remove what nothing uses and keep one copy of what was written several times 2026-11-05 23:21:47 +08:00
platform.rs Every computer goes by its own name; a server brain works on the computer the person uses 2026-11-05 16:47:28 +08:00
policy.rs AnyBot: first commit of the working desktop app 2026-11-04 16:51:51 +08:00
portal.rs Stream deltas keep tool-call slots; chunked bodies accepted; portal sessions race-safe 2026-11-05 15:48:20 +08:00
preview.rs Texture caches capped; big previews decode off the UI thread; helper processes reaped 2026-11-05 15:48:22 +08:00
providers.rs 需要處理: a bot hands a step to the person with its computer's live screen in the chat; the window fills to the top; the 電腦 card and viewer keep their text in place 2026-11-05 17:29:55 +08:00
remote.rs Bots click by number: every control on the screen is boxed and numbered, on every computer 2026-11-06 00:47:01 +08:00
routines.rs Routines follow the clock in each timezone; channels resume where they stopped; pages find checks the bot 2026-11-05 15:48:22 +08:00
setup.rs Setup quotes service paths and writes launcher and unit files atomically 2026-11-05 15:48:22 +08:00
share.rs Export drops threads; a broken keyring stops with the secret recoverable 2026-11-05 15:48:20 +08:00
teach.rs One way to act on a screen: a real click or keystroke, wherever the bot looked 2026-11-05 21:51:19 +08:00
teams.rs Remove what nothing uses and keep one copy of what was written several times 2026-11-05 23:21:47 +08:00
theme.rs Remove what nothing uses and keep one copy of what was written several times 2026-11-05 23:21:47 +08:00
tools.rs Remove what nothing uses and keep one copy of what was written several times 2026-11-05 23:21:47 +08:00
triggers.rs Routines follow the clock in each timezone; channels resume where they stopped; pages find checks the bot 2026-11-05 15:48:22 +08:00
tunnel.rs Remove what nothing uses and keep one copy of what was written several times 2026-11-05 23:21:47 +08:00
vault.rs Remove what nothing uses and keep one copy of what was written several times 2026-11-05 23:21:47 +08:00
vault_store.rs Remove what nothing uses and keep one copy of what was written several times 2026-11-05 23:21:47 +08:00
vnc.rs People watch and help on the bots' computer through VNC (noVNC), carried by the account server 2026-11-05 23:05:44 +08:00
voice.rs Remove what nothing uses and keep one copy of what was written several times 2026-11-05 23:21:47 +08:00
web.rs Bots click by number: every control on the screen is boxed and numbered, on every computer 2026-11-06 00:47:01 +08:00
wire.rs Remove what nothing uses and keep one copy of what was written several times 2026-11-05 23:21:47 +08:00
wl.rs Wayland screenshots can't crash the desktop when /run/user is full 2026-11-05 20:06:46 +08:00
x11.rs Bots click by number: every control on the screen is boxed and numbered, on every computer 2026-11-06 00:47:01 +08:00