Showing the last saved plugin snapshot.
regrevia/dsh-mobile-use
“Android in the sidebar, driven by text instead of screenshots.”
Android in the sidebar, driven by text instead of screenshots. 30 tools read the real UI tree, tap by text/id/ref, measure animation motion, and mirror the screen into the sidebar where you circle a spot and send it back with one sentence — the host ships the marked-up frame plus the controls inside the circle to the chat. Token cost is the point: a screen check is a 200-600 token text block, not a 1k+ token screenshot, and a warm check costs 100-200 ms of wall clock. Video is raw H.264 straight into WebCodecs — no transcoding — with p50 2 ms host-write to decoded frame over a 26 s run, one decoder, zero dropped frames; it falls back to MSE on its own and ?avc=0 forces the old path. Sound is one switch, off by default and remembered per serial, so the default path pays nothing; when on, audio rides its own socket (48 kHz stereo PCM, measured 22 s.
