Zero-spawn CDP browser control plugin for DeepSeek Harness: screenshots, pixel assertions, page JS — no vision model, no per-use approval
Pending human review — the facts below come from the source repository.
Zero-spawn CDP browser control plugin for DeepSeek Harness: screenshots, pixel assertions, page JS — no vision model, no per-use approval
Users who want this capability in DSH; check the source and docs before installing.
dsh plugin --profile web add github:zaiwenJ/dsh-cdp-browser No supported platforms were declared.
fetch + global WebSocket (Node ≥ 22) + zlib PNG decode. No child_process, no npm dependencies, no per-use approval. ## Why zero-spawn Plugins that spawn an engine and pipe its stdio (e.g. modlens) collide with the harness sandbox's pipe ban (EPERM/EINVAL) on every call. Connecting to a browser the user started themselves is plain network I/O — allowed in confined mode. The one manual step (launching the browser) happens outside the harness, so the model never needs approval again for visual checks. ## Setup (once) 1. Install into the profile (done via dsh plugin --profile web add file:<path>). 2. Start your browser with CDP (the provided edge-debug.cmd does this): msedge.exe --remote-debugging-port=9222 --remote-allow-origins=* --user-data-dir=<dir> <url> 3. Restart the Web GUI. The cdp_* tools appear in the next session. ## Tools | Tool | What it does | | --- | --- | | cdp_status | List tabs/targets of the CDP browser + browser version | | cdp_open | Open (or reuse) a tab for a url; returns target id | | cdp_eval | Evaluate JS in a page (awaitPromise, returnByValue) | | cdp_shot | Navigate + PNG screenshot, saved to an absolute path | | cdp_assert | Scripted interaction + deterministic checks (pixel / css / dom / js) with a pass/fail report | ## cdp_assert check shapes js checks: [ { type: 'pixel', x: 0.5, y: 0.96, color: '#245edb', tolerance: 16 }, // relative coords 0..1 or absolute px { type: 'css', selector: '#taskbar', property: 'background-color', equals: 'rgb(36, 94, 219)' }, { type: 'css', selector: '.xp-window', property: 'border-radius', matches: '^\\d+px' }, { type: 'dom', selector: '.xp-desk-icon', text: 'My Computer' }, { type: 'js', expression: 'window.__XP.selfTest()', equals: { ok: true } }, ] // every check accepts click: '#start-btn' | { selector } | { x, y } and waitMs ## Development bash node plugins/dsh-cdp-browser/test/e2e.mjs # needs dev server + CDP Edge, starts nothing Determinism notes (learned from the XP app's first plugin e2e): - Reload the page per test run. A long-lived tab accumulates state across scripted sweeps (windows, dialogs, menus) and can wedge openApp; a fresh navigate + skipBoot per suite is deterministic. probe-apps.mjs bisects per-app hangs when an app regresses. - Synthetic clicks toggle state. el.click() runs the real handlers — clicking a toggle twice flips it twice. One click per assertion. - Gradient surfaces need stop-aware sampling. Sample where a gradient stop dominates (flat zones or edges), not mid-gradient blends, or use tolerance-aware nearColor against computed-style values. The package exposes ./cdp (targets, openTarget, withPage, Cdp, decodePng, samplePixel, nearColor, runChecks, savePng) for reuse outside the harness.Not by stars — picked by hand, one at a time.
A visual settings dashboard for DeepSeek Harness: every registered settings namespace — including third-party plugin ones the official UI never covers — rendered as editable, schema-driven forms. Early, but the right direction: stop hand-editing YAML.
A DIY trajectory visualizer for DeepSeek Harness: watch the agent’s plan and execution unfold as a graph instead of scrolling raw logs. Early, but it fills a real gap — understanding at a glance what the agent is doing.
Dispatch DSH work from Claude Code / Codex: spin up in-host DSH agent sessions with per-tier presets, watch native subagent progress, and borrow a multimodal bridge that lends the text-only harness vision and image generation. An orchestration plugin that turns DSH into a backend for other coding agents.