dsh-plugin-web-focus
面向 DSH 的聚焦式页面阅读：web_focus 相关性选择，涵盖稀有术语、链接压缩、原始文本保留、缓存和分节窗口。
插件会安装到这里；不确定时保持 web。
npx -y @deepseek-ai/dsh plugin --profile web add github:shutongcao1-design/dsh_WebFocus#ceb79d31aa9de9e872c0d77dc10fa034c775e11ePlugin Web Focus 以 dsh-plugin-web-focus 发布，当前版本为 0.2.2。Plugin Hub 会校验它的 manifest，并保存精确安装来源，便于复现安装结果。
Focused reading for DSH (DeepSeek Harness):
web_focus fetches one URL and injects the sentences that answer a focus you
write, instead of the whole page.
The built-in web_fetch injects a page's markdown as-is (up to the host's
output cap). This plugin registers a separate tool, web_focus, that ranks
sentences by token overlap with focus, guarantees coverage of rare query terms,
drops navigation chrome and compresses links, keeps the uncompressed original on
disk, and labels exactly how much was omitted.
0.2.0 registers no fetch provider. web_fetch keeps its stock behaviour; the
plugin reaches the network only through the public ctx.web.fetch() API. There is
no fetchProvider patch and disabling the bundle cannot break web_fetch.
SANITIZE_CALL_SITES points at assemble.js's compressStage; the stale
provider.js reference is removed.population no longer loses to rarer words.founding / foundation now trigger the founding-date pass alongside
founded / established / incorporated.The unreleased 0.1.0 prototype took over the fetch path and, when a digest retained under 40% of a page's sentences, injected the whole compressed page instead. A controlled benchmark (below) measured what that did:
| Page size | 0.1.0: injected | 0.2.x: injected | 0.1.0: key sentences kept | 0.2.x |
|---|---|---|---|---|
| 10k chars | 6.9k | 2.9k | 76% | 100% |
| 25k | 15.5k | 2.4k | 94% | 100% |
| 50k | 62k (full text) | 4.0k | 100% (by accident) | 100% |
| 100k | 79.8k (capped full text) | 4.3k | 61% | 100% |
| 200k | 79.8k (capped full text) | 4.4k | 56% | 100% |
| no matching content | 30k / 80k | 644 / 1.7k | — | — |
Live-page checks, same code path (measured during development):
en.wikipedia.org/wiki/San_Francisco: 459,687 raw chars → 3,765 body chars
(0.8% of the raw page) with focus population mayor mission founding date.
Population 873,965, mayor Daniel Lurie, and June 29, 1776 are all
present. The old full-text fallback produced 79.8k chars on this page.zh.wikipedia.org/wiki/Xiamen: 335,038 raw chars → 3,946 body chars (1.2% of
the raw page). The Siming district and Hubin North Road 61 are present.Four changes produced that:
| Mayor | Daniel Lurie | row (role + person) and a | Mission | June 29, 1776 | row (earliest dated founding/incorporation row). The date pass
recognises founded, founding, foundation, established and
incorporated.⚠️ [digest: sparse match …] note.
full=true (or the retained raw text) remains the way to read everything.
Zero-match pages now return headings and first/last sentences — not 80k chars
of unrelated text.clamp(50%, 4k, 24k) page budget
was replaced by a cap that scales with the number of content-bearing focus
tokens (4k–12k), and sentences below 22% of the best selected score are dropped
unless forced, block-cohesive, or coverage-protected. Whole low-score blocks are
dropped together, so list items stay whole.Two measured selection bugs were also fixed: the budget-reconciliation pass used to sacrifice a rank-2 answer sentence (score 44.7) to keep low-score "sticky" filler, and the score fill could exceed the budget because coverage additions were not counted. MediaWiki Parsoid JSON (the infobox template leaked as one 18.6k line on the San Francisco page) is dropped, and markdown table rows are preserved instead of being mistaken for menu lines.
raw text → strip invisible chars → compress links / drop nav → split sentences
→ forced: first 2 + last 2 + query-matched headings (at most 8)
→ score fill: focus-sized budget 4k–12k
→ protect the top query-bearing answer sentences
→ query-term/role/date coverage (displaces ordinary filler)
→ block cohesion (groups of ≤4 sentences)
→ adaptive trim (<22% of best score)
→ budget reconciliation (answers and forced sentences survive)
→ coverage header + sparse-match note
Scoring is in-page IDF × query-token overlap, plus small priors for position,
numbers and headings. focus is a keyword query, not a summarization
instruction: write the words you expect the answer to contain.
Token-overlap selection cannot find a fact that shares no vocabulary with the
focus. The benchmark's paraphrase case (page says "closed a $42 million financing
round", focus says "how much outside money did it take") keeps 2 of 3 key
sentences; the missing one has a score of 0.8 (numeric prior only). This is a
limitation of lexical retrieval, not a tuning bug. Mitigations: write the focus
with likely page vocabulary, use full=true for paraphrase-heavy pages, or read
the retained raw text. The other adversarial cases — multi-sentence answers,
tables, Chinese pages, a rare term appearing in seven sentences, a key past the
80k cap — all keep 100% of key sentences.
web service (@deepseek-ai/dsh-web-app).@deepseek-ai/schemastery (peer dependency; DSH provides it).The host's http fetcher truncates decoded bodies at 100,000 chars by default.
On a large Wikipedia page that cut lands inside the infobox, before the prose:
the plugin receives navigation only, compresses it under the 8k selection
trigger, and cannot select what never arrived. The plugin now warns explicitly
when truncated: true, but the real fix is the host row:
- id: web-fetch-http
config:
maxBodyChars: 2000000
That is the value used by the profile this was tested with (2M = the plugin's own
HTML input cap, so the host is no longer the limiting factor). It requires a host
restart. maxTextLength (80k) remains the separate context-budget knob.
The package is not published to npm. Clone this repository and install the bundle from the checkout:
git clone https://github.com/shutongcao1-design/dsh_WebFocus.git
plugin_manager action: install_bundle target: <absolute path to the checkout>
The bundle patch only inserts the plugin row; it does not touch the web
row. If an older provider-based copy is installed, remove that bundle first and
update any profile patch that referenced its provider id.
| Option | Default | Meaning |
|---|---|---|
rawDir | <package>/data/raw | Where uncompressed raw text is written (anchored to the module location, not cwd) |
rawMaxChars | 4194304 | Per-file limit; beyond it the file is truncated and the header says so |
rawCleanupDays | 30 | Age at which raw text is deleted at startup (0 disables); symlinks are skipped |
pageCacheTtlSeconds | 1800 | Page-cache TTL |
negativeCacheTtlSeconds | 240 | Failure-cache TTL, deliberately shorter |
maxTextLength | 80000 | Hard limit on injected page text; headers and markers count against it |
sourcesMax | 30 | Maximum source-footer entries kept |
enableFocusTool | true | Register web_focus |
exposeInternals | false | Expose cache/rawStore/web on ctx.__webFocus for probes |
web_focus throw instead of re-fetching. refresh: true clears both caches.focus produces a different digest.web_focus renders only notice + content. The structured fields
(kept, total, fallback, fromCache, rawPath) are for tooling.rawDir somewhere durable if you rely on it.rawCleanupDays). Choose a private rawDir, lower the retention, or delete
the directory if you process sensitive pages. The page cache is in memory and
is lost on restart.ctx.web.fetch, so URL validation, SSRF blocking, redirect policy, size caps and
charset rules remain the host's.node --test # 31 tests; integration tests skip when the host peer is absent
The package is self-contained: shared helpers are vendored under lib/vendor/,
and test/package.test.js enforces that no import leaves the package root.
The benchmark harness used for these numbers is a separate development-only project and is not shipped in this package. It generates filler pages, injects known key sentences over five length bands (10k–200k) and runs the adversarial cases; it compares this package against a frozen earlier snapshot of the same selection code and writes JSON evidence.
Issues and pull requests are welcome. Run npm test before sending a change.
The package deliberately has no runtime dependencies; keep host integration on
the public ctx.web.fetch() API and vendor any shared helper under lib/vendor.
MIT — see LICENSE.
This is an independent community plugin, not affiliated with or endorsed by DeepSeek.