dsh-vision-reasoner
在图片上标记并查看图片：一个 DeepSeek Harness 插件，可将图像转换为带编号标记的记录，并提供带坐标标签的特写图和可供核对的对比图表。
插件会安装到这里；不确定时保持 web。
npx -y @deepseek-ai/dsh plugin --profile web add github:LionNatsu/dsh-vision-reasoner#ff2ab957d71a011d106b5da6afe2a89e2a655d3eVision Reasoner 以 dsh-vision-reasoner 发布，当前版本为 0.1.1。Plugin Hub 会校验它的 manifest，并保存精确安装来源，便于复现安装结果。
A DeepSeek Harness plugin that lets a model put numbered marks on a picture and look at what it drew. Every view is labelled in original-image pixels, so a coordinate comes from the picture rather than from a guess at a scaled preview, and several places can be compared in one image. It is not specific to any kind of picture: counting the people in a photograph is one use, checking which of two similar regions a note meant is another.
| Tool | Purpose |
|---|---|
vision_mark | Add numbered marks. One call takes a whole round of them. |
vision_update | Move, recaption, recolour or delete marks by number — 17=yellow, 21 "half hidden", 16 removed in one call. |
vision_show | Look: the whole frame with a ruler, a close-up of one address, several addresses as one sheet, or a cover that paints given colours out. |
vision_list | Read the record back as text. |
A mark is a position, a number, a caption and a colour. The number is drawn on the
picture, so #17 can be moved, recoloured or deleted without describing it in
words. The tools never count or judge what is in a picture — that is the model's
statement to make — and vision_list reports only how many marks the record
holds.
dsh plugin --profile <name> add dsh-vision-reasoner
Or from the Web UI: Plugins → Add plugin, with the package name. The package
declares dsh.bundle.patch → ./cordis.patch.yml (one Host row), which the
profile loader applies the next time the profile loads. There is no build step and
no install script.
The only dependency is sharp (Apache-2.0),
which the harness already uses for every image a session attaches
(@deepseek-ai/dsh-attachment-local depends on it), so a deployment that can run
this plugin already has it. Nothing third-party is vendored: the icon and the two
locale files are this package's own. Node ^22.19.0 || >=24.0.0.
The record is not written to disk. Marks live in the session log. The harness logs every tool call with its arguments and its result, and the record is a fold of those events, rebuilt with the same two pure functions the live call used. A reopened session recovers the same record, and nothing appears beside your picture.
Each view is written twice. The model receives an image block through the
attachment service, the shape read_image sends, so the picture arrives with the
call that drew it. The Web UI's preview needs a file, because it decides how to
render a document from its extension and an attachment object has none; the PNG is
therefore also written to <cwd>/.dsh-vision/<name>.png and reported
workspace-relative in images[].path. That directory is the only thing this
plugin writes, and only when there is a picture to show.
A missing picture is reported, not thrown. No attachment service, or a model
that does not declare image input (the gate read_image applies), returns the text
plus a note instead of an image block; so does a failed write. Anything merely
unknown — an unresolvable route, an adapter error — attaches anyway, because
withholding a picture over a failed lookup costs more than it protects.
Pictures are read through ctx.fs, so the sandbox decides what may be read.
cover paints the given colours out, so whatever still shows has not been
marked. It checks the record, not the perception that produced it.ids: false and captions: false draw the rings alone, for places where the
annotations cover what is being read.MAX_VIEW_DIMENSION), including
sheets, whatever the caller asks for.tool/call, so the fold does not see them.cover.node test/vision.test.mjs # record, views, geometry, dimension caps
node test/tools.test.mjs # the Host half against a stand-in harness
The first renders real PNGs and inspects pixel colours, so a mark that moved would fail. The second drives all four tools against a fake session and filesystem: it checks that every returned value satisfies its declared output schema, and that the record is a fold — a committed call counts, a failed one does not, an unfinished one never happened.
tools/replay-session.mjs <session.v4.jsonl.zstd> [--png out.png] rebuilds a
record from a stored session log with no harness in the loop, and can render it
onto the picture it names. tools/inspect-region.mjs IMAGE X Y W H prints part of
an image as ASCII. tools/row-css.mjs prints the harness's own tool-row CSS.
index.js is the Host half. lib/client.js is the browser half, which claims one
transcript row per tool name. The module contracts are in
docs/DESIGN.md.
MIT — see LICENSE.