dsh-bundle-vision
A zero-core-change vision capability for DeepSeek Harness, shipped as one installable npm package that is both a profile bundle and a plugin:
- the plugin registers the model-facing
describe_image tool;
- the bundle patch mounts that plugin on any profile.
The tool reads a local PNG/JPEG/WebP/GIF file, commits the bytes through the shipped attachment service, and asks the named multimodal route about it in one direct LLM request (provider / model are tool arguments). The result is text only — no image block ever enters the calling session, so a text-only main model gains vision without any change to dsh itself.
How it works against the shipped seams
Everything the tool uses already ships with every dsh profile:
ctx.fs (bounded byte read, session-workspace resolution) — filesystem capability;ctx.attachments (saveImage, image limits, magic-byte validation) — durable image storage;ctx.llm (resolveModelInfo + stream) with the pi-ai multi-provider adapter — the multimodal request itself.
The one per-deployment prerequisite is the same as for any vision use of dsh: the multimodal model must declare image input in the llm-pi-ai settings section, e.g.:
llm-pi-ai:
providers:
my-vision:
apiKeyEnv: MY_VISION_API_KEY
api: openai-completions
baseURL: https://example.invalid/v1
models:
- id: my-vision-model
input: [text, image]
(On releases whose Models page has the input-modality control, the same declaration is one dropdown.)
Install (installed dsh, no source checkout)
From the npm registry:
dsh plugin --profile <name> add dsh-bundle-vision
Or from a packed tarball (e.g. before the first publish, or for a pinned version):
dsh plugin --profile <name> add ./dsh-bundle-vision-0.1.0.tgz
dsh plugin forwards to pnpm inside the profile directory and reconciles the profile's bundle layers automatically — a dependency declaring dsh.bundle joins the layer stack. Restart dsh <name>; the tool registers for every agent (profile-root registrations are visible to all preset scopes).
Use
Ask the main model, naming the route:
Use describe_image with file_path /path/to/photo.jpg, provider my-vision, model my-vision-model, and prompt "OCR the text in this image".
The main model supplies provider/model per call — configure several multimodal routes and switch per call, no profile edits. Refusals name the failing gate (unknown extension, deployment media types, a route whose model does not declare image input, a missing file, a type-mismatched file, an errored stream).
Version floor
The package declares >=0.1.0-rc.6 peer dependencies on the dsh seam packages. Bump the floor if a later release is required.
Development
npm install # dev deps resolve the seam packages from the npm registry
npm run typecheck # tsc --noEmit over src + tests
npm test # vitest
npm run build # tsdown (lib/index.js) + tsc declarations (lib/types)
npm pack # the installable tarball
