dsh-image-webp-to-png
将 WebP 附件 request-images 重新编码为 PNG，供无法解码 WebP 的 LLM 后端（例如 llama.cpp）使用。修复带 alpha 通道图像的“400: Failed to load image or audio file”错误。
插件会安装到这里；不确定时保持 web。
npx -y @deepseek-ai/dsh plugin --profile web add github:MrGnUm/dsh-image-webp-to-png#e2991964767b388bac5464c8bdd1c97fdefc87a0Image Webp To Png 以 dsh-image-webp-to-png 发布，当前版本为 0.1.0。Plugin Hub 会校验它的 manifest，并保存精确安装来源，便于复现安装结果。
A DeepSeek Harness (DSH) bundle that fixes the 400: Failed to load image or audio file error you get when sending alpha-channel images to a backend that
cannot decode WebP — most notably llama.cpp (its vision decoder is stb_image,
which has no WebP support).
It is an installable plugin: it lives in your profile, is re-applied on every DSH
start, and survives DSH updates without touching the root-owned
/usr/lib/node_modules/@deepseek-ai/dsh/node_modules/@deepseek-ai/dsh-attachment-local
file.
DSH normalizes every attached image in dsh-attachment-local. The codec choice is
hard-coded (encodingLadder):
const mediaType = hasAlpha ? "image/webp" : "image/jpeg";
So any image with an alpha channel is re-encoded to WebP. (A clean 8-bit sRGB image with no metadata that fits the size/limit budget passes through as-is; opaque images become JPEG.)
stb_image cannot decode WebP → the request is
rejected with 400 {"code":400,"message":"Failed to load image or audio file"}
and the server logs E mtmd_helper_bitmap_init_from_buf: failed to decode webp buffer.There is no configuration knob in dsh-attachment-local to change this codec,
and the server side (llama.cpp) is not going to add a WebP decoder, so the fix
belongs on the client.
The adapter (e.g. dsh-llm-pi-ai, used by your fedotov provider) builds the
outgoing request by calling the attachment seam:
attachments.readImageRequest(ref, target, signal) // -> { data, mediaType, width, height, ... }
This bundle wraps that one seam method at DSH start (idempotently, guarded by a
Symbol). Whenever the underlying store returns a WebP request-image, the
wrapper transparently re-encodes those bytes to PNG:
variantId, so a given image is re-encoded once.Everything else passes through untouched (JPEG stays JPEG, PNG stays PNG).
The wrapper is fail-open: if sharp is missing, a decode fails, or the seam is
not ready at load time, the original WebP result is returned unchanged and DSH
keeps working exactly as before. This bundle can never block or fail a request.
dsh-image-webp-to-png/
├── package.json # bundle manifest (dsh.bundle.patch)
├── cordis.patch.yml # self-declares the entry (id: image-webp-to-png)
├── lib/index.mjs # the bundle: wrap(attachments) + webpToPng()
├── install.sh # install into a profile (default: web)
└── uninstall.sh # remove from a profile
Requirements: pnpm on PATH, and a DSH profile (default ~/.dsh/profiles/web).
cd dsh-image-webp-to-png
./install.sh # -> ~/.dsh/profiles/web
# or a different profile:
DSH_PROFILE_DIR=/path/to/profile ./install.sh
install.sh (idempotent, backs up package.json first):
dsh-image-webp-to-png as a link: dependency pointing at this directory.dsh.profile.bundles array.pnpm install in the profile to create the symlink + update the lockfile.The fix takes effect on the next DSH web session (immediately if the profile
has patchReload: "live").
Repo: MrGnUm/dsh-image-webp-to-png
(private). From any machine with pnpm, git, and access to the repo — HTTPS
clone works with the gh credential helper (no token prompt):
git clone https://github.com/MrGnUm/dsh-image-webp-to-png.git
cd dsh-image-webp-to-png
./install.sh # -> ~/.dsh/profiles/web
Then restart the DSH web session (or it hot-reloads if the profile has
patchReload: "live"). Remove later with ./uninstall.sh.
Send an alpha-channel image (a PNG with transparency) to your fedotov model
and ask it to describe it. Before the bundle: 400 … Failed to load image or audio file. After: the model describes the image.
You can also watch the DSH logs for the one-time line:
dsh-image-webp-to-png: wrapped attachments.readImageRequest (WebP -> PNG).
./uninstall.sh # clean removal
# or, using the backup install.sh made:
./uninstall.sh ~/.dsh/profiles/web/package.json.bak-<timestamp>
The client-side fix above is sufficient. If you would rather fix it at the source,
the root cause is the hard-coded hasAlpha ? "image/webp" : "image/jpeg" in
dsh-attachment-local/lib/index.js (encodingLadder, and the matching
pipeline.webp(...) branch in encode()). Upstream has no option to emit PNG for
alpha images; a small patch adding a PNG branch (and bumping the
request-image-v6 transform version so stale WebP cache entries are regenerated)
would remove the need for this bundle.
LocalAttachmentStore). If a future DSH changes the seam method name
(readImageRequest) or its return shape, the wrapper degrades to a no-op
(fail-open) and the original behaviour resumes.sharp is resolved from the DSH installation
(/usr/lib/node_modules/@deepseek-ai/dsh/node_modules/sharp); this bundle has
no runtime dependencies of its own.