dsh-frontier-repro
以证据为先的前沿 AI 雷达和可复现性门槛，用于 DeepSeek Harness
插件会安装到这里；不确定时保持 web。
npx -y @deepseek-ai/dsh plugin --profile web add dsh-frontier-repro@0.3.1Frontier Repro 以 dsh-frontier-repro 发布，当前版本为 0.3.1。Plugin Hub 会校验它的 manifest，并保存精确安装来源，便于复现安装结果。
Primary signals in. Auditable reproduction out.
中文 · Download · Star the project
An evidence-first frontier AI radar and reproduction gate for DeepSeek Harness.
This is not another generic news reader, arXiv search engine, or paper summarizer. It covers the missing path from a curated primary-source signal to a versioned release evidence bundle and then to an auditable reproduction decision. Executed attempts are retained—including failures and negative results—and a successful exact/scaled claim requires commands, artifacts, measured claim results, and independent verifier evidence.
| Discover what matters | Build evidence, not hype | Reproduce without overclaiming |
|---|---|---|
| Curated arXiv, first-party lab, GitHub, Hugging Face, hardware-vendor, verified blog, and optional X signals. | Cross-source release bundles retain immutable revisions, provenance, missing evidence, and substantive change history. | Claim-level protocols preserve commands, artifacts, metrics, resources, verifiers, failures, and negative results. |
[!TIP] If this makes a frontier release easier to trust or reproduce, give the repository a star. It helps more DSH users find the project.
Existing DSH plugins already cover literature discovery/full text (dsh-ai4scholar, dsh-literature), guided paper reading and notes (dsh-paper-workshop), general RSS reading (dsh-news), scientific-claim adjudication (dsh-research-plugins), and replayable experiment execution (dsh-science-workbench). This plugin does not duplicate those surfaces. It adds:
firstSeenAt / lastSeenAt / supersedesDigest version chains, and substantive-only watchlists;execute_existing, partial_reimplementation, and from_scratch_replication protocols;See docs/research.md for the overlap audit and docs/architecture.md for the Cordis spatiotemporal mapping.
Corporate/personnel announcements, placeholder titles, missing-date records from date-contracted sources, and personal-life posts are filtered before persistence. Sources may declare category allow/deny lists and known boilerplate titles. Recent Hugging Face model cards are inspected only to discover paper, code, data, and evaluation links; full card text is not archived. arXiv records retain both a stable paper id and the observed immutable vN. GitHub repositories and public Hugging Face models/datasets are resolved to full SHAs, while mutable popularity counts remain context only.
cs.AI, cs.CL, cs.LG, cs.CV, cs.RO, and cs.SE through the official Atom API.No unverified DeepSeek-founder or GLM-person account is preloaded. Add a custom person source only with a first-party identityEvidenceUrl.
| Tool | Purpose |
|---|---|
frontier_repro_status | Source, corpus, credential, and persisted source-health status without network access |
frontier_repro_collect | Refresh curated sources, persist, dedupe, and rank signals |
frontier_repro_events | List versioned cross-source release evidence bundles and substantive watch changes |
frontier_repro_bundle | Inspect one bundle, predecessor chain, source records, claims, and all attempts |
frontier_repro_watch | Add/remove/acknowledge release watches by substantive digest |
frontier_repro_search | Search the local corpus only |
frontier_repro_revert_collection | Safely undo the latest live collection batch |
frontier_repro_get | Full provenance, artifacts, assessment, and run history |
frontier_repro_assess | Evidence gate for exact/scaled/behavioral reproduction |
frontier_repro_assess_claims | Claim-level gate for execute/partial/from-scratch modes and exact/scaled/toy equivalence |
frontier_repro_graph | Deterministic source/artifact/requirement/run dependency graph |
frontier_repro_record_result | Persist executed commands, artifacts, metrics, deviations, and verdict |
frontier_repro_record_attempt | Preserve one claim-level attempt, resources, verifier, and honest outcome |
frontier_repro_manifest | Canonical reproduction handoff manifest with SHA-256 integrity |
frontier_repro_trackio_scaffold | Export a local-first Trackio logbook scaffold without executing or publishing |
Requires Node.js ^22.19 or >=24 and DeepSeek Harness 0.1.0-rc.7 or newer within the 0.1.x line. The in-app X credential card uses the plugin-settings extension introduced in rc.7.
dsh plugin --profile web add "https://github.com/JimchengChina/dsh-frontier-repro/releases/latest/download/dsh-frontier-repro.tgz"
For source development, clone the repository, run pnpm install, and add its absolute path instead. Headless profiles can install the same release with --profile headless.
Restart the selected profile. The default corpus is $DSH_HOME/frontier-repro/index.json.
During installation, the plugin reminds you that X API access is optional. In DSH Web, open Settings → Plugins → Plugin configuration → Frontier Repro to save an X API bearer token. If you do not configure one, X sources are disabled and skipped by default; arXiv, official lab blogs, GitHub, Hugging Face, and all other sources continue normally.
Tagged releases attach a verified package tarball and SHA-256 file. Storefronts can use https://github.com/JimchengChina/dsh-frontier-repro/releases/latest/download/dsh-frontier-repro.tgz without running a source build.
Use Settings → Plugins → Plugin configuration → Frontier Repro in DSH Web, set X_BEARER_TOKEN in the launch environment, or write the same reference through the DSH credentials store. The token is resolved for every collection and never enters config, the corpus, or tool output. Without X API access, default collection skips X sources and every other source continues. Explicitly requesting an X source still returns its exact missing condition.
No HTML scraping fallback is used.
- id: frontier-repro
config:
defaultDays: 90
defaultLimit: 20
maxRecords: 1000
maxCollections: 20
requestTimeoutMs: 20000
maxResponseBytes: 5242880
pageConcurrency: 3
githubEnrichLimit: 8
huggingFaceEnrichLimit: 20
githubTokenEnv: GITHUB_TOKEN
xBearerTokenEnv: X_BEARER_TOKEN
# storagePath: /absolute/path/index.json
# sourceFile: /absolute/path/sources.json
promptGuidance: true
promptOrder: 145
sourceFile is trusted local administrator configuration. Tool arguments never accept arbitrary source URLs. Custom sources may declare allowCategories, denyCategories, requirePublishedAt, boilerplateTitles, and healthStaleAfterDays. A github_org source declares an organization plus bounded releaseRepoLimit / releasesPerRepo; person sources require a name, role, and first-party identity evidence. GITHUB_TOKEN is optional and only raises public API limits; X API access remains explicitly required for X sources. See sources.example.json and docs/source-policy.md.
frontier_repro_events / frontier_repro_bundle.changed_since_watch only when capability claims, evaluation evidence, licenses, or immutable artifacts changed; acknowledge after review.execute_existing, partial_reimplementation, or from_scratch_replication, plus exact, scaled, or toy equivalence.passed requires all required claim metrics and a passing verifier with identity/evidence. A toy pass is always stored as toy_only, never reproduced.pnpm run verify
node scripts/smoke.mjs
pnpm run smoke:plugin
node scripts/smoke.mjs openai-news google-deepmind-news zai-release-notes
The tests cover parsing, enrichment, event clustering/versioning, GitHub organization releases, watch rollback safety, claim grading, multi-attempt/verifier enforcement, Trackio export, digests, lifecycle serialization, transaction rollback, evidence topology, manifests, storage, and registration/disposal through the real DSH ToolRuntime. smoke.mjs exercises source adapters directly; smoke:plugin runs collection through the real tool runtime. Both perform read-only requests and never call X.
githubEnrichLimit; Hugging Face pinning can be bounded with huggingFaceEnrichLimit. A pinning failure is reported and does not erase the source record.MIT