RiskProof
Stop sensitive data from leaving through AI tools, and see where it came from.
RiskProof tracks cross-tool data flows and blocks sensitive tool output in DeepSeek Harness.
A persistent security beacon shows redacted execution receipts. Deterministic rules need no extra LLM calls.
English · 简体中文
Try the rules before setting up DSH
With Node.js 22.19+, run four synthetic protection examples:
npx --yes --package=dsh-riskproof@0.7.0 riskproof-demo --language en
No DSH profile, model API key or repository checkout is needed. npm downloads the
package; the installed rehearsal runs locally with the default balanced policy.
It checks web-influenced commands, customer data egress, changed tool schemas and
read-only task restrictions. All four should show ✓ and deny. Use --json for
structured results. This demonstrates the rules; it does not activate protection
or validate your configuration. Install into DSH below to protect real tool calls.
Quick Start
Requires Node.js 22.19+, with DSH and pnpm installed:
dsh plugin --profile web add dsh-riskproof@0.7.0
dsh --profile web --dump-config
Confirm the output includes name: dsh-riskproof, restart the Web profile, and click
its security beacon. Then enter this directly in the conversation composer:
/riskproof demo
Four isolated rehearsals show web content influencing a command, customer data transfer,
a tool schema change and a read-only restriction. They use synthetic inputs, read no private files, run no shell commands,
send no email, and do not enter live protection counts. RiskProof's rules and direct slash
commands make no extra model calls; ordinary DSH model usage keeps its normal cost.
See installation and troubleshooting for the complete steps.
| Compatibility | Verified scope |
|---|
| Node.js | 22.19+; see the CI matrix |
| DSH | Install/tool pipeline: 0.1.0-rc.7, 0.1.2-rc.1 and 0.2.1-rc.4; Web: 0.1.2-rc.1 and 0.2.1-rc.4 |
| Model | Deterministic rules need no reviewer model or additional API key |
| Language | Beacon, overview and reports: experience.language: en or zh-CN (default) |
Newer DSH versions require separate verification. See validation evidence
for the historical 0.1 results and the v0.7 validation record for the current release.
Start here
See protection beside your conversation
A persistent RiskProof security beacon sits beside the DSH conversation. Ordinary tool
calls update it automatically. Click to open a compact overview; activity never opens it for you.
Persistent RiskProof beacon
- Waits honestly for tool activity; there is no continuous simulated scan.
- Shows pending execution receipts and briefly acknowledges newly checked calls.
- Displays a call-distribution ring, the last 24 checks and up to three recent risk chains.
- Follows the selected conversation and removes stale charts when its connection is unavailable.
- Separates initial sync from disconnection, offers manual reconnect, and displays task scope and record limits.
Live call distribution and provenance
Real DSH Web screenshots; a local test model produced these records through the actual
Agent/tool pipeline. Normal use does not require a rehearsal.
The chart counts calls with no triggered risk, calls blocked by RiskProof, and calls needing
attention. It does not invent a safety score. Observe mode, disabled recording and disabled
detection features are identified. Counts cover retained records in the current plugin run.
Not triggering a rule does not establish that an operation is safe.
Commands remain secondary entries; long output is collapsed by default:
| Need | DSH command |
|---|
| Open the compact overview | /riskproof |
| Check protection settings and next steps | /riskproof doctor |
| Read the text provenance report | /riskproof trace |
| Restrict to inspection | /riskproof task read-only |
| Keep tool capabilities local | /riskproof task local-only |
| Restore ordinary task scope | /riskproof task standard |
| Preview a registered tool without executing it | /riskproof test <tool> <JSON> |
| Optional isolated rehearsals | /riskproof demo |
The model can also call the read-only riskproof_report tool. The beacon reads redacted
statistics through DSH's authenticated connection about once per second while the page is
visible. It makes no model requests and creates no tool records. The beacon, overview and command/tool text follow
experience.language: zh-CN (default) or en.
See configuration gaps and what to do next
Expand Protection checks in the beacon overview, or run /riskproof doctor to inspect
execution mode, evidence recording, provenance, label propagation, chain detection,
credential output protection and effective rule posture. Explicit overrides that relax a
strict preset remain visible. Recent risk cards also explain the next step.
These are read-only configuration checks, with no test tool dispatch, credential reads or
extra activity counts. See the protection checks guide.
Preview before executing
Use /riskproof test send_email {"to":"outside@example.com","body":{"refreshToken":"synthetic-example"}}
with a tool registered in your session. See the policy verdict, labels and matched rules
using current task restrictions and retained provenance. It makes no tool call, adds no receipt
and never updates the tool identity baseline. Use synthetic inputs; results exclude arguments.
Other plugins, host approval and actual output are outside the preview.
Opaque OAuth tokens, TOTP secrets and private keys in exact nested credential fields now
receive sensitive labels even without a provider-specific prefix. Detected output labels
survive trusted declassification. See policy previews and credential fields.
What RiskProof answers
Most tool-permission plugins answer one question: is this tool allowed?
RiskProof answers a different one:
Where did the data in this tool call come from, what did it flow through, and where is it about to go?
A single tool call is usually safe. The composition is not.
web_fetch ← UNTRUSTED_WEB
│
database_query ← CUSTOMER_DATA
│
send_email ← external destination
│
RiskProof → DENY (evidence-backed, before the side effect)
Why RiskProof
| Tool-name allowlists | RiskProof |
|---|
| Is this tool allowed? | Where did this data come from? |
| Single call | Cross-tool flow |
| Tool name | Provenance + taint |
| Static rule | Stateful attack chain |
| Permission decision | Evidence-backed execution decision |
RiskProof is a layer over the DSH Tool Runtime, not another Agent Runtime. It never re-implements tool dispatch, approval, or lifecycle — it observes and decides.
Local build and configuration
Alternatively, build a local package from the repository root:
# build and install from this checkout
npm ci
mkdir -p artifacts
npm pack --pack-destination artifacts
dsh plugin --profile web add ./artifacts/dsh-riskproof-0.7.0.tgz
# confirm the bundled patch was composed
dsh --profile web --dump-config
The package declares a DSH bundle, so plugin add composes its riskproof row automatically. No second install or manual row is required. Restart the profile to see the beacon, then click it to inspect the current conversation.
The current version is 0.7.0. See installation and update instructions. Installation, SDK host startup,
commands, tool execution and HTTP transport have been verified on DSH 0.1.0-rc.7, 0.1.2-rc.1 and 0.2.1-rc.4.
Chrome desktop and narrow-viewport Web acceptance also passed on DSH 0.1.2-rc.1 and 0.2.1-rc.4,
including provenance and read-only denials through the real Agent loop with a local
simulated model. See the current validation record.
To tune it, override the bundled row from the profile's later cordis.patch.yml layer:
- id: riskproof
config:
experience:
language: en # zh-CN (default) | en; beacon and reports
mode: enforce # enforce | observe
policy:
preset: balanced # permissive | balanced | strict
internalDomains: [acme.internal]
blockedDomains: [collector.evil.example]
# allowedExternalDomains: [api.approved.example]
classification:
overrides:
gmail_send: [EXTERNAL_ACTION]
company_db: [PRIVATE_ACCESS]
output:
blockedTaints: [SECRET, API_KEY]
# trustedDeclassifiers: { approved_redactor: [PII] }
See docs/configuration.md for the full reference.
See it work
sequenceDiagram
participant A as Agent
participant T as DSH ToolRuntime
participant R as RiskProof
A->>T: web_fetch(url)
T->>R: tools/pre-execute
R-->>T: allow (EXTERNAL_INGESTION recorded)
T-->>A: untrusted content
A->>T: database_query(sql)
T->>R: tools/pre-execute
R-->>T: ask (operator approves private access)
T-->>A: CUST-8842 balance 125000
A->>T: send_email(to=external, body=CUST-8842…)
T->>R: tools/pre-execute
R-->>T: DENY — ingestion + private access + sensitive data + external action
T-->>A: Error: <reason>
The same flow is reproduced as a deterministic regression test in tests/security/attack-chain.test.ts.
Try it locally with no model or profile — a real DSH ToolRuntime pipeline with three mock tools:
npm run demo
See demo/README.md.
Features
Track data origin
Know where tool inputs came from. RiskProof maps arguments back to the tool results that produced them.
Follow sensitive data
Carry security labels — UNTRUSTED_WEB, CUSTOMER_DATA, PII, SECRET, … — across tool calls, additively.
Control sensitive output
Inspect model-facing results in tools/post-execute; block SECRET and API_KEY output by default before it enters model context.
Declassify through pinned tools
Let exact operator-approved tools remove selected inherited labels. Labels detected in the returned value are always restored, so a redactor must actually remove the sensitive data.
Detect attack chains
Identify the EXTERNAL_INGESTION → PRIVATE_ACCESS → EXTERNAL_ACTION pattern that single-tool checks miss.
Stop before execution
Block or ask before the side effect runs, through the native tools/pre-execute gate.
Guard sensitive surfaces
Gate credential-file paths, high-confidence destructive commands, download-and-execute pipelines, blocked destinations, and credentials embedded in network-capable commands.
Adapt without rewriting rules
Start with the default balanced preset, roll out with permissive, or use strict; every configurable decision can still be overridden individually.
Explain every decision
Generate structured, privacy-preserving security evidence and actionable remediation for every decision. Keep proofs in memory or append them to an operator-controlled JSONL file.
How it works
RiskProof hooks the native DSH tool pipeline:
tools/pre-execute
│ capability classification
│ argument provenance mapping
│ taint analysis
│ toolchain state (EIT → PAT → NAT)
│ deterministic policy evaluation
▼
allow / ask / deny (monotonic with other plugins)
│
tool execute
│
tools/post-execute
│ output taint evaluation
│ trusted declassification
▼
accept / block
│
tools/result
│ update ContextTracker
│ update Toolchain state
▼ record execution evidence
- Classification is deterministic (tool name + description + schema), configurable, and never uses an LLM.
- Provenance uses exact and bounded substring matching over a per-session context index.
- Taint is additive; only an exact operator-approved declassifier can remove selected inherited labels.
- Decisions are deterministic, explainable, and testable.
See docs/architecture.md.
Security boundaries
RiskProof protects supported observable tool-call flows through DSH:
- DSH tool calls through the supported
tools/pre-execute / tools/post-execute / tools/result paths
- supported observable provenance (exact / bounded substring matching)
- configured sensitive flows and cross-tool attack patterns
RiskProof does not replace:
- OS sandbox / process isolation
- network firewall / SSRF protection
- endpoint security / malware scanning
- credential vaults
- full semantic DLP
See docs/security-model.md for the complete threat model and known limitations.
Documentation
See the documentation index for guides, security design and version records.
Roadmap
v0.2 (delivered)
- DSH-native runtime (
tools/pre-execute, tools/result)
- Provenance + taint tracking
- Cross-tool EIT → PAT → NAT detection
- Privacy-preserving proof with optional JSONL persistence
- Policy presets, sensitive-path gates, deterministic command-risk checks, and egress domain policy
- Remediation guidance and per-rule proof statistics
v0.3 (delivered)
- Native security receipts, provenance timeline, bilingual reports and safe rehearsals
- Tool metadata continuity: description and input/output schema fingerprints
- Operator-selected task contracts: standard / read-only / local-only
- Execution-token correlation between policy gates and final results
- Taint inheritance through intermediate tools; bounded, isolated session state
v0.4 (delivered)
- Output-side information-flow control before results reach model context
- Default credential-output blocking with configurable label selection
- Exact-name trusted declassifiers with deterministic re-tainting
- Redacted output-control and declassification receipts
v0.5–v0.6 (delivered)
- Bilingual protection checks and actionable configuration guidance
- Structured credential field detection and side-effect-free policy previews
v0.7 (current)
- Terminal rehearsal without a DSH profile or model setup
- First-use command guidance in the Web overview
- DSH 0.2 compatibility in the real-host validation matrix
- Weekly public download snapshots with explicit comparison windows
Later
- Richer structured/semantic DLP adapters
- Cross-process provenance with explicit trust boundaries
- More real-world tool mappings and reproducible false-positive cases
Choosing alongside auto-review
| Need | Direction |
|---|
| A second model evaluates whether an approval request should proceed | dsh-auto-review |
| Track cross-tool data flows, block sensitive output and inspect execution receipts | RiskProof |
These use different host hooks. Joint use still needs plugin-order and host-version testing;
combined acceptance has not been verified. RiskProof covers observable, matchable flows and
configured rules; see the security model.
Contributing
Issues, rule submissions, tool-capability mappings, and false-positive reports are welcome. See CONTRIBUTING.md.
See the growth and iteration plan for current gaps, public
measurement and the next priorities.
If RiskProof helps you, a GitHub star helps others discover it.
Installation feedback, redacted false-positive reports and tool mappings help improve it too.
Security reporting
Please report vulnerabilities privately. See SECURITY.md.
License
Apache-2.0
