Build robust provider-aware context management
Provide proactive, configurable compaction with model-visible pressure signals, bounded tool-output spilling, and repeat-call limits. Base it on actual provider limits and ensure deterministic progress with model-free fallbacks when summarization or oversized requests fail.
Explore challenge
The problem
Provide proactive, configurable compaction with model-visible pressure signals, bounded tool-output spilling, and repeat-call limits. Base it on actual provider limits and ensure deterministic progress with model-free fallbacks when summarization or oversized requests fail.
Start with these discussions
- token 消耗过大的根因分析及改进建议github · ▲2 · 6 comments
- [Proposal] Provider-neutral prompt token pressure + local overflow -> compact-retrygithub · ▲1 · 6 comments
- Compaction cannot rescue an oversized session — the summarization request itself exceeds the provider request-size limit (HTTP 413)github · ▲1 · 3 comments