Load tool definitions only when needed
Support deferred and selective tool loading so tool schemas are injected only on demand or when the available tool set changes. This reduces repeated prompt and caching overhead while allowing agents to access tools as needed.
Explore challenge
The problem
Support deferred and selective tool loading so tool schemas are injected only on demand or when the available tool set changes. This reduces repeated prompt and caching overhead while allowing agents to access tools as needed.
Start with these discussions
- 模型对话是否每一次都有必要带上工具定义?github · ▲2 · 3 comments
- Performance: zero prompt-cache hits + large tool-schema overhead slow down long tasksgithub · ▲2 · 1 comments
- [Feature Request] 工具按需加载(Tool on-demand loading):降低多插件 profile 每轮 tool schema 注入成本github · ▲1 · 1 comments