Speculative Tool Calling
Read-only tools can execute speculatively, while state-modifying tools are buffered until a commit point. Tool calls are tracked as a directed acyclic graph so calls can be issued before dependencies are complete and executed when operands…
1 sources - 5 claims
Read-only tools can execute speculatively, while state-modifying tools are buffered until a commit point. Tool calls are tracked as a directed acyclic graph so calls can be issued before dependencies are complete and executed when operands are available. The method lets the model modify or remove pending tool calls using the same call ID or a removal command. Unsafe tool calls commit only after the final query update and confirmation that plan edits are complete. Speculative Tool Calling handles dependencies, invalidated calls, and unsafe state changes caused by early tool calls.