chips infrastructure
The Tool Schema Became a Reusable Cache Block
ReCache separates recurring tool and skill descriptions so their key-value states survive changes in order and combination.
Summary
ReCache separates recurring tool and skill descriptions so their key-value states survive changes in order and combination.
Resource-local attention and positions make cached schema blocks composition-invariant, while route selection and pruning reduce what remains visible at inference. On a benchmark assembled from seven public tool-and-skill datasets, the preprint reports nearly unchanged invocation F1, a 3.655-times time-to-first-token speedup for resource-wise attention and a 92.43 percent reduction in allocated KV-tensor memory for the complete framework.
Why it matters
ReCache separates recurring tool and skill descriptions so their key-value states survive changes in order and combination.
Limits and context
No additional limitation was separately recorded.
Key claims
ReCache separates recurring tool and skill descriptions so their key-value states survive changes in order and combination.
Evidence: source-2026-08-23-005
Sources
- arXiv preprint 2608.19662arXiv · primary research
Corrections
No corrections have been recorded for this story.