robotics
The Assistant Remembered Objects It Never Touched
A persistent 3D ledger retained locations, histories and context after objects left view, lifting accuracy on three egocentric-memory tests.
Summary
A persistent 3D ledger retained locations, histories and context after objects left view, lifting accuracy on three egocentric-memory tests.
Ledger associates object observations across egocentric video, clusters each object by resting location and records a move only after repeated evidence, reducing false changes from localization noise. It also stores short descriptions such as contents or supporting surfaces and can answer later questions without reopening the original video. The authors report accuracy rising from 29.7% to 42.6% on HD-EPIC and from 33.8% to 38.5% on UCS-Bench, with 0.99-meter median localization error for returned Ego4D objects. Performance fell across stitched multi-scene streams, and per-scene construction recovered only part of that loss. The work makes persistence a first-class component of embodied memory: what matters later may be something the wearer merely passed.
Why it matters
A persistent 3D ledger retained locations, histories and context after objects left view, lifting accuracy on three egocentric-memory tests.
Limits and context
- Ledger associates object observations across egocentric video, clusters each object by resting location and records a move only after repeated evidence, reducing false changes from localization noise.
- Performance fell across stitched multi-scene streams, and per-scene construction recovered only part of that loss.
Key claims
A persistent 3D ledger retained locations, histories and context after objects left view, lifting accuracy on three egocentric-memory tests.
Qualification: Ledger associates object observations across egocentric video, clusters each object by resting location and records a move only after repeated evidence, reducing false changes from localization noise.
Evidence: source-2026-10-08-003
Sources
- arXiv preprint 2610.10538arXiv · primary research
Corrections
No corrections have been recorded for this story.