frontier models
The Fisher Subspace Decided Whether the Task Was New
FiUni detects latent task changes batch by batch, then reuses, expands or creates low-rank adaptation subspaces.
Summary
FiUni detects latent task changes batch by batch, then reuses, expands or creates low-rank adaptation subspaces.
The method compares principal subspaces from a Kronecker-factored Fisher approximation and freezes historical structure to balance knowledge sharing against isolation. The authors report competitive results against task-aware continual-learning methods with fewer trainable parameters, despite receiving no explicit task boundary at training time. The evidence is benchmark-based and does not remove all forgetting risk.
Why it matters
FiUni detects latent task changes batch by batch, then reuses, expands or creates low-rank adaptation subspaces.
Limits and context
- The evidence is benchmark-based and does not remove all forgetting risk.
Key claims
FiUni detects latent task changes batch by batch, then reuses, expands or creates low-rank adaptation subspaces.
Qualification: The evidence is benchmark-based and does not remove all forgetting risk.
Evidence: source-2026-08-29-013
Sources
- arXiv preprint 2608.27070arXiv · primary research
Corrections
No corrections have been recorded for this story.