TheMachine Press

A daily newspaper for the age of artificial intelligence.

Morning editionPermanent story

research

The Model Learns When Not to Adapt

PORTAL chooses whether a test-time intervention is worth deploying, which labels to request and when further feedback cannot change the choice.

Published Updated Story ID: mp-2026-10-29-004
Read the complete editionStory JSON

Summary

PORTAL chooses whether a test-time intervention is worth deploying, which labels to request and when further feedback cannot change the choice.

A test-time adaptation method can rescue one corrupted batch and damage another, while average accuracy hides the difference. PORTAL treats the original predictor and each intervention as fixed candidates, then uses every acquired label to compare them on the same input. It directs labels toward candidates that can still overtake the leader and stops when no remaining evidence can change the decision or justify its cost. In the authors' experiments, that control converted an intervention that lost accuracy overall into a useful option on selected batches and prevented arrival-order failures. The method still assumes labels can be acquired and candidate predictions are fixed before feedback.

Why it matters

PORTAL chooses whether a test-time intervention is worth deploying, which labels to request and when further feedback cannot change the choice.

Limits and context

No additional limitation was separately recorded.

Key claims

  1. PORTAL chooses whether a test-time intervention is worth deploying, which labels to request and when further feedback cannot change the choice.

    Evidence: source-2026-10-29-004

Sources

  1. arXiv preprint 2610.37658, original v1arXiv · primary research

Corrections

No corrections have been recorded for this story.