safety security
The Audit Never Opens the Output Gate
MIT researchers tested whether adapted image models had learned an illegal harmful capability by reading internal changes instead of generating the prohibited material.
Summary
MIT researchers tested whether adapted image models had learned an illegal harmful capability by reading internal changes instead of generating the prohibited material.
A team from MIT, Boston University, and the child-safety nonprofit Thorn reports a way to audit LoRA adapters for harmful specialization without asking the model to produce an image. Gaussian probes feed random inputs into intermediate layers, then measure how fine-tuning changed the model's internal computation. In tests on three model families, the method identified adapters specialized for child sexual abuse material with 100 percent accuracy. That result is limited to the evaluated adapters, but it gives model hosts a scalable route to screen uploads without creating illegal output or exposing reviewers to it.
Why it matters
MIT researchers tested whether adapted image models had learned an illegal harmful capability by reading internal changes instead of generating the prohibited material.
Limits and context
No additional limitation was separately recorded.
Key claims
MIT researchers tested whether adapted image models had learned an illegal harmful capability by reading internal changes instead of generating the prohibited material.
Evidence: source-2026-07-13-001
Sources
- MIT News: Non-generative harmful-model auditMIT News · secondary reporting
Corrections
No corrections have been recorded for this story.