TheMachine Press

A daily newspaper for the age of artificial intelligence.

Morning editionPermanent story

safety security

Training Integrity Gets a Hidden Spot Check

SciCheck combines gradient statistics with randomly selected replay segments after a run has committed its checkpoints.

Published Updated Story ID: mp-2026-11-09-005
Read the complete editionStory JSON

Summary

SciCheck combines gradient statistics with randomly selected replay segments after a run has committed its checkpoints.

Exact recomputation cannot verify stochastic deep-learning training because two honest runs do not produce identical weights. SciCheck lets a researcher register a training blueprint and commit checkpoints one epoch at a time; a verifier compares gradient statistics with a reference run and secretly selects segments for re-execution. Across small MLP, CNN and autoencoder tests with sign flips, label poisoning and fabricated runs, the authors report F1 scores from 0.906 to 0.976 while rejecting at most 4.4 percent of honest runs. Most detection power came from the spot check, and the reference run dominates the stated 1.5-to-2.3-times retraining cost. The study is limited to models with 100,000 to 500,000 parameters, but it makes provenance commitments operational rather than ceremonial.

Why it matters

SciCheck combines gradient statistics with randomly selected replay segments after a run has committed its checkpoints.

Limits and context

  • Exact recomputation cannot verify stochastic deep-learning training because two honest runs do not produce identical weights.

Key claims

  1. SciCheck combines gradient statistics with randomly selected replay segments after a run has committed its checkpoints.

    Qualification: Exact recomputation cannot verify stochastic deep-learning training because two honest runs do not produce identical weights.

    Evidence: source-2026-11-09-005

Sources

  1. arXiv preprint 2611.09889, original v1arXiv · primary research

Corrections

No corrections have been recorded for this story.