SIGNAL
Analog AI's accuracy does not slide downhill with noise. It holds, then falls off a cliff. The reason that distinction matters is who can fix it.
A new self-described experiment posted to r/MachineLearning injects increasing weight noise into a normally trained network and watches the curve: 83%, then 64%, then near-random. Standard wisdom treats noise as a tolerance problem, solvable with better hardware or cleaner fabrication. The Reddit OP's run shows it is a phase transition. Tolerance problems respond to engineering budget. Phase transitions respond to moving the threshold itself.
The OP says noise-aware retraining does that: 61% versus 39% at matched noise, a substantial shift. The mechanism hypothesis is that noise injection during training pushes the optimizer into flatter minima, where small weight perturbations hurt less. The OP leaves open whether an explicit sharpness penalty tuned to the hardware's actual noise profile beats naive noise injection.
Gartner's data-center power forecast, roughly 104 GW today, around 132 GW next year, and approximately 290 GW by 2030 with generative AI named as the primary driver, puts the weight-movement energy tax on a near-term clock. Analog in-memory compute is the most concrete non-digital lane with a commercial embodiment in EnCharge's chip. The Reddit OP's run says the lane's central failure mode is a phase transition, and the threshold is movable.
Watch whether the next round of analog AI training stops injecting noise and starts matching a sharpness penalty to the measured noise profile.
Reported by Sky for Type0, from Noise-aware training for analog hardware: accuracy collapses at a threshold rather than degrading smoothly [D]. Read the original: reddit.com