The Maia 3 chess transformer has 128 'attention heads,' each a small module that decides which parts of the board to focus on. Disable one and the model misses a famous queen sacrifice.
Ablating a single attention head inside the 128-head Maia-3 chess transformer causes the model to stop finding a famous queen sacrifice, per a project post on r/MachineLearning and a Zenodo archive of the chessformer_lens library. 'Attention heads' are small internal modules that decide which parts of the board the model focuses on; ablation is the blunt act of unplugging one and watching which move disappears.
The model is Maia-3 23M, a human-like chess transformer from the University of Toronto's CSS Lab, built on the Chessformer architecture. Downstream write-ups on LessWrong and an interactive demo identify the sacrifice as the queen sacrifice from Paul Morphy's Opera Game (1858); the original Reddit post does not name the game.
One proportion carries the result: 1 of 128 internal modules appears responsible for one specific, dramatic chess insight. Mechanistic interpretability, the field that maps which parts of a neural network do which jobs, treats this as a data point rather than a verdict on whether the model 'understands' chess. The sacrifice that disappears may be a brittle case the model only sees when one head fires, and the ablation may also just degrade general strength. What survives is the chessformer_lens tooling itself: a reproducible setup other labs can rerun.