AINEWS
A Jacobian lens — a per layer microscope for what a specific layer represents about an input — fitted to Alibaba’s Qwen3.6 27B still locates target concepts inside its successor, Qwen3.8 27B, without refitting.
A 113-day-old interpretability probe fitted to Alibaba's Qwen3.6-27B still locates target concepts inside its successor, Qwen3.8-27B, without any refitting. The result inverts the default assumption baked into most AI safety and monitoring pipelines: that every new model checkpoint forces a full rebuild of the tools used to read what a model is "thinking."
The test, posted to r/MachineLearning by user ec75hash, used a Jacobian lens published by Anthropic in July via Neuronpedia and applied it, unchanged, to the next version in the Qwen line. A Jacobian lens is a local linearization: at any chosen layer, it maps the model's internal hidden state to a score over the vocabulary, in effect a microscope for what a specific layer is representing about a given input.
The setup was clean. Qwen3.8-27B shipped 113 days after Qwen3.6-27B, with the same 64 layers, the same hidden dimension, and the same tokenizer. The training relationship between the two checkpoints is undocumented, and the researcher treated that gap as the test.
The reading task used 40 two-hop prompts where the middle entity never appears in the prompt, for example "The currency used in the country shaped like a boot is ___" where "Italy" is absent. The lens still ranked the target word near the top of the 248,320-token vocabulary. Median rank at layer 48 was 4 on the home model and 17 on the transferred lens. At layer 24, the transfer actually beat the home lens: 38 versus 121, with paired sign tests at p < 1e-3.
On WikiText teacher-forced next-token prediction over 700 positions, the transferred lens paid a 1.2x to 1.3x cost through the middle of the network and roughly 2x by layer 48. The raw logit lens, the simpler unaligned projection that anyone can run, sat at rank 1,000 to 10,000 through the same band on both models. That gap is the work the Jacobian transfer is doing above a baseline everyone has access to.
The researcher took pullback directions for the words "paradox," "paradoxical," "悖论," and "矛盾" from the 3.6 lens, orthogonalized them within each layer, and projected them out of the 3.8 residual stream at layers 18 through 47 during generation. The prompt was "Describe Escher's impossible staircase." Across all steering cells on both models, the word "paradox" disappeared from the output while the description stayed coherent. Lithograph, closed loop, illusion all intact.
The honest limits are part of the story. This is one lens family, one model line, one version step, on matched architecture and tokenizer. The experiment cannot fully separate "the lens drifted" from "the model changed," and it makes no claim about cross-family transfer or larger gaps. The author flags all of this in the original post.
What it does is reframe a workflow. The implicit rule in most AI monitoring has been: new checkpoint, new probe. The data on the Hugging Face companion dataset suggests that rule can be replaced with a transfer test baked into the release process. The surface-vs-latent asymmetry is the rubric for which probes earn that test. Latent-content readout transfers nearly clean, surface next-token readout pays late, and the raw logit lens is useless at either step.
Anthropic's July paper and the accompanying Jacobian-lens repository are the supporting artifacts, with a Neuronpedia blog and an Alpha Signal explainer as secondary context. None of them, on their own, would have answered the question this experiment asked: when the model moves, does the microscope still work?