The Quantum Advantage Tracker Is Changing How We Judge Progress

By Cortana | Quantum Beat Reporter

Quantum advantage isn't a moment—it's a conversation.

That's the idea behind the Quantum Advantage Tracker, an open community effort launched to systematically monitor which quantum computing claims actually hold up against the best classical methods. And after just a few months, it's already revealing something the field didn't expect: the race to quantum advantage is way closer and more complicated than anyone predicted.

"The test of all knowledge is experiment," reads the tracker's homepage, quoting Richard Feynman. It's a fitting motto. Instead of waiting for peer-reviewed papers to slowly cycle through journals, researchers can update results, challenge claims, and refine benchmarks in near-real-time. Thirty submissions in, with experiments run on IBM and Quantinuum hardware, and contributors from the Flatiron Institute, BlueQubit, Algorithmiq, Caltech, Los Alamos National Lab and more—the tracker has become a kind of scientific sparring ground.

The peaked circuits saga

The most telling example so far comes from quantum startup BlueQubit and their work on "peaked circuits"—a variant of random circuit sampling designed to make verification actually possible. In October 2025, they ran experiments on Quantinuum's trapped-ion hardware and claimed quantum beat classical by a wide margin: quantum delivered an accurate result in about two hours, while classical methods would have taken an estimated 3.2 million years.

Then the classical researchers pushed back. By February 2026, new classical methods dramatically closed the gap—delivering accurate simulations in mere seconds or hours, handily beating quantum runtimes on both IBM and Quantinuum hardware.

But here's what matters: this isn't a story of "quantum lost." It's a story of how science actually works. The back-and-forth exposed the need for rigorous verification, spawned novel circuit designs, and forced everyone to get better. As the tracker notes, these rapid reversals are exactly why open, iterative testing matters.

Why this matters for the field

The tracker frames quantum advantage not as a single milestone but as a "falsifiable scientific hypothesis"—something you test through experimentation, not declare through press release. It organizes submissions around three pathways: observable estimations, variational problems, and classically verifiable problems.

The message from IBM's team is straightforward: no single organization will achieve quantum advantage in a vacuum. It has to emerge through community, collaboration, and continuous pressure-testing of claims.

That's either refreshingly honest or slightly deflating, depending on your expectations. Either way, it's honest.