Case 003 / findings / 3 October 2026
What the measurements show
Not on four real US road maps in our implementations. Every one of 1,600 quiet-server road runs returned certified distances, but road-map medians were about 6–75× slower than direct Dijkstra. These timings do not test the papers' asymptotic bounds.
Original research: Duan, Mao, Mao, Shu & Yin (STOC 2025) · Duan, Mao, Shu & Yin (2026) · Kadria & Roditty (2026). Full author credits below.
Paired median wall-clock slowdown relative to direct binary-heap Dijkstra on each map. Logarithmic scale. KR pipeline includes Dijkstra black-box substitutes.
What the data says.
This table contains the measured comparison behind the answer. The expert sections below explain how the numbers were produced and what they cannot establish.
Swipe to see all columns →
| Road map | Duan 2025 | Duan 2026 | KR pipeline |
|---|---|---|---|
| NY | 73.5× 60.8–81.5× | 35.0× 28.3–39.3× | 7.4× 6.3–8.6× |
| BAY | 72.4× 62.0–83.6× | 33.2× 28.1–37.1× | 6.6× 5.5–7.4× |
| COL | 70.6× 57.0–75.2× | 36.6× 29.3–40.5× | 6.3× 5.0–6.9× |
| FLA | 75.0× 67.4–81.7× | 39.5× 35.7–43.1× | 6.9× 6.2–7.7× |
Each small range is the minimum to maximum across the 50 paired seed–source ratios for that map.
Claim-by-claim verdicts.
Confirmed means supported within the stated test; Partly confirmed keeps a tested piece separate from an untested part. Not confirmed means the tested evidence did not show the claim. Could not test marks missing evidence or an inapplicable setup.
Swipe to see all columns →
| Claim | Verdict | Evidence boundary |
|---|---|---|
| Certified distances on tested graphs | Confirmed | 1,600/1,600 quiet-server road rows passed certificates. |
| Duan 2025 faster on these road maps | Not confirmed | Its measured implementation was slower on each map. |
| Duan 2026 faster on these road maps | Not confirmed | Its measured implementation was slower on each map. |
| Kadria–Roditty pipeline faster here | Not confirmed | The substituted pipeline was slower on each map. |
| The papers' asymptotic bounds | Could not test | Changed data structures and black boxes, finite graphs, and astronomical crossover scales. |
| Paper algorithm correctness in general | Partly confirmed | Output certificates passed for tested nonnegative integer graphs only. |
Expert detail: measurements and interpretation
The comparison pairs each paper-implementation time with the selected direct Dijkstra time on the same seed and source. Each road map contributes 50 paired sources across five seeds. The selected Dijkstra variant is binary heap on every map. “KR practical” is itself a direct binary-heap Dijkstra; it is a baseline, never the Kadria–Roditty paper method. The plotted KR pipeline has Dijkstra substituted for two cited black boxes. The directed implementations also replace some queues or maps whose amortized costs matter to the proofs.
An earlier independent implementation study of the 2025 method, arXiv 2511.03007, reported only a 3–4× slowdown. Our 71–75× 2025 road gap therefore partly reflects our less-optimized implementation and different setup. The magnitude is not a replication. Road weight conventions also differ. These timings come from one dedicated quiet AMD EPYC-Rome server core, with a warm-up before every timed run and algorithm order rotated across sources; the earlier laptop run, shared with other agents, gave larger and noisier ratios and remains in the downloadable data for transparency.
Laptop vs quiet server: ranges below span the four road-map medians for each method. The earlier source-level ratios also varied more widely.
Swipe to see all columns →
| Method | Shared laptop | Quiet server |
|---|---|---|
| Duan 2025 | 83.7–125.5× | 70.6–75.0× |
| Duan 2026 | 46.4–66.5× | 33.2–39.5× |
| KR pipeline | 8.5–12.4× | 6.3–7.4× |
Quiet-server binary-heap Dijkstra medians: NY 28.5 ms, BAY 32.5 ms, COL 46.3 ms, FLA 116.1 ms.
All full benchmark distances passed an independent certificate. The tests used nonnegative integer graph weights, while the theorems address real-weight comparison-addition models. Our finite implementation timings cannot test or refute big-O guarantees at astronomically large input sizes. Component counters and small synthetic fits remain exploratory. The complete road and synthetic run CSVs are linked below; each is under five megabytes.
How we tested
We implemented each algorithm in Rust, calibrated direct Dijkstra baselines, checked graph outputs against a distance oracle and certificate, and ran paired source comparisons on New York, Bay Area, Colorado and Florida road graphs. The quiet-server sweep used five seeds and ten sources per map, plus synthetic families. The data files preserve every full run, along with the earlier laptop sweep and its paired summaries.
Limitations and next check
The implementations substitute data structures and two Kadria–Roditty black boxes. They therefore cannot test or refute the papers' big-O results. The prior independent 2025 study found only a 3–4× slowdown, so our much larger gap is implementation-sensitive. The quiet-server timings and the earlier shared-laptop timings are both available below.
Issues we found in the papers
Our agents flagged these while building the algorithms. A second, independent reviewer then re-derived each one from the original PDF, with its own code. None of them changes the computed distances or the papers’ main theorems. We have not yet heard from the authors. Reproducers: repro.py (with dmsy25.py and dmsy26.py) and kr_tie_check.py.
Minor wording: Duan et al. 2025, Lemma 3.3. The text says an overfull block is split into two blocks of “at most ⌈M/2⌉” elements. For even M, M+1 elements cannot fit that way. The paper’s own median split gives about M/2 each, which is all the proof needs. No effect on results.
Known proof gap, already reported: Duan et al. 2025, Section 3.2. As printed, two sibling recursive calls can return the same vertex: a stale queue entry survives after a child call finishes that vertex (7-vertex example in repro.py). Distances stay correct. The earlier independent study (arXiv 2511.03007) reported this first, with a one-line fix it says the authors confirmed. With the fix, the running-time proof holds.
Proof gap, fixable: Duan et al. 2026, Lemma 3.8. The same mechanism affects the 2026 paper. Its disjointness claim (and the remark “Ui is not in D, no need to remove”) fails for the algorithm as printed (12-vertex example). Distances stay correct. Removing completed vertices from the parent queue fixes it, and the main theorem is not affected.
Small slip, fixable: Duan et al. 2026, Algorithm 4. The apparent “B” mix-up was only a text-extraction artifact: the PDF clearly writes B′ and B. Separately, the base case as printed can return a boundary that is too high when it stops early, which contradicts Lemma 3.7(2) (11-vertex example). Distances stay correct. Returning the smallest remaining queue value fixes it.
Minor, fixable: Kadria & Roditty 2026, Lemma 4. When two samples are equally close, the paper’s super-source procedure can pick a different “nearest sample” than its own definition specifies (5-vertex example; 23 of 3,000 random small graphs). So Lemma 4 is false as written. Distances and the main running-time result are unaffected, and comparing the sample ID before the predecessor ID during relaxation fixes it at no extra cost.
Original sources, data and corrections
The ideas and original claims belong to the paper authors. Kael Research is responsible for these implementations, checks and interpretations. Original source: Breaking the Sorting Barrier for Directed Single-Source Shortest Paths (arXiv v2 2025-07-30; STOC 2025)
By Ran Duan, Jiayi Mao, Xiao Mao, Xinkai Shu, Longhui Yin
A Faster Directed Single-Source Shortest Path Algorithm (2026-02-10)
By Ran Duan, Xiao Mao, Xinkai Shu, Longhui Yin
A Faster Undirected Single-Source Shortest Path Algorithm (2026-09-14)
By Avi Kadria, Liam Roditty. Download each public CSV below; the full experiment repositories, including any larger uncopied raw artifacts, are available on request. For corrections, see our public log or contact us through the site.
Quiet-server run files and metadata, followed by the preserved laptop files: