BDH-CQ Leverages Recurrent Latent Reasoning to Slash ARC-AGI Inference Costs
inference reasoning
| Source: Mastodon | Original article
BDH‑CQ employs recurrent latent reasoning to reduce inference costs for ARC‑AGI.
A new reasoning model called BDH‑CQ has been released, promising a dramatic drop in the cost of running ARC‑AGI inference. The model, described in a pre‑print posted on 10 August 2026, blends in‑context learning with a technique the authors term “recurrent latent reasoning.” As inputs arrive at inference time, they continuously refresh a recurrent memory, allowing the system to solve a query through a series of iterative calculations inside a high‑dimensional latent space. Crucially, the model does not verbalise its intermediate steps, which the authors say streamlines computation.
Despite its modest 150‑million‑parameter size, BDH‑CQ reaches a pass@2 score of 29.5 percent on the public ARC‑AGI‑1 benchmark – 118 correct answers out of 400 tasks – while costing roughly $0.00070 per task. That per‑task price is an order of magnitude lower than the fees typically reported for larger language models on comparable reasoning workloads, suggesting a path to scalable, cost‑effective AI reasoning.
The development matters because inference cost remains a primary barrier to deploying sophisticated reasoning models in production environments, from research labs to edge devices. By showing that a relatively small model can achieve respectable performance at sub‑millidollar expense, BDH‑CQ challenges the prevailing assumption that only massive, compute‑hungry architectures can handle complex reasoning tasks.
The next steps to watch include whether the recurrent latent reasoning approach can be transferred to larger models or other domains such as visual reasoning, and how hardware partners – especially those focused on inference acceleration – might optimise runtimes for the latent‑space computations. Follow‑up studies will also reveal if the cost advantage holds across broader benchmark suites and real‑world applications.
Sources
Back to AIPULSEN