Spark encrypted firmware cuts Linux inference speed to 35%
gpu inference nvidia
| Source: HN | Original article
Nvidia's RTX Spark laptop sees inference speed cut by 35% on Linux because its encrypted firmware throttles GPU performance.
Nvidia’s newest RTX Spark laptops are delivering only a third of the AI inference performance that users expect on Linux, a hands‑on investigation has revealed. The slowdown stems from an encrypted power‑management firmware that locks the GPU’s clock to roughly 780 MHz on Linux, whereas the same hardware runs above 2 GHz under Windows. The result is a roughly 65 percent drop in large‑language‑model (LLM) inference speed, leaving Linux users with just 35 percent of the throughput they see on the competing OS.
The issue matters because the RTX Spark line is marketed toward developers and researchers who rely on Linux for its open‑source tooling and reproducibility. With AI workloads ballooning – as reflected in recent reports of soaring demand for Nvidia chips across the industry – a hidden performance ceiling could steer projects toward alternative hardware or force teams to stay on Windows or use WSL (Windows Subsystem for Linux), which currently sidesteps the throttle.
Nvidia has not offered a Linux‑compatible firmware patch, and the encrypted nature of the code prevents community workarounds. However, three open‑source projects have already demonstrated a firmware exploit that can lift the artificial throttle, hinting at a possible community‑driven fix. The next steps to watch are Nvidia’s response: whether the company will release an updated firmware or driver that restores full clock speeds on Linux, and how quickly the exploit can be hardened. The episode also raises broader questions about the trade‑off between firmware security and performance in AI‑focused GPUs, a balance that will shape adoption of Nvidia’s hardware in the Nordic research and startup ecosystems.
Sources
Back to AIPULSEN