DuplexCascade launches full‑duplex speech‑to‑speech dialogue with VAD‑free cascaded ASR–LLM–TTS pipeline and micro‑turn optimization
speech
| Source: Mastodon | Original article
A new paper introduces DuplexCascade, a VAD‑free full‑duplex speech‑to‑speech system that links ASR, LLM and TTS with micro‑turn optimization, aiming for lower resource use.
A research team has released a new paper, DuplexCascade: Full‑Duplex Speech‑to‑Speech Dialogue with VAD‑Free Cascaded ASR‑LLM‑TTS Pipeline and Micro‑Turn Optimization, on arXiv (Mar 10 2026). The work proposes a spoken‑dialogue architecture that discards voice‑activity‑detection (VAD) segmentation, a long‑standing bottleneck that forces half‑duplex exchanges in most cascaded systems. Instead, user audio streams continuously into a streaming automatic‑speech‑recognition (ASR) engine, which emits partial transcriptions in real time. Every ≈0.6 seconds these fragments are merged into a “micro‑turn” that is fed to a large language model (LLM) and then to a text‑to‑speech (TTS) component, enabling the system to respond while the speaker is still talking.
The authors benchmark DuplexCascade on Full‑DuplexBench and VoiceBench, where it achieves state‑of‑the‑art turn‑taking latency and maintains strong conversational intelligence compared with other open‑source speech‑to‑speech solutions. By eliminating VAD, the pipeline reduces the latency spikes and brittle control that have limited the naturalness of voice assistants and interactive agents.
The development matters because full‑duplex interaction is a prerequisite for truly conversational AI—think of a human‑like back‑and‑forth without the “please wait” pauses that dominate current products. If the micro‑turn approach scales, it could lower computational overhead while preserving LLM reasoning, a combination that many developers are racing to achieve.
The next steps to watch include open‑source releases of the code, real‑world integration tests in smart‑speaker or automotive assistants, and follow‑up studies that aim to trim resource consumption further. Success could reshape how voice interfaces handle simultaneous speaking and listening, bringing them closer to natural human dialogue.
Sources
Back to AIPULSEN