Realtime-Venus Enables Full‑Duplex Interaction with Asynchronous Delegation
| Source: HF Papers | Original article
Researchers introduce Realtime‑Venus, a full‑duplex interaction system that enables asynchronous delegation for seamless spoken and video communication.
A research team from Ant Group and Tsinghua University has unveiled **Realtime‑Venus**, a new conversational platform that can keep talking while it works behind the scenes. The system pairs a native full‑duplex model with an asynchronous delegation framework, allowing the assistant to perceive, speak and hand off tasks to external tools without pausing the dialogue. Two specialised front‑ends are released: **Realtime‑Venus‑Omni**, which handles audio‑visual interaction, and **Realtime‑Venus‑Audio**, focused on spoken exchange. Both are built on the MiniCPM‑o 4.5 architecture and share a post‑training recipe that blends offline understanding with proactive, full‑duplex trajectories and delegation workflows.
The breakthrough matters because natural interaction in both digital and physical settings demands continuous perception and timely responses. Existing voice assistants typically wait for a user to finish speaking before invoking external services, creating noticeable latency. By keeping the foreground conversation alive while a background “harness” executes commands, Realtime‑Venus promises smoother, more human‑like exchanges and could accelerate the adoption of multimodal AI in robotics, smart‑home devices, and immersive media.
The open‑source release on GitHub includes code, quick‑start instructions and a citation, inviting developers to experiment with the asynchronous delegation pattern. Watch for early integrations into consumer products, benchmark results that compare its latency and task‑completion rates against current assistants, and follow how the research community builds on the post‑training recipe. The system also raises questions about control and safety when AI agents act autonomously in the background—issues that will likely surface as developers begin to embed Realtime‑Venus in real‑world applications.
Sources
Back to AIPULSEN