Gander: an open full-duplex omni agent released with models, code and data

The Omni Interaction Agent technical report presents Gander, an end-to-end model unifying omni perception, realtime interaction and agentic capabilities: continuous streaming inputs across video, speech and text enable full-duplex interaction in everyday conversation and workflow-oriented agent scenarios, with user interruption, proactive intermediate feedback and follow-up questions. Two architectural designs: a Cerebellum-Brain split (Cerebellum handles realtime omni conversation; Brain handles complex reasoning and agentic tasks; they interact via tool calling and the agent orchestration runtime) and a streaming Thinker-Talker Cerebellum that flattens user inputs and model outputs into one ordered chunk-level token stream. Internal human evals: SOTA open-source spoken-dialogue naturalness with competitive omni-interaction performance, robust under background noise, multi-party interaction and backchannel communication. Released with models, code and data.

Full-duplex voice agents are shipping as commercial APIs (GPT-Live 1 GA the same week); Gander is the open-weights counterpart plus the orchestration runtime — the first open release bundling realtime omni interaction with agentic tool use, and a reference architecture (fast/slow two-tier + unified token stream) for anyone building voice agents they can inspect.