WORLDWIDE_SanGuai / Research bulletin

[ worldwide.arakne.de ]

世界很大,讀一小點。

SanGuai 的三日研究佈告板。每天更新,讀完就走。

EST. 202672H上架 72 小時
人工智慧 / 2611.15131

Duo:用於全雙工互動的互惠世界模型

Duo: A Reciprocal World Model for Full-Duplex Interaction

作者: Hengyuan Cao, Biao Gong, Guoshan Lu, Qiyuan Zhang, Lin Liu, Yiding Tian, Yilei Jiang, Yuxin Ma et al.論文發布: 2026-11-11離架倒數: 16 小時

研究速讀

本報告提出互惠世界模型(RWM)與Duo v1,一個能持續感知影音輸入並即時回應使用者的全雙工世界模型。作者主張智慧與物理現實同屬世界的基本構成,並以意圖與實現兩項能力重新定義世界模型,再以自迴歸推理、統一時間軸的同步 token 與雙重 rollout 蒸餾等設計實現。

值得留意

  1. 作者提出 RWM 框架,將意圖(Intent)與實現(Realization)視為同等基本的能力,而非把推理與決策當作外部控制。
  2. Duo v1 以自迴歸建模處理連續互動推理與參與決策,並在統一時間軸上同步 Intent 與 Realization 的 token,以注意力遮罩維持因果性。
  3. 作者稱系統可持續感知即時音訊、視訊與文字,支援自發對話與打斷,並可用於分享實物、重塑虛擬場景或遊玩影音遊戲。

閱讀限制

僅依標題與摘要整理,未閱讀全文,因此無法核實技術細節、實驗設置或效能數據,所有主張均出自作者。

原始摘要 [EN]

In this report, we introduce the Reciprocal World Model (RWM) and present Duo v1, a full-duplex world model that continuously perceives audiovisual inputs while responding to users in real time. The RWM treats intelligence and physical reality as equally fundamental to what constitutes a world. Existing world models largely focus on simulating the latter, leaving reasoning and decision-making as external controls rather than intrinsic parts of the world itself. In RWM, we identify two equally fundamental capabilities: Intent, which provides the cognition underlying world interactions, and Realization, which generates coherent audio-visual behavior. To realize this formulation, Duo v1 introduces three key technical designs: (1) Leveraging autoregressive modeling for continuous interaction reasoning and participation decisions, rather than restricting it to instruction understanding for diffusion models. (2) Constructing chunk-specific conditions and synchronize tokens across Intent and Realization on a unified timeline. Module-specific attention masks enforce causal dependencies both within and across chunks, preventing access to future inputs. (3) Mitigating distribution shift in both modules through dual rollout distillation, training on autoregressively generated Intent tokens and synthesized audiovisual histories from Realization. Both modules continuously perceive real-time audio, video, and text, enabling full-duplex interaction with spontaneous conversations and interruptions. Beyond conversation, users can share real objects, reshape virtual scenes, guide assistants, or play audiovisual games without mouse or keyboard controls. The release of Duo v1 makes our first step, with the next version coming soon. We look forward to broader exploration of this emerging field.

AI 摘要僅根據公開標題與摘要整理;研究結論來自作者,請以原文為準。