독서리서치레이더투자 프레임워크
로그인 / 회원가입
← 읽기로 돌아가기
뉴스주제 · 全双工语音主动向量중대1 분 소요DisconfirmAI 편집부

arXiv Preprint: 'Initiative Vector' Identified in Full-Duplex Voice Models Enables Reference-Guided Style Transfer

Researchers identified an internal control mechanism in full-duplex voice models that allows transferring a speaker's turn-taking style using short audio references.

2026-10-16 12:00 GMT+8

Researchers have identified a single late-layer residual-stream direction, termed the "initiative vector," within full-duplex spoken language models that determines when the model takes the floor in a conversation.

While existing methods control conversational personality from the outside, this study reveals an internal quantity that sets how much the model speaks. Experiments show that scaling this vector shifts the speech ratio from a baseline of 21-30% to either 6-12% or 42-61%, with consistent effects across various conversations, model weights, and corpora.

Crucially, a short reference recording is sufficient to transfer a specific speaker's turn-taking style to the model. The transfer is highly reference-specific: swapping in another speaker's reference worsens the match in 93-98% of cases, indicating that style is not frozen into the weights but can be read, shifted, and calibrated per person.

These findings rely on first-party benchmarks and have not yet been independently reproduced. The work highlights a new mechanism for controlling AI voice interaction styles without retraining, though real-world stability in complex environments remains to be verified.

출처

  • arxiv.org↗
주제
로그인 / 회원가입
독서리서치레이더투자 프레임워크

全双工语音主动向量

研究人员在全双工语音模型中识别出“主动向量”(initiative vector),这是一个控制话轮转换的内部方向。该发现表明,模型的对话风格并非冻结在权重中,而是可以通过短录音进行转移和校准。这一突破解决了现有模型在实时交互中难以自然切换…

3 단계0 건업데이트됨 2026-10-17 02:40

현재까지의 과정

  1. 2026-10-14arXiv预印本《Reference-Guided Turn-Taking Style Transfer for Full-Duplex Spoken Language Models》提交,首次提出并验证了“主动向量”的存在及其在风格转移中的作用。arxiv.org ↗
  2. 2026-10-06另一项研究《Coupled but Late》指出,当前全双工模型在无人干预的对话中,话轮转换比人类慢400-560毫秒,且表现为反应式而非预测式,凸显了优化话轮控制的紧迫性。arxiv.org ↗
  3. 2026-08-04阿里巴巴团队发布《Enabling Proactive Spoken Turns via a Generalized Style-Aware Full-Duplex Framework》,提出LPS-TC控制器和WildTurn数据集,旨在通过显式建模提升主动话轮能力。arxiv.org ↗

아직 해결되지 않은 문제

  • 主动向量在不同架构的全双工模型中的普适性如何?
  • 基于参考音频的风格转移在复杂噪声环境下的鲁棒性表现?
  • 如何将主动向量的发现与现有的端到端语音模型训练流程结合以提升效率?
전체 주제 읽기 →
리서치 계속하기 →