ByteDance Launches SeedRealtime, a Full-Duplex Audio-Visual LLM

ByteDance's Seed research team released SeedRealtime on August 5, a native audio-visual full-duplex large language model that fuses sound, vision, and text within a single unified architecture. Unlike cascaded systems that chain separate modules for speech recognition, vision, and text-to-speech, SeedRealtime runs perception, understanding, and response generation in parallel over continuous multimodal streams. The model has already been deployed in ByteDance's Douyin and Doubao consumer apps,

1 min
ByteDance Launches SeedRealtime, a Full-Duplex Audio-Visual LLM

ByteDance's Seed research team released SeedRealtime on August 5, a native audio-visual full-duplex large language model that fuses sound, vision, and text within a single unified architecture. Unlike cascaded systems that chain separate modules for speech recognition, vision, and text-to-speech, SeedRealtime runs perception, understanding, and response generation in parallel over continuous multimodal streams.

The model has already been deployed in ByteDance's Douyin and Doubao consumer apps, which the company claims is the first large-scale rollout of full-duplex audio-visual technology.

Three capabilities distinguish SeedRealtime from earlier approaches. First, joint audio-visual understanding lets the model resolve ambiguities by cross-referencing what it hears with what it sees -- for example, disambiguating homophones by analyzing visual context, or interpreting temporal references like "this one" by tracking gestures and scene changes. Second, proactive interaction means the model monitors the environment continuously and can speak unprompted when it detects a relevant change, such as spotting an object the user asked to be reminded about. Third, the model manages conversational timing natively, distinguishing background chatter from the primary speaker and deciding when to interject without relying on an external voice activity detector.

ByteDance published end-to-end human evaluation results showing SeedRealtime cuts conversational pacing failures by roughly half compared to cascaded pipelines. The company reports fewer instances of the model being cut off mid-sentence, responding sluggishly after pauses, or being falsely triggered by background noise.

The launch follows OpenAI's GPT-Live announcement in late July and places ByteDance directly in competition with other full-duplex voice efforts from OpenAI, Microsoft, and Google. SeedRealtime's immediate consumer deployment through Douyin gives it a distribution advantage that lab-stage competitors currently lack.

ByteDance also operates Volcano Engine, its cloud AI platform, which suggests an API path for enterprise use, though the company has not yet announced developer access details for SeedRealtime.

The release marks a shift in the voice AI landscape away from turn-based interaction and toward models that watch, listen, and speak simultaneously -- a technical threshold that multiple labs are now crossing within the same quarter.

Written by

More to read

  • Decentralized and Peer-to-Peer LLM Inference in Production: Architecture, Ring Memory Partitioning, and Network Latency

    Decentralized and Peer-to-Peer LLM Inference in Production: Architecture, Ring Memory Partitioning, and Network Latency Frontier open-weight models such as Llama 3.1 405B, DeepSeek-V3, and Command R+ have expanded model capabilities, but their parameter scales exceed the physical memory limits of individual consumer and edge workstations. Running a 405-billion parameter model in 16-bit precision requires over 810 GB of memory, and even 4-bit quantized variants require roughly 230 GB of contiguo

    1 min
  • Discrete Diffusion in Large Language Models: How Continuous-Time Markov Chains, Absorbing States, and Score Entropy Challenge Autoregressive Generation

    The dominance of autoregressive architectures in large language models rests on a fundamental mathematical formulation: the chain rule of probability. By factoring the joint distribution of a sequence into a product of conditional probabilities, $p(x) = \prod_{i=1}^N p(x_i \mid x_{<i})$, autoregressive models reduce text generation to sequential next-token prediction. While this left-to-right causal factorization has scaled effectively across compute regimes, it imposes rigid operational constr

    1 min
  • AI Agents Surpass Humans on OpenRouter as Agentic Token Usage Jumps 14x

    Autonomous AI agents have overtaken human users as the primary consumers of language model compute on OpenRouter, with agentic token volume surging fourteenfold over the past six months. Data published by OpenRouter analyst Peter Walker indicates that February 6 marked the permanent inflection point where token consumption by automated agents exceeded direct human API traffic. Since that threshold, agentic token volume on the multi-model gateway has climbed from 0.51 trillion to 7.3 trillion to

    1 min