Duplex Compute
Research notes
RESEARCH NOTE / 008

OpenAI Realtime API alternatives: decide which layer you are replacing

Realtime is one model doing speech, reasoning, tools and speech output in one session. Most alternatives replace only part of that, so start by naming the part.

Duplex Compute · October 13, 2026 · Rates and versions checked October 13, 2026

The Realtime API uses one model to interpret audio, decide what to do and respond in speech. Its current model, gpt-realtime-2.1, supports function calling, configurable reasoning effort and image input. It also handles barge-in: with voice activity detection on, it cancels the current response when the user starts talking. Neither feature is missing, so neither is a reason to switch on its own.

The usual reasons are narrower. Realtime bills by tokens, at $32 per million audio input tokens and $64 per million audio output tokens, and resends the conversation to the model on every response, so long calls get expensive in ways that are hard to predict. A session lasts at most 60 minutes. The reasoning model is fixed to OpenAI's speech model. Some teams want open weights or their own hardware.

Six kinds of replacement

What each alternative replaces
KindExamplesWhat you keep or add
Another speech-to-speech modelGemini 3.8 LiveSame shape as Realtime; a different model and rate card
A voice frontend over your own backendGPT-Live; Duplex ComputeYour text agent and tools; the voice layer is separate
A bundled voice agent APIDeepgram Voice AgentOne connection running listen, think and speak stages
An orchestration frameworkPipecat, LiveKit AgentsYour code wires providers together; models are billed elsewhere
An open full-duplex modelMoshi, NemotronLabs VoiceChatWeights you serve yourself, or a hosted wrapper
A managed voice platformVapi, RetellPhone numbers, dashboards and operations around third-party models

Gemini Live

Google's Live API is the closest like-for-like swap. Its pricing section for Gemini 3.8 Live, 3.8 Live Extended Thinking and 3.1 Flash Live Preview lists audio input at $3 per million tokens (about $0.005 per minute) and audio output at $12 per million (about $0.018 per minute). Tools use function declarations. Pin the model before you design around async tools: the capability table on the tools page marks Gemini 3.1 Flash Live Preview as synchronous only and Gemini 2.5 Flash Live Preview as synchronous and asynchronous. It does not cover 3.8.

Session lifetime works differently. Without context compression, audio-only sessions stop at 15 minutes, and a single connection lasts around 10 minutes. Session resumption and compression extend a conversation across connections. Your client has to handle the reconnect.

GPT-Live and other voice frontends

GPT-Live is OpenAI's other voice API, and a different architecture. It listens while speaking and delegates reasoning and tools to a backend you choose, including an agent you already run on another provider. It bills $0.05 per session minute, with backend usage on top. Our GPT-Live vs. Realtime note compares the two in detail.

Deepgram Voice Agent

Deepgram's Voice Agent API runs listening, thinking and speaking over one connection, and its function calls can run in your client or on Deepgram's side. The Standard pay-as-you-go tier is $0.075 per minute of WebSocket connection time. Cheaper tiers exist where you bring your own LLM or TTS, and those providers then bill you separately.

Pipecat and LiveKit Agents

Frameworks orchestrate models that other providers supply. LiveKit Agents runs Python or Node.js agents as participants in LiveKit rooms, under Apache 2.0, with plugins for most major AI providers. Pipecat is an open-source Python framework, and it can run over LiveKit's WebRTC transport, so the two are not exclusive. Either can wrap a speech-to-speech model such as Realtime itself, or chain separate speech-to-text, LLM and text-to-speech providers.

Hosting is a separate meter from the models. Pipecat Cloud's agent-1x profile costs $0.01 per active minute. LiveKit Cloud includes agent-session minutes by plan, then charges $0.01 per minute. Neither figure includes the model calls.

Open full-duplex models

Moshi models two audio streams, the user's and its own, and ships PyTorch, MLX and Rust implementations. Its weights are CC-BY 4.0. Its README documents no tool calling. NemotronLabs VoiceChat is an 11B full-duplex model with tool calling, and its README is frank about limits. The documented deployment needs an NVIDIA GPU with at least 80 GB of memory. NVIDIA recommends at most five tools per session and says the user cannot interrupt the agent while a tool runs.

A hosted wrapper can expose less than the checkpoint. .wave's Nemotron VoiceChat beta costs an introductory $0.005 per minute, caps sessions at 120 seconds and supports no tools, custom instructions or text input.

Vapi and Retell

These are platforms for running phone agents, with numbers, transfers and dashboards. They sit on top of model providers rather than replacing them. Vapi charges $0.05 per minute for hosting and passes model costs through at cost. Retell lists $0.055 per minute for voice infrastructure plus your chosen TTS and LLM, and quotes $0.07 to $0.31 per minute depending on configuration. Choose one if you need the phone operations. A web or app developer may not.

Requirements to check before switching

Tools, session length and billing unit. Rates checked October 13, 2026; each excludes the costs noted.
OptionToolsSession lengthBilling unit
OpenAI gpt-realtime-2.1Function calling in the model60 min maxTokens by modality
Gemini 3.8 LiveFunction declarations; async support varies by model15 min audio-only without compression; resumableTokens; ≈$0.005/min in, ≈$0.018/min out
GPT-Live (gpt-live-1)Through the delegated backendNo number in the guides checked$0.05/session min + backend
Deepgram Voice Agent StandardClient-side or server-side functionsNo maximum in the docs; idle sockets need KeepAlive$0.075/connection min
Pipecat Cloud or LiveKit CloudWhatever the chosen LLM supportsSet by the chosen providers$0.01/min hosting + every provider
Self-hosted NemotronLabs VoiceChatYes; ≤5 recommended, no interrupting during toolsYour deploymentYour GPU time
.wave Nemotron VoiceChat betaNone120 s$0.005/session min, introductory
Vapi / RetellPlatform toolsPlatform settingsPlatform minutes + models + telephony

No row in this table is a complete bill. Per-minute rates meter different things: open connections, generated audio, hosting containers. The voice agent pricing note has the formula for each billing model, so you can put two options on the same workload.

A migration checklist

  1. Record a set of real calls on Realtime today, with tool calls, corrections, interruptions and the final application state.
  2. List the Realtime features your code depends on: semantic_vad, image input, truncation on interruption, the function_call_output loop.
  3. Map each to the candidate's equivalent, or note that your code must now do it.
  4. Decide what happens to a tool call already running when the user interrupts or corrects it.
  5. Rebuild the bill from logged usage: connected time, speaking time, tokens, cache hits and hosting.
  6. Replay the same scenarios on the candidate and compare task success as well as speed and cost.

Step six matters most. A provider that answers faster and books the wrong date costs more per finished task. OpenAI's voice agent evaluation cookbook shows how to check tool calls and resulting state, not only the audio.

Choosing by application

Starting points, not verdicts
You are buildingLook first at
A voice layer for an agent you already runGPT-Live with client delegation, or another full-duplex voice API
A drop-in speech-to-speech swapGemini 3.8 Live
A pipeline where you swap STT, LLM or TTSPipecat or LiveKit Agents
An inbound phone line run by non-engineersVapi or Retell
On-premises or open-weights onlyMoshi or NemotronLabs VoiceChat on your own GPUs

Duplex Compute belongs in the first row. It is a full-duplex voice API with tool calling, configurable behavior and long conversations, priced at $0.01 per connected minute. That is the voice-session rate; your backend model and tools cost what they cost.

Related notes

Moving off Realtime?

If you want full-duplex voice with your own tools at a flat $0.01 per connected minute, tell us your expected voice hours, your tool requirements and how you use Realtime today.

Request access