Skip to main content
Deepgram's Docs

Search documentation

Type to search this documentation.

On this pageOverview

July 31, 2026

Mid-session Listen updates, STT latency, session length limit & Google Enterprise Agent API

Section titled “Mid-session Listen updates, STT latency, session length limit & Google Enterprise Agent API”

UpdateListen: switch model and language mid-session

Section titled “UpdateListen: switch model and language mid-session”

UpdateListen now accepts model and language changes, so you can switch speech-to-text models and languages without restarting the session. Previously the provider identity had to match the current session.

JSON
{
  "type": "UpdateListen",
  "listen": {
    "provider": {
      "type": "deepgram",
      "version": "v1",
      "model": "nova-3-general",
      "language": "es"
    }
  }
}

Send the fields that apply to the model you are switching to: language for V1 (Nova) models, and keyterms, eot_threshold, eager_eot_threshold, eot_timeout_ms, and language_hints for V2 (Flux) models. Keyterms can only be updated mid-session for Flux models — set Nova-3 keyterms in the Settings message at the start of the session. The server responds with a ListenUpdated acknowledgement once the changes are applied.

For details, see the UpdateListen documentation.

LatencyReport now includes stt_latency, the time from audio received to transcript produced. Every turn reports the full STT → LLM → TTS breakdown.

JSON
{
  "type": "LatencyReport",
  "stt_latency": 0.12,
  "ttt_token_latency": 0.34,
  "tts_latency": 0.18,
  "total_latency": 0.64
}

For details, see the Latency Report documentation.

Voice Agent sessions now close automatically after 2 hours. Two new codes mark the limit:

Time into the session Event Code
1 hour 55 minutes Warning MAXIMUM_SESSION_LENGTH_APPROACHING
2 hours Error (terminal) MAXIMUM_SESSION_LENGTH_REACHED

KeepAlive does not extend the limit. To continue a conversation past 2 hours, open a new connection and replay the prior turns in agent.context.messages.

For details, see Maximum session length.

Managed Google LLMs now run on either of Google's APIs: the AI Studio API or the Gemini Enterprise Agent (GEA) API, formerly the Vertex API. GEA adds regional Google endpoints for models where available. Select the API with think.provider.version from any Deepgram Voice Agent endpoint: ai-studio-v1beta for AI Studio, gemini-enterprise-agent-v1 for GEA. The existing v1beta value remains valid as an alias for ai-studio-v1beta.

JSON
{
  "agent": {
    "think": {
      "provider": {
        "type": "google",
        "version": "gemini-enterprise-agent-v1",
        "model": "gemini-2.5-flash"
      }
    }
  }
}

Defaults when you omit version:

Deepgram Voice Agent endpoint Default version
wss://agent.deepgram.com/v1/agent/converse (general) ai-studio-v1beta — global AI Studio, the broadest model coverage
wss://api.eu.deepgram.com/v1/agent/converse (EU) gemini-enterprise-agent-v1 — GEA EU, every request served in the EU
wss://api.au.deepgram.com/v1/agent/converse (AU) ai-studio-v1beta — global AI Studio, as GEA has no Australia-specific endpoint

Fewer Gemini models are available on the EU GEA endpoint than on global AI Studio. For current availability by region, see Google's documentation.

For details, see Regional Endpoints and LLM Models.

Resolved a sample rate issue that prevented some users from using the Flux TTS early access model in the Voice Agent.

Suggest an edit

Propose a replacement for this page. The site team reviews it before applying any changes.

Export
Documentation menu