OpenAI unveils voice intelligence capabilities in its API

OpenAI announced on Thursday that its API now includes several new voice intelligence features, designed to help developers build apps capable of speaking, transcribing, and translating conversations.
The company's new GPT‑Realtime‑2 is another voice model, built to produce a realistic vocal simulation that can engage in conversation with users. However, unlike its predecessor (GPT‑Realtime‑1.5), this version incorporates GPT‑5‑class reasoning, which OpenAI says was developed to handle more complex user requests.
The company is also releasing GPT‑Realtime‑Translate, which — as the name suggests — offers real‑time translation services that keep pace with the user during conversations. This feature supports over 70 input languages (languages it can understand) and 13 output languages (languages it speaks back).
Finally, the company has introduced a new transcription capability called GPT‑Realtime‑Whisper, which provides live speech‑to‑text functionality that captures words as interactions happen.
“Together, the models we are launching move real‑time audio from simple call‑and‑response toward voice interfaces that can actually do work: listen, reason, translate, transcribe, and take action as a conversation unfolds,” the company said.
Who will benefit from these updates? Companies looking to expand customer service capabilities are an obvious audience. However, OpenAI also notes that the new features will support a wide range of areas, including education, media, events, and creator platforms.
As useful as these tools may be from an enterprise perspective, there is also potential for misuse. The company says it has built guardrails to prevent its new features from being abused for spam, fraud, or other forms of online abuse. Specific triggers have been embedded in the system so that “conversations can be halted if they are detected as violating our harmful content guidelines,” according to OpenAI.
All the new voice models are included in OpenAI’s Realtime API. Translate and Whisper are billed per minute, while GPT‑Realtime‑2 is billed based on token consumption.
Related article
Sam Altman Sparks Debate Over AI's Deceleration
Listen onApple PodcastsListen onSpotifyOpenAI CEO Sam Altman recently suggested that it may be time to “pace the rate of AI development” to allow society to “harden around some of these new capability levels.”On the latest episode of TechCrunch’s Equ
OpenAI fights Apple trade secret lawsuit
OpenAI rebutted Apple’s trade secret allegations on Tuesday, arguing the lawsuit is unfounded.“We take these claims seriously but see no evidence supporting them,” OpenAI stated, as reported by Bloomberg’s Ed Ludlow on X. “We support fair competition
OpenAI robotics head Caitlin Kalinowski resigns over Pentagon partnership
OpenAI robotics leader Caitlin Kalinowski has stepped down following the company’s controversial partnership with the Department of Defense.“This wasn’t an easy call,” Kalinowski explained in a social media statement. “While AI plays a vital role in
Related Special Topic Recommendations
Comments (0)
0/500

OpenAI announced on Thursday that its API now includes several new voice intelligence features, designed to help developers build apps capable of speaking, transcribing, and translating conversations.
The company's new GPT‑Realtime‑2 is another voice model, built to produce a realistic vocal simulation that can engage in conversation with users. However, unlike its predecessor (GPT‑Realtime‑1.5), this version incorporates GPT‑5‑class reasoning, which OpenAI says was developed to handle more complex user requests.
The company is also releasing GPT‑Realtime‑Translate, which — as the name suggests — offers real‑time translation services that keep pace with the user during conversations. This feature supports over 70 input languages (languages it can understand) and 13 output languages (languages it speaks back).
Finally, the company has introduced a new transcription capability called GPT‑Realtime‑Whisper, which provides live speech‑to‑text functionality that captures words as interactions happen.
“Together, the models we are launching move real‑time audio from simple call‑and‑response toward voice interfaces that can actually do work: listen, reason, translate, transcribe, and take action as a conversation unfolds,” the company said.
Who will benefit from these updates? Companies looking to expand customer service capabilities are an obvious audience. However, OpenAI also notes that the new features will support a wide range of areas, including education, media, events, and creator platforms.
As useful as these tools may be from an enterprise perspective, there is also potential for misuse. The company says it has built guardrails to prevent its new features from being abused for spam, fraud, or other forms of online abuse. Specific triggers have been embedded in the system so that “conversations can be halted if they are detected as violating our harmful content guidelines,” according to OpenAI.
All the new voice models are included in OpenAI’s Realtime API. Translate and Whisper are billed per minute, while GPT‑Realtime‑2 is billed based on token consumption.
Sam Altman Sparks Debate Over AI's Deceleration
Listen onApple PodcastsListen onSpotifyOpenAI CEO Sam Altman recently suggested that it may be time to “pace the rate of AI development” to allow society to “harden around some of these new capability levels.”On the latest episode of TechCrunch’s Equ
OpenAI fights Apple trade secret lawsuit
OpenAI rebutted Apple’s trade secret allegations on Tuesday, arguing the lawsuit is unfounded.“We take these claims seriously but see no evidence supporting them,” OpenAI stated, as reported by Bloomberg’s Ed Ludlow on X. “We support fair competition
OpenAI robotics head Caitlin Kalinowski resigns over Pentagon partnership
OpenAI robotics leader Caitlin Kalinowski has stepped down following the company’s controversial partnership with the Department of Defense.“This wasn’t an easy call,” Kalinowski explained in a social media statement. “While AI plays a vital role in





Home






