OpenAI, on Thursday, May 7, introduced its new generation of voice models that have the ability to reason, translate, and transcribe as users speak. The company said that its latest models in the API have the potential to create a wide range of voice apps for developers. In simple words, developers will now be able to create apps that can talk, transcribe, and translate conversions with users in real-time.
The new models are GPT-Realtime-2, which comes with GPT-5 class reasoning capable of handling harder requests and carrying out conversations naturally. The second model is GPT-Realtime-Translate, which is OpenAI’s new live translation model that translates speech from over 70 input languages into about 13 output languages. And the model does this in real time while maintaining the pace of the speaker. Meanwhile, the third model is GPT-Realtime-Whisper, which is a new streaming speech-to-text that transcribes speech live as the speaker talks.
Voice models are among the most preferred ways for millions to use software. However, OpenAI said that building practical voice products is far more complex. This is because an AI agent needs to understand the context of the conversation, adjust when a request changes, use tools as the conversation continues, and, most importantly, respond in a manner that feels appropriate for the time.
“Together, the models we are launching move realtime audio from simple call-and-response toward voice interfaces that can actually do work: listen, reason, translate, transcribe, and take action as a conversation unfolds,” OpenAI said in its official blog.
Disclaimer
We strive to uphold the highest ethical standards in all of our reporting and coverage. We StartupNews.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.
