OpenAI has introduced its latest chatbot model, GPT-4o, which has become “more human-like” and is now capable of processing visual data.
Say hello to GPT-4o, our new flagship model which can reason across audio, vision, and text in real time: https://t.co/MYHZB79UqN
Text and image input rolling out today in API and ChatGPT with voice and video in the coming weeks. pic.twitter.com/uuthKZyzYx
— OpenAI (@OpenAI) May 13, 2024
The AI tool “particularly excels in understanding video and sound compared to existing models.” This feature includes emotion recognition and breath rhythm analysis.
The chatbot also features a full-fledged Voice Mode for voice interaction.
According to the presentation, the product can assist users with various everyday tasks, such as preparing for interviews. OpenAI also demonstrated how GPT-4o can call customer support to replace an iPhone.
Other examples showed the neural network’s ability to tell “dad jokes,” translate conversations in real-time between two languages, judge a game of “rock-paper-scissors,” and respond with sarcasm.
One video depicted ChatGPT’s reaction to meeting a user’s puppy for the first time.
“Hello, Bowser! Aren’t you the most adorable creature?” exclaimed the chatbot.
OpenAI stated that the “o” in GPT-4o stands for “omni,” symbolizing a step towards more natural human-computer interaction.
GPT-4o is “much faster and 50% cheaper” than GPT-4 Turbo. The neural network responds to audio queries in 2.3 seconds. The average response time of the chatbot is 3.2 seconds, which is comparable to human reaction time in a typical conversation, OpenAI emphasized.
The version of the neural network for text and image input was launched on May 13. The full version with video support will be available “in the coming weeks.”
“It’s like AI from the movies. I’m still a bit amazed that it’s real. The shift to human-level response time and expressiveness has been a significant change,” stated OpenAI CEO Sam Altman.
According to him, conversations with the neural network now feel “truly natural.”
Previously, Altman noted that the future of artificial intelligence will be marked by the emergence and growing popularity of personal assistants. They will become an integral part of everyday life and may even replace smartphones.
Back in April, the LMSYS platform introduced the gpt2-chatbot language model, which has been linked to OpenAI.