ChatGPT's highly anticipated new Voice mode has just starred again in new demo that shows off its acting skills – and the video could be a taste of what we can expect from the reported new deal between Apple and OpenAI.
The video shows someone writing a story and getting ChatGPT to effectively do improv drama, providing voices for a “majestic lion” and a mouse. Beyond the expressiveness of the voices, what's notable is how easy it is to interrupt the ChatGPT voice for a better conversational flow, and also the lack of latency.
OpenAI says the new mode will “be rolling out in the coming weeks” and that's a pretty big deal. Not least because, as Bloomberg's Mark Gurman has again reported, Apple is expected to announce a new partnership with OpenAI at WWDC 2024 on June 10.
Exactly how OpenAI's tech is going to be baked into iOS 18 remains to be seen, but Gurman's report states that Apple will be “infusing its Siri digital assistant with AI”. That means some of its off-device powers could tap into ChatGPT – and if it's anything like OpenAI's new demo, that would be a huge step forward from today's Siri.
Voice assistants finally grow up?
Siri's reported AI overhaul will likely be one of the bigger stories of WWDC 2024. According to Dag Kittlaus, who co-founded and ran Siri before Apple acquired it in 2010, the deal with OpenAI will likely be a “short- to medium-term relationship” while Apple plays catch up. But it's still a major surprise.
It's possible that Siri's AI improvements will be restricted to more minor, on-device functions, with Apple instead using its OpenAI partnership solely for text-based queries. After all, from iOS 15 onwards, Apple switched Siri's audio processing to being on-device by default, which meant you could use it without an internet connection.
But Bloomberg's Gurman claims that Apple has “forged a partnership to integrate OpenAI’s ChatGPT into the iPhone’s operating system”. If so, it's possible that one unlikely move could be followed by another, with Siri leaning on ChatGPT for off-device queries and a more conversational flow. It's already been possible to use ChatGPT with Siri for a while now using Apple's Shortcuts.
It wouldn't be the first time that Apple has integrated third-party software into iOS. Back on the original iPhone, Apple made a pre-installed YouTube app which was later removed once Google had made its own version. Gurman's sources noted that by outsourcing an AI chatbot, “Apple can distance itself from the technology itself, including its occasional inaccuracies and hallucinations.”
We're certainly looking forward to seeing how Apple weaves OpenAI's tech into iOS –and potentially Siri – at WWDC 2024.
With ChatGPT-4o, all users can now access more advanced tools like discussing files and photos you upload to ChatGPT. The generative AI can also conduct data analysis and create charts, and it can access the internet to inform its responses.
However, with all of these features rolling out to everyone – even if they come with usage limits for non-paying users – there’s a big question of if people should stay subscribed to OpenAI’s premium tier for ChatGPT.
It’s not like ChatGPT Plus has become entirely obsolete. Subscribers still have exclusive features like the ability to create custom GPTs, higher usage rate limits with 4o, and first access to new features – this includes early access to Voice Mode when it launches “in the coming weeks.”
But it’s understandable why subscribers feel a little burned. They’re paying $ 20 (around £16 / AU$ 30) per month for a service that’s not that different from the free one. Unless you’re an AI power user, now’s seemingly a terrible time to sign up for ChatGPT Plus.
Thinking long term
(Image credit: Shutterstock/Daniel Chetroni)
So why would OpenAI want to make its premium service less appealing? Well, there are two prevailing theories.
The far-fetched one is that OpenAI will soon release an early version of GPT-5, or at least some kind of exciting new features that’ll be exclusive to its paid members beyond the voiced version of ChatGPT. It’s not out of the question, though this feels like something OpenAI would have mentioned during its Spring Update event on May 13, so color us skeptical.
The likely reason is that OpenAI is changing track to focus on bringing in as many users as possible, rather than paid ones, at least for now.
What’s more, ChatGPT’s rivals – like the Meta AI and Google Gemini – are free to use and offer many of the same premium tools at no cost. If it’s already a struggle to get people to use AI when it’s free, you can bet it’s significantly harder with a paywall in the way.
We’ll have to wait and see if ChatGPT Plus gets any improvements in the coming weeks, but if you’re currently subscribed (or thinking of joining) you might want to hold off for now.
If you're feeling a bit overwhelmed or left behind by ChatGPT and other AI tools, fear not – a big new international study has found that most of us aren't using generative AI tools on a regular basis.
The study from Reuters Institute and Oxford University (via BBC), which surveyed over 12,000 people across six countries, seemingly reveals how little that AI hype has percolated down to real-world use, for now.
Even among the people who have used generative AI tools like ChatGPT, Google Gemini or Microsoft Copilot, a large proportion said they'd only used them “once or twice”. Only a tiny minority (7% in the US, 2% in the UK) said they use the most well-known AI tool, ChatGPT, on a daily basis.
A significant proportion of respondents in all countries (including 47% in the US, and 42% in the UK) hadn't even heard of ChatGPT, a figure that was much higher for other AI apps. But after ChatGPT, the most recognized tools were Google Gemini, Microsoft Copilot, Snapchat My AI, Meta AI, Bing AI and YouChat.
Trailing further behind those in terms of recognition were generative AI imagery tools like Midjourney, plus Claude and the xAI's Grok for X (formerly Twitter). But while the regular use of generative AI tools is low, the survey does provide some interesting insights on what the early dabblers are using them for.
This table from the survey shows answers to the question: “You said you have used a generative AI chatbot or tool. Which, if any, of the following have you tried to use it for (even if it didn’t work)?” (Image credit: Reuters Institute and Oxford University)
Broadly speaking, the use cases were split into two categories; “creating media” and, more worryingly given the issue of AI hallucinations, “getting information”. In the former, the most popular answer was simply “playing around or experimenting” (11%), followed by “writing an email or letter” (9%) and “making an image” (9%).
The top two answers in the 'getting information' category were “answering factual questions” (11%) and “asking advice” (10%), both of which were hopefully followed by some corroboration from other sources. Most AI chatbots still come with prominent warnings about their propensity for making mistakes – for example, Google says Gemini “could provide inaccurate information or could even make offensive statements”.
AI tools are arguably better for brainstorming and summarizing, and these were the next most popular uses cases in the survey – with “generating ideas” mentioned by 9% of respondents and “summarizing text” cited by 8% of people.
But while the average person is still seemingly at the dabbling stage with generative AI tools, most people in the survey are convinced that the tools will ultimately have a big impact on our daily lives. When asked if they thought that “generative AI will have a large impact on ordinary people in the next five years”, 60% of 18-24 year olds thought it would, with that figure only dropping to 41% among those who were 55 and older.
Why are AI tools still so niche?
ChatGPT was easily the most well-known AI tool in the survey, but regular users were still in the minority. (Image credit: Reuters Institute and Oxford University)
All surveys have their limitations, and this one focuses mostly on standalone generative AI tools rather than examples of the technology that's baked into existing products – which means that AI is likely more widely used than the study suggests.
Still, its broad sample size and geographic breadth does give us an interesting snapshot of how the average person views and uses the likes of ChatGPT. The answer is that it remains very niche among consumers, with the report's lead author Dr Richard Fletcher suggesting to the BBC that it shows there's a “mismatch” between the “hype” around AI and the “public interest” in it.
Why might that be the case? The reality is that most AI tools, including ChatGPT, haven't yet convinced us that they're frictionless or reliable enough to become a default part of our tech lives. This is why the focus of OpenAI's new GPT-4o model (branding being another issue) was a new lifelike voice assistant, which was designed to help lure us into using it more regularly.
So while this survey's respondents were “generally optimistic about the use of generative AI in science and healthcare, but more wary about it being used in news and journalism, and worried about the effect it might have on job security”, according to Dr Fletcher, it seems that AI tech is going to become a daily part of our lives regardless – just not quite yet.
Microsoft revealed the revamped standalone Copilot app for Windows 11 at this year’s Build 2024 event, and it’s now rolling out to testers – and some of those testers have noticed striking similarities between the app and AI rival ChatGPT.
The Copilot app (which was previously rumored, and even (kind of) spotted in one version of Windows) is present in build 26100 in the Release Preview channel, which is the last step before hitting the final version of Windows 11. In fact, this is the preview version of the Windows 11 24H2 update which lands later this year.
The new app is no longer an anchored side panel on the desktop, but a full app in a window, allowing you to move and resize the AI assistant as needed, just like any other app. The Copilot icon is also centrally located in the Windows 11 taskbar now, rather than on the far right in the system tray.
That certainly represents a good deal more flexibility for Copilot, and for how you might want to use the AI, but some users testing the new app are noticing something else – that the revamped Copilot interface resembles ChatGPT in a few respects.
As Windows Latest notes, the similarities include the left-hand side menu that displays previous chats, alongside the general ‘vibe’ of the new Copilot app.
Familiar territory
Aside from Copilot having the chat bar in the center of the app panel, and maybe a splash of color, there really isn’t a lot of difference between the two AI-powered chatbots. Microsoft can’t be entirely blamed for imitating the iconic ChatGPT’s layout, though, as many other ChatGPT alternatives have adopted the same style of layout to allow users to easily familiarize themselves with the newer apps.
Think about how easy it is for you to navigate most of the social media apps on your phone – they all have a similar layout, so even if you’ve only just joined a new one, you can find your way around before learning the more intricate details. That said, I do think Microsoft could have done a little better here in trying to come up with its own style, but the app is still in testing within the Windows Insider program, so perhaps the design will be tweaked further ahead of its public release.
If you’d like to try out the new Copilot app, you’ll need to be part of that Windows Insider testing program. Joining is pretty straightforward, and once you’re all signed up you’ll have access not just to the Copilot app, but to other updates and features Microsoft tries out in preview versions.
Do bear in mind a couple of things, though: test versions of Windows 11 aren’t something you want to be running on your main PC (as things are more likely to go wrong, so don’t run any risks in that regard). Also, remember that just because a feature has appeared in testing, that doesn’t mean it’ll make the cut for release in the final version of Windows 11 used by everyone.
OpenAI's high-profile run-in with Scarlett Johansson is turning into a sci-fi story to rival the move Her, and now it's taken another turn, with OpenAI sharing documents and an updated blog post suggesting that its 'Sky' chatbot in the ChatGPT app wasn't a deliberate attempt to copy the actress's voice.
OpenAI preemptively pulled its 'Sky' voice option in the ChatGPT app on May 19, just before Scarlett Johansson publicly expressed her “disbelief” at how “eerily similar” it sounded to her own (in a statement shared with NPR). The actress also revealed that OpenAI CEO Sam Altman had previously approached her twice to license her voice for the app, and that she'd declined on both occasions.
But now OpenAI is on the defensive, sharing documents with The Washington Post suggesting that its casting process for the various voices in the ChatGPT app was kept entirely separate from its reported approaches to Johansson.
The documents, recordings and interviews with people involved in the process suggest that “an actress was hired to create the Sky voice months before Altman contacted Johansson”, according to The Washington Post.
The agent of the actress chosen for the Sky voice also apparently confirmed that “neither Johansson nor the movie “Her” were ever mentioned by OpenAI” during the process, nor was the actress's natural speaking voice tweaked to sound more like Johansson.
OpenAI's lead for AI model behavior, Joanne Jang, also shared more details with The Washington Post on how the voices were cast. Jang stated that she “kept a tight tent” around the AI voices project and that Altman was “not intimately involved” in the decision-making process, as he was “on his world tour during much of the casting process”.
With Johansson now reportedly lawyering up in her battle with OpenAI, the case looks likely to continue for some time.
Interestingly, the case isn't completely without precedent, despite the involvement of new tech. As noted by Mitch Glazier (chief executive of the Recording Industry Association of America), there was a similar case in the 1980s involving Bette Midler and the Ford Motor Company.
After Midler declined Ford's request to use her voice in a series of ads, Ford hired an impersonator instead – which resulted in a legal battle that Midler ultimately won, after a US court found that her voice was distinctive and should be protected against unauthorized use.
OpenAI is now seemingly distancing itself from suggestions that it deliberately did something similar with Johansson in its ChatGPT app, highlighting that its casting process started before Altman's apparent approaches to the actress.
This all follows an update to OpenAI's blog post, which included a statement from CEO Sam Altman claiming: “The voice of Sky is not Scarlett Johansson's, and it was never intended to resemble hers. We cast the voice actor behind Sky’s voice before any outreach to Ms. Johansson. Out of respect for Ms. Johansson, we have paused using Sky’s voice in our products. We are sorry to Ms. Johansson that we didn’t communicate better.”
But Altman's post on X (formerly Twitter) just before OpenAI's launch of GPT-4o, which simply stated “her”, doesn't help distance the company from suggestions that it was attempting to recreate the famous movie in some form, regardless of how explicit that was in its casting process.
OpenAI has pulled ChatGPT's popular 'Sky' chatbot voice after Scarlett Johansson expressed her “disbelief” at how “eerily similar” it sounded to her own. But fans of the controversial voice in the ChatGPT app aren't happy – and have now started a petition to bring it back.
The Sky voice, which is one of several that are available in the ChatGPT app for iOS and Android, is no longer available after OpenAI stated yesterday on X (formerly Twitter) that it'd had hit pause in order to address “questions about how we chose the voices in ChatGPT”.
Those questions became very pointed yesterday when Johansson wrote a fiery statement given to NPR that she was “shocked, angered and in disbelief” that OpenAI CEO Sam Altman would “pursue a voice that sounded so eerily similar to mine” after she had apparently twice declined licensing her voice for the ChatGPT assistant.
OpenAI has rejected those accusations, stating in a blog post that “Sky’s voice is not an imitation of Scarlett Johansson but belongs to a different professional actress using her own natural speaking voice.” But pressure from Johansson's lawyers, which NPR reports are demanding answers, has forced OpenAI to suspend the voice – and fans aren't happy.
In a fascinating example of how attached some are already becoming to AI chatbots, a popular Reddit thread titled 'Petition to bring Sky voice back' includes a link to a Change petition, which currently has over 300 signatures.
In fairness, many of the Reddit comments and signatures predate Johansson's statement and OpenAI's reasoning for pulling the Sky voice option in the ChatGPT app. And it now looks increasingly likely that the voice won't simply be paused but instead put on indefinite hiatus.
But the thread is still an interesting, and mildly terrifying, glimpse of where we're headed with convincing AI chatbot voices, whether they're licensed from famous actresses or not. One comment from Redditor JohnDango states that “she was the only bot I spoke to that had a 'realness' about her that made it feel like a real step beyond chatbot,” while GaneshLookALike noted mournfully that “Sky was full of warmth and compassion.”
That voice, which we also found to be one of ChatGPT's most convincing options, is now on the backburner while the case rumbles on.
It doesn't sound like ChatGPT's 'Sky' voice is going to return anytime soon. In her statement shared with NPR, Scarlett Johansson said she'd been “forced to hire legal counsel” and send letters to OpenAI asking how the voice had been made. OpenAI's blog post looks like its response to those questions, though it remains to be seen whether that's enough to keep the lawyers at bay.
Johansson understandably sounds determined to pursue the issue, adding in her statement to NPR that “in a time when we are all grappling with deepfakes and the protection of our own likeness, our own work, our own identities, I believe these are questions that deserve absolute clarity.”
OpenAI CEO Sam Altman also didn't exactly help his company's cause by simply posting “her” on X (formerly Twitter) on the eve of the launch of its GPT-4o model, which included the new voice mode that it demoed. That looks like a thinly-veiled reference to Spike Jonze's movie Her,about a man who develops a relationship with an AI virtual assistant Samantha, which was voiced by none other than Scarlett Johansson.
For now, then, it looks like fans of the ChatGPT app will need to make do with the other voices – including Breeze, Cove, Ember and Juniper – while this fascinating case rumbles on. This also shouldn't effect the rollout of GPT-4o's impressive new conversational voice powers, which OpenAI says it will be rolling out “in alpha within ChatGPT Plus in the coming weeks”.
If you've ever posted a comment or post on Reddit, there's a chance that it will be used as material for training OpenAI's AI models after the two companies confirmed that they've reached a deal that enables this exchange.
Reddit will be given access to OpenAI's technology to build AI features, and for that (as well as an undisclosed monetary amount), it's giving OpenAI access to Reddit posts in real-time that can be used by tools like ChatGPT to formulate more human-like responses.
OpenAI will be able to access real-time information from Reddit's data API, software that enables the retrieval of and interaction with information from Reddit's platform, providing OpenAI with structured and unique content from Reddit. This is similar to an agreement Reddit reached with Google at the beginning of the year, allowing Google to train its own AI models on Reddit's data, reported to be worth $ 60 million.
According to the official Reddit blog post publicizing the deal, the deal will help people discover and engage with Reddit's communities thanks to the Reddit content brought to ChatGPT and other new OpenAI products. Through Reddit's APIs, OpenAI's tools will be able to understand and showcase Reddit's content better, particularly when it comes to recent topics.
(Image credit: Shutterstock/GaudiLab)
Reddit, the company, and Reddit, the community of users
Users and moderators on Reddit will apparently be offered new features thanks to applications powered by OpenAI's large language models (LLMs). OpenAI will also start advertising on Reddit as an ad partner.
The blog post put out by Reddit also claims that the deal is in the spirit of keeping the internet open, as well as fostering learning and research to keep it that way. It also cites that it wants to continue to build up its community, recognizing its uniqueness and how Reddit serves as a place for conversation online. Reddit claims that this deal was signed to improve everyone's Reddit experience using AI.
It also hasn't explicitly been stated by either company that Reddit data will be used to train OpenAI's models, but I think many people assume this will be the case – or that it’s already happening. In contrast, it was disclosed that Reddit would give Google “more efficient ways to train models,” and then there's the fact that OpenAI founder Sam Altman is himself a Reddit shareholder. This doesn't confirm anything specific and, as reported by The Verge, “This partnership was led by OpenAI’s COO and approved by its independent Board of Directors.”
(Image credit: JASON REDMOND/AFP via Getty Images)
Official statements expressing the benefits of the partnership
Speaking about the partnership and as quoted in the blog post, representatives from both companies said:
“Reddit has become one of the internet’s largest open archives of authentic, relevant, and always up to date human conversations about anything and everything. Including it in ChatGPT upholds our belief in a connected internet, helps people find more of what they’re looking for, and helps new audiences find community on Reddit.”
– Steve Huffman, Reddit Co-Founder and CEO
“We are thrilled to partner with Reddit to enhance ChatGPT with uniquely timely and relevant information, and to explore the possibilities to enrich the Reddit experience with AI-powered features.”
– Brad Lightcap, OpenAI COO
They're not wrong, and many people make search queries appended with the word “Reddit” as Reddit threads will often provide information directly relevant to what you're searching for.
It's an interesting development, and OpenAI's sourcing of information – both in terms of accuracy and concerning training data – has been the main topic of discussion around the ethics of its practices for some time. I suppose at least this way, Reddit users are being made aware that their information can be used by OpenAI – even if they don’t really have a choice in the matter.
The announcement blog post reassures users that Reddit believes that “privacy is a right,” and that it has published a Public Content Policy that gives more detail about Reddit's approach to accessing public content and user protections. We'll have to see if this will be upheld as time goes on, and what the partnership looks like in practice, but I hope both companies will take users' concerns seriously.
OpenAI just announced its new GPT-4o (‘o’ for ‘omni’) model which combines text, video, and audio processing in real-time to answer questions, hold better conversations, solve maths problems, and more. It’s the most ‘human’-like iteration of the large language model (LLM) so far, available to all users for free shortly. GPT-4o has launched with a macOS app for ChatGPT Plus subscribers to try – but interestingly, there’s no Windows app just yet.
A blog post from OpenAI specifies that the company “plan[s] to launch a Windows version later this year,” choosing instead to offer the tech to Mac users first. This is odd, considering Microsoft has pumped billions of dollars into OpenAI and has its own OpenAI-powered digital assistant, Copilot. So, you would think the platform to receive initial exclusive access to a groundbreaking bit of tech like GPT-4o would be Microsoft Windows.
Why do things this way around? One theory floated by Windows Latest is that this could be a clever move on OpenAI’s part as Apple users might prefer a native app over a web app compared to Windows users. As an Apple user, I would indeed prefer to have an app for something I might use as regularly as GPT-4o, rather than having to navigate a web app – so perhaps other Apple fans may feel the same.
A further consideration here is with AI Explorer incoming as the big feature for Windows 11 later this year (in the 24H2 update), Microsoft may not want another feature like GPT-4o muddying the AI waters in its desktop OS.
Jumping in before Apple can
With such a jump between the public version of ChatGPT and the new GPT-4o model (which is also set to be available for free, albeit with limited use), OpenAI will surely want as many people using its product as possible. So, venturing into macOS territory makes sense if the firm wants to tap into a group of people who haven’t gravitated to its AI naturally.
So far Apple has not made any great efforts to integrate AI tools into its operating system in the same way that Microsoft has Copilot embedded into a user’s desktop taskbar. That leaves OpenAI with the perfect opportunity to jump onto the desktops of Mac users and show off what GPT-4o can do before Apple gets the chance to introduce its own AI assistant for macOS – if it does so.
We'll have to wait for WWDC to find out if Apple has its own take on the Copilot concept ready or if Mac users interested in artificial intelligence tools will find a new bestie in GPT-4o. That’s not to say I wouldn’t eat up whatever Apple has up its sleeve for Mac users – just that swapping over may be a little harder once I’m used to the way GPT-4o for Mac works for me.
It's another big week in artificial intelligence in a year that's been full of them, and Google has teased a new AI feature coming to mobile devices just hours ahead of its Google I/O 2024 event – where we're expecting some major announcements.
A social media post from Google shows someone asking their phone about what's being shown through the camera. In this case, it's people setting up the Google I/O stage, which the phone correctly identifies.
User and phone then go on to have a real-time chat about Google I/O 2024, complete with a transcription of the conversation on screen. We don't get any more information than that, but it's clearly teasing some of the upcoming reveals.
As far as we can tell, it looks like a mix of existing Google Lens and Google Gemini technologies, but with everything running instantly. Lens and Gemini can already analyze images, but studying real-time video feeds would be something new.
The AI people
One more day until #GoogleIO! We’re feeling 🤩. See you tomorrow for the latest news about AI, Search and more. pic.twitter.com/QiS1G8GBf9May 13, 2024
See more
It's all very reminiscent of the multimodal features – mixing audio, text, and images – that OpenAI showed off with its own ChatGPT bot yesterday. ChatGPT now has a new AI model called GPT-4 Omni (GPT-4o), which makes all of this natural interaction even easier.
We've also seen the same kind of technology demoed on the Rabbit R1 AI device. The idea is that these AIs become less like boxes that you type text into, and more like synthetic people who can see, recognize, and talk.
Based on this teaser, it looks likely that this is the way the Google Gemini AI model and bot is going. While we can't identify the smartphone in the video, it may be that these new features come to Pixel phones (like the new Google Pixel 8a) first.
All will be revealed later today, May 14: everything gets underway at 10am PT / 1pm ET / 6pm BST, which is May 15 at 3am AEST. We've put together a guide to how to watch Google I/O 2024 online, and we'll be reporting live from the event too.
OpenAI just held its eagerly-anticipated spring update event, making a series of exciting announcements and demonstrating the eye- and ear-popping capabilities of its newest GPT AI models. There were changes to model availability for all users, and at the center of the hype and attention: GPT-4o.
Coming just 24 hours before Google I/O, the launch puts Google's Gemini in a new perspective. If GPT-4o is as impressive as it looked, Google and its anticipated Gemini update better be mind-blowing.
What's all the fuss about? Let's dig into all the details of what OpenAI announced.
1. The announcement and demonstration of GPT-4o, and that it will be available to all users for free
OpenAI demoing GPT-4o on an iPhone during the Spring Update event. (Image credit: OpenAI)
The biggest announcement of the stream was the unveiling of GPT-4o (the 'o' standing for 'omni'), which combines audio, visual, and text processing in real time. Eventually, this version of OpenAI's GPT technology will be made available to all users for free, with usage limits.
For now, though, it's being rolled out to ChatGPT Plus users, who will get up to five times the messaging limits of free users. Team and Enterprise users will also get higher limits and access to it sooner.
GPT-4o will have GPT-4's intelligence, but it'll be faster and more responsive in daily use. Plus, you'll be able to provide it with or ask it to generate any combination of text, image, and audio.
The stream saw Mira Murati, Chief Technology Officer at OpenAI, and two researchers, Mark Chen and Barret Zoph, demonstrate GPT-4o's real-time responsiveness in conversation while using its voice functionality.
The demo began with a conversation about Chan's mental state, with GPT-4o listening and responding to his breathing. It then told a bedtime story to Barret with increasing levels of dramatics in its voice upon request – it was even asked to talk like a robot.
It continued with a demonstration of Barret “showing” GPT-4o a mathematical problem and the model guiding Barret through solving it by providing hints and encouragement. Chan asked why this specific mathematical concept was useful, which it answered at length.
A look at the updated mobile app interface for ChatGPT. (Image credit: OpenAI)
They followed this up by showing GPT-4o some code, which it explained in plain English, and provided feedback on the plot that the code generated. The model talked about notable events, the labels of the axis, and a range of inputs. This was to show OpenAI's continued conviction to improving GPT models' interaction with code bases and the improvement of its mathematical abilities.
The penultimate demonstration was an impressive display of GPT-4o's linguistic abilities, as it simultaneously translated two languages – English and Italian – out loud.
Lastly, OpenAI provided a brief demo of GPT-4o's ability to identify emotions from a selfie sent by Barret, noting that he looked happy and cheerful.
If the AI model works as demonstrated, you'll be able to speak to it more naturally than many existing generative AI voice models and other digital assistants. You'll be able to interrupt it instead of having a turn-based conversation, and it'll continue to process and respond – similar to how we speak to each other naturally. Also, the lag between query and response, previously about two to three seconds, has been dramatically reduced.
ChatGPT equipped with GPT-4o will roll out over the coming weeks, free to try. This comes a few weeks after Open AI made ChatGPT available to try without signing up for an account.
2. Free users will have access to the GPT store, the memory function, the browse function, and advanced data analysis
OpenAI unveils the GPT Store at its Spring Update event. (Image credit: Open AI)
GPTs are custom chatbots created by OpenAI and ChatGPT Plus users to help enable more specific conversations and tasks. Now, many more users can access them in the GPT Store.
Additionally, free users will be able to use ChatGPT's memory functionality, which makes it a more useful and helpful tool by giving it a sense of continuity. Also being added to the no-cost plan are ChatGPT's vision capabilities, which let you converse with the bot about uploaded items like images and documents. The browse function allows you to search through previous conversations more easily.
ChatGPT's abilities have improved in quality and speed in 50 languages, supporting OpenAI’s aim to bring its powers to as many people as possible.
3. GPT-4o will be available in API for developers
3. GPT-4o will be available in API for developers (Image credit: OpenAI)
OpenAI's latest model will be available for developers to incorporate into their AI apps as a text and vision model. The support for GPT-4o's video and audio abilities will be launched soon and offered to a small group of trusted partners in the API.
4. The new ChatGPT desktop app
A look at the new ChatGPT desktop app running on a Mac. (Image credit: OpenAI)
OpenAI is releasing a desktop app for macOS to advance its mission to make its products as easy and frictionless as possible, wherever you are and whichever model you're using, including the new GPT-4o. You’ll be able to assign keyboard shortcuts to do processes even more quickly.
According to OpenAI, the desktop app is available to ChatGPT Plus users now and will be available to more users in the coming weeks. It sports a similar design to the updated interface in the mobile app as well.
5. A refreshed ChatGPT user interface
ChatGPT is getting a more natural and intuitive user interface, refreshed to make interaction with the model easier and less jarring. OpenAI wants to get to the point where people barely focus on the AI and for you to feel like ChatGPT is friendlier. This means a new home screen, message layout, and other changes.
6. OpenAI's not done yet
(Image credit: Open AI)
The mission is bold, with OpenAI looking to demystify technology while creating some of the most complex technology that most people can access. Murati wrapped up by stating that we will soon be updated on what OpenAI is preparing to show us next and thanking Nvidia for providing the most advanced GPUs to make the demonstration possible.
OpenAI is determined to shape our interaction with devices, closely studying how humans interact with each other and trying to apply its learnings to its products. The latency of processing all of the different nuances of interaction is part of what dictates how we behave with products like ChatGPT, and OpenAI has been working hard to reduce this. As Murati puts it, its capabilities will continue to evolve, and it’ll get even better at helping you with exactly what you’re doing or asking about at exactly the right moment.