Gemini’s next evolution could let you use the AI while you browse the internet

Gemini may receive a big update on mobile in the near future where it’ll gain several new features including a text box overlay. Details of the upgrade come from industry insider AssembleDebug who shared his findings with a couple of publications.

PiunikaWeb gained insight into the overlay and it’s quite fascinating seeing it in action. It converts the AI’s input box into a small floating window located at the bottom of a smartphone display, staying there even if you close the app. You could, for example, talk to Gemini while browsing the internet or checking your email. 

AssembleDebug was able to activate the window and get it working on his phone while on X (the platform formerly known as Twitter). His demo video shows it behaving exactly like the Gemini app. You ask the AI a question, and after a few seconds, a response comes out complete with source links, images, as well as YouTube videos if the inquiry calls for it. Answers have the potential to obscure the app behind it. 

AssembleDebug’s video reveals the length depends on whether the question requires a long-form answer. We should mention that the overlay is multimodal so you can write out an inquiry, verbally command the AI, or upload an image.

Smarter AI

The other notable changes were shared with Android Authority. First, Gemini on Android will gain the ability to accept different types of files besides photographs. Images show a tester uploading a PDF, and then asking the AI to summarize the text inside it. Apparently, the feature is present in the current version of Gemini however activating it doesn’t do anything. Android Authority speculates the update may be exclusive to either Google Workspace or Gemini Advanced; maybe both. It’s hard to tell at the moment.

Second is a pretty basic tool, but useful nonetheless called Select Text. The way Gemini works right now is you’re forced to copy a whole block of text even if you just want a small portion. Select Text solves this issue by allowing you to grab a specific line or paragraph. 

Yeah, it’s not a flashy upgrade. Almost every app in the world has the same capability. Yet, the tool has “huge implications for Gemini’s usability”. It greatly improves the AI’s ease of use by not being so restrictive.  

See more

A fourth, smaller update was found by AssembleDebug. It’s known as Real-time Responses. The descriptor text found alongside it claims the tool lets you see answers being written out in real-time. However, as PiunikaWeb points out, it’s only an animation change. There aren’t any “practical benefits.” Instead of waiting for Gemini to generate a response as one solid mass, you can choose to see the AI write everything out line by line similar to its desktop counterpart.

Google I/O 2024 kicks off in about three weeks on May 14. No word on when these features will roll out, but we'll learn a lot more during the event.

While you wait, check out TechRadar's roundup of the best Android smartphones for 2024 if you're looking to upgrade.

You might also like

TechRadar – All the latest technology news

Read More

Anyone can now browse through Apple Vision Pro apps on the web

You no longer need an Apple Vision Pro to look at Vision Pro apps, because the visionOS App Store is now available for browsing on the web – just like the equivalent App Stores for iOS, iPadOS, macOS, and tvOS.

Head to the Vision Pro App Store in your browser (as spotted by 9to5Mac), and you're able to browse through categories including business, entertainment, and education. You can also find iPhone and iPad apps and games that'll run on the Vision Pro.

You can read our Apple Vision Pro review to get an idea of how much we love the mixed reality headset – and it's now even more appealing, because you don't have to don the device to check out new apps you might be interested in.

What's more, it gives people who don't own one of the headsets a chance to see the apps that are available for it. When you're spending $ 3,499 (about £2,750 / AU$ 5,330) and up on a piece of hardware, maybe you want to see what you'll be able to do on it before buying.

A wider roll out

Apple Vision Pro App Store

See anything you like? The Apple Vision Pro App Store (Image credit: Future)

The experience of browsing through the visionOS App Store is very similar to what you may already be familiar with when you browse for apps for other devices – and some app listings have simply had an extra Apple Vision tab added to them.

You can check out screenshots, see descriptions of the apps and reviews that have been left by other users, and get information about the data collected by each app. Details of app prices and in-app purchase prices are also shown.

It's possible that the launch of the Vision Pro App Store on the web is something to do with the headset's rumored international launch. At the moment, you can only buy the device in the US, but that could be changing in the near future.

There's also been talk that a cheaper version of the Vision Pro could be in the pipeline – though it might not break cover until 2026. It may not be selling in massive numbers yet, but there's no doubting Apple's commitment to the Vision Pro.

You might also like

TechRadar – All the latest technology news

Read More