These new smart glasses can teach people about the world thanks to generative AI

It was only a matter of time before someone added generative AI to an AR headset and taking the plunge is start-up company Brilliant Labs with their recently revealed Frame smart glasses.

Looking like a pair of Where’s Waldo glasses (or Where’s Wally to our UK readers), the Frame houses a multimodal digital assistant called Noa. It consists of multiple AI models from other brands working together in unison to help users learn about the world around them. These lessons can be done just by looking at something and then issuing a command. Let’s say you want to know more about the nutritional value of a raspberry. Thanks to OpenAI tech, you can command Noa to perform a “visual analysis” of the subject. The read-out appears on the outer AR lens. Additionally, it can offer real-time language translation via Whisper AI.

The Frame can also search the internet via its Perplexity AI model. Search results will even provide price tags for potential purchases. In a recent VentureBeat article, Brilliant Labs claims Noa can provide instantaneous price checks for clothes just by scanning the piece, or fish out home listings for new houses on the market. All you have to do is look at the house in question. It can even generate images on the fly through Stable Diffusion, according to ZDNET

Evolving assistant

Going back to VentureBeat, their report offers a deeper insight into how Noa works. 

The digital assistant is always on, constantly taking in information from its environment. And it’ll apparently “adopt a unique personality” over time. The publication explains that upon activating for the first time, Noa appears as an “egg” on the display. Owners will have to answer a series of questions, and upon finishing, the egg hatches into a character avatar whose personality reflects the user. As the Frame is used, Noa analyzes the interactions between it and the user, evolving to become better at tackling tasks.

Brilliant Labs Frame exploded view

(Image credit: Brilliant Labs)

An exploded view of the Frame can be found on Brilliant Labs’ official website providing interesting insight into how the tech works. On-screen content is projected by a micro-OLED onto a “geometric prism” in the lens. 9To5Google points out this is reminiscent of how Google Glass worked. On the nose bridge is the Frame’s camera sitting on a PCBA (printed circuit board assembly). 

At the end of the stems, you have the batteries inside two big hubs. Brilliant Labs states the frames can last a whole day, and to charge them, you’ll have to plug in the Mister Power dongle, inadvertently turning the glasses into a high-tech Groucho Marx impersonation.

Brilliant Labs Frame with Mister Power

(Image credit: Brilliant Labs)

Availability

Currently open for pre-order, the Frame will run you $ 350 a pair. It’ll be available in three colors: Smokey Black, Cool Gray, and the transparent H20. You can opt for prescription lenses. Doing so will bump the price tag to $ 448.There's a chance Brilliant Labs won’t have your exact prescription. They recommend to instead select the option that closely matches your actual prescription. Shipping is free and the first batch rolls out April 15.

It appears all of the AI features are subject to a daily usage cap. Brilliant Labs has plans to launch a subscription service lifting the limit. We reached out to the company for clarification and asked several other questions like exactly how does the Frame receive input? This story will be updated at a later time.

Until then, check out TechRadar's list of the best VR headsets for 2024.

You might also like

TechRadar – All the latest technology news

Read More

ChatGPT could become a smart personal assistant helping with everything from work to vacation planning

Now that ChatGPT has had a go at composing poetry, writing emails, and coding apps, it's turning its attention to more complex tasks and real-world applications, according to a new report – essentially, being able to do a lot of your computing for you.

This comes from The Information (via Android Authority), which says that ChatGPT developer OpenAI is working on “agent software” that will act almost like a personal assistant. It would be able to carry out clicks and key presses as it works inside applications from web browsers to spreadsheets.

We've seen something similar with the Rabbit R1, although that device hasn't yet shipped. You teach an AI how to calculate a figure in a spreadsheet, or format a document, or edit an image, and then it can do the job for you in the future.

Another type of agent in development will take on online tasks, according to the sources speaking to The Information: These agents are going to be able to research topics for you on the web, or take care of hotel and flight bookings, for example. The idea is to create a “supersmart personal assistant” that anyone can use.

Our AI agent future?

The Google Gemini logo on a laptop screen that's on an orange background

Google is continuing work on its own AI (Image credit: Google)

As the report acknowledges, this will certainly raise one or two concerns about letting automated bots loose on people's personal computers: OpenAI is going to have to do a lot of work to reassure users that its AI agents are safe and secure.

While many of us will be used to deploying macros to automate tasks, or asking Google Assistant or Siri to do something for us, this is another level up. Your boss isn't likely to be too impressed if you blame a miscalculation in the next quarter's financial forecast on the AI agent you hired to do the job.

It also remains to be seen just how much automation people want when it comes to these tasks: Booking vacations involves a lot of decisions, from the position of your seats on an airplane to having breakfast included, which AI would have to make on your behalf.

There's no timescale on any of this, but it sounds like OpenAI is working hard to get its agents ready as soon as possible. Google just announced a major upgrade to its own AI tools, while Apple is planning to reveal its own take on generative AI at some point later this year, quite possibly with iOS 18.

You might also like

TechRadar – All the latest technology news

Read More

Ray-Ban Meta smart glasses finally get the AI camera feature we were promised, but there’s a catch

When the Ray-Ban Meta smart glasses launched they did so without many of the impressive AI features we were promised. Now Meta is finally rolling out these capabilities to users, but they’re still in the testing phase and only available in the US.

During their Meta Connect 2023 announcement, we were told the follow-up to the Ray-Ban Stories smart glasses would get some improvements we expected – namely a slightly better camera and speakers – but also some unexpected AI integration.

Unfortunately, when we actually got to test the specs out its AI features boiled down to very basic commands. You can instruct them to take a picture, record a video, or contact someone through Messenger or WhatsApp. In the US you could also chat to a basic conversational AI – like ChatGPT – though this was still nothing to write home about. 

While the glasses’ design is near-perfect, the speakers and camera weren’t impressive enough to make up for the lacking AI. So overall in our Ray-Ban Meta Smart Glasses review we didn’t look too favorably on the specs. 

The Ray-Ban Meta Smart Glasses Collection is stylish looking on this person's face

Press the button or ask the AI to take a picture (Image credit: Meta)

Our perception could soon be about to change drastically, however, as two major promised features are on their way: Look and Ask, and Bing integration.

Look and Ask is essentially a wearable voice-controlled Google Lens with a few AI-powered upgrades. While wearing the smart glasses you can say “Hey Meta, look and…” followed by a question about what you can see. The AI will then use the camera to scan your environment so it can provide a detailed answer to your query. On the official FAQ possible questions you can ask include “What can I make with these ingredients?” or “How much water do these flowers need?” or “Translate this sign into English.” 

To help the Meta glasses provide better information when you’re using its conversational and Look and Ask features the specs can also now access the internet via Bing. This should mean the specs can source more up-to-date data letting it answer questions about sports matches that are currently happening, or provide real-time info on what nearby restaurants are the best rated, among other things.

Still not perfect

Orange RayBan Meta Smart Glasses in front of a wall of colorful lenses including green, blue, yellow and pink

(Image credit: Meta)

It all sounds very science fiction, but unfortunately these almost magical capabilities come with a catch. For now, the new features – just like the existing conversational AI – are in beta testing. 

So the glasses might have trouble with some of your queries and provide inaccurate answers, or not be able to find an answer at all. What’s more, as Meta explains in its FAQ any AI-processed pictures you take while part of the beta will be stored by Meta and used to train its AI. So your Look and Ask snaps aren’t private.

Lastly, the Meta Ray-Ban smart glasses beta is only available in the US. So if you live somewhere else like me you won’t be able to try these features out – and probably won’t until 2024.

If you are in the US and happy with the terms of Meta’s Privacy Policy, you can sign up for the Early Access program and start testing these new tools. For everyone else hopefully these features won’t be in beta for long, or at least won’t be US-exclusive – otherwise we’ll be left continuing to wonder why we spent $ 299 / £299 / AU$ 449 on smart specs that aren’t all that much better than dumb Ray-Ban Wayfarers at half the cost.

You might also like

TechRadar – All the latest technology news

Read More

Samsung Glasses could be the name of a new pair of Samsung smart specs

Rumors of some kind of Samsung smart glasses have been swirling for years at this point, but it looks as though the wait for an actual device might soon be over: Samsung has filed to register “Samsung Glasses” as a trademark in the UK.

This comes from UploadVR (via Android Central), and the filing comes with a description of the categories the product covers: virtual reality headsets, augmented reality headsets, headphones, smartphones, and smart glasses.

That covers a lot of ground. Virtual reality or VR means fully enclosed digital experiences, augmented reality or AR means looking at the real world with digital graphics overlaid on top, mixed reality or MR is enhanced AR where the digital elements and real elements interact, and extended reality or XR is used to mean VR, AR and MR all together.

Exactly which category the Samsung Glasses might fall into remains to be seen, but we know that the company is working on several different products offering these technologies, after previously being responsible for the Samsung Gear VR.

What to expect

Samsung itself has confirmed that it has an XR headset in the pipeline to rival the Apple Vision Pro, but it's not expected to appear until later in 2024, so that Samsung has time to get features such as display sharpness as good as they can be.

The term “glasses” really doesn't sound like a headset, anyway. Could it be that Samsung is also working on a pair of AR specs? We've seen suggestions of this in previous years, though no confirmation from Samsung itself.

Or, we might be talking about more basic smart glasses: able to take photos and videos, an on-board smart assistant, but no fancy augmented reality. See our Ray-Ban Meta Smart Glasses review for Meta's recent entry in this product category.

Right now it's not clear exactly what to expect – but it looks very much like Samsung will soon launch a device that you can wear on your face. Its next big launch event should be for the Samsung Galaxy S24 phone, sometime in January.

Follow TechRadar on TikTok for news, reviews, unboxings, and the best deals!

You might also like

TechRadar – All the latest technology news

Read More

Windows 11 could get a smart feature to help you save money on energy bills

Windows 11 could be getting a new change to give you an idea of how much power your desktop PC chugs through on a daily basis – and per app power usage data, too.

Or at least this is a new feature spotted in the latest preview build of Windows 11 (from the Dev channel), albeit the functionality is hidden away.

The ever-present Windows testing detective on Twitter, PhantomOfEarth, uncovered the feature using ViVeTool. (That’s a Windows configuration utility that can be used to poke around under the hood and enable features lurking in the background, still yet to be enabled by Microsoft).

See more

As you might imagine, these features are hidden for good reason – they are still wonky and incomplete, and that’s very much the case with what we see here.

But the broad gist of it is that in build 23506, Microsoft is turning the Battery Usage panel into Energy (& Battery) Usage, meaning that it’ll be relevant not just for the best laptops out there and battery levels, but to show power usage for desktop PCs.

As PhantomOfEarth explains, the panel will show energy usage data for the Windows 11 PC, and break that down to individual apps, too – so if there’s an energy hog piece of software on your system, it’ll be clearly visible.

People running desktop computers will be able to see energy usage, but those with laptops can choose to switch between energy usage and battery level (so don’t worry, the latter isn’t being ditched).

Microsoft will also provide overall energy use and emissions data, but as the leaker observes, this is not yet finished and appears to display placeholder readings for now.


Analysis: Inbound for the 23H2 update? Perhaps…

It’s no surprise to see the feature isn’t fully working, because as we noted above, this is why the Energy (& Battery) Usage panel hasn’t yet been sent live in Windows 11 – it isn’t ready.

However, it’s something we expect will be added in time, given that it’ll be pretty useful to see a full breakdown of your PC’s power usage and environmental footprint, as it were. (At a time when those concerns are becoming increasingly sensitive, of course).

Being able to view your energy footprint and adjust your PC’s settings to see how you can do better – and save money on energy bills, hopefully, even if only a little – will be a welcome ability. Indeed, we can see this feature being tied into Microsoft’s AI project eventually, so you’ll be able to request: “Copilot, help me save energy on this PC.” Followed by a useful set of changes based on the relevant data collected here (well, hopefully).

At any rate, we wouldn’t be surprised to see this functionality arrive in the Windows 11 23H2 update (when Copilot will theoretically also pitch up, but we remain unconvinced about that rumor).

TechRadar – All the latest technology news

Read More

Google Sheets thinks it might finally be smart enough to topple Microsoft Excel

Google Workspace has announced an upgrade to its spreadsheet software that could make the tool more useful than ever before.

In its battle to take on great rival Microsoft Excel, the company's Google Sheets platform has enjoyed a number of recent updates to help users get more from their data.

This includes so-called “smart chip” technology, which lets users quickly access information or data from other Google Workspace files, bringing the likes of Slides, Docs and Gmail even closer together for the ultimate collaboration tool.

Google Sheets smart chip metadata

Following an initial rollout in February 2023, Google Sheets has already seen an initial smart chips upgrade, taking the form of richer experiences, including extra functionality when posting YouTube clips in a spreadsheet, further expansions have now been announced.

Going forward, the company says users will be able to quickly extract information from smart chips to give your work extra detail or analysis, pulling in information from people, file and event chips. It will also allow users you to pull out metadata associated with specific smart chips into its own cell, all whilst maintaining a connection with the chip it was extracted from. 

Google Sheets smart chips metadata

(Image credit: Google Workspace)

The company gave the example of making it easier to keep track of a set of documents, as well as who owns them and details such as creation time or who last modified the file, which can now be done by extracting those fields from the relevant file chips.

“Smart chip data extraction allows you to track and organize data more easily, and also perform deeper analyses using data that is derived from smart chips,” a Google Workspace update blog post announcing the change read.

“Useful actions include using file chips to understand when a document was last updated or using people chips to sort and filter employees based on job location to best delegate region specific tasks.”

The feature is rolling out now for users on Rapid Release domains, with a wider release scheduled for June 14. 

The ability to extract data already stored in chips will be available to all Google Workspace customers and users with personal Google Accounts, but some limits on extracting all available data will be placed on the latter, along with users with Google Workspace Essentials Starter, Business Starter, Frontline Starter, Frontline Standard, and Nonprofits accounts.

TechRadar – All the latest technology news

Read More

Matter’s first update won’t light up your smart home, but the next one might

The Connectivity Standards Alliance (CSA) is rolling out the first major update to the Matter standard. Well, it's supposed to be a major update, but it's more like a minor patch.

Matter 1.1, as it’s called, won't add any new new device types to the support list, nor will there be any major changes to the individual platforms like Apple HomeKit. The CSA, instead, is making three relatively small changes affecting both companies and users alike, and those changes mostly affect the former. 

Change number one is it is now easier for smart home manufacturers to get started with Matter. The standard’s specifications reportedly have been made clearer allowing for “better guidance” in growing “support for new device types.” The CSA has also made it easier for developers to certify their products so they can get into the hands of customers faster. 

Finally, Matter 1.1 will be fixing a bug affecting Intermittently Connected Devices or ICD, which are “typically battery-powered” gadgets like motion sensors and door locks. Moving forward, it will be less likely an ICD “will be reported as offline” whenever a user or platform interacts with it. But, as far we understand the CSA, the bug isn’t completely gone. The error can still happen.

And that’s pretty much it for Matter 1.1. Two developer-centric changes and one for the users that doesn’t solve the problem at all. It just lowers the chance of the error occurring.

Analysis: the hype is gone

This update is disappointing, to say the least. It’s been seven months since Matter officially launched, and it’s pretty safe to say the hype surrounding the standard has effectively died. Roll out, too, has been slow. Google, for example, has only recently added Matter support to its Google Home app on iOS. And it took Amazon nearly four months to finally roll out Matter to its Echo lineup

Plus, multi-admin control is still a problem, according to The Verge. It isn’t easy to switch your gadget from one platform to another if it’s already connected to one, for instance. And that's something that doesn’t make any sense because the whole point of Matter – its reason for existence – is to have better interoperability between smart home platforms.

It appears the CSA is allowing smart home brands to update their individual platforms at their own discretion. The question is: when are they going to be updating? In all honesty, who knows?

The CSA states it’s going to remain committed to its goal of a “twice-yearly release cycle” for future updates. It’s currently working on “the next version of Matter”, bringing in “new features and device type support.” We contacted the CSA for more information on Matter 1.2, as we’ll call it. This story will be updated at a later time.

If you want to know what works with the standard, check out TechRadar’s list of the smart home devices that play nice with Matter.

TechRadar – All the latest technology news

Read More

Windows 11 gets smart interface changes and new voices

Windows 11 has a new preview out in the Dev Channel which comes with some smart tweaks for the interface, and some better, more natural, voices for Narrator.

Narrator – the built-in tool which reads out the contents of the screen for you, such as a web page, for example – now has two new natural voices in English US (female), which are called ‘Jenny’ and ‘Aria’. Users can select whichever they prefer, and once the voices are downloaded and installed, they work without an internet connection.

Microsoft has also introduced some new keyboard shortcuts for Narrator in order to more easily facilitate switching between different voices (and more besides).

The new preview build 22543 further applies some small, but nifty, tweaks to the desktop interface, including for resizing snapped windows. When you’re doing this, the snapped windows (aside from the main one) are blurred out and overlaid with their relevant app icon. It’s a pretty cool effect that makes it slightly easier to see exactly how much space you’re granting these snapped windows.

Furthermore, the media control fly-out panel on the lock screen has now been changed to match the controls in Quick Settings. This particular tweak is only rolling out to a limited number of testers at the moment, and feedback will be evaluated before a wider rollout commences. In other words, don’t be surprised if you aren’t getting this yet.

As ever, there are a bunch of fixes for Windows 11 delivered in this preview, and that includes the solution to a crashing issue with File Explorer that happens when dragging a file out of a ZIP. All the work done is summed up in Microsoft’s blog post on the new build (along with the inevitable known issues with an early preview – expect some unknown ones, too).


Analysis: Pacey progress with accessibility features

Continued progress on the accessibility front is good to see, in terms of the more natural-sounding voices for Narrator, which have already been welcomed by testers who use the feature. Presumably we will see more options for different voices rolling out before long.

Accessibility is something Microsoft has rightly been prioritizing in Windows, with the most recent major move being the introduction of full voice control capabilities (built using Nuance’s Dragon speech recognition tech), and a virtual keyboard you can type with using your voice. Work on accessibility has been going on for years, of course, and bringing in very useful features like eye tracking which debuted almost five years ago with Windows 10.

TechRadar – All the latest technology news

Read More