6 things we’ve learned about the Apple Vision Pro from the visionOS beta

Apple has launched its first-ever beta for visionOS – the operating system the upcoming Apple Vision Pro mixed-reality headset will use – giving us a glimpse at what its new gadget should be capable of at launch.

As explained in the Apple Developer blog post making the announcement, the launch of the visionOS SDK will give developers the chance to start working on spatial computing apps for the Vision Pro. It will also help developers understand the Vision Pro's capabilities. Even better, the SDK provides a visionOS simulator so that developers can test out their 3D interface in a number of room layouts with various lighting conditions. And those tests have already revealed a number of details about what the Vision Pro will and won’t be able to do at launch.

This is only the first beta, and users are accessing the simulator via a PC rather than a headset – so expect some changes to be made to visionOS before it officially launches. With that said, here’s what we’ve learned so far about the Apple Vision Pro from the visionOS beta.

1. Visual Search is coming 

Visual Search is basically the Vision Pro’s version of Google Lens or the Visual Lookup feature found on the best iPhones and best iPads (via MacRumors).

A man wearing the Apple Vision Pro headset and pressing its shutter button to take a photo

You can use the Vision Pro to scan real-world objects and text (Image credit: Apple)

According to info found in the visionOS beta, Vision Pro headset wearers will be able to use the headset’s cameras to find information about an item they scan and to interact with real-world text. This includes copying and pasting the text into Vision Pro apps, translating it between 17 supported languages, and converting units (like grams to ounces, or meters to feet). This sounds pretty neat, but unless you’re wearing your Vision Pro headset all the time while traveling abroad or baking with a recipe we aren’t too sure how often you’ll rely on these features.

2. The OS is intuitive 

While not the most flashy feature, intuitive OS design and windows management in 3D space will be crucial for the Vision Pro. The idea of having loads of software windows floating around us seems neat – it'd be like we’re a real-world Tony Stark – but if it's a pain to position them how we want, it’ll be easier to stick with a traditional PC and monitor.

Thankfully, it looks like it’s super easy to move, resize, and hide app windows in Vision Pro, as shown off by @Lascorbe on Twitter.

See more

The video also shows that you aren’t moving the apps on a fixed cylinder around you; you can take full advantage of the 3D space around you by bringing some windows closer while moving others further away – and even stacking them in front of each other if you want. While dragging a window it’ll turn translucent so you can see what’s behind it as you decide where to position it.

3. Porting iOS to visionOS is easy 

According to developers (like @lydakisg on Twitter) that have started working with visionOS, it’s incredibly easy to port iOS apps over to the new system – so many of the best iPhone apps could be available on the Vision Pro at launch. 

See more

This is great news for people that were worried that the Vision Pro might not have an app library comparable to the Quest Store found on Meta’s VR headsets like the Meta Quest Pro.

The only downside is that the ported iOS apps appear in a floating window as they would on a Mac rather than being a fully-fledged immersive experience. So while your favorite appears can easily appear on the Vision Pro, they might not take advantage of its new tech – at least not without the developers spending more time working on a dedicated visionOS version.

4. Battery percentages return 

Battery percentages are a sore spot for many iPhone users. When the iPhone X was released over five years ago it changed the battery status symbol – the percentage disappeared and only a steadily emptying symbol of a battery remained. While this symbol does give a visual indication of how much charge your phone has left, it’s not always as clear as a number; as such, it's been a constant request from iPhone users for Apple to bring back battery charge percentages – which it did with iOS 16 when the iPhone 14 launched.

A woman wears the Vision pro in front of a menu showing a battery icon that has no number inside of it

The Vision Pro trailer shows a battery icon with no percentage (Image credit: Apple)

Unfortunately, a brief section of Apple’s Vision Pro intro video showed us that the Vision Pro might make the iPhone X’s mistake by using a battery status symbol without a number.  

See more

Thankfully for fans of Apple’s more accurate battery symbol, users like @aaronp613 on Twitter have found that battery percentages do show up on Vision Pro. It’s not a massive win, but an important one for a lot of people. 

5. Apps can use unique control schemes 

The visionOS beta not only gives developers tools to create their own Vision Pro apps and to port their existing iOS software to the system; they’re also given details, sample code, and videos showing off the kinds of projects they could create for the upcoming Apple hardware.

One such game is Happy Beam, a video of which has been shared on Twitter by @SwiftlyAlex.

See more

Happy Beam doesn’t look super interesting in and of itself – one Twitter commenter noted it looks like the sort of AR game you could play on the Nintendo 3DS – but it shows that the Vision Pro is able to recognize different hand gestures (like forming a heart) and translate them to different in-game controls. 

We’ll have to wait and see how developers use these capabilities in their creations, but we can already imagine a few possible implementations. For example, rather than using button prompts you could make a scissors gesture with your hand to cut images and text from one document, then clap your hands to paste it in a new spot.

It also appears that Apple is conscious that its headset should remain accessible. As shown in the Happy Beam demo, there are alternative controls that allow Vision Pro users to rely on simpler gestures or controllers to play the game – with it serving as a reminder to other developers to consider similar alternative control schemes in their software.

This gameplay video shared by @wilburwongdev on YouTube shows how the game changes when not using your hands.

6. Fitness apps are discouraged

One last tidbit that has been spotted not in the visionOS beta but in the developer guidelines for the operating system. In its guidelines, Apple says app makers should “avoid encouraging people to move too much” while immersed in the headset. The wording is a little vague, but it seems as if Apple is against the development of fitness apps for Vision Pro at this time.

One notable omission from the Vision Pro reveal trailer was that there were no fitness apps featured. Many people (some of our writers included) use VR headsets for working out, or even just getting a bit active. There’s Beat Saber and Pistol Whip for more gamified workouts, or FitXR and Litesport for more traditional fitness options. These developer notes make the omission seem more intentional, suggesting fitness and activities involving a lot of movement are not in Apple’s current plan for the Vision Pro. We’ll have to wait and see if this changes when the device launches.


Want to learn more about the Vision Pro? Check this round-up of 5 features Apple may have removed from the Vision Pro before it was even out.

TechRadar – All the latest technology news

Read More

5 features Apple may have removed from the Vision Pro before it was even out

Apple’s Vision Pro won’t come out until early 2024; however, some features may already be on the cutting room floor.

A recent report from tech news site The Information reveals what the five missing features are and it even goes into a bit of detail explaining why Apple apparently saw fit to remove them. Below is a list of each of them. Do note that Apple has not publicly commented on any of this and that there’s still a chance any of these could show up in a future update. They're not completely off the table – yet. As The Information states, you can look at the missing tech as a road map where the Vision Pro can go post-launch. 

1. Fitness apps

Apple Vision Pro meditation

(Image credit: Apple)

We know from looking at the official trailer the Vision Pro will come with some sort of meditation app, but nothing else fitness-related. As it turns out, there were plans to introduce a lot more health-centric content. Apple, at one point, was working on a tai chi app complete with an on-device guide to help people with the exercises and yoga software that would’ve utilized the “headset’s downward-facing camera to measure breathing”. 

Additionally, Apple developers sought a way to install “face cushions that were better suited for” intense workouts. Some employees even had talks with brands like Nike for some sort of collaboration. 

The reasons why the fitness plans fell through are, according to the report, 1) the external battery pack got in the way and 2) the glass screen on the front was “too fragile to survive a bump from furniture”.

2. Gaming with precise controls

Gaming on Apple Vision Pro

(Image credit: Apple)

Video games are a major draw for people looking to purchase a VR headset. After all, there are a lot of great virtual reality titles available for other platforms. So, you can imagine the disappointment many had when it was revealed the Vision Pro won’t provide a unique gaming experience. You'll have to use a gamepad when playing.

As to why the company isn't going all in on video games for its headset, an Apple engineer reportedly stated in a Slack channel the device’s hand tracking is “great for performing gestures [and] providing visual feedback”, but not for anything precise. Without those precise controls, gaming on the Vision Pro just isn’t possible.

3. Mac apps

macbook air 15-inch against pink background

(Image credit: Future)

At the presentation, the world saw that the Vision Pro was capable of running its own optimized versions of Mac software. Engineers at the company attempted to see if it was possible to “grab” an app from a desktop Mac or MacBook and seamlessly drag it over to the headset. Unfortunately, they couldn’t do it.

Despite the Vision Pro sporting Apple's M2 chip, which can be found on some high-end MacBooks, the headset’s operating system, visionOS, is based on iOS. This means the headset is unable to directly run Mac apps without limitations.

4. Augmented Apple TV Plus Content

Apple TV Plus home screen

(Image credit: Apple)

A big selling point for the Vision Pro is it allows people to watch movies or play games on a massive, virtual screen. But, would it be possible to offer users a much more immersive experience?

At the launch event, Apple showed various journalists, including US Editor in Chief Lance Ulanoff, a pre-recorded video of “sitting courtside at a professional basketball game in [a full] 180-degree stereoscopic 3D” view. Imagine turning around and seeing the Los Angeles Lakers or Miami Heat right next to you. The company didn’t say why the demo wasn’t shown to the public. However, The Information surmises it could be due to the “current state of internet speeds and the amount of data [needed]… to make the experience feel seamless.” The technology just isn't there yet.

5. Full-body tracking

Woman in a meeting while wearing the Vision Pro

(Image credit: Apple)

It’s unknown if any of the previous four entries will ever be released, but one that is said to still be in the works is full-body tracking. This tech works by scanning a person’s body, face, and hands to track movements before “representing their likeness in 3D space.” The idea is to portray realistic movement when talking with others via headset. It’s meant to make everyone feel like they’re in the same room. Instead of full-body tracking, we got digital personas for FaceTime.

It’s unknown why Apple removed full-body tracking from the reveal, but the report implies the technology will arrive at some point.

Although the Vision Pro is set to release in about six months or so in early 2024, there’s still work to be done. The Information points out that not a single Apple executive or employee has put on the headset “in front of a live audience” outside of a select group. Even then, that group wasn’t allowed to see “Siri or the virtual keyboard” among other things in action. It appears the headset isn't ready for its first public appearance. Hopefully, we'll get our hands on a demo build soon.

TechRadar – All the latest technology news

Read More

Adobe Summit 2023 live: all the news and announcements from Day One

Welcome to our live coverage of Adobe Summit 2023. For the next two days (June 8 – 9), we’re on the floor at ExCel London to see what’s new from Adobe. 

CEO Shantanu Narayen will be kicking things off in the opening keynote, He’ll be joined by other Adobe execs and industry leaders to reveal the latest work from the company, and its impact. Expect plenty of focus on productivity, personalization, creativity, and, of course, AI. 

Day One is about to start – and we'll be here to provide all the updates as they happen.

TechRadar – All the latest technology news

Read More

Our favorite free video editing software gets unexpected performance boost from new macOS Sonoma

One of the big announcements at Apple’s WWDC 2023 was macOS Sonoma (we looked it up; it means “Valley of the Moon”). 

Apple claims the new operating system has a sharp focus on productivity and creativity. It says “the Mac experience is better than ever.” To prove it, the company revealed screensavers, iPhone widgets running on Macs, a gaming mode, and fresh video conferencing features. 

But the new macOS has another surprising feature for users of our pick for best free video editing software.  

The final cut 

Beyond WWDC’s bombshell reveal – yes, Snoopy is an Apple fan now – the event served up more than enough meat to keep users happy. There’s a new Macbook Air 15-inch on the way, said to be the “world’s thinnest.” The watchOS 10 beta countdown has started. And the Vision Pro is dividing opinion. Is the VR headset the future or will it lose you friends?

The reveal of the new Mac operating system, meanwhile, feels quieter somehow. Muted. Perhaps new PDF editor functionalities and a host of “significant” updates to the Safari browser aren’t as eye-catching as a pair of futuristic AR/VR ski goggles.  

However, Craig Federighi, Apple’s senior vice president of Software Engineering, said, “macOS is the heart of the Mac, and with Sonoma, we’re making it even more delightful and productive to use.” 

What he didn’t say, but the company later revealed, is that Sonoma adds an extra bonus for video editors. 

Designed for remote and hybrid in-studio workflows, the operating system brings a high-performance mode to the Screen Sharing app. Taking advantage of the media engine in Apple silicon, users are promised responsive remote access with low-latency audio, high frame rates, and support for up to two virtual displays. 

According to Apple, “This mode empowers pros to securely access their content creation workflows from anywhere – whether editing in Final Cut Pro or DaVinci Resolve, or animating complex 3D assets in Maya.” It also enables remote colour workflows that previously demanded the best video editing Macs and video editing PCs

It seems Final Cut Pro is getting a lot of attention lately. May saw the launch of Final Cut Pro for iPad – how did it take so long? – and now better support in the operating system. What next? Perhaps that open-letter from film & TV professionals pleading for improved support really did focus minds at Apple Park.  

TechRadar – All the latest technology news

Read More

Windows 11 suffers from a weird bug that messes with SATA SSDs and hard drives

Microsoft has confirmed that Windows 11 users are also experiencing an odd bug with SATA hard drives that has already been witnessed plaguing Windows 10 (and indeed Windows 8.1 and 7).

Neowin reports that Microsoft let us know this problem affects Windows 11 via a support document that discusses the glitch, and advises users what can be done about it.

The bug causes an internal SATA drive – this can affect both hard drives and SSDs that are installed inside your PC via a SATA connection – to be detected as removable media in the Windows taskbar, as opposed to a permanently attached drive (which, of course, it very much is).

Microsoft explains: “Whether or not a device is considered removable is determined by your system’s BIOS and how it marks the various SATA ports on the motherboard.

“The inbox driver directly inspects SATA ports and considers devices connected to those ports marked ‘external’ as removable devices. Not all storage drivers do this, which can be a potential cause for corruption or data loss.”


Analysis: A fix is available, fortunately

The good news here is that many modern systems won’t be affected by the bug, as most SSDs these days aren’t SATA – and hard drives are a piece of tech that’s on the way out, and very much doing a vanishing act.

Still, that’s not to say that there aren’t plenty of PCs out there with a SATA drive in them, even if only an old hard drive recruited into the mix for media storage duties, say.

The good news is that Microsoft provides the details of a fix in the support document. As Microsoft advises, the first thing to do is to check for a BIOS update for your motherboard. If you haven’t got the latest version, update it, and keep your fingers crossed that this may solve the issue.

If it doesn’t, or you’re already on the newest BIOS – don’t flirt with installing any beta BIOS, by the way, it’s just not worth the risk – then Microsoft outlines instructions for manually dealing with the problem here.

Note that you will have to enter a lengthy command (which pretty much looks like gobbledegook) so make sure you get this right. It’s a touch fiddly, and involves tinkering with the Registry, so a mistyped mistake could be bad news – just be very careful you type in exactly what Microsoft says in the final step (for Windows 8 or later, which obviously includes Windows 11 users).

TechRadar – All the latest technology news

Read More

Get ready to take your Bing AI chat from the desktop to mobile, without starting over

Microsoft is working on yet another sizable update to Bing AI with this round going to mobile. The latest batch comes just weeks after a previous announcement of various desktop improvements and we have a lot to cover.

Starting off with the Bing app itself, users will be able to add a Bing Chat widget to their “iOS or Android home screen”. This gives you direct access to the AI with the option to either type in your query into the text window or select the microphone icon to ask the question verbally. You can start fresh with a new chat or continue with an old one as Microsoft is enabling the frequently requested “continuous conversations across platforms”. So now a conversation held with Bing on the desktop can continue on mobile devices and vice versa.

The last Bing app update sees the AI gaining new support for multiple countries and languages, which opens it up to more people around the world. Unfortunately, a list of all the newfound support was not included in the post (although we did ask). Microsoft also claims it “improved the quality for non-English chats.” However, the company didn’t provide any details on the level of improvement. 

Expanding support

Moving on to the second app, SwiftKey will have a Compose feature to help you write texts “according to the parameters you suggest”. These parameters include the subject matter, tone, length, and format with the final one being useful for drafting emails. Of course, you can edit those drafts. Two new tones are being added to SwiftKey as well – Witty and Funny – bringing the total to six. So, if you want to have Bing create some eye-rolling dad jokes, you can (just be sure you use this power wisely). To top it all off, the AI-powered Translator on Android will be migrating over to iOS “within the next week” or so.

The Edge browser app is getting Contextual Chat allowing users to ask Bing a question based on the content they’re viewing. The example given is you can ask the AI what the best wine would be to pair with a recipe you're looking at or have it write up a summary of an article you're looking at. Learning will also be made a bit easier thanks to Selected Text Actions. Highlighting a piece of text will open a conversation with Bing where it will then explain that topic in detail complete with “cited sources”.

And last but not least, every single group chat in Skype will have access to the generative AI. All you have to do is tag it by entering “@Bing” into a discussion. 

Bing AI update on mobile apps

(Image credit: Windows)

Availability

The release dates of all these features are all over the place which is why it wasn’t mentioned earlier. The Skype update, SwiftKey Compose tool, and the Bing widget are releasing this week (week of May 14, 2023). Next week, we’ll see continuous conversations alongside the Translator tool. Everything else is unknown other than a vague “soon”. 

We asked Microsoft if it could provide us with dates for the unmentioned features plus a list of the newly supported countries and languages. This story will be updated at a later time.

While we have you check out TechRadar’s list of the best AI tools for 2023 to see what the technology is capable of. It’s not just assistants or content generators.

TechRadar – All the latest technology news

Read More

Google Meet calls will now remove background noise, even if you dial in from your phone

Google Meet calls are about to get more serene for phone users, thanks to the expansion of the video conferencing software's noise cancellation feature.

As part of a sweep of updates to Google Workspace, the company's suite of productivity tools, those who dial into a meeting from their phone can now enjoy the same elimination of background noise as desktop users. 

Google says the technology “can remove background noises such as typing, closing a door, room echo, or the sounds of a nearby construction site” to enable the complete focus of participants without distraction. It will also make them easier to hear too.

Select customers

The tech giant says that it only filters out noises that are not clearly those of a human voice. So voices coming from other sources, such as a nearby TV or radio, or other people talking in the room, will not be filtered out.

It therefore advises that if other sounds are needed in your call, such as the playing of musical instruments, for example, then noise cancellation should be turned off in order for them to be picked up. This is perhaps why for those subscribed to one of the educational tiers of Google Workspace, the feature is off by default.

To toggle noise cancellation on or off on, you need to tap or click the cog icon that open up the settings when on Google Meet. For iPhone and Android device users, they should see a noise cancellation option that they can tap to activate or deactivate. Desktop/ laptop users will find this option under the audio section of the settings. 

However, it appears that for those calling into a meeting with their phone, noise cancellation is activated depending on whether your organization has it turned on or off beforehand. 

Noise cancellation for phone users is now available for the following Workspace customers only: Business Standard, Business Plus, Enterprise Essentials, Enterprise Standard, Enterprise Plus, Education Plus, the Teaching and Learning Upgrade, and Frontline”.

Noise cancellation in general is currently unavailable to those in “South Africa, UAE, and the immediately surrounding areas”. Google also mentions that those using an electrolarynx should have the feature turned off, and that Pexip device users have it on by default, and should refer to the device documentation to turn it off. 

TechRadar – All the latest technology news

Read More

You can now join a video call straight from Google Docs

Joining a Meet video call is now easier than ever thanks to a new feature that will allow users to join directly from Google Docs, Sheets or Slides.

The Google Workspace update allows users to join a video conferencing call with just a click, meaning there's no need to scrabble around for a calendar invite or email.

Going forward, Google Docs users will see a new icon next to the “Share” button, allowing them to join a Meet video call directly from their document.

Google Docs video calls

The new taskbar will house a full list of all the video calls and meetings a users has scheduled, including dates and times, with the join button showing once a meeting is live.

As mentioned, it will be present not just in Google Docs, but also Sheets and Slides, giving users multiple ways to join.

Google Docs join a Meet call

(Image credit: Google Workspace)

Google says this new approach will also allow users to have the content they are working on open and within sight whilst on a call, rather than needing to juggle multiple apps or browser windows.

The tool was first announced last month, but is now rolling out to all Google Workspace customers, as well as legacy G Suite Basic and Business users now. It will be on by default, with users starting to see the changes immediately.

“To help teams do their best work in the hybrid work world, as many of us begin a return to office, we continue to make enhancements to Google Meet to help ensure that video meetings are inclusive and collaborative no matter the location or device preference,” the entry in the Google Workspace update blog states.

 “We hope this feature makes it easier for everyone in the meeting to collaborate in real-time while having a conversation—all from the same tab.”

Google Meet is also set to soon receive a new picture-in-picture mode, which will allow Chrome users to bring up a floating meeting window that sits on top of other browser tabs.

TechRadar – All the latest technology news

Read More