Vision Pro spatial Personas are like Apple’s version of the metaverse without the Meta

While the initial hype over Apple Vision Pro may have died down, Apple is still busy developing and rolling out fresh updates, including a new one that lets multiple Personas work and play together.

Apple briefly demonstrated this capability when it introduced the Vision Pro and gave me my first test-drive last year but now spatial Personas is live on Vision Pro mixed-reality headsets.

To understand “spatial Personas” you need to start with the Personas part. You capture these somewhat uncanny valley 3D representations of yourself using Vision Pro's spatial (or 3D) cameras. The headset uses that data to skin a 3D representation of you that can mimic your face, head, upper torso, and hand movements and be used in FaceTime and other video calls (if supported).

Spatial Personas does two key things: it gives you the ability to put two (or more) avatars in one space and lets them interact with either different screens or the same one and does so in a spatially aware space. This is all still happening within the confines of a FaceTime call where Vision Pro users will see a new “spatial Persona” button.

To enable this feature, you'll need the visionOS 1.1 update and may need to reboot the mixed reality headset. After that you can at any time during a FaceTime Persona call tap on the spatial icon to enable the featue.

Almost together

Apple Vision Pro spatial Personas

(Image credit: Apple)

Spatial Personas support collaborative work and communal viewing experiences by combining the feature with Apple's SharePlay. 

This will let you “sit side-by-side” (Personas don't have butts, legs or feet, so “sitting” is an assumed experience) to watch the same movie or TV show. In an Environment (you spin the Vision Pro's digital crown until your real world disappears in favor of a selected environment like Yosemite”) you can also play multi-player games. Most Vision Pro owners might choose “Game Room”, which positions the spatial avatars around a game table. A spatial Persona call can become a real group activity with up with five spatial Personas participating at once.

Vision Pro also supports spatial audio which means the audio for the Persona on the right will sound like it's coming from the right. Working in this fashion could end up feeling like everyone is in the room with you, even though they're obviously not.

Currently, any app that supports SharePlay can work with spatial Personas but not every app will allow for single-screen collaboration. If you use window share or share the app, other personas will be able to see but not interact with your app window.

Being there

Apple Vision Pro spatial Personas

Freeform lets multiple Vision Pro spatial Personas work on the same app. (Image credit: Apple)

While your spatial Personas will appear in other people's spaces during the FaceTime call, you'll remain in control of your viewing experience and can still move your windows and Persona to suit your needs, while not messing up what people see in the shared experience.

In a video Apple shared, it shows two spatial Personas positioned on either side of a Freeform app window, which is, in and of itself somewhat remarkable. But things take a surprising turn when each of them can reach out with their Persona hands to control the app with gestures. That feels like a game-changer to me.

In some ways, this seems like a much more limited form of Meta CEO Mark Zuckerberg's metaverse ideal, where we live work and play together in virtual reality. In this case, we collaborate and play in mixed reality while using still somewhat uncanny valley avatars. To be fair, Apple has already vastly improved the look of these things. They're still a bit jarring but less so than when I first set mine up in February.

I haven't had a chance to try the new feature, but seeing those two floating Personas reaching out and controlling an app floating a single Vision Pro space is impressive. It's also a reminder that it's still early days for Vision Pro and Apple's vision of our spatial computing future. When it comes to utility, the pricey hardware clearly has quite a bit of road ahead of it.

You might also like

TechRadar – All the latest technology news

Read More

Apple Vision Pro update makes Personas less creepy and can take the creation process out of your hands

I finally look slightly less creepy in my Apple Vision Pro mixed reality headset. Oh, no, I don't mean I look less like an oddball when I wear it but if you happen to call me on FaceTime, you'll probably find my custom Persona – digital Lance – a little less weird.

While Apple Vision Pro hasn't been on the market very long and the $ 3,499 headset is not owned in iPhone numbers (think tens of thousands, not millions) this first big visionOS update is important.

I found it under Settings when I donned the headset for the first time in a week (yes, it's true, I don't find myself using the Vision Pro as often as I would my pocketable iPhone) and quickly accepted the update. It took around 15 minutes for the download and installation to complete.

VisionOS 1.1 adds, among other things, enterprise-level Mobile Device Management (MDM) controls, closed captions and virtual keyboard improvements, enhanced Home View control, and the aforementioned Persona improvements.

I didn't test all of these features, but I couldn't wait to try out the updated Personas. Despite the update, Personas remains a “beta” feature. visionOS 1.1 improves the quality of Personas and adds a hands-free creation option.

Before we start, here's a look at my old Vision Pro Persona. Don't look away.

Image 1 of 3

Apple Vision Pro 1-1 update

My original Persona (Image credit: Future)
Image 2 of 3

Apple Vision Pro 1-1 update

My original Persona (Image credit: Future)
Image 3 of 3

Apple Vision Pro 1-1 update

My original Persona (Image credit: Future)

Personas are Vision Pro's digital versions of you that you can use in video conference calls on FaceTime and other supported platforms. The 3D image is not a video feed of your face. Instead, Vision Pro creates this digital simulacrum based on a Spatial Photography capture of your face. Even the glasses I have on my Persona are not real.

During my initial Vision Pro review, I followed Apple's in-headset instructions and held the Vision Pro in front of my face with the shiny glass front facing me. Vision Pro's voice guidance told me to slowly look left, right, up, and down, and to make a few facial expressions. All this lets the stereo cameras capture a 3D image map of my face.

Because there are also cameras inside the headset to track my eyes (and eyebrows) and a pair of cameras on the outside of the headset that points down at my face and hands, the Vision Pro can, based on how I move my face (and hands), manipulate my digital persona like a puppet.

There's some agreement that Apple Vision Pro Personas look a lot like us but also ride the line between reality and the awful, uncanny valley. This update is ostensibly designed to help with that.

Apple Vision Pro 1-1 update

Scanning my face for my new Persona using the hands-free mode. (Image credit: Future)

Apple, though, added a new wrinkle to the process. Now I could capture my Persona “hands-free” which sounds great, but means putting Vision Pro on a table or shelf and then positioning yourself in front of the headset. Good luck finding a platform that's at the exact right height. I used a shelf in our home office but had to crouch down to get my face to where Vision Pro could properly read it. On the other hand, I didn't have to hold the 600g headset up in front of my face. Hand capture still happens while you're wearing the headset.

Image 1 of 3

Apple Vision Pro 1-1 update

My new visionOS 1.1 hands-free Persona (Image credit: Future)
Image 2 of 3

Apple Vision Pro 1-1 update

My new visionOS 1.1 hands-free Persona (Image credit: Future)
Image 3 of 3

Apple Vision Pro 1-1 update

My new visionOS 1.1 hands-free Persona (Image credit: Future)

It took a minute or so for Vision Pro to build my new Persona (see above). The result looks a lot like me and is, in my estimation, less creepy. It still matches my expressions and hand movements almost perfectly. Where my original Persona looked like it lacked a soul, this one has more warmth. I also noticed that the capture appears more expansive. My ears and bald head look a little more complete and I can see more of my clothing. I feel like a full-body scan and total Persona won't be far behind.

This by itself makes the visionOS 1.1 update worthwhile.

Apple Vision Pro vision 1-1

Apple Vision Pro vision 1.1 remove system apps from Home View (Image credit: Future)

Other useful feature updates include the ability to remove system apps from the Home View. To do so, I looked at an app, in this case, Files, and pinched my thumb and forefinger together until the “Remove App” message appeared.

Apple also says it updated the virtual keyboard. In my initial review, I found this keyboard one of the weakest Vision Pro features. It's really hard to type accurately on this floating screen and you can only use two fingers at a time. My accuracy was terrible. In the update, accuracy and the AI that guesses what you intended to type appears somewhat improved.

Overall, it's nice to see Apple moving quickly to roll out features and updates to its powerful spatial computing platform. I'm not sure hands-free spatial scanning is truly useful, but I can report that my digital persona will no longer send you screaming from the room.

You might also like

TechRadar – All the latest technology news

Read More

Meta is planning on introducing dozens of chatbot personas – including a Futurama favourite

Meta is gearing up to announce a generative artificial intelligence chatbot (internally dubbed as ‘Gen AI Personas’) that is aimed at enticing younger users to the world of AI chatbots. The new chatbot is expected to launch during Meta’s Connect event on September 27, and will introduce some familiar but… dated ‘personas’. 

The Verge notes that the chatbots will come with different personas that will promote more humanlike, engaging conversations to appeal to younger users.  One of the ‘sassy’ robot personas is inspired by Bender from Futurama and Alvin the Alien.  

Meta is planning to add “dozens” of familiar faces to its chatbot roster and even plans on creating a tool that will enable celebrities to make their own chatbots for their fans. This is good news, as I could finally talk to Beyonce.

How do you do, fellow kids? 

Meta is clearly putting a lot of time and effort into perfecting its chatbot game in the budding world of AI. We all remember Snapchat AI, which rose to fame for about a week and then quickly fizzled out into obscurity.  

Interestingly, the Wall Street Journal reached out to former Snap and Instagram executive Meghana Dhar, who noted that chatbots don’t “scream Gen Z to me, but definitely, Gen Z is much more comfortable” with new technology. She also adds that Meta’s goal with the chatbots is likely to be to keep them engaged for longer so it has “increased opportunity to serve them ads.”

That would explain the rather random selection of ‘young people’ personas that Meta is going for. While Bender from Futurama is pretty recognizable, he’s not exactly a Gen Z icon. As someone from the demographic Meta seems to be targeting, it’s an extremely odd celebrity to slap onto your product, considering there’s a plethora of other (more relevant) personalities to choose from. 

The advantage Meta has in picking Gen Z as its target demographic is that Gen Z is very public about who they are super into right now. Meta could have picked literally anyone else, so hopefully the other personalities it has up its sleeve are a bit more … contemporary. 

You might also like…

TechRadar – All the latest technology news

Read More