After many years of Apple keeping its ecosystem firmly locked down, cracks have started to appear in its famous walled garden, with the newly released iOS 17.4 allowing third-party app stores for the first time. However, access to these is only available to users within the European Union (EU) – and don’t expect to be able to get around the restriction using a VPN.
First, you must have an Apple ID that's set to an EU member state. As well as that, there’s a geolocation check to ensure that you're physically located in one of those countries. Apple says it doesn’t collect your actual location, only an indicator of whether you're eligible to use third-party app stores or not.
Interestingly, the geolocation aspect of Apple’s restrictions implies that even the best VPN services won’t be able to bypass them. That’s because a VPN can change your IP address to fool a server into believing that you're located in a different country, but a geolocation check happens on the device itself (usually using GPS), and therefore can't be spoofed in the same way.
Apple might use other ways to check your location, and it already has a system in place that does just this. Also as found by 9to5Mac, this system looks up things like your rough location (on a nation level, not your exact location), your Apple ID billing address, the region you are using in the Settings app, and the type of device you’re using.
The app stores are coming
(Image credit: Shutterstock / BigTunaOnline)
Apple says that you will be able to access alternative app stores if you leave the EU for a brief “grace period,” but warns that if you’re “gone for too long, you’ll lose access to some features, including installing new alternative app marketplaces.” Apps you’ve installed will still work, but you won’t be able to update them. The company hasn’t said how long the grace period is.
Alternative app stores have only just been permitted, but one is already available to download. Called the Mobivention App Marketplace, this store is aimed at corporate customers who want a outlet for distributing their own business-focused apps. Other providers, like MacPaw, Epic Games and AltStore, have said they’ll be launching their own app stores soon.
Apple didn’t give a reason for why it's going so far to ensure that only EU citizens can access third-party app stores, but one reason could be to clamp down on the idea spreading to users in other nations. For one thing, Apple has repeatedly said that third-party app stores to which access is being enforced by the EU’s Digital Markets Act (DMA) could be unsafe.
As well as that, they also represent a potential threat to Apple’s revenues – just one look at Apple’s onerous fees for developers who use third-party app stores shows you how worried Apple must be. While the company is being forced to open up in the EU, no other jurisdiction has followed suit, so it seems likely that Apple wants to contain the spread of alternative app stores as much as it can.
If you’re located inside the EU, you’ll be able to try out these new app stores pretty much straight away. If you’re not, all you can do is wait to see if Apple is forced to open up elsewhere.
The iTunes for Windows app has just received a sweeping overhaul. The app has now been split into four different entities: an iCloud app, Apple Music, Apple TV and a new Devices app. These new apps offer a refreshed onboarding and set-up experience, aesthetic improvements and a more intuitive syncing process that’ll make downloading your iCloud content to your PC much easier.
Even now, after all these years, iTunes in Windows 11 hasn’t improved in a sufficient way to win me over. For a long time, it’s remained clunky and slow and honestly just not that helpful. Using the app in Windows feels like navigating a twenty-year-old bit of software.
Thankfully, it seems like Apple has finally gotten the hint and has decided to dissect it and offer four separate apps that concentrate on specific features and use cases, rather than being a jack-of-all-trades as iTunes often felt like. This move could hint at the swift death of iTunes altogether, as the app is now even more redundant.
So, what's new?
iCloud Photos gets a big boost that brings the Windows 11 app on par with the preinstalled apps you find on Apple Macs, offering the ability to create Shared Albums on your PC, and access and remove photos and videos from your cloud storage directly from your PC. Perhaps my favourite new feature is that you can now view your photos directly from the default Microsoft Photos app in Windows 11.
Being able to view all your photos, both from your PC and from your phone in one place in the Windows Photos app is an incredibly convenient change. If you need something for work or you just want to send a few photos in an email to someone, you now don’t have to use different apps and trawl folders to find what you need, now you can just open the default photo app on your Windows 11 PC and have all your photos in one place – making the process a lot more seamless – and more like the experience iCloud users on Apple devices are used to.
(Image credit: Apple )
The new iCloud Drive app will now let you share files with friends, family and colleagues straight from File Explorer, which again is such a time-saving integration that makes your Apple device feel more at home with your Windows PC. Not every iPhone user will own a Mac or MacBook, and it’s great to finally see Apple implement changes that mean iPhone users with Windows 11 laptops and PCs don’t feel like second-class citizens.
Password management across your iPhone and your PC will be a lot smoother as well, so if you happen to forget any of your passwords you can just view them in the iCloud Passwords app on your Windows PC without having to pick up your iPhone or iPad. Your passwords will also be saved and synced across not just your Apple devices but to your PC as well via the Chrome and Edge web browsers with an iCloud Passwords extension. Again, this is great news for people who use PCs and need to quickly log into their accounts without having to fumble with their personal devices.
Finally, your Apple Calendars, Bookmarks and contacts will be synced up on your PC as well, so you’ll be able to view your iCloud Calendar in Microsoft Outlook. This applies to both the free version that comes with your PC and the paid version for Microsoft 365 subscribers.
(Image credit: Apple )
The Apple Music app has also received a refresh to its user interface as well as time-synced lyrics and 4K music videos, which is a feature in the iOS and iPad versions of the app. The Apple TV app for Windows is a new addition that aims to bring your viewing library to your desktop, which is great news for those of us who like to have a show or a movie in the background while you work on personal projects. I love binge-watching TV shows while playing games on my PC, and this is great news because it means I won’t have to prop my iPhone up by my display just to watch something at the same time.
The fourth app being introduced to Windows is called 'Devices' and offers a straightforward way for you to keep track of what devices are connected to your iCloud account, as well as allowing you to sync, update and backup your Apple devices right from your desktop. This means the iTunes app will be left with Podcasts and Audiobooks for now, with all the other features split between these four apps. So, you won’t lose any of your favourite bits of audio content.
The implementation of these new apps adds a more contemporary feel to the Apple experience on Windows. All these positives combined will hopefully make it feel less like you’re using an ancient app that’s been ignored for several years.
Overall, this is a positive move from Apple that finally brings some much-needed improvements to PC users who want to sync up their iPhones to their devices. This way you get the best out of the Apple ecosystem file-sharing experience without having to own an actual Mac.
For the past year or two, the world has watched as a string of incredible artificial intelligence (AI) tools have appeared, and everyone has been wondering one thing: when will Apple join the party? Now, we finally have an answer.
On a recent earnings call (via The Verge), Apple CEO Tim Cook revealed that AI tools are coming to the company’s devices as soon as “later this year.” Cook then added that “I think there’s a huge opportunity for Apple with generative AI.” While the Apple chief didn’t reveal any specifics, the small amount he did discuss has already been enough to get tongues wagging and for speculation to run riot.
It’s no surprise that Apple is working on generative AI tools – Cook admitted as much back in August 2023, when he explained that Apple has been developing its own generative AI “for years.” But the latest admission is the first time we’ve seen anyone put a launch date on things, even if it is a very rough date.
Given that this is a software update (and a big one at that), it seems likely that Apple has is its Worldwide Developers Conference (WWDC) in mind. The company will use this June event to unveil its upcoming operating systems and software upgrades (like iOS 18). And with its audience mostly comprised of developers, it makes sense for Apple to tease something like generative AI that could give devs a new tool in their iOS arsenal.
As well as that, industry analyst Jeff Pu has previously claimed that iOS 18 will be one of Apple’s biggest software updates ever precisely because of its inclusion of generative AI, so Cook’s statements seem to confirm Pu’s claim. That means there could be a lot to look forward to at WWDC – and some big new features coming to your iPhone.
What's en route?
The most likely upgrade that Cook is referring to is a rebooted version of Apple's Siri voice assistant. Bloomberg's reliable Apple commentator Mark Gurman recently predicted that iOS 18 will be “one of the biggest iOS updates – if not the biggest – in the company's history” and that this will be largely tied to a “big upgrade to Siri”.
According to another respected leaker Revegnus, Apple is building a proprietary LLM (large language model) to “completely revamp Siri into the ultimate virtual assistant”. It's about time – while Siri was impressive when it landed over a decade ago, it's since plateaued. So we can expect a much more conversational, and powerful, voice assistant by the end of 2024.
(Image credit: Shutterstock / Tada Images)
But what else might benefit from the generative AI that Apple's been working on? Messages, Apple Music and Pages are all expected to receive significant AI-based improvements later this year, with some of Apple's rivals recently giving us hints of what to expect. Google Messages will soon get added Bard powers for texting help, while Spotify has already shown that the future of streaming is AI-powered DJs.
Lastly, there's photography and video, but it seems likely that Apple will tread more carefully than Samsung and Google here. The Galaxy S24 cameras are all about AI skills, which are something of a mixed bag. While Instant Slow-Mo (which generates extra frames of video to turn standard 4K/60p video into slow motion clips) is very clever and useful, Generative Edit opens the floodgates to digital fakery (even with its watermarks).
It'll be fascinating to see how Apple treads this line across all aspects of the iPhone. But one other key iPhone feature, privacy, could also put the brakes on Apple getting too carried away with generative AI…
Why Apple is taking its time
(Image credit: Unsplash [Omid Armin])
Apple has been consistently criticized for not launching its own generative AI, especially as arch-rival Microsoft has been so decisive in spreading its Copilot AI to almost every aspect of Windows and its own apps.
But there’s a likely reason for Apple’s sluggishness, and it comes down to user privacy. Apple takes a strong stance on this, and often touts its devices’ privacy-protecting capabilities as one of their main benefits. AI tools are known to sweep up user data and have been known for their privacy compromises, so it’s no surprise that Apple has taken its time here, presumably to ensure its AI is as pro-privacy as possible.
As well as that, Apple doesn’t usually rush into a new market before it is ready, instead preferring to wait a little longer before blowing its rivals away with something it thinks is far superior. We saw that with the original iPhone, for example, and also with the Apple Vision Pro, and it seems that generative AI is just the latest thing to get this treatment from Apple.
Whether Apple’s own AI actually is better than the likes of ChatGPT and Copilot remains to be seen, but it looks like we’ll find out sooner rather than later.
Sick of struggling to find the answers to your search queries in Safari, Chrome, or any of the other best browsers on iOS? A new alternative has just emerged that uses artificial intelligence (AI) to do the searching for you, potentially helping you find accurate results much more quickly.
Called Arc Search, the app is made by The Browser Company of New York, an outfit that has also made the desktop Arc browser that captured headlines in 2023. With Arc Search, the developer has added a bunch of interesting features that could see it supplant your current favorite browser on your iPhone.
First among them is the app’s 'Browse for Me' feature. When you enter a search query, you can view a standard page of results in your search engine of choice, or you can instead tap the Browse for Me button. This uses AI to gather information from six different sources, then builds a custom web page that displays all the key information you need to answer your search query.
This can include useful photos and videos, bullet-pointed text, and more. It’s a clever way to pull in information from a variety of sources and ensure you stand a good chance of getting what you need at the first attempt, without having to endlessly scroll through useless information and unhelpful websites.
Privacy protections
(Image credit: Future)
Arc Search comes with other handy features besides Browse for Me. For instance, you can tell it to block ads, trackers and GDPR cookie banners on all websites. That’s a great way to protect your privacy by default, although it’s not clear if the app actually opts out of cookies on GDPR banners or simply hides them.
Arc Search will also automatically archive inactive tabs after one day, which might come in handy for people who struggle to control their tab overload (such as yours truly). And there’s a reader mode that strips out unnecessary visual elements to give you a more focused experience.
Some of features aren’t available in Browse for Me, though. For instance, you can’t share your custom pages or copy a link to them, nor can you view them in reader mode. Perhaps these tools will come later.
Regardless, Arc Search is an intriguing alternative to the usual suspects when it comes to iOS browsers, and could make its own claim to the best browser title if it continues to add interesting features. If you want to try it out, it’s free to download on the iOS App Store with no subscriptions or in-app purchases to worry about.
Big changes are coming to the iOS App Store for users in the European Union (EU), as Apple has announced it will soon start allowing third-party app stores to distribute apps to users from a host of European nations. And now, we’ve gained our first look at what these stores could look like.
AltStore, an existing provider of “sideloaded” apps, has announced they’re working on bringing their own alternative app store to iOS. That will move the store out of its current gray area of providing unofficial apps and transform it into what its developer calls a “legitimate app marketplace“.
Right now, AltStore provides a range of apps that fall foul of Apple’s existing App Store rules. For example, it hosts Delta, a Nintendo games console emulator, and UTM, a virtual machine that allows you to run Linux, Windows and more on iOS.
AltStore’s developer did not outline exactly what changes it is planning to make, but one difference is likely to be the installation process. Right now, you have to install a server app onto your Mac or Windows PC, then connect your iOS device and install the app store from your computer.
Once AltStore becomes has been approved by Apple as that “legitimate app marketplace,” you will likely simply be able to download the AltStore app directly to your iPhone, with no lengthy workaround process required. In theory, this will mean being able to download any apps you want, including ones that don't conform to Apple's own App Store guidelines.
(Image credit: AltStore)
You'll also be able to set the likes of AltStore (assuming it gets approval) as your iPhone's default app store, and manage them in Settings. As Apple states in its explainer about the app changes, “users can manage their list of allowed marketplace developers and their marketplace apps in Settings and remove them at any time”.
Your default third-party app store will integrate with some iPhone features like Spotlight, to help you find and use the apps. But if you delete that non-Apple App Store, this will also delete “all related data from the device and stop updates for apps from that marketplace”.
A seismic change coming to your apps
(Image credit: Jaap Arriens/NurPhoto via Getty Images)
The momentous change in Apple’s App Store policy will be implemented in iOS 17.4, which is currently in beta and is due for a full release in March.
Anyone in the E.U. will be able to install apps from third-party stores, and any developer will be able to release their own app store as long as they meet Apple’s requirements for fraud prevention, customer service and experience, and can provide a €1m credit note attesting to its ability to guarantee user support. However, despite the potential for this move to upend the way European users get their apps, there are a few catches attached to it.
For instance, Apple says that restrictions you place on in-app purchases using iOS’s Screen Time feature will not work in third-party app stores. Likewise, Family Purchase Sharing will be limited, as will the Ask to Buy feature, while universal purchases – where apps you buy work across various Apple platforms – won’t be available. That’s because Apple won’t be facilitating payments on third-party stores, so won’t be able to implement these features. The company also says it won’t be able to help users with refunds, purchase history, subscription management, and more.
Apple has fought tooth and nail against this change, but its hand was forced by the E.U.’s Digital Markets Act (DMA), which will start levying hefty fines against companies that don’t open up their platforms from March onwards. Apple says this move is likely to provide “new avenues for malware, fraud and scams, illicit and harmful content, and other privacy and security threats,” and that it won’t be lifting its App Store restrictions anywhere outside the EU. It’s possible the company might even be able to stop you bypassing the geolocation restrictions using a VPN, too.
That said, opening up iOS in this way could lead to some more positive changes. Web browsers on iOS won’t be forced to use Apple’s WebKit engine, for example, and users will be given greater ability to change their default browser. Payment apps will also gain access to Apple’s NFC system, which could mean we start to see contactless alternatives to Apple Pay popping up.
With the EU breathing down its neck, Apple has been forced to begrudgingly make these changes. That could prompt other jurisdictions around the world to consider passing their own app store laws, finally blasting a hole through Apple’s long-standing walled garden. That’s perhaps something for the future – for now, AltStore has shown us what that future could look like.
Google announced around this time last year that it was working on the addition of Live Activities support to the Google Maps app for iPhone and iPads, and slated it for release later in 2023, but so far it still hasn’t been released. However, new assets found in the latest version in the app indicate that Google is still working on this feature, and the wait may soon be over.
The feature will display turn-by-turn directions on the Lock Screen and in the Dynamic Island of iPhone 14 Pro and iPhone 15 series handsets, providing users with real-time ETAs, directions for driving, biking, walking, public transit, and more kinds of navigation. Users can look forward to all of that in easy-to-read live notifications without having to unlock their phones and opening the app.
I wonder if this feature will also be present on iPhone 16 and iPhone 16 Pro models’ Dynamic Islands, and would assume this would become standard for future iPhone models. It would also be nice to see a similar feature for Android devices (Dynamic Islands is a feature that’s exclusive to modern iPhones).
(Image credit: Getty Images)
A sign to keep your hopes up
A contributor at MacRumors, Aaron Perris, looked into the app’s assets after its most recent update, and found signs that users can remain hopeful that Google hasn’t given up adding these features to Google Maps on iPhone, despite the delay.
This is reassuring, as while the new features were still in development as of August of last year, after that there were no strong indications that Google was pushing forward with it until now. MacRumours says that this recent discovery suggests that we might see the new feature soon.
Apple has also opened up the Live Activities API for third-party iPhone app developers in iOS 16.1’s release. Developers have since made some handy apps and added some useful support features to existing apps, like DoorDash and United Airlines, thanks to the Live Activities API.
As an Android device user, I’m pretty jealous – this sounds like an awesome feature that makes it easier to get up and go, and stay on the move. It will make commuting with the help of your iPhone safer and more convenient, as well. I understand why iPhone users might be getting antsy after such a long delay and limited communication from Google, but it’s worth it for the Google Maps team to get it right.
Software designers Oliur and Shane Levine have released a series of wallpapers that convert the lock screen on your iPhone into an iPod Classic.
It’s a real blast from the past. The collection is known as the iPod Wallpaper Pack, consisting of “12 high-definition wallpapers” sporting a multitude of colors. Just to name a few of the shades, you'll get the classic silver look, black, turquoise, hot pink, and lime green. But one of our favorite aspects of these covers is the attention to detail the designers gave each of them.
(Image credit: Oliur)
One wallpaper is completely covered by heart and flower stickers, and it looks exactly like something your little sister would do to your iPod. Another has carefully placed stickers around the click wheel: AC/DC in one corner with Rockstar Games in the other. Plus, we like how a few of the selections have scratches and chipped-off paint because who among us did not drop their iPod multiple times?
(Image credit: Oliur)
Availability
The date and time will hover around the same location – somewhere near the top of the screen with battery life over in the top right corner. There’s even a little bit of room for widgets in the iPod display.
Oliur’s iPod Wallpaper Pack is currently available for $ 14 on its official website. Upon purchase, the images will be placed into a 58 MB ZIP file that needs to be extracted to be used. According to tech news site T3, you can save the wallpapers by uploading them to your iCloud account if you’re buying them on your iPhone.
If you’re curious about what happened to iPods, Apple officially retired the series back in May 2022 with the final model being the 7th generation iPod Touch. The company continued to sell the device for a little while on its online store, however, if you go on there today, it’s completely gone. It’s sold out. Nowadays if you want an iPod, you’ll have to try your luck on a third-party retailer like Amazon or Walmart.
Or better yet: get yourself something more modern. If you want recommendations, check out TechRadar’s roundup of the best MP3 player for 2023.
Google has announced that big changes are coming to Google Drive, its cloud-based file storage platform. This latest series of tweaks to the popular cloud storage service come mainly in the form of a shiny new landing page, but there’s an extra treat in sort for iOS users.
The new homepage (aptly named the ‘Home’ view) will become the default landing page for every Drive user when it rolls out over the next couple of months – though you’ll be able to swap back to the old view if you prefer. In a blog post explaining the changes, Google says that Home will be “streamlined” compared to the standard My Drive landing page, designed to make it “easier and faster for you to find files that matter most”.
To that end, the Home screen will include personalized suggestions that use AI to learn which files and folders you access regularly (or documents that are tied to upcoming events in your Google calendar). It’ll also include new ‘search chips’ that make filtering your files easier, and will employ Google’s Material Design 3 guidelines for a (hopefully) more modern and user-friendly look.
That’s not all, folks
Google isn’t stopping there, either. A long-awaited Drive feature is finally coming to iPhone and iPad: the document scanner, which uses your device camera to take high-quality scans of physical documents which are then converted to PDFs, with the ability to scan multiple pictures in succession for producing multi-page documents.
The feature has been available for Drive users on Android for a while now, so it’s good to see that Google isn’t planning on leaving iPhone owners out in the cold. The document scanner (which was recently upgraded for Android Users) will also use machine learning to suggest names for your scanned documents, such as recognizing a receipt from a store and giving it an appropriate filename.
The scanner feature is rolling out to iOS and iPadOS users now, so if you’ve got an Apple device you can expect to have it soon if you don’t already. The updated Google Drive homepage will be arriving at a slower pace, with early access starting now and a wide release for personal users from January 15 next year.
I’m personally a little dubious about an AI-powered homepage for Drive – ‘suggested content’ in the software I use has rarely been useful in my experience, AI-assisted or not. But thankfully Google has already confirmed that users will get an instant pop-up asking if they’d like to swap their default view back to the old My Drive page, so it’s not like this change is being forced on us.
You can now get Windows on your Apple iPhone, iPad, or Mac – sort of – with Microsoft’s latest innovation for its operating system, although this currently comes with a sizable catch (more on that later).
Of course, we’re not talking about a full-blown installation of the desktop OS, but rather, the new Windows App from Microsoft.
The application allows you to stream a Windows 11 desktop from a remote PC to your Apple device (or indeed another Windows device, or anything with a browser). Or alternatively you can stream a Windows 365 instance, or other options like Azure Virtual Desktop.
The Windows App is essentially a hub to facilitate streaming whichever instances you want to a given device. It packs support for multi-monitor setups, and device redirection to allow for the use of connected hardware like printers, webcams, speakers and so on hooked up to the device that the app is running on.
The Windows App is currently in preview – so expect potential flakiness – and available for iOS, iPadOS, macOS, and Windows itself. Those streaming a Windows desktop instance via a web browser don’t have to install any software at all.
Analysis: A business move, but that could change
(Image credit: Microsoft)
So, that catch we mentioned: as well as it being a beta, the Windows App only works for Microsoft business accounts, not personal accounts – yet.
But as The Verge, which picked up on the app’s release, points out, the login on the Windows version of the Windows app seemingly has an option to use a personal Microsoft account, it just doesn’t work yet.
That’s not exactly surprising as this is a beta, which is the other caveat here – not everything will necessarily work properly yet. This is a more than a hopeful suggestion that consumers will be able to use the app and stream a remote PC to their Apple (or other) device eventually, come release.
Of course, another omission here is the lack of Android support, and presumably that’s something else that will be in the pipeline.
I’ve had exactly two Apple Visio Pro experiences: one six months ago, on the day Apple announced its mixed reality headset, and the other just a few hours ago. And where with the first experience I felt like I was swimming across the surface of the headset’s capabilities, today I feel like I’m qualified as a Vision Pro diver. I mean, how else am I expected to feel after not only experiencing spatial video on the Vision Pro, but also shooting this form of video for the headset with a standard iPhone 15 Pro?
By now, you probably know that iOS 17.2, which Apple released today as a public beta, will be the first time most of us will gain experience with spatial video. Granted, initially it will only be half the experience. Your iPhone 15 Pro and iPhone 15 Pro Max will, with the iOS 17 update, add a new videography option that you can toggle under Camera Formats in Settings. Once the Vision Pro ships, sometime next year, the format will turn on automatically for Vision Pro owners who have connected the mixed reality device to their iCloud accounts.
I got a sneak peek at not only the new iPhone 15 Pro capabilities, but at what the life-like content looks like viewed on a $ 3,499 Apple Vision Pro headset – and I now realize that spatial video could be the Vision Pro’s killer app.
A critical iPhone design tweak
(Image credit: Apple)
To understand how Apple has been playing the long game with its product development, you need only look at your iPhone 15 Pro or iPhone 15 Pro Max, where you’ll find a subtle design and functional change that you likely missed, but which is obviously all about the still unreleased Vision Pro. It turns out Apple designed the iPhone 15 Pro and Pro Max with the Vision Pro's spatial needs in mind, taking the 13mm ultrawide camera and moving it from its position (on the iPhone 14 Pro) diagonally opposite the 48MP main camera to the spot vertically below with the main camera, which on the 14 Pro was occupied by the telephoto camera; the telephoto camera moves to the ultrawide's old slot.
By repositioning these two lenses, Apple makes it possible to shoot stereoscopic or spatial video, but only when you hold the iPhone 15 Pro and iPhone 15 Pro Max in landscape mode.
It is not, I learned, just a matter of recording video through both lenses at once and shooting slightly different angles of the same scene to create the virtual 3D effect. Since the 13mm ultrawide camera shoots a much larger frame, Apple’s computational photography must crop and scale the ultrawide video to match the frames coming from the main camera.
To simplify matters, Apple is only capturing two 1080p/30fps video streams in HEVC (high-efficiency video coding) format. Owing to the dual stream, the file size is a bit larger, creating a 130MB file for about one minute of video.
Even though these spatial files are ostensibly a new media format, they will appear like any other 2D video file on your iPhone or Mac. However, there will be limits. You can trim one of these videos, but you can’t apply any other edits, lest you break the perfect synchronization between the two streams.
The shoot
Spatial video capture arrives on the iPhone 15 Pro and 15 Pro Max with the iOS 17.2 public beta update, which anyone can download today (you have to change your settings to accept beta updates). Note that you’ll only be shooting horizontal spatial video (Image credit: Apple)
For my test, I used a standard iPhone 15 Pro running the iOS 17 developer beta. We had already enabled Spatial Video for Apple Vision Pro under Settings in Camera/Formats. In the camera app's video capture mode, I could select a tiny icon that, naturally, looks just like the Vision Pro to shoot in Spatial Video mode.
When I selected that, the phone guided me to rotate the phone 90 degrees so it was in landscape orientation (the Vision Pro icon rotates as soon as you tap it). I also noticed that the image level tool, which is optional for all formats, is on by default when you use spatial video. This is because spatial videos are best when shot level. In fact, shooting them in situations where you know you might not be able to keep the phone level, like an action shot, could be a bad idea. Mostly this is about what it will feel like to watch the finished product in the Vision Pro headset – lots of movement in a 3D video a few centimeters from your face might induce discomfort.
Similarly, I found that it’s best to keep between three and eight feet from your subject, so they don’t end up appearing like giants in the final spatial video.
I shot a couple of short spatial videos of a woman preparing sushi. I tried to put the sushi in the foreground and her in the background to give the scene some depth. Nothing about shooting the video felt different from any others I’ve shot, though I probably overthought it a bit as I was trying to create a pair of interesting spatial videos.
Even though the iPhone is jumping through a bunch of computational hoops to create Spatial Video out of what you shoot, you should be able to play the video back instantly. We handed over our phones and then, a few minutes later, we were ready to view our videos in the Vision Pro.
Hello, my old friend
(Image credit: Apple)
While I was worried that after all these months, I wouldn’t remember how to use the Vision Pro, it really only took me a moment or two to reorient myself to its collection of gaze, gesture, and Digital Crown-based controls. It remains a stunningly intuitive piece of bleeding-edge tech. I still needed to hand over my glasses for a prescription measurement so we could make sure Apple inserted the right Zeiss lenses (you don’t wear glasses when using the headset). It’s a reminder that, unlike an iPhone, the Vision Pro will be a somewhat bespoke experience.
For this second wear session, I did not have the optional over-the-head strap, which meant that, for the first time, I felt the full weight of the headgear. I did my best to adjust the headband using a control knob near the back of the headset while being careful not to over-tighten it, but I’m not sure I ever found that sweet spot (note to self: get the extra headband when you do finally get to review one of these headsets).
There were some new controls since I last tried the Vision Pro – for example, I could now resize windows by looking over at the edge of a window and then by virtually pinching and pulling the white curve that appears right below it. I got this on the second try, and then it became second nature.
I finally got a good look at the Vision Pro Photos app, which was easy to navigate using my gaze and finger taps – you pinch and pull with either hand to swipe through photos and galleries. I usually kept my hands in or near my lap when performing these gestures. I looked at photos shot with the iPhone 15 Pro at 24MP and 48 MP. It was fun to zoom into those photos, so they filled my field of view, and then pinch and drag to move around the images and see some of the exquisite detail in, for instance, the lace on a red dress.
I got a look at some incredible panorama shots, including one from Monument Valley in Arizona and another from Iceland, which featured a frozen waterfall, and which virtually wrapped all the way around me. As I noted in my original Vision Pro experience, there’s finally a reason to take panoramic photos with your iPhone.
Head spatial
This spatial video scene was one of the most effective. Those bubbles appeared to float right by my face (Image credit: Apple)
Inside the Vision Pro Photos app is a new media category called Spatial. This is where I viewed some canned spatial videos and, finally, the pair of spatial videos I shot on the iPhone 15 Pro. There was the campfire scene I saw during my WWDC 2023 experience, a birthday celebration, an intimate scene of a family camping, another of a family cooking in a kitchen, and, my favorite, a mother and child playing with bubbles.
You can view these spatial videos in a window or full-screen, where the edges blend with either your passthrough view or your immersive environment (a new environment is Joshua Tree) that replaces your real world with a 360-degree wraparound image. In the bubble video, the bubbles appeared to be floating both in the scene and closer to my face; I had the impulse to reach out and touch them.
In the kitchen scene, where the family is sitting around a kitchen island eating and the father is in the background cooking, the 3D effect initially makes the father look like a tiny man. When he turned and moved closer to his family, the odd effect disappeared.
It’s not clear how spatial video shot on iPhone 15 Pro is handling focal points, and if it’s defaulting to a long depth of field or using something different for the 3D effect. You can, by tapping your iPhone's screen during a spatial video shoot, set the focus point but you can't change this in editing.
My two short videos were impressive, if I do say so myself. During the shoot, I did my best to put one piece of sushi the chef held up to me in the foreground, and in the final result, I got exactly the effect I was hoping for. The depth is interesting, and not overbearing or jarring. Instead, the scene looks exactly as I remember it, complete with that lifelike depth. That’s not possible with traditional videography.
What I did not do was stand up and move closer to the spatial videos. Equally, these are not videos you can step into and move around. You're still only grabbing two slightly different videos to create the illusion of depth.
In case you’re wondering, the audio is captured too, and this sounded perfectly normal. I didn't notice any sort of spatial effect, but these videos were not shot with audio sources that spanned the distance of a room.
In this sample provided by Apple, you can see how the candle smoke appears to float toward you – it’s a trippier effect when you’re wearing the Vision Pro headset (Image credit: Apple)
What’s next?
Because you’ll have spatial video shooting capabilities when you install the iOS 17.2 public beta you could be shooting a lot of spatial video between now and when Apple finally starts selling the Vision Pro to consumers. These videos will look perfectly normal – but imagine having a library of spatial video to swipe through when you do finally buy the Vision Pro. That, and the fact that your panoramas will look stunning on the device, may finally be the reason you buy Apple's headset.
Naturally, the big stumbling factor here is price. Apple plans on charging $ 3,499 (around £2,800 / AU$ 5,300) for the Vision Pro, not including the head strap accessory, which as mentioned, you’ll probably need. That means that while millions may own iPhone 15 Pros and be able to shoot spatial video, a precious few will be able to watch them on a Vision Pro.
Perhaps Apple will make the Vision Pro part of one of its financing plans, so that people can pay it off with a monthly fee. There might also be discounts if you buy an iPhone 15 Pro. Maybe not. Whatever Apple does, spatial video may make the most compelling case yet for, if not owning a Vision Pro, then at least wishing you did.
1 844.742.7448 
Email Us
Remote Support 
Contact
