The iPhone 12 Pro’s lidar sensor — the black circle at the bottom right of the camera unit — opens up AR possibilities and much more.
Patrick Holland/CNET
Apple is going bullish on lidar, a technology that’s brand-new to the iPhone 12 family, specifically to the iPhone 12 Pro and iPhone 12 Pro Max. (All four iPhone 12 variants, including the iPhone 12 Mini, are on sale now.) Peer closely at one of the new iPhone 12 Pro models, or the most recent iPad Pro, and you’ll see a little black dot near the camera lenses, about the same size as the flash. That’s the lidar sensor, and it’s a new type of depth-sensing that could make a difference in a number of interesting ways.
If Apple has its way, lidar is a term you’ll start hearing a lot now, so let’s break down what we know, what Apple is going to use it for and where the technology could go next. And if you’re curious what it does right now, I spent some hands-on time with the tech, too.
What does lidar mean?
Lidar stands for light detection and ranging, and has been around for a while. It uses lasers to ping off objects and return to the source of the laser, measuring distance by timing the travel, or flight, of the light pulse.
Trying some of the LiDAR-enabled AR apps I can find for the 2020 iPad Pro, to show meshing. Here’s one called Primer, an early build to test wallpaper on walls pic.twitter.com/SatibguyTm
Lidar is a type of time-of-flight camera. Some other smartphones measure depth with a single light pulse, whereas a smartphone with this type of lidar tech sends waves of light pulses out in a spray of infrared dots and can measure each one with its sensor, creating a field of points that map out distances and can “mesh” the dimensions of a space and the objects in it. The light pulses are invisible to the human eye, but you could see them with a night vision camera.
Isn’t this like Face ID on the iPhone?
It is, but with longer range. The idea’s the same: Apple’s Face ID-enabling TrueDepth camera also shoots out an array of infrared lasers, but can only work up to a few feet away. The rear lidar sensors on the iPad Pro and iPhone 12 Pro work at a range of up to 5 meters.
Lidar’s already in a lot of other tech
Lidar is a tech that’s sprouting up everywhere. It’s used for self-driving cars, or assisted driving. It’s used for robotics and drones. Augmented reality headsets like the HoloLens 2 have similar tech, mapping out room spaces before layering 3D virtual objects into them. But it also has a pretty long history.
Microsoft’s old depth-sensing Xbox accessory, the Kinect, was a camera that had infrared depth-scanning, too. In fact, PrimeSense, the company that helped make the Kinect tech, was acquired by Apple in 2013. Now, we have Apple’s face-scanning TrueDepth and rear lidar camera sensors.
CNET Apple Report
Stay up-to-date on the latest news, reviews and advice on iPhones, iPads, Macs, services and software.
The iPhone 12 Pro camera works better with lidar
Time-of-flight cameras on smartphones tend to be used to improve focus accuracy and speed, and the iPhone 12 Pro does the same. Apple promises better low-light focus, up to six times faster in low-light conditions. The lidar depth-sensing is also used to improve night portrait mode effects. So far, it makes an impact: read our review of the iPhone 12 Pro for more.
Better focus is a plus, and there’s also a chance the iPhone 12 Pro could add more 3D photo data to images, too. Although that element hasn’t been laid out yet, Apple’s front-facing, depth-sensing TrueDepth camera has been used in a similar way with apps, and third-party developers could dive in and develop some wild ideas. It’s already happening.
It also greatly enhances augmented reality
Lidar allows the iPhone 12 Pro to start AR apps a lot more quickly, and build a fast map of a room to add more detail. A lot of Apple’s AR updates in iOS 14 are taking advantage of lidar to hide virtual objects behind real ones (called occlusion), and place virtual objects within more complicated room mappings, like on a table or chair.
I’ve been testing it out on an Apple Arcade game, Hot Lava, which already uses lidar to scan a room and all its obstacles. I was able to place virtual objects on stairs, and have things hide behind real-life objects in the room. Expect a lot more AR apps that will start adding lidar support like this for richer experiences.
Snapchat’s next wave of lenses will start adopting depth-sensing using the iPhone 12 Pro’s lidar.
Snapchat
But there’s extra potential beyond that, with a longer tail. Many companies are dreaming of headsets that will blend virtual objects and real ones: AR glasses, being worked on by Facebook, Qualcomm, Snapchat, Microsoft, Magic Leap and most likely Apple and others, will rely on having advanced 3D maps of the world to layer virtual objects onto.
Those 3D maps are being built now with special scanners and equipment, almost like the world-scanning version of those Google Maps cars. But there’s a possibility that people’s own devices could eventually help crowdsource that info, or add extra on-the-fly data. Again, AR headsets like Magic Leap and HoloLens already prescan your environment before layering things into it, and Apple’s lidar-equipped AR tech works the same way. In that sense, the iPhone 12 Pro and iPad Pro are like AR headsets without the headset part… and could pave the way for Apple to make its own glasses eventually.
A 3D room scan from Occipital’s Canvas app, enabled by depth-sensing lidar on the iPad Pro. Expect the same for the iPhone 12 Pro, and maybe more.
Occipital
3D scanning could be the killer app
Lidar can be used to mesh out 3D objects and rooms and layer photo imagery on top, a technique called photogrammetry. That could be the next wave of capture tech for practical uses like home improvement, or even social media and journalism. The ability to capture 3D data and share that info with others could open up these lidar-equipped phones and tablets to be 3D-content capture tools. Lidar could also be used without the camera element to acquire measurements for objects and spaces.
I’ve already tried a few early lidar-enabled 3D scanning apps on the iPhone 12 Pro with mixed success (3D Scanner App, Lidar Scanner and Record3D), but they can be used to scan objects or map out rooms with surprising speed. The 16-foot effective range of lidar’s scanning is enough to reach across most rooms in my house, but in bigger outdoor spaces it takes more moving around. Again, Apple’s front-facing TrueDepth camera already does similar things at closer range.
Now playing: Watch this:
Our in-depth review of the iPhone 12 and 12 Pro
13:48
Apple isn’t the first to explore tech like this on a phone
Google had this same idea in mind when Project Tango — an early AR platform that was only on two phones — was created. The advanced camera array also had infrared sensors and could map out rooms, creating 3D scans and depth maps for AR and for measuring indoor spaces. Google’s Tango-equipped phones were short-lived, replaced by computer vision algorithms that have done estimated depth sensing on cameras without needing the same hardware. But Apple’s iPhone 12 Pro looks like a significantly more advanced successor, with possibilities for that lidar that extend into cars, AR headsets, and much more.
CHICAGO (AP) — United Airlines has struck a deal with Elon Musk’s SpaceX to offer satellite-based Starlink WiFi service on flights within the next several years.
The airline said Friday the service will be free to passengers.
United said it will begin testing the service early next year and begin offering it on some flights by later in 2025.
Financial details of the deal were not disclosed.
The announcement comes as airlines rush to offer more amenities as a way to stand out when passengers pick a carrier for a trip. United’s goal is to make sitting on a plane pretty much like being on the ground when it comes to browsing the internet, streaming entertainment and playing games.
“Everything you can do on the ground, you’ll soon be able to do on board a United plane at 35,000 feet, just about anywhere in the world,” CEO Scott Kirby said in announcing the deal.
The airline says Starlink will allow passengers to get internet access even over oceans and polar regions where traditional cell or Wi-Fi signals may be weak or missing.
Sony has made it easy for Canadian consumers to preorder the PlayStation 5 Pro in Canada directly from PlayStation’s official website. Here’s how:
Visit the Official Website: Go to direct.playstation.com and navigate to the PS5 Pro section once preorders go live on September 26, 2024.
Create or Log in to Your PlayStation Account: If you don’t have a PlayStation account, you will need to create one. Existing users can simply log in to proceed.
Place Your Preorder: Once logged in, follow the instructions to preorder your PS5 Pro. Ensure you have a valid payment method ready and double-check your shipping information for accuracy.
Preorder Through Major Canadian Retailers
While preordering directly from PlayStation is a popular option, you can also secure your PS5 Pro through trusted Canadian retailers. These retailers are expected to offer preorders on or after September 26:
Best Buy Canada
Walmart Canada
EB Games (GameStop)
Amazon Canada
The Source
Steps to Preorder via Canadian Retailers:
Visit Retailer Websites: Search for “PlayStation 5 Pro” on the website of your preferred retailer starting on September 26.
Create or Log in to Your Account: If you’re shopping online, having an account with the retailer can speed up the preorder process.
Preorder in Store: For those who prefer in-person shopping, check with local stores regarding availability and preorder policies.
3. Sign Up for Notifications
Many retailers and websites offer the option to sign up for notifications when the preorder goes live. If you’re worried about missing out due to high demand, this can be a useful option.
Visit Retailer Sites: Look for a “Notify Me” or “Email Alerts” option and enter your email to stay informed.
Use PlayStation Alerts: Sign up for notifications directly through Sony to be one of the first to know when preorders are available.
4. Prepare for High Demand
Preordering the PS5 Pro is expected to be competitive, with high demand likely to result in quick sellouts, just as with the initial release of the original PS5. To maximize your chances of securing a preorder:
Act Quickly: Be prepared to place your order as soon as preorders open. Timing is key, as stock can run out within minutes.
Double-Check Payment Information: Ensure your credit card or payment method is ready to go. Any delays during the checkout process could result in losing your spot.
Stay Informed: Monitor PlayStation and retailer websites for updates on restocks or additional preorder windows.
Final Thoughts
The PlayStation 5 Pro is set to take gaming to the next level with its enhanced performance, graphics, and new features. Canadian gamers should be ready to act fast when preorders open on September 26, 2024, to secure their console ahead of the holiday season. Whether you choose to preorder through PlayStation’s official website or your preferred retailer, following the steps outlined above will help ensure a smooth and successful preorder experience.
For more details on the PS5 Pro and to preorder, visit direct.playstation.com or stay tuned to updates from major Canadian retailers.
Since the PlayStation 5 (PS5) launched four years ago, PlayStation has continuously evolved to meet the demands of its players. Today, we are excited to announce the next step in this journey: the PlayStation 5 Pro. Designed for the most dedicated players and game creators, the PS5 Pro brings groundbreaking advancements in gaming hardware, raising the bar for what’s possible.
Key Features of the PS5 Pro
The PS5 Pro comes equipped with several key performance enhancements, addressing the requests of gamers for smoother, higher-quality graphics at a consistent 60 frames per second (FPS). The console’s standout features include:
Upgraded GPU: The PS5 Pro’s GPU boasts 67% more Compute Units than the current PS5, combined with 28% faster memory. This allows for up to 45% faster rendering speeds, ensuring a smoother gaming experience.
Advanced Ray Tracing: Ray tracing capabilities have been significantly enhanced, with reflections and refractions of light being processed at double or triple the speed of the current PS5, creating more dynamic visuals.
AI-Driven Upscaling: Introducing PlayStation Spectral Super Resolution, an AI-based upscaling technology that adds extraordinary detail to images, resulting in sharper image clarity.
Backward Compatibility & Game Boost: More than 8,500 PS4 games playable on PS5 Pro will benefit from PS5 Pro Game Boost, stabilizing or enhancing performance. PS4 games will also see improved resolution on select titles.
VRR & 8K Support: The PS5 Pro supports Variable Refresh Rate (VRR) and 8K gaming for the ultimate visual experience, while also launching with the latest wireless technology, Wi-Fi 7, in supported regions.
Optimized Games & Patches
Game creators have quickly embraced the new technology that comes with the PS5 Pro. Many games will receive free updates to take full advantage of the console’s new features, labeled as PS5 Pro Enhanced. Some of the highly anticipated titles include:
Alan Wake 2
Assassin’s Creed: Shadows
Demon’s Souls
Dragon’s Dogma 2
Final Fantasy 7 Rebirth
Gran Turismo 7
Marvel’s Spider-Man 2
Ratchet & Clank: Rift Apart
Horizon Forbidden West
These updates will allow players to experience their favorite games at a higher fidelity, taking full advantage of the console’s improved graphics and performance.
Design & Compatibility
Maintaining consistency within the PS5 family, the PS5 Pro retains the same height and width as the original PS5 model. Players will also have the option to add an Ultra HD Blu-ray Disc Drive or swap console covers when available.
Additionally, the PS5 Pro is fully compatible with all existing PS5 accessories, including the PlayStation VR2, DualSense Edge, Pulse Elite, and Access controller. This ensures seamless integration into your current gaming setup.
Pricing & Availability
The PS5 Pro will be available starting November 7, 2024, at a manufacturer’s suggested retail price (MSRP) of:
$699.99 USD
$949.99 CAD
£699.99 GBP
€799.99 EUR
¥119,980 JPY
Each PS5 Pro comes with a 2TB SSD, a DualSense wireless controller, and a copy of Astro’s Playroom pre-installed. Pre-orders begin on September 26, 2024, and the console will be available at participating retailers and directly from PlayStation via direct.playstation.com.
The launch of the PS5 Pro marks a new chapter in PlayStation’s commitment to delivering cutting-edge gaming experiences. Whether players choose the standard PS5 or the PS5 Pro, PlayStation aims to provide the best possible gaming experience for everyone.
Preorder your PS5 Pro and step into the next generation of gaming this holiday season.
