🍌 How the Technology of 3D Scanning Real Objects Works

Gaussian splats are a new technology for creating 3D models, actively implemented by Scaniverse, a platform developed by Niantic, the creators of Pokémon Go.

ℹ️ A typical 3D model is a mesh of polygons. This approach is good for simple objects, but the result of scanning complex shapes (e.g., people) often resembles characters from early Tomb Raider games.

Gaussian splatting technology replaces the polygon grid with point clouds with individual parameters (size, transparency, etc.) for better quality and realism.

To create a 3D model of any object using Scaniverse, you only need a regular smartphone camera (even without LiDAR sensors) and a bit of patience. Machine learning algorithms ensure high levels of detail. You can view the resulting 3D image from any angle and uploaded to popular XR headsets (see video #1 ⤴️).

🌎 Where Can This Be Useful?

Niantic's Vice President of Engineering, Brian McClendon, calls Gaussian splats the most significant breakthrough in 3D graphics over the past 30 years. This technology could revolutionize game development, video content creation, and mapping. For Niantic, it's currently the key to building its global spatial AI model, which we discussed in December.

But Niantic isn't the only player betting on this technology:

➡️ Gracia AI, a startup, creates highly detailed 3D videos without limitations on clothing, patterns, lighting, or hairstyles. The downside: One minute of 3D video takes up 9 GB of storage (see video #2 ⤴️).

➡️ Hyperscape by Meta allows for the creation of photorealistic digital copies of complex environments (see video #3 ⤴️). However, the app is still in the tech demo stage.

More on the topic:

➡️ Top 5 most exciting VR games of 2024

➡️ Will we live in AR glasses?

#news #PokemonGo #VR @hiaimediaen