This is Changing 3D Scanning!!

InspirationTuts
25 Aug 202309:40

TLDRThe script discusses the advancements in 3D scanning and augmented reality, highlighting Kiri Engine as a versatile tool for both iPhone and Android. It introduces a new feature, virtual scanning using Neurogeometry, which overcomes photogrammetry's limitations with AI. Kiri Engine's implementation of Neurogeometry, particularly the norlandulo technique, offers a promising alternative for creating high-quality 3D models from videos, even of objects with few feature points. The script also touches on the potential of this technology in various fields and invites viewers to explore Kiri Engine's capabilities.

Takeaways

  • 🌐 3D scanning and photogrammetry are gaining more attention with the rise of AI and AR technologies.
  • 📈 The market for 3D scanning technologies is expanding, with more tools, hardware, and apps becoming accessible.
  • 📱 Kiri Engine is a notable tool for 3D scanning and AR technology, available for both iPhone and Android devices.
  • 🔍 Kiri Engine offers an alternative to traditional 3D scanning apps like Polycam and supports grammar as well.
  • 💡 A new feature in Kiri Engine is virtual scanning using NeRF technology, specifically the norlandulo technique.
  • 🎥 NeRF (Neural Radiance Field) is a machine learning technology that reconstructs 3D scenes from images or videos.
  • 🔄 NeRF can create 3D models from scenes and objects that lack distinct features, which is a limitation for photogrammetry.
  • 🤖 Kiri Engine's norlandulo improves upon NeRF by not only generating rendered scenes but also producing usable 3D models in software like Blender.
  • 🎥 Using Kiri Engine's featureless scan involves recording a video of the object from multiple angles and submitting it to the cloud for processing.
  • ⏳ The processing time for the featureless scan may be longer than traditional photogrammetry, and video length is limited to 2 minutes.
  • 🔄 NeRF and norlandulo are not expected to replace photogrammetry entirely, but they address some of its shortcomings and are powerful additions to the 3D scanning toolkit.

Q & A

  • What is 3D scanning and how is it being impacted by artificial intelligence and augmented reality?

    -3D scanning is the process of converting 2D images into a three-dimensional model, and it's gaining more attention with the rise of artificial intelligence and augmented reality. Technologies like Kiri Engine are making 3D scanning more accessible by incorporating AI and AR, allowing for the creation of detailed 3D models for various applications.

  • What are the limitations of photogrammetry in 3D scanning?

    -Photogrammetry requires distinct features in the image of an object, such as changes in color or shape, to create a complete 3D model. It struggles with objects that have little detail, such as those with a single color, or are transparent, translucent, or extremely reflective.

  • How does Kiri Engine differ from other 3D scanning tools?

    -Kiri Engine offers multiple ways of 3D scanning, including traditional photogrammetry and a new feature called 'featureless' scanning using Neural Radiance Fields (NeRF) technology. It's available for both Android and iPhone, and it's one of the few tools that currently support NeRF technology.

  • What is NeRF technology and how does it work?

    -NeRF stands for Neural Radiance Fields, which is a machine learning technology that reconstructs an entire 3D scene from a set of images or a video. It uses AI to learn and generate 3D models of scenes and objects that lack enough feature points for traditional photogrammetry.

  • What is the significance of the Norlandulo technique mentioned in the script?

    -Norlandulo is an emerging technique that builds upon NeRF. It not only generates neural rendered scenes like NeRF but also produces a high-quality match of the object that is usable in 3D software like Blender. It addresses some of the shortcomings of NeRF and photogrammetry by improving mesh quality and texture generation.

  • How does the featureless scanning work in Kiri Engine?

    -To use the featureless scanning in Kiri Engine, users record a video of the object they want to scan, circling around it to capture it from different angles. The video is then submitted to the cloud for processing, which may take longer than traditional photogrammetry due to the computationally intensive nature of the NeRF and Norlandulo technologies.

  • What are some applications of 3D scanning in the entertainment industry?

    -3D scanning is widely used in the entertainment industry for game development and VFX in movies. It helps create realistic characters and environments, as seen in games like The Matrix and Call of Duty, and movies like the Fast and Furious series, where it was used to recreate the likeness of Paul Walker.

  • How does Kiri Engine address the limitations of photogrammetry?

    -Kiri Engine addresses the limitations of photogrammetry by incorporating NeRF and Norlandulo technologies, which can generate 3D models from objects that lack distinct features and improve mesh quality, making them suitable for use in 3D software.

  • What is the difference between NeRF and Norlandulo in terms of 3D model quality?

    -While NeRF can generate 3D models from images with insufficient feature points, it may not produce high-quality meshes. Norlandulo, on the other hand, enhances upon NeRF by not only generating neural rendered scenes but also improving the quality of the 3D models to be usable in typical 3D pipelines.

  • What other features does Kiri Engine offer besides the featureless mode?

    -Besides the featureless mode, Kiri Engine offers a web app, an access library, the ability to create a floor plane, in-app editing, texturing, and more, providing users with a comprehensive set of tools for 3D scanning and modeling.

  • How can users access Kiri Engine for free?

    -Users can access Kiri Engine for free by following the link provided in the video description, which is compatible with both Android and iPhone devices.

Outlines

00:00

📐 The Evolution of 3D Scanning and Kiri Engine's Role

This paragraph discusses the growing importance of 3D scanning and photogrammetry in the industry, particularly with the rise of artificial intelligence and augmented reality. It highlights Kiri Engine as a notable tool for 3D scanning and AR technology, available on both Android and iPhone. The introduction of a new feature, virtual scanning using Nerf technology (specifically the norlandulo technique), is emphasized. This technology aims to address some of the limitations of photogrammetry, such as difficulties scanning reflective surfaces or objects with few distinctive features. The video script also mentions a previous video explaining Nerf technology and sets the stage for discussing the advancements and features of Kiri Engine in more detail.

05:01

🧠 Understanding Nerf and Orlando: The Future of 3D Scanning

The second paragraph delves into the concepts of Nerf (Neural Radiance Field) and Orlando, which are machine learning technologies used for 3D scene reconstruction. Nerf is capable of reconstructing scenes from images or videos, even when there are insufficient feature points for traditional photogrammetry. Orlando takes this a step further by not only generating neural rendered scenes but also creating 3D models that are compatible with software like Blender. The paragraph explains how Kiri Engine has implemented Orlando technology, making it accessible on both iPhone and Android devices. It also addresses the limitations of photogrammetry and how Orlando 2.0 could potentially overcome these to become a more viable alternative for 3D scanning. The video script ends with a call to action for viewers to try Kiri Engine and engage with the content by commenting and subscribing.

Mindmap

Keywords

💡3D scanning

3D scanning is the process of capturing the shape and appearance of real-world objects or environments and converting them into three-dimensional digital models. In the video, it is highlighted as a growing field within 3D technology, with increasing relevance in artificial intelligence and augmented reality applications.

💡Photogrammetry

Photogrammetry is a technique used in 3D scanning that involves taking multiple photographs of an object or scene and using software to stitch these images together into a detailed 3D model. It relies on distinct features in the images, such as color changes or textures, to create a complete shape.

💡Kiri Engine

Kiri Engine is a 3D scanning and augmented reality tool that allows users to create 3D models using their smartphones. It offers multiple ways to capture environments, including traditional photogrammetry and the newly introduced featureless scanning using Nerf technology.

💡Nerf technology

Nerf, short for Neural Radiance Fields, is a machine learning technique that uses artificial intelligence to reconstruct 3D scenes from a collection of images or video. It is capable of creating 3D models of scenes and objects that traditional photogrammetry might struggle with, due to a lack of distinct features.

💡Neurological

Neurological, in the context of the video, refers to a technology that is based on Nerf and goes a step further by not only generating neural rendered scenes but also producing high-quality, usable 3D models that can be imported into 3D software like Blender. It addresses the limitations of both Nerf and photogrammetry by improving mesh quality and texture viability.

💡Featureless scanning

Featureless scanning is a term used to describe the process of creating 3D models from objects or scenes that lack distinct features, such as color variations or textures, which are typically required for photogrammetry. This new method leverages technologies like Nerf and neurological to overcome the limitations of traditional 3D scanning techniques.

💡Point Cloud

A Point Cloud is a collection of data points that represent the external surface of an object or scene, captured in 3D space. It is a common output of 3D scanning processes, including photogrammetry, and serves as the foundation for creating 3D models.

💡AI

Artificial Intelligence (AI) refers to the simulation of human intelligence in machines that are programmed to think and learn like humans. In the context of the video, AI is used in Nerf technology to learn from and reconstruct 3D scenes from images or video, showcasing its role in advancing 3D scanning techniques.

💡AR technology

Augmented Reality (AR) technology involves overlaying digital information, such as images, videos, or 3D models, onto the real world, enhancing the user's perception and interaction with their environment. The video positions Kiri Engine as a tool that leverages AR technology, making 3D scanning and visualization more accessible.

💡3D model

A 3D model is a digital representation of any object, character, or scene in three dimensions. It is created through various techniques, including 3D scanning and photogrammetry, and is used in a wide range of applications from gaming and movies to architectural visualization and medical imaging.

💡Texture

Texture in 3D modeling refers to the detailed pattern or appearance applied to the surface of a 3D model, which gives it a more realistic look by simulating materials like wood, metal, or fabric. The video emphasizes the importance of texture quality in 3D models and how neurological technology aims to enhance it.

Highlights

3D scanning is becoming increasingly popular with the rise of artificial intelligence and augmented reality.

Kiri Engine is a tool for 3D scanning and AR technology, offering an alternative to iPhone 3D scanning apps like Polycam.

Kiri Engine is available for both Android and iPhone, and supports for grammar as well.

A new feature in Kiri Engine is virtual scanning using NeRF technology, specifically a technique called Norlandulo.

NeRF technology attempts to mitigate some of the shortcomings of photogrammetry, though it's not perfect and has its own drawbacks.

Kiri Engine's Futural Scan and Norlandulo aim to improve upon NeRF's limitation of not generating great mesh qualities.

3D scanning or photogrammetry converts 2D images into 3D models for various applications like entertainment, architecture, medical, and engineering.

Photogrammetry requires distinct features in images, such as color or shape changes, to create a complete 3D model.

NeRF stands for neural Radiance field and uses AI to reconstruct 3D scenes from a set of images or a video.

NeRF can reconstruct scenes and objects that lack enough feature points for traditional photogrammetry.

Norlandulo goes a step further than NeRF by generating neural rendered scenes and producing usable 3D models for software like Blender.

Kiri Engine's featureless mode is based on the Norlandulo algorithm, making it a powerful tool for 3D scanning.

The featureless mode in Kiri Engine allows for 3D scanning by recording a video and submitting it to the cloud for processing.

The processing time for the featureless mode might be longer than traditional photogrammetry due to it being a newer technology.

NeRF is not expected to replace photogrammetry, but Norlandulo and its advancements could potentially be a stronger contender.

Kiri Engine offers additional features like a web app, access library, in-app editing, and more.

Kiri Engine can be downloaded for free and is compatible with both Android and iPhone.