I Faked 8K 3D 360° with AI...and it looks *GOOD* 😵 | Insta360 X4 vs. Titan

Hugh Hou
27 May 202404:06

TLDRExplore Barcelona's highest point with the Insta360 X4, which, despite not being a 3D camera, delivers an immersive 8K 3D 360° experience through AI-powered Immersity AI by Leia Inc. This technology excels in depth estimation, especially in challenging low-light conditions, and rivals the $20,000 Insta360 Titan. The video offers tips on cost-effectively converting 2D to 3D 360° footage with Immersity AI, emphasizing the AI's impressive strides in enhancing 360° video content.

Takeaways

  • 🌐 The video showcases a view from the highest point in Barcelona, Spain, captured in 8K 3D 360°.
  • 🤖 The 3D effect was artificially generated using AI from a service called Immersity AI by Leia Inc.
  • 🎥 The Insta360 X4, which is not a 3D camera, was used to capture the footage, and AI was later applied to create the 3D effect.
  • 🌅 The AI faced challenges in creating a 3D effect due to low light, sunrise, and motion in the scene.
  • 🏞️ For stationary shots, the AI performed well in depth estimation, creating a seamless 360° experience.
  • 📹 The AI's training on equirectangular videos, possibly from the creator's own 3D 360 videos, helped it understand 360° videos better.
  • 💰 A comparison is made between the AI-generated 3D effect and footage from a dedicated 3D 360° camera, the Insta360 Titan, which is much more expensive.
  • 💵 The cost of using Immersity AI is discussed, with pricing based on video length and frame rate.
  • 💻 Tips are provided for maximizing the use of credits when using Immersity AI, including video length and file format recommendations.
  • ⏱️ The AI processing time for a 1-minute 8K video is approximately half an hour.
  • 📢 The video ends with an invitation to connect with the creator at upcoming events and a call to action for viewers to subscribe for more content.

Q & A

  • What is the highest point in Barcelona, Spain, mentioned in the video?

    -The video does not explicitly state the name of the highest point in Barcelona, Spain, but it is likely referring to the Bunkers del Carmel, which is a popular spot for panoramic views of the city.

  • Is the Insta360 X4 a 3D camera?

    -No, the Insta360 X4 is not a 3D camera. The 3D effect in the video was generated using AI with a service called Immersity AI by Leia Inc.

  • How does Immersity AI by Leia Inc. enhance the 2D video footage?

    -Immersity AI enhances 2D video footage by using AI to create a 3D effect, making the scenes feel more immersive even though the original footage was not captured in 3D.

  • What challenges did the AI face while processing the video shot at sunrise in Barcelona?

    -The AI faced challenges due to low light conditions, the specific lighting of the sunrise, and motion in the video shot at Barcelona.

  • How does the AI handle stitching for stationary shots in 360 videos?

    -For stationary shots, the AI does a commendable job with depth estimation and is able to create a seamless 360-degree view without visible stitch lines.

  • What is the comparison point between the AI-generated 3D effect and a dedicated 3D 360 camera like the Insta360 Titan?

    -The video compares the AI-generated 3D effect to footage from a dedicated 3D 360 camera, the Insta360 Titan, to discuss the quality and realism of the AI's 3D conversion.

  • How much does it cost to convert a 1-minute 8K 360 video using Immersity AI?

    -Converting a 1-minute 8K 360 video using Immersity AI costs 900 credits, which is roughly $5.

  • What is the file size limit for uploading videos to Immersity AI for conversion?

    -The file size limit for uploading videos to Immersity AI is up to 2 gigabytes.

  • What video format and 3D softness setting are recommended for uploading to Immersity AI?

    -For uploading to Immersity AI, it is recommended to use the MP4 Top and Bottom format and set the 3D softness to 1.1 to avoid an overly intense 3D effect.

  • How long does it take for the AI to process a 1-minute 8K video?

    -The AI takes about half an hour to process a 1-minute 8K video.

  • What tips are given for maximizing the use of credits on Immersity AI?

    -To maximize credits on Immersity AI, it is advised to upload edited videos around 50 to 60 seconds in length, as anything over 60 seconds will increase the cost per minute.

Outlines

00:00

🌄 Introduction to 360 Video Technology

The script begins with a welcome to Barcelona's highest point, showcasing a panoramic view captured with the Insta360 X4 camera. The narrator humorously corrects a misconception about the camera's capabilities, clarifying that it is not a 3D camera, and then presents the same shot in 2D. The script introduces Immersity AI by Leia Inc., a service that uses AI to create a 3D effect from 2D footage, enhancing the immersive experience. The challenges of capturing in low light and motion are discussed, followed by a comparison of AI-generated 3D with footage from a dedicated 3D 360 camera, the Insta360 Titan. The script invites viewers to share their thoughts and discusses the cost-effectiveness of AI in producing 8K 3D 360 content.

Mindmap

Keywords

💡Insta360 X4

The Insta360 X4 is a consumer-grade 360-degree camera known for its high-quality video capture. In the video, it is used to capture an epic view in Barcelona, Spain, showcasing its ability to record in 8K resolution. However, the camera itself is not capable of 3D capture, which is a key point of discussion in the video.

💡3D 360

3D 360 refers to three-dimensional 360-degree video, which provides a fully immersive viewing experience by capturing depth as well as the 360-degree field of view. The video discusses how the effect of 3D 360 was artificially generated using AI for the Insta360 X4 footage, which is typically a 2D capture device.

💡AI

AI, or Artificial Intelligence, is the simulation of human intelligence in machines that are programmed to think like humans and mimic their actions. In the context of the video, AI is used to create a 3D effect from 2D footage through a service called Immersity AI by Leia Inc.

💡Immersity AI by Leia Inc.

Immersity AI by Leia Inc. is a service that uses AI to generate 3D effects from 2D videos, enhancing the viewing experience by adding depth perception. The video highlights how this service was used to make the Insta360 X4 footage appear as if it was captured in 3D, despite the camera's native 2D capabilities.

💡Depth Estimation

Depth estimation in video processing refers to the calculation of the distance of objects from the camera to create a sense of depth. The video mentions that for stationary shots, the AI's depth estimation is commendable, indicating that it does a good job at simulating the depth in 3D videos.

💡Stitch Line

A stitch line in 360-degree videos is the visible seam where the video footage from different camera lenses is combined. The video praises the AI for its ability to create a seamless 360-degree experience without visible stitch lines, particularly when looking behind the viewer.

💡Insta360 Titan

The Insta360 Titan is a professional-grade 360-degree camera capable of capturing 3D 360-degree video natively. The video compares the AI-generated 3D effect from the Insta360 X4 footage to the native 3D capture of the Insta360 Titan to discuss the quality and cost-effectiveness of AI in video production.

💡Insta360 Stitcher

Insta360 Stitcher is a software used for stitching together footage from multiple cameras into a single, seamless 360-degree video. The video mentions its use in stitching 8K 3D 360 footage from the Insta360 Titan, highlighting the professional quality of the output.

💡Credits

In the context of the video, 'credits' refers to the virtual currency used to pay for the Immersity AI service. The video provides tips on how to maximize the use of credits when converting 2D videos to 3D, such as uploading videos of specific lengths to save on costs.

💡MP4 Top and Bottom format

MP4 Top and Bottom format is a method of encoding 360-degree video where the top and bottom halves of the spherical image are placed one above the other in the video file. The video advises using this format when uploading files to the Immersity AI service for conversion to 3D.

💡Convergence

Convergence in 3D video refers to the adjustment of the alignment of the left and right images to create a single, cohesive 3D image. The video suggests setting the convergence to infinite depth to zero for optimal viewing, although it cautions that the description of this setting might be misleading.

Highlights

Welcome to the highest point in Barcelona, Spain!

The view was captured with the Insta360 X4 in 8K 3D 360, but it's not a 3D camera.

The 3D effect was generated using AI with Immersity AI by Leia Inc.

AI makes 2D footage feel more immersive, even in challenging low light conditions.

For stationary shots, the AI does a commendable job with depth estimation.

There's no stitch line when looking behind, showcasing AI's understanding of 360 videos.

Comparing AI-generated 3D with a dedicated 3D 360 camera, the Insta360 Titan.

AI isn't perfect yet, but it’s made significant strides in 3D video generation.

Using AI can save money in producing 8K 3D 360 content, which is costly.

Converting a 1-minute 8K 360 video with Immersity AI costs 900 credits (about $5).

For 60fps, the cost is 1800 credits (about $10), with free credits on sign-up.

To maximize credits, upload edited videos around 50 to 60 seconds.

Files can be up to 2 gigabytes, but ProRes format is not supported.

Use MP4 Top and Bottom format and set the 3D softness to 1.1 for better results.

Turn on Convergence and set infinite depth to zero for optimal 3D effect.

The AI takes about half an hour to process a 1-minute 8K video.

The presenter will be in Taiwan for Computex and speaking at AWE 2024.

Subscribe for more in-depth tutorials on 2D to Spatial Video conversion with AI.