From XR to AI: David Dowling Shares Pixotope's Latest Innovations
TLDRIn this video, David Dowling from Pixotope discusses the latest innovations in virtual production. Pixotope, a five-year-old software company, has developed solutions to aid studios and broadcasters in realizing their virtual production visions. The conversation covers various applications, including extended reality (XR), Pixotope Pocket—a mobile phone application for students to visualize AR elements—and Pixo Fly, a markless tracking system for drones and steady cams. The company has also made strides in AI with an AI Keyer that eliminates the need for green screens, allowing for AR elements to be placed in front of and behind subjects. Dowling expresses excitement about the future of virtual production, as it becomes more integrated into standard production workflows, with an emphasis on ease of use and problem-solving technologies.
Takeaways
- 🌟 Pixotope is a virtual production solution that has been in business for five years, evolving from a production company to a software company.
- 📈 Extended Reality (XR) is a significant application of Pixotope, demonstrated at the UN Lum Booth with a 2.6 pitch LED panel and XR software.
- 📱 Pixotope Pocket is a new application designed for students, allowing them to combine tracking with video using a mobile phone, which is currently iOS-based but will soon support Android.
- 🚀 Pixotope Pocket is gaining popularity for its ability to enable hands-on AR element visualization without the need for studio space, which is a game-changer for students.
- 🤖 Pixotope Fly is a markless tracking system for drones or steadicams, which has become incredibly popular and has recently integrated zoom functionality for precise camera movements.
- 📊 Traditional tracking required physical setup with sensor cameras and markers, whereas Pixotope Fly uses machine learning to develop a point cloud for real-time, low-latency tracking.
- 🔍 The AI Kia is a groundbreaking development that eliminates the need for green screens by automatically detecting people and creating a map to overlay AR elements.
- 🎥 This innovation is particularly useful for commentators and sports presenters, allowing for over-the-shoulder graphics without the need for a green box setup.
- 📉 The AI technology behind this development is still learning and training, with an expected first release by the end of summer or the beginning of fall.
- 🌐 Virtual production is becoming mainstream, with Pixotope helping to eliminate the fear factor and making it another tool in the production toolkit.
- ⚙️ Ease of use is a key focus for Pixotope, aiming to create interfaces that don't require an engineering degree to operate, appealing to operators who prefer simplicity.
Q & A
What is Pixotope and how long has the company been in business?
-Pixotope is a virtual production solution that has been in business for five years as a software company. Prior to that, they were a production company, and they developed their software to assist studios and broadcasters in realizing their virtual production visions.
What is the purpose of Pixotope Pocket and which platforms does it support?
-Pixotope Pocket is an application designed for students to combine tracking with video using a mobile phone. It is currently running on iOS and will soon be available for Android as well.
How is Pixotope Pocket being used by students and professionals?
-Pixotope Pocket is used for previs, allowing users to visualize AR elements by attaching their mobile phones to the camera. Students can use it to build and previs their AR elements without needing access to a studio, which is particularly beneficial for hands-on learning.
What is Pixo Fly and how does it work?
-Pixo Fly is a system developed for markless tracking for drones or steady cams. It uses machine learning to develop a point cloud, which can be used for tracking and applying AR elements in real time with very low latency.
How has Pixo Fly improved the process of tracking in virtual production?
-Pixo Fly eliminates the need for physical setup and sensor cameras within a stadium. It allows for easy zooming and tracking of specific areas, such as the 10-yard line in NFL games, and can use external buildings as tracking points.
What is the latest innovation in Pixotope's product line?
-The latest innovation is an AI key, which allows for chroma key effects without the need for a green screen. This technology automatically detects people and creates a map to place AR elements, enabling full functionality of chroma key.
How does the AI key differ from traditional chroma key methods?
-The AI key is able to automatically detect the edges of a person, eliminating the need for a green screen or any specific background. It is designed to work with low processing power and is integrated with gaming engines for efficiency.
What are some potential use cases for the AI key technology?
-The AI key can be used for sports commentators and presenters who are in ordinary rooms, allowing for over-the-shoulder graphics and player elements without the need for a green box setup.
What is David Dowling excited about in the field of virtual production for the next year or two?
-David Dowling is excited about the overall progress in virtual production, as it is becoming more mainstream and less intimidating. He highlights the ease of use and the problem-solving capabilities of tools like Pixo Fly, which are making virtual production more accessible.
How does Pixotope aim to make virtual production more accessible to operators?
-Pixotope aims to make virtual production more accessible by creating user-friendly interfaces that do not require an engineering degree to operate. The goal is to allow operators to easily press buttons without worrying about the technical connections between different components.
What is the current status of the AI key technology and when is it expected to be released?
-The AI key technology is very close to being released. It is currently in the training phase, with the first release expected at the end of summer or the beginning of fall.
How does Pixotope's approach to virtual production differ from other companies?
-Pixotope's approach differs by focusing on eliminating the fear factor associated with virtual production and making it another tool in the production toolkit. They emphasize ease of use and practical solutions to common problems, such as tracking in outdoor environments.
Outlines
🎬 Overview of Virtual Production Solutions by Pixo Real
This paragraph introduces the topic of the video, which is the latest updates in virtual production technology provided by Pixo Real. The video features an interview with David from Pixo Real, who gives an overview of the company's virtual production solutions. Pixo Real has been in business for five years and has a background in production, which has informed the development of their software. The software aims to assist studios and broadcasters in achieving their virtual production goals. The discussion also touches on extended reality applications and a strategic partnership with UN Lum, highlighting a demonstration of their 2.6 pitch LED panel combined with Pixo Real's XR software.
📱 Introducing Pixo Pocket: A Mobile Application for Students
Pixo Pocket is a recently developed application designed specifically for students. It allows for the combination of tracking and video using a mobile phone, currently supporting iOS with Android support coming soon. The app is being adopted by the broadcast industry, videographers, and cinematographers. It is particularly useful for previs, enabling students to visualize AR elements without the need for university studios. The application works by utilizing a gaming machine, such as those with Nvidia graphics, to run the Pixo Pocket software and then using the mobile phone for tracking and video integration.
🚀 Pixo Fly: Markless Tracking for Drones and Steadicams
Pixo Fly is a product developed nearly two years ago for markless tracking of drones and steady cams. It has become very popular and now includes a zoom feature, which is particularly useful for sports events like the NFL. The system uses machine learning to develop a point cloud, which can be used for tracking and applying AR elements in real time with very low latency. Traditionally, tracking required physical setup with sensor cameras and markers, but Pixo Fly eliminates this need by using a drone camera to capture the environment and create the necessary tracking points.
🤖 AI-Powered Innovation: Eliminating the Need for Green Screens
The video also discusses an upcoming AI innovation by Pixo Real that eliminates the need for green screens in chroma key processes. The AI system automatically detects people and creates a map to enable the placement of AR elements, allowing presenters to stand in front of and behind AR elements without a green screen. This technology is particularly useful for commentators and sports presenters who can now have graphics over their shoulders without needing a green box. The AI is still in training, but the first release is expected at the end of the summer or the beginning of fall.
🌟 Excitement for the Future of Virtual Production
David expresses excitement about the future of virtual production, noting that it's becoming less of a specialized term and more a part of regular production. Pixo Real has worked to eliminate the fear factor associated with virtual production, positioning it as another tool in the production toolkit. The video highlights the ease of use and problem-solving capabilities of Pixo Real's technology, such as Pixo Fly for tracking. The goal is to make virtual production accessible to more broadcast productions without requiring extensive technical knowledge.
Mindmap
Keywords
💡Virtual Production
💡Pixotope
💡Extended Reality (XR)
💡PIXO Pocket
💡Machine Learning
💡Pixo Fly
💡Chroma Key
💡Artificial Intelligence (AI)
💡Broadcast Industry
💡Real-Time Tracking
💡Strategic Partners
Highlights
Pixotope is a virtual production solution that has been in business for five years as a software company.
Pixotope has its roots in production, which influences its approach to helping studios and broadcasters realize their virtual production visions.
Extended reality (XR) is a significant application area for Pixotope, demonstrated on the UN Lum Booth.
Pixotope Pocket is a new application designed for students, combining tracking with video using a mobile phone.
Pixotope Pocket is currently running on iOS and will soon be available on Android.
The application is gaining popularity in the broadcast industry and among videographers and cinematographers.
Users can visualize AR elements with Pixotope Pocket, enhancing previs capabilities without the need for studio space.
Pixotope Fly is a system for markless tracking for drones or steady cams, which has become incredibly popular.
Zoom functionality has been incorporated into Pixotope Fly, allowing for dynamic AR marker placement on the field.
Traditional tracking required sensor cameras and physical markers, whereas Pixotope Fly uses machine learning for real-time tracking without markers.
Pixotope Fly is used globally across various sports and for election graphics, showcasing its versatility.
An AI Key has been developed by Pixotope, eliminating the need for a green screen and allowing for AR elements to be placed in front of and behind subjects.
The AI technology automatically detects people and creates a map for AR element placement, enhancing the functionality of chroma key.
The AI is currently learning and training, with an expected first release by the end of summer or beginning of fall.
Virtual production is becoming mainstream, with Pixotope contributing to its normalization as just another tool in the production toolkit.
Pixotope is focused on solving tracking problems outside with user-friendly interfaces that don't require an engineering degree to operate.
The future of virtual production is exciting, with an emphasis on ease of use and broader adoption in broadcast productions.
