Hollywood is Using AI! Have You Noticed?
TLDRThe latest advancements in AI technology are revolutionizing the film industry, as highlighted in this week's AI film news. A company named Infinite Realities has developed a system that allows for 3D camera movement around a scene, creating photorealistic video. Netflix and a24 are also leveraging AI tools, with the latter using AI for movie posters. Adobe has released new AI features in Photoshop, enhancing image quality and offering generative expand capabilities. Meanwhile, Stable Diffusion 3 is making waves for its text-to-image generation capabilities, potentially surpassing other systems like Dolly 3 and Mid Journey V6. The documentary 'What Jennifer Did Now' by Netflix has sparked discussions on the use of AI in documentaries, while AI-generated content is being explored by major companies like TCL. The film industry is also seeing the rise of AI-generated music, with artists like Drake experimenting with the technology. As AI continues to evolve, it is set to transform creative projects, with upcoming events and courses focusing on AI filmmaking and advertising.
Takeaways
- 🎬 Infinite Realities allows filmmakers to shoot a scene and move the camera around in 3D space with photorealistic quality, hinting at the future of filmmaking.
- 📈 Netflix and a24 are utilizing AI tools, indicating a growing trend of AI integration in the entertainment industry.
- 🔍 Midjourney's new style reference feature enables quick iteration through various image examples for creative direction, enhancing the design process.
- 🎨 Adobe's updates to Firefly and Photoshop introduce powerful AI image generation capabilities, readily available for users.
- 📱 Adobe Firefly's generative expand feature in the mobile version allows users to expand image frames with an online tool, soon to be accessible in the cloud.
- 🚀 Stable Diffusion 3 by the team at stable diffusion claims to rival or surpass state-of-the-art text-to-image generation systems, offering an open-source alternative.
- 🌟 Hollywood is increasingly using AI for various aspects of film production, from pre-production to marketing, as seen in projects by Netflix and a24.
- 📺 TCL, a major electronics company, is exploring AI-generated content with their own TV plus platform, positioning themselves as an AI studio.
- 🤖 CAA, a leading Hollywood talent agency, is cloning A-list celebrities using AI, allowing talent to appear in multiple projects simultaneously.
- 🎵 Drake's release of an AI-generated song featuring clones of Tupac and Snoop Dogg reflects the music industry's experimentation with AI as a creative tool.
- 🏆 The launch of the world's first AI film trailer competition by Curious Refuge, in partnership with Submachine, invites creators to showcase their AI film skills.
Q & A
What is the innovative approach by the team at infinite realities for shooting scenes?
-Infinite realities has developed a system that allows shooting a scene and then moving the camera around in 3D space, creating a 3D representation of the scene with photo-realistic video quality. This enables filmmakers to place subjects in any scene and shoot the entire environment, potentially revolutionizing the future of filmmaking.
How does the AI uprisor tool help in the filmmaking process?
-The AI uprisor tool is used to enhance maximum detail on elements that may have been lost during the process of moving the 3D camera around the scene. It helps in refining the final output, ensuring that the details are captured accurately.
What new feature did Mid Journey release for creative direction?
-Mid Journey released a new style reference feature that allows users to quickly iterate through various image examples for creative direction. This tool enables creative exploration by pulling random styles and generating different visual outcomes for a given subject.
How does Adobe's Firefly 3 compare to other image generators in terms of quality?
-Adobe Firefly 3 is Adobe's most powerful AI image generator to date, with high-quality results. However, when compared to other generators like Mid Journey, Firefly 3 may not be as photorealistic, especially for cinematic aesthetics. Adobe's model is primarily trained on Adobe's stock library, which can sometimes result in stock photography-like images.
What new capabilities are available in Adobe Photoshop 2024?
-Adobe Photoshop 2024 includes new features such as generative expand, which allows users to expand the edges of a frame with a new background. It also has the ability to use the Firefly model directly within Photoshop to generate images from prompts, and a feature to generate subtle variants of a generated image using the 'generate similar' option.
What is the significance of the Stable Diffusion 3 API in the context of text-to-image generation?
-null
How is AI being used in Hollywood for film production?
-AI is being used in Hollywood for various stages of film production, from pre-production to marketing and distribution. It is used to create movie posters, generate visuals for documentaries, and even clone A-list celebrities for their presence in multiple movies simultaneously.
What is the ethical consideration when using AI-generated visuals in documentaries?
-The ethical consideration is transparency. Documentarians should disclose the use of AI-generated images to the audience, especially when the imagery is intended to represent real events or people. Failure to disclose can mislead viewers and undermine the credibility of the documentary.
What new opportunities does AI present for talent agencies and actors?
-AI presents the opportunity to clone A-list celebrities, allowing them to appear in multiple movies or projects at the same time. This can streamline the production process, reduce the need for re-shoots, and enable talent to be involved in more projects than would be possible through traditional scheduling.
How are mainstream artists beginning to embrace AI in their creative process?
-Mainstream artists are starting to use AI as a creative tool to generate music, create avatars, and produce visual content. For example, Drake released an AI-generated song featuring clones of Tupac and Snoop Dogg, and the team at Synesthesia released AI avatars that can predict expressions from a script.
What is the potential impact of AI on the future of filmmaking and advertising?
-AI has the potential to significantly impact filmmaking and advertising by enabling virtual photo shoots, generating realistic 3D environments, and creating highly detailed and customized visuals. It can also facilitate the creation of content that is more efficient, cost-effective, and personalized to audience preferences.
What are some of the upcoming AI film events and competitions that creators can participate in?
-There are several upcoming AI film events and competitions, including the world's first AI film trailer competition, which offers a chance to win an Apple Vision Pro. Creators can also look forward to the Runway Film Festival in LA and New York, and AI events hosted by Curious Refuge.
Outlines
🎬 Innovative 3D Video Technology and AI Tools
Infinite Realities has introduced a groundbreaking system that allows users to shoot a scene and navigate around it in 3D space with stunning photorealistic quality. A24 and Netflix have also ventured into AI, with projects like M journei and Adobe's new AI tools that are readily available for use. Drake's release of an AI-generated song underscores the current trend of AI in creative fields. The ability to place subjects into any scene and shoot the environment comprehensively is a significant step towards the future of filmmaking.
🖼️ AI Image Generation: Firefly vs Mid Journey
Adobe Firefly 3, Adobe's latest AI image generator, is put to the test against Mid Journey, with a focus on cinematic stills and hyper-realistic imagery. While Firefly's quality has improved, it still leans towards an editorial look, likely due to its training on Adobe's stock library. Mid Journey, on the other hand, offers a more filmic and consistent aesthetic. Adobe also introduced generative expand for mobile, allowing users to expand the edges of a frame with AI, a feature already available in Adobe Photoshop 2024.
🌌 Adobe Photoshop 2024 Beta: New Features
Adobe Photoshop 2024 beta offers a suite of new features, including the ability to use the Firefly model directly within Photoshop for image generation. Users can now generate images from text prompts or reference images, and even add elements like bacon to a breakfast scene with generative fill. The 'enhance detail' feature improves the resolution of generative fills, and the 'generate background' feature allows for the creation of new backgrounds from prompts, although it requires careful art direction for best results.
📽️ AI in Hollywood and Creative Industries
AI is making waves in Hollywood and creative industries. Netflix's documentary 'What Jennifer Did' and A24's movie posters for Alex Garland's Civil War film showcase AI's growing role. TCL, a major electronics company, is positioning itself as an AI studio, creating an AI-generated romcom trailer. CAA, a leading Hollywood talent agency, is exploring the cloning of A-list celebrities for film appearances. Meanwhile, Drake's AI song featuring clones of Tupac and Snoop Dogg indicates mainstream adoption of AI in music.
🌟 AI Filmmaking and Advertising Course
Curious Refuge is offering an AI filmmaking and advertising course starting May 1st, which is proving to be very popular. The organization also hosts meetups and AI film events worldwide, including an upcoming AI filmmaking meetup in London. The Runway Film Festival is another significant event on the horizon, with versions in LA and New York.
🏆 Launch of the World's First AI Film Trailer Competition
The world's first AI film trailer competition has been launched, offering participants the chance to win an Apple Vision Pro and gain recognition in the AI filmmaking community. The competition is partnered with Submachine and judged by experts from Curious Refuge, the TV Academy, and guest judge Matt Wolf, a renowned YouTuber and AI expert.
📚 AI Developments in Academic Research
Researchers from the University of Hong Kong have made significant advancements in AI applications. One system allows for the dynamic alteration of lighting in a 3D scan of a city, while another enables the removal of shadows from reference images for more accurate 3D modeling. Additionally, a new tool promises to offer 3D camera control for generating photorealistic results, which could revolutionize virtual product photography and filmmaking.
🎵 AI in Music Videos and Mainstream Media
AI technology is being used to create realistic avatars with natural facial features and lip sync, as demonstrated by Synesthesia. In the music industry, Paul Trillo has used AI tools to render scenes for a music video, achieving higher fidelity by combining AI-generated content. Meanwhile, Drake's recent AI song and the release of AI avatars indicate a growing trend of AI integration in creative expression.
🌍 AI Film Showcase: Exploring Diverse Themes
The episode concludes with a showcase of AI films. Paul Trillo's project for TED offers a virtual flythrough of various worlds, while Ryan Ven's short film about an astronaut stranded in space demonstrates effective use of AI within the constraints of the technology. Lastly, Dave Clark's 'Max the Robot,' a 1950s sitcom about a boy who is a robot, rounds out the showcase with its unique blend of humor and AI-generated content.
Mindmap
Keywords
💡AI Film News
💡Infinite Realities
💡AI Upriser
💡Mid Journey
💡Adobe Firefly
💡Generative AI
💡Stable Diffusion 3
💡AI Filmmaking
💡AI Clones
💡AI Avatars
💡AI Film Trailer Competition
Highlights
A new company, Infinite Realities, allows for shooting a scene and moving the camera around in 3D space with photorealistic video quality.
Netflix and a24 have created projects utilizing AI tools, and Adobe has released new AI tools that are immediately available for use.
Drake has released an AI-generated song, showcasing the use of AI in the music industry.
Infinite Realities' system enables the creation of 3D Gaussian Splat videos where one can zoom in on the scene for detailed shots.
Mid Journey's new style reference feature on Discord or their website allows for iterating through various image examples for creative direction.
Adobe Firefly 3 is Adobe's most powerful AI image generator to date, offering high-quality image generation.
Comparisons between Adobe Firefly and Mid Journey show differences in photorealism and creative direction capabilities.
Adobe is bringing generative AI features to the mobile version of Adobe Firefly, allowing for frame expansion and content creation.
Adobe Photoshop 2024 beta allows for the use of the Firefly model directly within the software for image generation.
New features in Adobe Photoshop include generative fill, enhancing detail in generated images, and background removal with the option to generate a new background.
Stable Diffusion 3, released by the team at stable diffusion, claims to be equal to or better than state-of-the-art text-to-image generation systems.
The University of Hong Kong developed a system for dynamically changing lighting in a 3D scan of a city, which can be applied to filmmaking and advertising.
CAA, a major Hollywood talent agency, is cloning A-list celebrities for use in multiple movies simultaneously, leveraging AI technology.
Drake's recent AI song featuring clones of Tupac and Snoop Dogg demonstrates mainstream artists' growing acceptance of AI as a creative tool.
Synesthesia has released highly realistic AI avatars that can predict expressions from a script and feature natural facial movements and lip sync.
Paul Trillo's breakdown of his music video production process shows how AI tools like Runway can be combined for higher fidelity in animations.
TED's use of AI for a virtual flythrough experience showcases the adoption of AI in creating immersive and visually stunning content.
Ryan Ven's short film about an astronaut stranded in space exemplifies creative workarounds of AI limitations for compelling storytelling.
Dave Clark's 'Max the Robot' is a 1950s sitcom-style project that incorporates AI, indicating the versatility of AI in different genres and formats.