最好用的Midjourney新功能+GPT,AI半小时制作动态儿童绘本(最强教程) Best Midjourney feature ever make Children's book Tutorial

靜電的AI設計教室
8 Nov 202325:09

TLDRThe video script introduces two new AI functions, the style tuner by Midjourney and the updated Runway gen-2, which significantly simplify the process of creating children's picture book videos. The style tuner function enhances picture consistency, ideal for maintaining character uniformity in children's books. Runway gen-2 allows for video generation with improved fidelity and consistency, and the ability to adjust camera movement within generated videos. The tutorial demonstrates how to use these tools in combination with ChatGPT to craft a children's story, generate corresponding images, and edit them into a cohesive video, complete with dubbing and music, resulting in a captivating and visually consistent video suitable for children's entertainment and education.

Takeaways

  • 🎨 New AI functions have been introduced to simplify the creation of children's picture book videos.
  • 🌟 Midjourney's style tuner function improves picture consistency, ideal for character consistency in children's books.
  • 🚀 Runway gen-2 has been updated with enhanced video and picture-to-video generation capabilities, including adjustable camera motion in generated videos.
  • 📚 The tutorial demonstrates the process of creating a children's picture book video called 'Mia's Wishing Tree' using AI tools.
  • 🤖 ChatGPT4 was used to generate a bedtime story suitable for children aged 3-6, with a focus on warmth and storytelling.
  • 🖌️ The style tuner allows for the customization of artistic styles in generated images, such as comic or painted styles.
  • 🎥 Runway gen-2's text2video function enables the conversion of images and text into animated videos with added motion and camera effects.
  • 📈 The importance of selecting the right style and consistency in images for a cohesive children's book video is emphasized.
  • 🎞️ Video editing tools like Adobe Premiere Pro can be used to compile and finalize the AI-generated video content.
  • 🎶 The addition of background music and dubbing can enhance the storytelling experience of the video.
  • 💡 AI-generated content can be a lucrative way to create additional income through the production of unique digital media.

Q & A

  • What are the two new functions mentioned in the script that have made it easier to create children's picture book videos?

    -The two new functions mentioned are the 'style tuner' function from Midjourney, which improves picture consistency, and the updated 'Runway gen-2' which allows for better video generation and manipulation of the generated video's fidelity and consistency.

  • How does the style tuner function solve a common problem for designers?

    -The style tuner function solves the problem of maintaining a fixed style when using spells to draw. It allows designers to generate images with a consistent style by adding a style suffix to their content, ensuring that the resulting pictures have a uniform painting or comic style.

  • What is the significance of the update in Runway gen-2 for video generation?

    -The update in Runway gen-2 introduces significant improvements in the functions for generating videos from pictures and text. It now allows users to move within the Runway lens and adjust the amplitude of the movement in the generated videos, leading to more dynamic and engaging content.

  • How long did it take the speaker to create a children's picture book video called 'Mia's Wishing Tree' using ChatGPT?

    -It took the speaker approximately one hour to create a children's picture book video called 'Mia's Wishing Tree' using ChatGPT.

  • What is the purpose of the style tuner function in the context of creating a children's picture book?

    -The style tuner function is used to ensure character consistency throughout the picture book. By using this function, the generated images will have a uniform style, which is essential for maintaining the visual integrity of the story.

  • How does the speaker use ChatGPT to assist in the creation of the children's picture book video?

    -The speaker uses ChatGPT to generate a short bedtime story suitable for children aged 3-6, to storyboard the article, and to provide a name for the story. The AI's capabilities are utilized to streamline the creative process and generate content that can be visually represented.

  • What is the process for using the style tuner function in Midjourney?

    -To use the style tuner function in Midjourney, one must first create a channel, enter a command with a slash followed by 'tune', input keywords for the desired picture, and then select from generated groups of pictures to refine the style. The selected style is then used as a suffix for generating images with a consistent look.

  • What are the different screen ratios that can be set in Runway gen-2 for video generation?

    -In Runway gen-2, users can set different screen ratios for video generation, such as 9:16 for vertical videos or adjust the ratio for other formats as needed.

  • How does the speaker suggest using the generated videos to create extra income?

    -The speaker suggests that by using AI to create children's picture book videos, one can generate additional income by publishing these videos on various platforms or selling them as e-books or video files.

  • What is the final product of the tutorial described in the script?

    -The final product of the tutorial is a children's picture book video titled 'Mia's Wishing Tree', which is created using AI tools such as ChatGPT, Midjourney, and Runway Gen-2. The video is designed to be engaging and suitable for children, with a coherent storyline and visual style.

  • How does the speaker plan to share the detailed production process?

    -The speaker plans to release a detailed production video in a follow-up, which will include the entire complete version of 'Mia's Wishing Tree' and insights into the production process.

Outlines

00:00

🎨 Introducing AI in Children's Picture Book Creation

The paragraph introduces the audience to the presenter, Static Electricity, and discusses the recent advancements in AI painting, particularly the release of a new model training function by Midjourney called the style tuner. This function significantly improves picture consistency, making it ideal for children's picture books that require character consistency. The presenter also mentions Runway gen-2's new version, which has enhanced video and picture generation capabilities, including adjustable movement amplitude in generated videos. The ease of creating children's picture book videos with these AI tools is highlighted, along with a personal project where the presenter used ChatGPT to create a video called 'Mia's Wishing Tree' in about an hour. The paragraph concludes with a promise to release a detailed production video and the complete version of 'Mia's Wishing Tree' at the end of the program.

05:01

🖌️ Utilizing the Style Tuner Function

This section delves into the specifics of the style tuner function recently updated by Midjourney, which addresses the common issue of style inconsistency in AI-generated images. The presenter explains how the style tuner allows for a consistent comic or painted style across images. The process of using the style tuner is outlined, including creating a channel on Midjourney, entering commands, and selecting desired styles from generated groups of pictures. The presenter demonstrates how to refine the style by adding suffixes and how to generate a consistent style across different content. The paragraph concludes with a discussion on the practical application of the style tuner in generating a children's picture book, emphasizing the coherence of character design.

10:02

📖 Collaborative Storytelling with AI

The paragraph describes the process of using ChatGPT to generate content for a children's picture book. The presenter uses ChatGPT4 to craft a short, warm bedtime story suitable for young children, aiming to help them sleep and appreciate the beauty of the world. The story revolves around a character named Mia and her interactions with a wishing tree. The presenter also discusses the use of ChatGPT for creating a storyboard, specifying the number of images needed for the book. The paragraph concludes with the presenter's intention to integrate the generated story and images into the picture book production process, using a combination of ChatGPT, Midjourney, and Runway Gen-2.

15:03

🌲 Crafting Scenes for 'Mia's Wishing Tree'

The focus of this paragraph is on the practical application of the previously discussed AI tools to generate the scenes for 'Mia's Wishing Tree'. The presenter explains how to use the generated style from Midjourney to create relevant spells for each scene of the story. The process involves uploading images to Midjourney, generating spells, and selecting the appropriate scenes based on the story's requirements. The presenter also discusses the use of Runway Gen-2 to add movement to the images, enhancing the dynamic nature of the picture book. The paragraph details the steps taken to generate a series of pictures that tell Mia's story, from her wish at the tree to her dream sequence and eventual return to reality.

20:04

🎬 Editing and Dubbing the Picture Book Video

This paragraph covers the final steps in creating the video for 'Mia's Wishing Tree', including editing and dubbing. The presenter discusses the use of video editing tools, such as iMovie, to compile the generated videos into a cohesive narrative. The process involves importing the videos into the editing software, arranging them in a timeline, and adding transition effects. The presenter also talks about adding background music and using subtitles to generate dubbing for the video. The paragraph concludes with the presenter's intention to export the final video for sharing on video platforms and provides a preview of the completed video, emphasizing the emotional impact and the message of kindness and bravery conveyed through Mia's story.

Mindmap

Keywords

💡AI

Artificial Intelligence (AI) refers to the simulation of human intelligence in machines that are programmed to think and learn like humans. In the context of the video, AI is used to create children's picture book videos, demonstrating its capability in generating content, maintaining style consistency, and producing engaging visual and auditory experiences for children's stories.

💡Midjourney

Midjourney is an AI platform that specializes in creating images based on user input. In the video, it is highlighted for its new model training function called the 'style tuner' which allows for greater consistency in the style of images, crucial for maintaining character consistency in children's picture books.

💡Style Tuner

The style tuner is a function that enables users to adjust and fix the artistic style of AI-generated images. It ensures that the visual elements of a project, such as a children's picture book, have a uniform and desired aesthetic throughout. This function is particularly useful for maintaining character and scene consistency across multiple images.

💡Runway gen-2

Runway gen-2 is an AI tool that has been updated to significantly improve the generation of videos and pictures used in creating videos. It allows for adjustments in the amplitude of movement in generated videos, providing a more dynamic and engaging visual experience.

💡ChatGPT

ChatGPT is an advanced language model developed by OpenAI, capable of generating human-like text based on the prompts given to it. In the video, ChatGPT is used to create a bedtime story for children, demonstrating its utility in content creation for educational and entertainment purposes.

💡Children's Picture Book Video

A children's picture book video is a multimedia format that combines visual images with narrative storytelling, specifically designed for young audiences. These videos typically feature illustrations or animations that correspond to the text of a story, creating an interactive and engaging experience for children.

💡Character Consistency

Character consistency refers to the maintenance of a character's visual appearance and personality traits throughout a narrative. In the context of the video, it is essential for the creation of children's picture books to ensure that the characters are easily recognizable and relatable to the audience across different scenes and illustrations.

💡Video Fidelity and Consistency

Video fidelity and consistency refer to the quality and uniformity of the video content, including the visuals and the flow of the narrative. High fidelity ensures that the video is clear, realistic, and maintains a consistent style throughout, which is crucial for storytelling and viewer engagement.

💡Storyboard

A storyboard is a sequence of illustrations or images displayed in the order of scenes as they appear in a motion picture, video, or comic book. It serves as a visual guide for the narrative and helps in planning the sequence of events in a story.

💡Video Editing

Video editing is the process of manipulating and assembling video shots into a coherent sequence. It involves adding transitions, effects, text, and audio to create a polished final product. In the context of the video, video editing is the final step in bringing together the AI-generated images and story into a completed children's picture book video.

💡AI Design Classroom

AI Design Classroom refers to an educational platform or course that teaches the principles and techniques of using artificial intelligence in design processes. In the video, it is the name of the channel run by the speaker, who provides tutorials on utilizing AI tools for various design projects, including creating children's picture book videos.

Highlights

Introduction of two new AI functions that simplify the creation of children's picture book videos.

Midjourney's new model training function, the style tuner, greatly improves picture consistency.

The style tuner function is ideal for maintaining character consistency in children's picture books.

Runway gen-2 has released a new version with significant updates to video and picture generation.

Runway gen-2 allows for movement within the lens and adjustment of the movement amplitude in generated videos.

AI can now be used to create children's picture book videos with ease and improved effects.

Static electricity demonstrates the creation of a children's picture book video called 'Mia's Wishing Tree' using ChatGPT.

The style tuner function solves the problem of style fixation in AI-generated images.

By using the style tuner, images can be generated with a consistent comic or painting style.

A detailed walkthrough of how to use the style tuner function in Midjourney is provided.

ChatGPT4 is used to write a short bedtime story for children, showcasing its advanced capabilities.

The process of generating a story, storyboard, and images for a children's picture book is explained.

Runway Gen-2's text2video function is introduced as a tool for creating videos from images and text.

The importance of maintaining a consistent screen ratio for video generation is emphasized.

A step-by-step guide on how to generate videos using Runway Gen-2 and edit them using a video editing tool.

The final product, 'Mia's Wishing Tree', is showcased, demonstrating the effectiveness of the AI tools.

The video production process is outlined, highlighting the potential for creating engaging content for children.

The tutorial concludes with a call to action for viewers to support the content creator and follow for more tutorials.