Civitai AI Video & Animation // Making Depth Maps for Animation // 3.28.24

Tyler, the host, welcomes the audience to a video and animation stream focused on creating depth map animations. He introduces the plan to generate depth maps using Comfy UI and then stylize them with Anime Diff. The required resources, including a specific model by Phil (Machine Delusions) and two workflows, are shared with the audience through Discord and Twitch links. The first workflow generates the depth map, and the second stylizes it. Tyler emphasizes the creative potential of this process.

The host provides an overview of the two workflows that will be used in the stream. He emphasizes the simplicity and user-friendliness, particularly for Daz, who tests the workflows for their ease of use. The workflows are designed to minimize VRAM usage, making them accessible for users with limited hardware resources. The first workflow generates the depth map, and the second focuses on stylizing the animation using Anime Diff.

Tyler explains how to customize the depth maps using prompts. He details the process of using the batch prompt scheduler and the importance of the prompt syntax for generating the desired depth map. The host also discusses the use of the IP adapter for pushing specific images into the depth map and shows examples of generated depth maps, including one using an IP adapter image.

The host selects a prompt from the chat and begins the process of generating a depth map for an animation of a wizard in rainbow robes. He discusses the motion of the wizard and makes adjustments to the motion Laura to achieve the desired effect. The audience is shown how the black and white depth map is created and how it will be used in the second part of the workflow for stylization.

Tyler talks about the iterative process of generating depth maps, emphasizing the need to randomize seeds and rerun generations until a satisfactory result is achieved. He also discusses the second workflow, which applies style to the depth maps using Anime Diff. The host shows how to use the depth control net and control net to smooth out animations and mentions the possibility of using an IP adapter to stylize the depth map.

The host shares his excitement about the potential of using depth maps for creative projects like music visualizations. He takes prompts from the audience for bug-themed animations and discusses the use of different models and motion Lauras to achieve varied effects. The stream features experiments with insect-like imagery and motion, aiming to create unique and compelling animations.

Tyler addresses a question about creating image products and video animations without affecting the original. He refers viewers to a previous stream for answers. The host also discusses the VRAM usage during the workflow and reassures that the process is suitable for systems with as little as 8GB of VRAM. Community interaction continues with the audience providing prompts and sharing their creations.

The host talks about combining different images to create unique animations using the IP adapter. He demonstrates how even simple depth maps can be transformed into interesting visuals with the right image input. The stream showcases the process of combining various prompts and images to generate distinct and engaging animations.

Tyler discusses the process of upscaling the animations and preparing them for final use. He also talks about a future guest, Spence, who will join the stream to demonstrate how to create audio-reactive visuals using Comfy UI and other tools. The host expresses excitement about the upcoming stream and encourages viewers to attend.

The host provides links to the workflows and encourages the audience to download and experiment with them. He shares his enthusiasm for the creative potential of the tools and invites viewers to share their creations on the Civi Tai website and Machine Delusions' model page. Tyler also addresses a technical issue with loading a workflow image and provides a solution.

In the final part of the stream, Tyler thanks the audience for joining and recaps the activities. He highlights a creepy bug-themed animation as a memorable way to end the session. The host also promotes the next stream featuring guest creator Spence and encourages viewers to follow along for an inspiring and educational experience.