Character and Product Consistency on Midjourney

zero1cine
12 Mar 202415:40

TLDRThe video introduces a new feature, Character Reference (D-C ref), for maintaining character consistency across generations in Mid Journey. Users can input an image URL, which can be a selfie or any image found online, to influence the character's traits. The reference strength (CW) can be adjusted from 100 to zero, affecting how closely the generated character resembles the reference image. The feature works best with characters made from Journey images and can be combined with Style (SRE) to apply any desired style. Experiments with non-human subjects like animals and robots show varying results, and the video also explores the use of multiple character references and different styles, demonstrating the flexibility and potential of this tool for creative expression.

Takeaways

  • 📝 Character reference (D-C ref) allows maintaining consistency across character generations in mid-journey.
  • 🔗 To use character reference, type 'D-C ref', a space, and paste the URL of the image, which can be from any source.
  • 🎨 D-CW (Character Weight) can modify the reference strength from 100 (strong resemblance) to 0 (only facial features).
  • 👥 D-C ref is best for characters made with Journey images and not designed for real people photos.
  • 🔍 The precision of D-C ref is limited; it won't copy intricate details like text or logos.
  • 🤖 Both mid-journey models and SRE (Style Remix Edit) can be used in conjunction with D-C ref for varied styles.
  • 🐦 D-C ref can be applied to non-human subjects like animals and robots, though with varying degrees of accuracy.
  • 🌟 Experimenting with different CW values can yield different ages or styles for the same character.
  • 👫 Multiple characters can be included in a scene, but the system may struggle with more than two, merging their features.
  • 💃 D-C ref can also be used to create consistency in characters across different styles and scenarios.
  • 💡 For products, D-C ref can influence the design, though it may require more adjustment to achieve the desired result.
  • 🤳 Self-portraits can be used as references for character generation, but the results may not be photo-realistic.

Q & A

  • What is the purpose of using a character reference in Mid Journey?

    -The purpose of using a character reference in Mid Journey is to maintain the consistency of characters across generations. It allows users to input an image URL and have the AI model focus specifically on the character traits, ensuring that the generated images retain the desired features.

  • How does the D-C ref command work in Mid Journey?

    -The D-C ref command works by typing 'D-C ref' followed by a space and then pasting the URL of the image you want to use as a reference. This can be an image generated inside Mid Journey or any other image URL. The command helps to focus the AI on the character traits of the image provided.

  • What is the role of the D-CW parameter in character reference?

    -The D-CW parameter is used to modify the reference strength of the character reference image. It can be adjusted from 100 to zero, with 100 making the generated image look very similar to the character in the reference, and zero making it look more like the facial features but with less resemblance to the original character's overall appearance.

  • Is the character reference feature designed for real people photos?

    -The character reference feature is primarily designed for use with characters made from Mid Journey images. It is not specifically designed for real people photos, but it can still be used with them, albeit with some limitations.

  • Can character reference be combined with style transfer in Mid Journey?

    -Yes, character reference can be combined with style transfer in Mid Journey. This allows users to apply any desired style to the character while maintaining the character traits from the reference image.

  • What happens when using character reference with more than two characters?

    -Using character reference with more than two characters can lead to confusion, as the AI may start merging the characters together. The performance tends to decrease when trying to include three or more characters in the same scene.

  • How does changing the CW value affect the generated image?

    -Changing the CW value affects the level of detail and similarity to the character reference. Lower values like 20 will bring the facial expression and style of hair but may start to change other aspects too much. Higher values like 100 will retain more specific traits like tattoos and small details, making the generated image very similar to the reference.

  • Can character reference be used with different styles?

    -Yes, character reference can be used with different styles. The script demonstrates using the same character in a photorealistic style, an illustrated style, and even a Disney-Pixar character style, showing that the consistency of the character can be maintained across various artistic interpretations.

  • How does character reference work with non-human subjects like animals or robots?

    -Character reference can be applied to non-human subjects as well. The script shows examples of using a European bird and a robot design as references. While there might be some discrepancies in small features, the overall character traits are preserved, demonstrating the versatility of the feature.

  • Can character reference be used for products?

    -Yes, character reference can be used for products. The script provides an example of using a perfume bottle as a reference, showing that the AI can pick up on certain aspects like roundness and apply them to the generated product image, although it may require some adjustment of values for the best result.

  • What was the outcome when the user tried to use their own selfie as a character reference in Mid Journey?

    -When the user tried to use their own selfie as a character reference with a CW value of 70, the generated image was not an exact replica but rather a version that looked similar to the user. The AI took the general traits but did not produce a photorealistic version, indicating that the feature may work better with fictional characters or images generated within Mid Journey.

Outlines

00:00

🎨 Introducing Character Reference in MidJourney

This paragraph introduces the concept of character reference in MidJourney, a tool designed to maintain consistency across character generations. It explains the process of using character reference by typing 'D-C ref' followed by the image URL, which can be from within MidJourney or any other source. The reference strength can be modified using 'D-CW' with values from 100 to zero, affecting the likeness of the character. The precision is limited, and it works best with characters made from Journey images, not real people photos. The paragraph also explores the application of character reference with different types of images, such as animals and robots, and demonstrates how it can be used to create variations of a character while maintaining certain traits.

05:00

🌟 Exploring Style and Character Consistency

This section delves into the exploration of character consistency across different styles. It discusses how the character's style does not need to match the image style, providing examples of the same character in various styles like Disney-Pixar and photorealistic. The paragraph also highlights the impact of changing CW values on the character's appearance, showing how different values can alter the character's age or features. It further explores the possibility of including multiple characters in a scene and the challenges associated with it, concluding that the current limit seems to be two characters before the AI starts merging them.

10:01

🎭 Testing Character Reference with Diverse Scenarios

This paragraph presents a series of tests with character reference in diverse scenarios, including the use of normal Journey work on nii, the effect of different CW values on character merging, and the application of character reference to products. It discusses the successful use of character reference in creating images with consistent character traits, even when the style or setup is drastically different. The paragraph also touches on the limitations when trying to include more than two characters in a scene and suggests a workaround for creating characters in a scene with three or more characters.

15:04

🚀 Final Thoughts and Future Applications

In the concluding paragraph, the speaker shares their personal experience with character reference, including testing it with their own selfie and exploring its application to products. The speaker emphasizes the potential of character reference in creating consistent characters and looks forward to seeing how others will utilize this tool to create amazing and consistent works. The paragraph also suggests that while character reference may require some fine-tuning and playing with values, it is a powerful tool for maintaining character consistency in MidJourney.

Mindmap

Keywords

💡Character Reference

Character Reference is a feature that allows users to maintain consistency in the appearance of their characters across different generations or iterations within an AI-based art generation platform. It is used by typing 'D-C ref' followed by a space and pasting the URL of an image, which can be a selfie, an image from the internet, or one generated within the platform. The reference image helps the AI focus on specific character traits, ensuring that the generated images retain the desired features.

💡Reference Strength (CW)

Reference Strength, denoted as 'CW' in the script, is a parameter that users can adjust to control the influence of the character reference image on the generated artwork. The strength can be set from 100 to zero, with 100 meaning the generated image will closely resemble the reference, and zero allowing for more creative freedom while still retaining some facial features. This flexibility allows users to balance between consistency and variety in their character designs.

💡M Journey

M Journey refers to the mid-journey phase of an AI art generation process, where users can refine and develop their characters further. It is a stage where character references and style adjustments become particularly important to achieve the desired aesthetic and consistency in character design.

💡Style Transfer (SRE)

Style Transfer, or 'SRE' as mentioned in the script, is a technique that allows users to apply a specific artistic style to their character references. This can range from photorealistic to stylized looks like those from Disney Pixar. The style transfer is applied on top of the character traits, allowing for a unique blend of visual consistency and artistic expression.

💡Non-Human Characters

Non-Human Characters refer to characters that are not human, such as animals or robots. The script discusses the use of character references for non-human entities, demonstrating the versatility of the AI in capturing and applying traits from various types of subjects, not just humans.

💡Alien Creatures

Alien Creatures in the context of the script refer to fictional, extraterrestrial beings that are not recognizable as part of our flora and fauna. The user creates a 3D alien fluffy creature and uses it as a character reference to explore how the AI handles generating images of such unconventional and imaginative subjects.

💡Character Differentiation

Character Differentiation is the process of creating distinct and unique characters within the same generation or across different iterations. It involves manipulating various parameters and references to ensure that each character has a unique set of traits, even when using the same base reference.

💡Multiple Characters

Multiple Characters refer to the inclusion of more than one character in a single generated image. The script explores the challenges and possibilities of using character references for creating scenes with multiple characters, each with their own distinct traits and styles.

💡Aspect Ratio

Aspect Ratio in the context of the script refers to the proportional relationship between the width and height of an image or scene. It is an important consideration when generating images with multiple characters to ensure that each character is clearly visible and that the overall composition is balanced.

💡Products

Products in the script refer to non-character items such as objects or merchandise that users may want to generate or stylize using the AI platform. The user tests the character reference feature with a product, such as a perfume bottle or a car, to see how the AI captures and applies the reference to non-human subjects.

💡Photorealism

Photorealism is an artistic style that aims to create images that are hyper-realistic and indistinguishable from photographs. In the context of the script, photorealism is one of the styles that can be applied to characters using the AI platform, allowing for a high degree of realism in the generated images.

Highlights

Character reference allows maintaining consistency between character generations.

Type 'D-C ref' followed by space and paste the image URL for character reference.

The reference can be an image from Mid Journey or any other image, including selfies or internet finds.

Use 'D-CW' to modify reference strength, with 100 being very similar and 0 focusing on facial features only.

Character reference is best for characters made from Journey images and not designed for real people photos.

It works similarly to regular image prompts but focuses specifically on character traits.

Precision is limited; it won't copy simple frees or shirt logos, for example.

Both MJ models work with character reference and can be combined with SRE for style application.

Character reference can be applied to animals, robots, and even alien creatures for consistency.

Changing styles can be effective with character reference, even in different styles like photorealistic or Disney Pixar.

Multiple characters can be included in a scene, but the system may get confused with more than two characters.

Character reference can also be used for products, requiring some adjustment for the best results.

The aspect ratio should be considered to fit multiple characters in a scene.

For three or more characters, create the first character and then add the others using different styles.

Character reference can be used for different age representations of the same character.

The technique can be used to create consistency in characters across various styles and scenarios.

The character reference feature is a powerful tool for artists and creators to maintain character consistency in their works.