Inpainting in Midjourney: A Deep Dive, Secret Commands & Tips for the Long Awaited Feature!

Theoretically Media
22 Aug 202313:58

TLDRIn this video, the presenter introduces the new inpainting feature in Midjourney, a tool for image editing that allows users to restore or modify parts of an image. The feature is powerful and fun to use, though it has some limitations. The presenter discusses how inpainting can be used to correct issues like extra limbs in images and how it can be combined with zooming out for better results. They also explore the use of the 'very region' button, the importance of having 'remix mode' turned on, and the potential for mistakes like double limbs. The video provides a detailed guide on how to use the inpainting tool effectively, including tips on selecting areas and issuing prompts for specific changes. The presenter shares their experiments with inpainting, demonstrating how it can be used to change character details, emotions, and add props to images. They also highlight the tool's ability to work with different styles and aspects, and discuss various commands that can be used with inpainting. The video concludes with an invitation for viewers to share their thoughts and any tips or tricks they've discovered while using the inpainting feature.

Takeaways

  • 🎨 **Inpainting Feature**: Midjourney has introduced a new feature called inpainting, which allows users to restore or modify parts of images without additional input.
  • 🖌️ **Technique Overview**: Inpainting is traditionally used for restoring artwork but is now being utilized in a digital context to edit images by highlighting areas for re-imagination.
  • ✋ **Extra Fingers Problem**: The feature helps to eliminate common image generation issues like extra fingers or limbs in a more controlled manner.
  • 🔍 **Region Selection**: Users can select specific areas of the canvas for inpainting using the 'Very Region' button, which is a powerful tool for targeted edits.
  • 📈 **Remix Mode**: To access specific inpainting features, users need to enable 'Remix Mode' in the settings, which allows for more control over the generated content.
  • 📐 **Free Draw Tool**: The free draw tool is used for selecting areas to be inpainted, although it can be a bit finicky and may require practice to use effectively.
  • 🔄 **Undo Function**: An undo feature is available to correct mistakes made during the inpainting process, providing flexibility and ease of use.
  • 📷 **Image Size Considerations**: Inpainting works best with upscaled images and covers regions of 20 to 50 percent of the image, although smaller areas can also yield good results.
  • 🔍 **Zooming and Panning**: Inpainting works well when combined with zooming out, but it cannot be used after panning, which might be a temporary limitation.
  • 🧞‍♂️ **Character Changes**: The feature can be used to change character details such as ethnicity, emotions, and props, offering a high degree of customization.
  • 🚫 **Limitations**: There are instances where inpainting may not respond as expected, but users can employ techniques like the 'slider method' to achieve desired results.
  • 🛠️ **Commands and Tools**: Various commands like 'chaos', 'stylize', 'style', and 'weird' can be used to influence the inpainting process, although some have limitations or unintended effects.

Q & A

  • What is inpainting in the context of the video?

    -Inpainting refers to the technique of restoring damaged or deteriorated parts of images or video. In the context of the video, it involves highlighting an area of an image and re-prompting within that area to allow the AI to reimagine the scene without additional user input.

  • What is the 'very region' button used for in Midjourney?

    -The 'very region' button is used for inpainting in Midjourney. It allows users to select certain areas of the canvas and have Midjourney reimagine it based on contextual clues in the image surrounding the area.

  • What is the recommended region size for inpainting to work best?

    -Midjourney advises that inpainting works best when you cover a region of 20 to 50 percent of your image. However, the video demonstrates that good results can be achieved with much smaller regions as well.

  • How does inpainting work with zooming out?

    -Inpainting works really well when combined with zooming out. However, you cannot perform inpainting after panning, as the current functionality locks you out of the inpainting feature if you have panned the image.

  • What are some limitations of the inpainting feature?

    -Some limitations include the inability to perform inpainting after panning, occasional issues with the free draw tool, and the potential for the AI to ignore user prompts or generate unexpected results.

  • How can you change a subject's ethnicity or add props using inpainting?

    -By using the inpainting module and adjusting the prompt to include desired characteristics or props, such as 'Korean man' or 'holding a red balloon,' the AI can generate images with the subject's ethnicity changed or with additional props.

  • What is the slider method and how is it used in inpainting?

    -The slider method involves issuing a colon colon and then repeating part of your phrase in the prompt. This method can be used to influence the AI to generate the desired outcome when the standard prompt is not producing the expected result.

  • What are some commands that can be used in Midjourney's inpainting feature?

    -Some commands that can be used are 'chaos', 'stylize', 'style', and 'weird'. These commands can be added to the prompt to influence the style or outcome of the inpainted image.

  • How does the 'weird' command affect the inpainting result?

    -The 'weird' command can introduce unexpected and unusual elements into the inpainted image, making the result quite different from the original. It should be used with caution as it can produce very unconventional outcomes.

  • What is the purpose of the 'undo last step' feature in the inpainting module?

    -The 'undo last step' feature allows users to revert the last action taken in the inpainting module, which can be helpful if the result of an inpainting attempt is not as desired or if there are errors that need correction.

  • How does the inpainting feature handle lighting and composition?

    -The inpainting feature does a good job of maintaining the overall lighting and composition of the original image, even when significant changes are made to the subject or objects within the inpainted area.

  • What is the significance of the 'remix mode' in using inpainting?

    -Remix mode is important for accessing specific inpainting features. It allows users to issue prompts for specific changes within the inpainted area, enhancing the control and customization of the inpainting process.

Outlines

00:00

🎨 Introduction to In-Painting Feature

This paragraph introduces the in-painting feature, a highly anticipated tool for image and video restoration. It discusses the technique's origins in artwork restoration and its application in mid-journey image editing. The speaker shares their excitement about the feature's potential, its limitations, and some unique discoveries. The paragraph also explains how in-painting allows users to select areas of an image for the software to reimagine based on contextual clues, and the necessity of having remix mode enabled for specific prompts. An example is given, demonstrating how in-painting can be used to alter a scene within an image.

05:01

🖌️ In-Painting Techniques and Experiments

The second paragraph delves into the practical use of in-painting, discussing the handling of lighting and the ability to make detailed changes such as adding props or changing emotions. It showcases the speaker's experiments with in-painting, including altering a character's pose, ethnicity, and expression. The paragraph also touches on the challenges of using the lasso tool for more complex shapes and the speaker's workaround using the slider method. Additionally, it mentions the successful application of in-painting with different styles and the potential for future updates to enhance the feature.

10:01

🔍 Advanced In-Painting Strategies and Observations

The final paragraph focuses on advanced strategies for in-painting, such as the slider method for overcoming the software's limitations when adding specific elements to an image. It also discusses the use of various commands like 'chaos', 'stylize', 'style', and 'weird' to achieve different effects. The speaker shares their observations on the feature's ability to maintain consistency in lighting and composition, even when significant changes are made to the image. The paragraph concludes with a call to action for viewers to share their thoughts and any tips or tricks they've discovered while using the in-painting feature.

Mindmap

Keywords

💡Inpainting

Inpainting refers to the technique of digitally restoring or filling in missing or damaged parts of images or videos. In the context of the video, it is a feature in the 'mid-journey' that allows users to highlight an area of an image and prompt the system to reimagine that area, correcting issues like extra limbs or changing certain aspects of the image based on contextual clues.

💡Mid-journey

Mid-journey appears to be a software or tool that enables users to edit and create images with advanced features like inpainting. The video discusses how to use inpainting within this tool, suggesting that it is a powerful and recently added feature.

💡Remix mode

Remix mode is a setting within mid-journey that, when enabled, allows users to make specific changes to parts of an image using inpainting. It is an essential feature for accessing the inpainting tool and making targeted modifications to the image.

💡Free draw tool

The free draw tool is a part of the inpainting module in mid-journey that allows users to manually select areas of the image they wish to modify. It is described as being a bit finicky, implying it may require some practice to use effectively.

💡Lasso tool

The lasso tool is another feature within the inpainting module used to make more precise selections for modifications. It is used to 'paint' around an area with a circular motion, allowing for more detailed inpainting adjustments.

💡Zooming out

Zooming out is a technique mentioned in the video that can be used in conjunction with inpainting to achieve better results. It suggests that by providing more context around the area to be inpainted, the software can make more accurate and coherent modifications.

💡Chaos

Chaos, in the context of the video, refers to a command that can be used in mid-journey to introduce random or unexpected elements into the inpainting process. It is one of the sliders that can be adjusted to control the outcome of the image modification.

💡Stylize

Stylize is a command that can be used within mid-journey to apply a specific style or aesthetic to the inpainted area. It is one of the tools that can be used to control the artistic direction of the changes made to the image.

💡Weird

Weird is a command that, when used, results in unusual or unconventional outcomes in the inpainting process. It is mentioned as a tool that can be used for creative exploration but should be used with caution as it can lead to unpredictable results.

💡Niji

Niji seems to be a term used in the video to describe a feature or mode within mid-journey that allows for the creation of images with a certain style or effect. It is mentioned in the context of working with inpainting to create stylized images.

💡Slider method

The slider method is a technique for refining prompts in mid-journey. By repeating part of the phrase with a double colon (::), users can influence the focus of the inpainting feature. It is presented as a workaround to achieve desired outcomes when the software does not respond as expected to a single prompt.

Highlights

Inpainting has arrived as a new feature in Midjourney, allowing users to restore or alter parts of images and videos.

The technique is traditionally used for restoring artwork but is now being applied to digital images in Midjourney.

Inpainting enables users to highlight an area and re-prompt within that area for image reimagining.

The 'Very Region' button is the primary tool used for inpainting in Midjourney.

Inpainting can correct anomalies such as extra fingers in generated images with ease.

The feature works best when covering a region of 20 to 50 percent of the image, but smaller areas can also yield good results.

Inpainting only works with upscaled images and integrates with zooming out for more precise control.

The 'Undo Last Step' feature allows users to correct mistakes made during the inpainting process.

The free draw tool is available for selecting areas to be inpainted, but it can be a bit finicky to use.

Remix mode must be turned on to access specific inpainting prompts for detailed changes.

Inpainting can be used to change ethnicities, emotions, and add props to images.

The slider method can be used to issue commands and achieve desired results when inpainting.

Commands such as 'chaos', 'stylize', 'style', and 'weird' can be used within the inpainting feature for creative effects.

Inpainting can sometimes ignore user prompts, but persistence and experimentation can lead to the desired outcome.

The feature is powerful for recontextualizing subjects while maintaining the original background.

Inpainting works with niji, allowing for dynamic and creative image transformations.

The presenter, Tim, showcases the inpainting process through various examples, demonstrating its capabilities and limitations.

The PDF of the presentation is available for free on Gumroad, with donations appreciated.