* This blog post is a summary of this video.

Creating Playable 3D Characters from AI-Generated Text Prompts

Table of Contents

Introduction to AI-Powered 3D Character Creation

Understanding the AI Tool Genie by Luma AI

In the realm of 3D modeling, artificial intelligence has taken a significant leap forward with the introduction of Genie by Luma AI. This AI tool revolutionizes the process of creating 3D characters by transforming text prompts into tangible 3D models. The tool's integration with Discord makes it accessible and user-friendly, allowing creators to generate a variety of models based on their textual descriptions. Genie's capabilities extend beyond mere model generation. It also offers a refining function, which enhances the quality and detail of the generated models. This feature is particularly useful for achieving a higher resolution, such as 4K, and for fine-tuning the textures to meet specific design requirements.

Setting Up Discord for Genie Access

To utilize Genie, a Discord account is mandatory. Once you have set up your account, you can follow the instructions provided by Luma AI to understand the types of prompts you can request. The process is straightforward: you start by typing 'slash Genie' followed by a description of the 3D model you wish to create. For instance, if you want a 'long-legged astronaut rabbit' in a 'cute style,' you would include these details in your prompt. Additionally, specifying the desired texture resolution, such as 4K, will guide Genie in generating a model that meets your visual expectations.

Crafting a 3D Model from Text Prompts

Entering the Prompt and Generating 3D Models

After entering the prompt, Genie processes the request and presents you with a selection of 3D model options. These initial models are low-quality previews, but they serve as a starting point for further refinement. If none of the initial models meet your criteria, you can request additional sets of models or adjust your prompt to refine the search until you find a suitable candidate.

Evaluating and Refining the Generated Models

Once a potential model is identified, you can request a more detailed version of the model. This refining process can take up to 20 minutes, depending on the queue of other user requests. During this time, Genie works on creating a high-resolution, detailed model that aligns with your specifications. The 3D viewer allows you to examine the model closely, rotate it, and even adjust material properties like roughness and metalness, although these settings will need to be reapplied later in the process.

Preparing the Model for Game Integration

Converting GLP to FBX Format in Blender

The default format for Genie-generated models is GLP, which needs to be converted to FBX for compatibility with most game engines. Blender, a versatile 3D modeling software, is the tool of choice for this conversion. In Blender, you can also make minor adjustments to the model, such as aligning and scaling it to ensure the origin is at the character's feet and rotating the model for better alignment in the game engine.

Adjusting Model Position and Scaling

Proper positioning and scaling are crucial for the model's integration into the game. The origin point should be set at the character's feet to ensure correct movement and interaction within the game environment. Additionally, the model's texture should be saved as a separate image file, as GLB models can include textures within the model, which may not be clearly defined when exporting to FBX format.

Rigging the 3D Character

Using Accurate Rigging Software

Rigging is the process of creating a skeleton for the 3D model, which allows for animation and movement. Accurate Rigging Software, available for free on the Real Luen website, is an effective tool for this task. The software guides you through the rigging process, starting with defining the center line and limb locations, and then moving on to setting joint points and defining the bends and joints of the character.

Defining Joints and Limbs

The rigging process involves determining the number of fingers and other fine details of the character's anatomy. For characters without distinct fingers, this value can be set to zero. After processing, Accurate Rigging Software automatically rigs the character, allowing you to test its movements with various motion capture files. Once satisfied, the rigged character can be exported in the correct format for integration into the game engine.

Importing and Configuring the Character in Unreal Engine

Setting Up the Project and Importing the FBX File

With the rigged character ready, the next step is to import it into Unreal Engine. Starting a new project with a third-person game template, you can create a new folder for your character under the content directory. Dragging the FBX file into Unreal Engine, it's essential to set the correct skeleton for the character to obey, which is typically the older 'Mannequin' model inherited from previous Unreal Engine versions.

Retargeting Animation Assets

To make the character playable, you need to connect its skeleton structure to an existing Unreal Engine skeleton. This is done through the 'Retarget Animation Assets' feature, which allows you to duplicate and retarget animation assets. By choosing the correct IK retargeter and selecting your rabbit character as the target, Unreal Engine can place all the retarget movements in the correct place, completing the integration process.

Making the Character Playable

Replacing the Default Character

With the character integrated, it's time to replace the default character in the game. This is done by navigating to the third-person folder, selecting blueprints, and changing the default character to your astronaut rabbit. This process ensures that the new character is ready for gameplay, with all the necessary animations and movements in place.

Testing the Playable Character

The final step is to test the playable character. By hitting the play button, you can see your AI-generated character come to life, running, jumping, and interacting within the Unreal Engine. This testing phase is crucial for ensuring that the character behaves as expected and that all animations are correctly applied.

Conclusion and Future of AI in 3D Modeling

The Potential of AI in Automating 3D Modeling

The process of creating a playable character from a text prompt using AI demonstrates the potential of automation in 3D modeling. The integration of AI tools like Genie can significantly streamline the creation process, reducing the need for manual labor and allowing creators to focus on the artistic aspects of their work.

Alternative Rigging Solutions

While Accurate Rigging Software is a powerful tool, there are alternative solutions available, such as Mixamo, which offers a similar rigging process directly in a web browser. This accessibility makes it a viable option for users on different operating systems, further expanding the reach of AI in 3D character creation.

FAQ

Q: What is the AI tool Genie used for?
A: Genie by Luma AI is used to generate 3D models from text prompts.

Q: How do you access Genie?
A: You need a Discord account to access Genie through its dedicated channels.

Q: What format does Genie generate 3D models in?
A: Genie generates 3D models in GLP format by default.

Q: Why is Blender used in the process?
A: Blender is used to convert the GLP format to FBX and make minor adjustments to the model.

Q: What is Acurate used for?
A: Acurate is a character rigging application used to prepare the 3D model for animation.

Q: How do you import the rigged character into Unreal Engine?
A: You import the FBX file into Unreal Engine and set the correct skeleton for the character.

Q: What is the purpose of retargeting animation assets?
A: Retargeting animation assets allows the character's skeleton to match the game engine's requirements.

Q: How do you make the character playable in Unreal Engine?
A: You replace the default character with the imported one and configure the animation class.

Q: Is there an alternative to Acurate for rigging?
A: Yes, Mixamo is a web-based service that can be used for rigging characters across different operating systems.

Q: What does the future hold for AI in 3D modeling?
A: AI is expected to further automate the 3D modeling process, making it more efficient and accessible.

PreNext