All content in this course uses:

Generate textures with Muse 

Muse’s texture capability is an asset generator for Unity that helps you create textures and materials for 2D and 3D GameObjects without coding or searching for texture map files. It creates textures and materials based on your natural-language prompts and reference images. 

In this tutorial, you will learn to do the following:

Generate a texture image using prompts in Muse.

View a texture using physically-based rendering (PBR) in Muse.

Add a material from Muse to your Unity project.

Overview

, and have that project open in the Unity Editor.

In the Unity Editor, go to the main menu and open 

. If you don't see that option, then you need to install the Muse Texture package, following one of these methods:

Before you begin

are 2D images (sometimes referred to as sprites) that wrap around 3D objects to create variations in color, reflectivity, physical texture, and other properties. For example, you can use textures to turn a plain cube into a block of bricks, a corroded piece of iron, or a Rubik's cube. 

are assets that allow you to change the way an object appears. They let you specify various options that tell Unity how to render 3D objects. Several of the options you can control in materials are textures that can make an object colored, bumpy, shiny, or even transparent.  

Muse Texture generates textures for your 3D objects and then lets you add those textures as materials in your Unity projects.

To learn more about textures and materials, try the 

Unlike a sprite, which can be an image of anything, a texture is an image that creates an effect on the surface of a 3D object. Think of surface effects such as grass, marble, gold, tree bark, or fur. 

In your prototype, you're going to make the rock you've selected in the garden scene into a magic rock. Start thinking of a texture you can apply to this rock that will make it stand out when your players are searching for treasure.

What are textures and materials?

To start generating some textures, follow these instructions:

.  To open a new Generator window, go to the main menu and select 

  Set the number of images you wish to generate. By default, Muse will generate four (4) textures. If you want a different number of images, change the value.

 box. Your prompt should be descriptive but concise. In this example, we are going to generate an obsidian stone texture.

: The negative prompt box allows you to enter specific features you do 

 Experiment with different prompts until you find a result you are happy with. Here are some examples of the textures generated for the obsidian stone prompt.

 If you have existing textures from which you want to base your new textures, you can drag them into the 

 area to serve as a guide for your generated textures.

Generate some rock textures

Once you are happy with the result, Muse can generate materials made of several maps that are typical of game assets. Each 

is an image that represents one aspect of a 3D surface. In a 3D scene, these maps will reflect or absorb light according to the lighting in your scene.

To view the maps that go into a material for one of your generated textures, follow these instructions:

(pencil icon) option, which will bring up the 

button to view this image as a material, and generate the maps that make up the material.

You'll see the sphere preview of the material, with lighting applied. Click and drag your cursor to rotate the material and see how all the maps, together, create a 3D effect.

, you can also see previews of the maps that make up the texture.

: scattering (roughness) or focusing (smoothness) of reflected light.

: blocking ambient light to create additional shadows. 

If you're familiar with materials and their properties, you can adjust some of those properties before you generate the final material.

: Increase or decrease the tiling to adjust the scale of the material.

 Adjust this value to move the position of the material.

 Adjust this value to rotate the material.

 Mirror the material on the vertical plane.

 Mirror the material on the horizontal plane.

 Switch displacement on or off. Displacement shows the effect of the Height map by displacing the geometry.

Preview and adjust the material parameters

  To bring the material into your project, drag the material preview from the 

 window, the material will be automatically named based on your prompt. 

 Another method is to right-click the material preview and select 

  In the Hierarchy, search for and select the 

 on the keyboard to center the view on the selected GameObject.

  To apply your material, drag it from the 

 view, and the GameObject will immediately take on your new surface attributes!

Add the generated material to a GameObject

Muse Texture Generator also gives you the option to use Canny images or patterns to generate your textures. 

, Muse will use it as a template to create the texture. This approach provides you with more precise control over the materials you produce.

 is a black-and-white image that has been processed to highlight the edges of objects. If you use a Canny image or one of the patterns provided by Muse, the resulting texture will use the lines as a guide for the image. If you use your own Canny image, make sure that it is tileable with crisp lines.

Below you can see a brick texture generated from a sample brick pattern.

 give you fine-grained control over the generation process. In the following steps, you'll generate a stone block texture to replace the current texture on the stone steps in the garden scene.

 section is set to use a color reference. In the 

. In this example, we used "Stone blocks."

 to generate textures. The number of textures you specified will dictate how many will be generated.

  Select a texture you like, then follow the same steps as in the previous step to add the texture to your project as a material.

 Navigate to the stone steps in front of the main doors into the courtyard. Alternatively, you can select the 

Generate textures with Canny images or Patterns

Now you know the basic features of Muse's texture generator and you can easily create many materials for 3D GameObjects! In the next tutorial, you'll generate sprites with Muse to change visual features in the scene.

Unity Version 2022.3