Set up a face tracking project

Add a face texture

Add accessories to your filter

Add animations to your filter

Add particle effects to your filter

Add post-processing to your filter

Submission: Ice cream company filter

Learn how to create a custom face filter app with fun textures, 3D models, particles, and effects. In the challenge, design a themed filter for an ice cream company.

Develop AR experiences that use trackable targets in the environment

Absolute Beginner AR Development

Evaluate platform capabilities and limitations in order to determine whether or not a given feature will work.

Absolute Beginner AR Design

In this mission you'll create your own custom face filter app that includes a wide variety of digital content. The face filter will include interesting textures, animated 3D models, dynamic particles, and post-processing effects. You'll also complete a challenge where you design a custom filter for an ice cream shop.

Create a basic face filter

Mobile AR Development

Mobile AR Development - Unity Learn

Ready to create AR experiences? In this learning pathway, you’ll develop AR apps compatible with iOS and Android devices!

Research future AR use cases to prepare for developing new kinds of applications

Create basic application interactions with Visual Scripting

Absolute Beginner Visual Scripting

Welcome to AR Development! In this learning Pathway, you'll create Augmented Reality (AR) applications that are compatible with iOS and Android devices. You’ll use Visual Scripting and Unity’s AR tools to develop a wide variety of engaging AR experiences. This pathway assumes a basic knowledge of Unity.

Welcome to AR Development 

Configure your AR development environment

Deploy your project to iOS or Android

Welcome to AR Development Quiz

Welcome to AR Development

Get ready for AR development: explore the field, hear from experts, install essential software, set up a Unity project, and deploy a test project to your mobile device.

In these tutorials, you'll get ready for AR development. First, you'll learn about the field of AR and hear from established creators in the AR industry. Next, you'll download all required software to get started and configure a Unity project for AR development. Finally, you'll deploy a test project to your mobile device to make sure everything is working as it should.

Get started with AR

Build a new scene with glasses

 Set up the UI

Create a visual script to detect a button press

Turn on the glasses with buttons

Update your graph to switch between glasses

Configure one color button

Complete the color switching functionality

Save and load the glasses

Submission: Ocean-themed face filter

Create with AR: Face Filters Quiz

Set up the UI

Expand on what you’ve learned with filters that add interactive elements. You’ll create an app for customizing and trying on glasses, then an ocean-themed face filter.

Now that you’ve created a basic face filter, you’re ready to develop your skills and work on a filter that involves interactivity. In this project, you will create your own interactive app that allows a user to select, customize, and visualize different pairs of glasses on their face.You will also complete a challenge where you design an interactive underwater scuba filter for an aquarium.

Create an interactive face filter

Create a new project for marker-based AR

Spawn an object on an AR Marker

Add a UI with rotation buttons

Add world space UI to your marker-based app

Add spatial audio to your marker-based app

Submission: Bring art to life with AR

Learn to create marker-based AR apps, which make digital models appear over marker images in the real world. In the challenge, you’ll breathe life into a 2D work of art.

Beginner Mobile Optimization

 app is an application that can recognize images (called markers) in the real world and then make content appear in the app. You may have seen applications that use this kind of technology to make AR content for movie posters, product labels, card games, and even business cards.

In this project, you’ll make a marker-based app with a user interface that lets the user control a 3D model, text, and audio.

Create a marker-based AR app

Set up a scene with plane detection

Detect the user’s touch

Detect when the user touches a plane

Instantiate the portal on a plane

Test the frame rate of the portal world

Limit the visibility of the portal world

Submission: AR friend

Create with AR: markers and planes Quiz

Make an app that detects flat surfaces and allows the user to spawn a portal on their floor or wall. Then complete a challenge to create an interactive character app.

In this project, you’ll create an AR app that makes use of plane detection technology. iOS and Android devices have the ability to detect flat surfaces — or planes — in your physical environment. This includes horizontal planes like the floor or a table, and vertical planes like the walls. 

You will create an app where the user will be able to tap on a plane in order to place a portal onto it. This portal will be a window into a virtual 3D environment that the user can peer into and explore. 

You will also complete a challenge where you design an app that allows the user to place a character on a table and interact with it.

Create a plane detection AR app

UFO project overview

Explore the Unity project

Begin the AR port

Selecting an orientation for your AR game

Enable the play area

Develop the AR UFO movement

Develop the AR UFO abduction action

Other AR considerations

Design your own AR app

In this Mission, you’ll port an existing desktop game to mobile and redesign it to be a fully functioning (and fun!) AR experience.

In this learning experience, you’ll port an existing desktop game to mobile and redesign it to be a fully functioning (and fun!) AR experience. You’ll conduct research, create a design document, modify visual scripts, and regularly playtest your app. At the conclusion of this project, you’ll also design and create your own fully realized AR application.

AR experience design

7aeb5ddd-819c-4c9e-861e-7c5390ac4ef5:6be16d818ddf

Overview

Explore the 3D accessories

Attach an accessory to the face tracker

Build and test

Tips on using your own assets 

Import FBX files

More things to try

Next steps

Zu-UnityLearn

Desarrollo de AR para novatos

Hammad_N

1A-3.3_add-face-ref-to-default-face.mp4

add accesories to your filter 3.4.mp4

1A3MediumMoreToTry (1).mp4

When you’re tracking the user’s face, you're also effectively tracking the position and rotation of their head. This allows you to add 3D models on and around the user’s head, like a halo or funny glasses!

In this tutorial you'll do the following: 

Place the 3D accessories, using the Face Reference Mesh as a reference.

Learn about the basics of mesh optimization and working with custom assets.

Games

Build AR projects to mobile devices

 Crear proyectos de AR en dispositivos móviles.

robinmitra

Desarrollar experiencias de AR con objetivos que se puedan rastrear en el entorno.

So far you’ve added a 2D texture to your app, but AR filters can do more. In this tutorial you’ll do the following:

Place the 3D accessories, using the Face Reference Mesh as a reference. 

Learn about the basics of mesh optimization and working with FBX custom assets.

By the end of this tutorial, you’ll be ready to start making your own 3D face filters. 

The package you downloaded for this project contains pre-made accessories that you can add to your scene. In the Project window, go to Assets > _BasicFaceFilter > Prefabs and take some time to explore the provided models. 

The Prefabs folder is shown in the Project window. 

Before you attach one of these 3D accessories to the face tracker, you need to add a visible face reference to your AR Default Face to help you place it properly.

Follow the below instructions to add a face reference: 

1.  In the Project window, make sure that you're in the Prefabs folder. 

2.  Double-click the AR Default Face prefab in the folder to open the prefab in the Scene view.

3.  Drag the Face_Reference_Mesh prefab from the Project window into the Hierarchy window to act as a reference. To zoom in on the Face_Reference_Mesh, double-click it in the Hierarchy window.

4.  Drag one of the provided accessories onto the AR Default Face GameObject in the Hierarchy window.

This will add the accessory to the prefab as a child of the GameObject. 

5.  Use the Transform tools to place your chosen accessory in the correct position. You can also adjust the rotation and scale if necessary. 

Note: If you need to refresh your memory, you can review the Transform tools and their shortcuts.

6.  In the Inspector window, disable the Face_Reference_Mesh GameObject.

7.  In the Hierarchy window, select the back arrow in the top left of the window to exit prefab editing mode.

A hat prefab object is highlighted in the Project window. An arrow indicates this object should be moved from the Project window into the Hierarchy window, then onto the AR Default Face GameObject.

The AR Default Face GameObject is shown in prefab editing mode. A top hat is being positioned on top of a green face mesh. 

The Face_Reference_Mesh GameObject is highlighted in the Hierarchy window. In the Inspector window, the checkbox next to the GameObject’s name is disabled, making the GameObject inactive.

The AR Default Face prefab is shown in the Hierarchy window with the back arrow that exits prefab editing mode highlighted.

When you build your application now, the accessory you added should appear in the correct position on your face. This may take some trial and error. If you’re not happy with the position of the accessory, open the prefab again to make further adjustments.

Follow the below instructions to build and test your app:

2.  Open the Build Settings window (File > Build Settings).  

3.  Make sure that your device is plugged in and then select Build and Run to build the app onto your device. 

4. The application will open automatically on your device. 

When a face is detected, the application should display the accessory you added (though it may not be in the perfect position).

Note: For a reminder of how to build to your device, you can review the process for Android or iOS.

Since AR typically runs on mobile hardware, it’s critical to create and use optimized assets for your applications. Optimization is a complicated topic, and there are many ways to optimize experiences.

Mesh optimization is one of the most important ways you can ensure better performance in your games and apps. The mesh for every model in a game or application (like the accessory that you just added to your AR app) is made up of polygons. The number of polygons in your game assets influences the performance of your game. High polycounts require a lot of real-time calculations and management, leading to a drop in frame rate. 

For mobile hardware, keeping the polycount between 300 and 1500 polygons per mesh will yield good results, whereas for desktop platforms the ideal range is 1500 to 4000 polygons. Keep in mind that these are only general recommendations. The overall polycount in the scene is also critical, meaning a scene with lots of characters would need to use even lower polycount models.

If you want to know more about mesh optimization, you can explore the following resources:

Arm & Unity Presents: 3D Art Optimization for Mobile Applications, which is an intermediate course for mobile development.

Unity’s documentation on normal maps, which you can use to give low-poly models high-poly details.

If you create your own assets and export them to Unity in FBX format, the materials and textures are usually embedded in the model during the export process by the modeling application, such as Blender or Maya.  When you import these models into Unity, the materials and textures will often not be visible and the model will only display in gray.

To fix this, you need to extract the embedded materials and textures after you have imported the model:

1.  In the Project window, navigate to the Assets folder and select the imported FBX model.

2.  In the Inspector window, select the Materials tab.

3.  Select Extract textures and choose the folder where the texture will be saved.

4.  Select Extract materials and choose the folder where the materials will be saved.

The Materials tab for an FBX model is shown in the Inspector window. 

If you want to further develop your skills, explore new concepts, or improve your project, check out some of the optional activities below. Each one is tagged as either Easy or Difficult, so you can choose the level of challenge. 

These activities are entirely optional, so if you’re not interested, no problem — just skip this step. We do recommend attempting at least one of them in order to get the most out of this learning experience. Good luck!

Easy: Import accessories from the Asset Store

The Unity Asset Store has many different kinds of assets you can use in your applications. Remember to use low-poly models for your app to ensure good performance on mobile devices. The Hats pack - 3D Microgames Add-Ons from Unity is a great asset package to start with! 

Find low-poly assets in the Unity Asset Store.

Add the accessory model or prefab to your app using the process that you followed earlier in this tutorial.

There are many ways to create your own 3D accessories both inside of Unity and with third-party applications like Blender, 3dsMax, or Maya. In Unity, you can use combinations of primitive shapes that share an empty parent, like cubes, spheres, and capsules, to create new looks and objects. You can also use Unity tools like ProBuilder to create more complex shapes inside of the Editor.  

When you’re ready to create your own 3D masterpiece, remember to use the Face Reference Mesh as a reference for the placement, rotation, and scale of your own 3D accessories. 

In this tutorial you learned how to add additional 3D accessories to a face filter. In the next tutorial, you'll make things even more exciting with special effects!

Add accessories to your filter

1. Overview

2. Explore the 3D accessories

3. Attach an accessory to the face tracker

4. Build and test

5. Tips on using your own assets

6. Import FBX files

7. More things to try

8. Next steps

Complete this tutorial