Welcome to AR Development 

Configure your AR development environment

Deploy your project to iOS or Android

Welcome to AR Development Quiz

Welcome to AR Development

test

Get ready for AR development: explore the field, hear from experts, install essential software, set up a Unity project, and deploy a test project to your mobile device.

Research future AR use cases to prepare for developing new kinds of applications

Evaluate platform capabilities and limitations in order to determine whether or not a given feature will work.

Absolute Beginner AR Design

Absolute Beginner AR Development

In these tutorials, you'll get ready for AR development. First, you'll learn about the field of AR and hear from established creators in the AR industry. Next, you'll download all required software to get started and configure a Unity project for AR development. Finally, you'll deploy a test project to your mobile device to make sure everything is working as it should.

Get started with AR

Mobile AR Development

Mobile AR Development - Unity Learn

Ready to create AR experiences? In this learning pathway, you’ll develop AR apps compatible with iOS and Android devices!

Develop AR experiences that use trackable targets in the environment

Create basic application interactions with Visual Scripting

Absolute Beginner Visual Scripting

Welcome to AR Development! In this learning Pathway, you'll create Augmented Reality (AR) applications that are compatible with iOS and Android devices. You’ll use Visual Scripting and Unity’s AR tools to develop a wide variety of engaging AR experiences. This pathway assumes a basic knowledge of Unity.

Set up a face tracking project

Add a face texture

Add accessories to your filter

Add animations to your filter

Add particle effects to your filter

Add post-processing to your filter

Submission: Ice cream company filter

Learn how to create a custom face filter app with fun textures, 3D models, particles, and effects. In the challenge, design a themed filter for an ice cream company.

In this mission you'll create your own custom face filter app that includes a wide variety of digital content. The face filter will include interesting textures, animated 3D models, dynamic particles, and post-processing effects. You'll also complete a challenge where you design a custom filter for an ice cream shop.

Create a basic face filter

Build a new scene with glasses

Set up the UI

Create a visual script to detect a button press

Turn on the glasses with buttons

Update your graph to switch between glasses

Configure one color button

Complete the color switching functionality

Save and load the glasses

Submission: Ocean-themed face filter

Create with AR: Face Filters Quiz

Expand on what you’ve learned with filters that add interactive elements. You’ll create an app for customizing and trying on glasses, then an ocean-themed face filter.

Now that you’ve created a basic face filter, you’re ready to develop your skills and work on a filter that involves interactivity. In this project, you will create your own interactive app that allows a user to select, customize, and visualize different pairs of glasses on their face.You will also complete a challenge where you design an interactive underwater scuba filter for an aquarium.

Create an interactive face filter

Create a new project for marker-based AR

Spawn an object on an AR Marker

Add a UI with rotation buttons

Add world space UI to your marker-based app

Add spatial audio to your marker-based app

Submission: Bring art to life with AR

Learn to create marker-based AR apps, which make digital models appear over marker images in the real world. In the challenge, you’ll breathe life into a 2D work of art.

Beginner Mobile Optimization

 app is an application that can recognize images (called markers) in the real world and then make content appear in the app. You may have seen applications that use this kind of technology to make AR content for movie posters, product labels, card games, and even business cards.

In this project, you’ll make a marker-based app with a user interface that lets the user control a 3D model, text, and audio.

Create a marker-based AR app

Set up a scene with plane detection

Detect the user’s touch

Detect when the user touches a plane

Instantiate the portal on a plane

Test the frame rate of the portal world

Limit the visibility of the portal world

Submission: AR friend

Create with AR: markers and planes Quiz

Make an app that detects flat surfaces and allows the user to spawn a portal on their floor or wall. Then complete a challenge to create an interactive character app.

In this project, you’ll create an AR app that makes use of plane detection technology. iOS and Android devices have the ability to detect flat surfaces — or planes — in your physical environment. This includes horizontal planes like the floor or a table, and vertical planes like the walls. 

You will create an app where the user will be able to tap on a plane in order to place a portal onto it. This portal will be a window into a virtual 3D environment that the user can peer into and explore. 

You will also complete a challenge where you design an app that allows the user to place a character on a table and interact with it.

Create a plane detection AR app

UFO project overview

Explore the Unity project

Begin the AR port

Selecting an orientation for your AR game

Enable the play area

Develop the AR UFO movement

Develop the AR UFO abduction action

Other AR considerations

Design your own AR app

In this Mission, you’ll port an existing desktop game to mobile and redesign it to be a fully functioning (and fun!) AR experience.

In this learning experience, you’ll port an existing desktop game to mobile and redesign it to be a fully functioning (and fun!) AR experience. You’ll conduct research, create a design document, modify visual scripts, and regularly playtest your app. At the conclusion of this project, you’ll also design and create your own fully realized AR application.

AR experience design

73e77abb-8613-4f1f-ac38-f741173f1c0a:f88335b01066

Overview

Before you begin

Determine your target mobile operating system

Download XCode [iOS only]

Install Unity with Android or iOS build modules 

Download and open the AR starter project 

Explore the starter project 

Create a new AR scene

Explore the template scene

More things to try

Next steps

Zu-UnityLearn

0.2.9_Spinning-cube.mp4

AR Reel – Unite Copenhagen

0.3.8_Spinning-cube-test RESIZE.mp4

0.2.10MediumMoreToTry.mp4

0.2.10DifficultMoreToTry.mp4

Developing for AR requires a bit more setup than a typical Unity project because you're working with two separate machines: your computer and your AR device. 

In this tutorial, you'll make sure you have all required software set up on your computer and on your mobile device. Then you’ll open and explore a new Unity project configured specifically for AR development.

Games

Build AR projects to mobile devices

Developing for AR requires a bit more setup than a typical Unity project because you are working with two separate machines: your computer and your AR device. 

In this tutorial, you will make sure you have all required software set up on your computer and on your mobile device. Then you’ll open and explore a new Unity project configured specifically for AR development.

This learning experience assumes that you are already familiar with the Unity Editor. If you’re new to Unity, the Unity Essentials learning pathway has been designed to help you get set up and ready to create in the Unity Editor.

Before you begin to set up your Unity project, consider updating your Unity Hub to the latest release. If you are using an older version of the Hub, there may be differences between the guidance provided here and your experience.

If you need to refresh your memory of the Unity Editor basics, you can take a moment to review Explore the Unity Editor at any time.

Depending on which type of phone you have, the setup process will be different: 

If you have an iPhone or iPad, you will work with Apple’s proprietary operating system: iOS.

If you have any other (non-Apple) phone or tablet, you will likely work with Google’s mobile operating system: Android.

Take note of which operating system you will be using, since this will affect which instructions you follow going forward.

This step is only relevant for iOS development. If you are developing for Android, you can skip this step.

To develop for an iOS handheld device, you need an Apple ID and an app on your Apple computer called XCode. XCode is Apple’s custom Integrated Development Environment (IDE) that allows you to build and test applications for MacOS and iOS.

To install XCode on your Mac computer, complete the following steps:

1.  Make sure you have an Apple ID and that you know your login credentials. If you don’t have an Apple ID, you can create one here. 

2.  Open the App Store app on your Mac computer. 

3.  Search for “XCode”, then select download to begin the download and installation process.

Note: XCode is an extremely large application (over 12 GB), and therefore may take a very long time to download and install. Feel free to continue on to the next step while XCode downloads in the background.

Image showing MacOS app store with “Xcode” being searched. The download button is highlighted.

To follow this course, you will need Unity version 2021.3.1f1 LTS as well as the build module for the platform you’re targeting (iOS or Android). These additional modules will allow you to build applications for your desired platform from Unity.

To install the required version of Unity, complete the following steps:

1.  Install Unity 2021.3.1f LTS. You can find this specific version of Unity in the Unity Download Archive.

Caution: You must use this specific version of Unity, and not the latest 2021.3 LTS release, to successfully complete the projects in this learning experience. 

2.  When prompted to add modules during the installation process, select either Android Build Support along with its sub-modules or iOS Build Support.

Note: If you already had Unity 2021.3.1f1 installed, you can add modules to an existing install.

Unity download window on the Add modules screen. The Android Build Support and iOS Build Support options are highlighted.

After Unity and the appropriate build modules have finished installing, you are ready to open the AR starter project.

To open the project using the Unity Hub, complete the following steps:

1.  Download the AR_Template_Zip file, then double-click it to see its contents.

2.  Locate the AR_Template_Project folder inside the zip folder and move it to a suitable location on your computer.

3.  Rename the AR_Template_Project folder to something more appropriate, like “[your-name]_AR_Project”.

4. Add the Unity project to the Unity Hub and open it. 

If you see a warning icon next to the Editor version of your project, you do not have the correct version of Unity installed. You need to go back to the previous step and install the specific required version of Unity.

The AR project should now be open in Unity. 

Unity hub project list showing the AR Starter Project. A warning icon is highlighted.

This starter project is pre-configured with all the packages and project settings needed for AR development to save you time when you create your first AR project. Let’s examine the project to understand what makes it AR-ready.

Here’s how to explore the packages you’ll need for your AR projects:

1.  From the main menu, select Window > Package Manager.

2.  From the Packages dropdown, select In Project to view only packages currently in this project.

3.  Notice the four packages in this project that are not included in default Unity projects: AR Foundation and XR Plugin Management.

The AR Foundation package provides all of the GameObjects and classes that you need to quickly develop interactive AR experiences in Unity. 

ARCore is Android’s AR framework. AR Foundation communicates with ARCore to get AR features on Android devices.

ARKit is Apple’s AR framework. AR Foundation communicates with ARKit to get AR features on Apple devices.

The XR Plugin Management package is a simple management tool for any platform-specific XR plug-ins, such as ARKit and ARCore.

In Unity, you can use AR Foundation to develop AR features for both iOS and Android. However, these two platforms do not have equal support. If you’re interested, you can learn the specific feature support per platform. Currently, ARKit supports more features than ARCore, including 3D object tracking and body tracking. 

Some Player settings have also been pre-configured for AR development. To browse through the Player settings, complete the following steps: 

1.  Go to the main menu and select Edit > Project Settings.

3.  From the Player settings, choose either the iOS or Android tab, depending on your target.

4.  Locate and scroll through the Other Settings. 

Most of these settings are pretty technical, so you don’t need to understand them completely or remember them at this point. However, if you’re interested, the settings that have been pre-configured for AR development include the following:

Removing the Vulkan Graphics APIs for Android, since these are not yet supported by ARCore.

Setting the minimum API levels for iOS and Android. 

Setting the Scripting Backend to IL2CPP instead of Mono to allow for 64-bit support.

Setting the Target Architecture to ARM64 (64-bit ARM) to meet the Google Play 64-bit requirement.

You can also read more about these default settings in Google’s documentation on setting up an AR project.

Package manager window with the following packages highlighted: AR Foundation, ARCore XR Plugin, ARKit XR Plugin, XR Plugin Management.

Infographic depicting Unity packages involved in building AR apps for iOS and Android. AR Foundation is located at the bottom. There is an arrow from AR Foundation to ARCore and then through to an Android device. There is another arrow from AR Foundation to ARKit and then through to an iOS device.

Project settings window with Player tab open. Android and iOS tabs are highlighted with the Other Settings section expanded.

In addition to providing you with a pre-configured project, we have also provided you with a pre-configured template scene. This will also help you get new AR projects up and running as quickly as possible. 

You’ll now create a new scene using this template and explore it to understand how it’s set up:

1.  From the main menu, select File > New Scene.

2.  From the New Scene window, select the AR Scene Template thumbnail and then select Create. 

3.  A new untitled scene will be created. To save it, select  File > Save As, and in the file explorer window that opens, navigate to the Scenes folder inside your project’s Assets folder. 

4.  Name the scene something like “AR Template Scene” and save it inside the Scenes folder.

You should now have a new copy of the AR template scene open in Scene view.

New scene window with AR project template outlined and with outline of ‘Create’ button. 

AR template scene open in the Scene view with the Hierarchy visible. 

This template scene can serve as a starting point for any AR app you want to create. It displays a spinning cube in the environment.

A typical 3D scene in Unity only has two GameObjects: the Main Camera and a Directional Light. Let’s look at what makes this scene ready for AR development: 

1.  In the Hierarchy, identify the three new unfamiliar GameObjects: the AR Session Origin, the AR Camera, and the AR Session. You will have to expand the foldout to see the AR Camera.

The AR Session Origin represents the device in space. When the user moves or rotates in the real world, the AR Session Origin moves accordingly in the Unity scene. And just like your real device has a camera, the AR Session Origin has the AR Camera GameObject attached to it. 

The AR Camera (a child of AR Session Origin) is the main camera of the AR application and must be set with the tag, MainCamera. It comes with additional components that allow this camera to work for AR, which you can read about in the documentation if you’d like: the AR Pose Driver, the AR Camera Manager, and the AR Camera Background. It is recommended that you delete any other cameras in the scene to avoid conflicts.

The AR Session manages an individual session of the AR experience, including things like frame rate and communication with the device. There can only be one active AR Session in a scene.


2.  Select Play and inspect the GameObjects in the Hierarchy while in Play mode.

3.  Notice the spinning cube centered in the Game view with a black background. This background will be replaced by your real-world environment when it’s running on your device.

4.  Notice the new GameObject named Trackables that appears as a child object of the AR Session Origin. This GameObject will store any objects detected in the real world environment, such as tracked faces, planes, or points. 

5.  While the scene is still running, select the AR Sessions Origin GameObject, then adjust its position and rotation values in the Inspector. Notice the spinning cube appears to move around, but actually it is your simulated device that is moving, just as if you were moving or rotating a handheld device in the real world.

6.  Select Play again to stop the application. Any changes you made to the AR Session Origin’s position and rotation will be reset.

The template project we provided already includes the AR Session and AR Session Origin, but adding these two GameObjects to your own scene from scratch is a simple process. For detailed instructions on setting up an AR scene and more information on each of these objects, check out the AR Foundation documentation.

AR template sene hierarchy view with AR Session Origin and AR session objects selected.

If you want to further develop your skills, explore new concepts, or improve your project, check out some of the optional activities below. Each one is tagged as either Easy, Medium, or Difficult, so you can choose the level of challenge. 

These activities are entirely optional, so if you’re not interested, no problem — just skip this step. 

We do recommend attempting at least one of them in order to get the most out of this learning experience. Good luck!

AR apps can be used for fun, education, marketing, art, and so much more. Sometimes AR is used on mobile devices like phones and sometimes it is used with head-mounted displays (HMDs). As you are starting your AR journey, it can be a great time to check out some of the ways that Unity has been used to make AR experiences in the past. Here are a few more examples of AR apps made with Unity:

Medium: Edit the rotation speed/direction

You can adjust the speed of the rotation for the Cube by finding the SceneTemplate_RotateCube component to make it rotate slower or faster. Remember that if you are testing in the editor before building to your device, none of the changes you make during Play mode will be saved! 

Difficult: Replace cube with another primitive

It’s time to think outside the box. Replace the cube included in the scene for another type of primitive 3D shape. If you would like the object to rotate like the cube did, remember to add the SceneTemplate_RotateCube script and then change the Rotation Speed and Object Rotation values. 

In this tutorial, you configured your computer, your mobile device, and your Unity project to prepare for AR development. In the next tutorial, you will actually build this project to either your iOS or Android device and test it out! This will ensure your AR Dev environment is set up and working perfectly before you begin designing your own AR apps.

Configure your AR development environment

1. Overview

2. Before you begin

3. Determine your target mobile operating system

4. Download XCode [iOS only]

5. Install Unity with Android or iOS build modules

6. Download and open the AR starter project

7. Explore the starter project

8. Create a new AR scene

9. Explore the template scene

10. More things to try

11. Next steps

Complete this tutorial