01b5b7ce-7826-5823-8090-fe08852beb65:yLp09thJhNvnon364cEbAI

Placing and Manipulating Objects in AR

Installing the AR Foundation Package

Configuring Your Scene for AR Foundation and Plane Detection

Creating the Interaction Script

Configuring Your Build Settings for Android

Conclusion

In this tutorial, we’ll learn how to use AR Session and AR Session Origin — both part of the Unity AR Foundation package — to place and manipulate objects in AR. If you haven’t installed the AR Foundation and AR package for your chosen mobile platform, please see Configuring Unity for XR Development. 

Games

Film

Automotive

This tutorial has been verified using Unity 2019.4 LTS, AR Foundation 2.1.10 and ARCore XR Plugin 2.1.12

Instantiating objects, also known as spawning, and adjusting their positions are foundational features of interactive AR applications. Although these applications may serve different use cases with different visual styles, the logic behind object spawning is typically very consistent. 

In essence, an AR application with object-spawning features must be able to:

Spawn and move an object after you press on the plane. 

Spawn multiple objects around the plane after you tap on other areas.

Allow you to select and reposition objects.

Figure 01: Wayfair uses AR to let users visualize what furniture would look like in their homes before purchasing it.

2. Once the Package Manager window is open, ensure that you can see the packages in the Unity Registry (Figure 02). 

3. Search for AR Foundation and click Install (Figure 03). 

You now have the AR Foundation package in your project. For this project, we will be using an Android device, so install the ARCore XR Plugin. 

Figure 02: Package Manager window showing the Unity Registry

Figure 03: Installing the AR Foundation package

1. Add the AR Session to your Scene by clicking GameObject > XR > AR Session (Figure 04).  

2. If your AR session doesn’t have an AR Input Manager, add it by clicking Add Component and searching for AR Input Manager (Figure 05). The AR Input Manager handles all of your Scene input so you can interact with trackable objects, such as planes and feature points. 

3. Add the AR Session Origin GameObject to the Scene by clicking GameObject > XR > AR Session Origin (Figure 06). 

4. In the AR Session Origin Inspector, make sure AR Camera is set as the reference in the AR Session Origin Camera parameter (Figure 07). 

5. To enable plane detection in your AR Scene, add the AR Plane Manager to the AR Session Origin object.

6. Specify the AR Plane Manager to detect vertical and horizontal planes by adjusting its DetectionMode to Everything. 

7. To interact with trackable features (such as planes), add the AR Raycast Manager.

8. Your AR Session Origin object should look like the following (Figure 08): 

9. We’ll need a plane Prefab so the AR Plane Manager script can display the location of the planes in our AR Scene. In the Hierarchy, right-click and select XR > AR Default Plane (Figure 08). 

10. Drag this new plane from the Hierarchy into the Project window to create a Prefab and delete it from the Hierarchy.

11. In the AR Plane Manager script, assign the AR Default Plane Prefab from the Project window to the Plane Prefab variable in the Inspector (Figure 09). 

12. We need an object to spawn in our Scene. Create a Cube and name it SpawnableObject.

14. Create a tag named Spawnable and assign it to SpawnableObject. We will use that tag to tell when a ray hits one of these Prefabs.

15. Drag SpawnableObject from the Hierarchy into the Project window to create a Prefab and then delete SpawnableObject from the Hierarchy (Figure 10). 

Figure 04: Adding the AR Session to the Scene

Figure 05: AR Session GameObject with the AR Input Manager

Figure 06: Adding the AR Session Origin to the Scene

Figure 07: AR Session Origin Camera field

Figure 08: Add and configure the AR Session Origin

Figure 08: Adding the AR Default Plane

Figure 09: Assigning the AR Default Plane Prefab

Figure 10: The completed SpawnableObject Prefab

1. Create a C# script and name it SpawnableManager.

2. Create an Empty Game Object in your Scene and name it SpawnManager.

3. Assign the SpawnableManager script to your SpawnManager object.

6. Now we’ll create some variables to the top of the script’s class: 

 [SerializeField]
ARRaycastManager m_RaycastManager;
List<ARRaycastHit> m_Hits = new List<ARRaycastHit>();
[SerializeField]
GameObject spawnablePrefab;

Camera arCam;
GameObject spawnedObject; 

7. Inside the Start method, we’ll set the spawnedObject variable to null and find the AR Camera. Add these lines to the Start method: 

spawnedObject = null;
arCam = GameObject.Find("AR Camera").GetComponent<Camera>();

8. In the Update method, we’ll check to see if there’s a touch event and, if so, we will:

Check to see which phase our touch event is at.

Check to see if we are touching a previously spawned object.  

If so, we will assign that object to our spawnedObject variable. 

If not, we instantiate the Prefab and assign that object to our spawnedObject variable.

If the phase is set to Moved and our spawnedObject variable has something in it, we’ll move the spawnedObject to the touch location on the plane.

If the phase is Ended, we’ll set the spawnedObject variable to null so we no longer are able to drag the Prefab around.

9. Add the following code to the Update method:

if (Input.touchCount == 0)
    return;

if (m_RaycastManager.Raycast(Input.GetTouch(0).position, m_Hits))
{
    if(Input.GetTouch(0).phase == TouchPhase.Began && spawnedObject == null)
    {
        if (Physics.Raycast(ray, out hit))
                {
                    if (hit.collider.gameObject.tag == "Spawnable")
                    {
                        spawnedObject = hit.collider.gameObject;
                    }
                    else
                    {
                        SpawnPrefab(m_Hits[0].pose.position);
                    }
                }

    }
    else if(Input.GetTouch(0).phase == TouchPhase.Moved && spawnedObject != null)
    {
        spawnedObject.transform.position = m_Hits[0].pose.position;
    }
    if(Input.GetTouch(0).phase == TouchPhase.Ended)
    {
        spawnedObject = null;
     }
}


10. Lastly, we need to create a method that will take in a location and instantiate our Prefab. Add the following method your Update method: 

private void SpawnPrefab(Vector3 spawnPosition)
{
    spawnedObject = Instantiate(spawnablePrefab, spawnPosition, Quaternion.identity);
}


11. Save your script and head back to Unity (Figure 11). 

12. In your SpawnableManager script on your SpawnManager object, drag the AR Session Origin object from the Hierarchy into the Raycast Manager variable in the Inspector. 

13. Drag the SpawnableObject Prefab from the Project window into the Spawnable Prefab variable (Figure 12). 

Figure 11: The completed SpawnableManager script

Figure 12: The completed SpawnManager object

If you’re using Android, you must first change a few settings in order to build your app.

1. Go to Edit > Project Settings… > Player > Other Settings and go to the Graphics APIs section. Remove Vulkan API from the list (Figure 13). 

2. Set the Minimum API Level to API Level 24 or higher (Figure 14). 

3. Open a web browser and go to https://gradle.org/releases.

4. Download Gradle v5.6.4 and unzip it into a location of your choosing.

5. Go to Edit > Preferences… > External Tools and uncheck Gradle Installed with Unity, then set the Gradle location to the location where you unzipped the download (Figure 15).
 

Now we just need to alter some Gradle files located in Assets\Plugins\Android inside your Project folder.

1. Go to https://developers.google.com/ar/develop/unity/android-11-build and follow the directions in the Unity 2019.3 and 2019.4 section.

2. Build and launch your project on your device. 

Figure 13: Remove the Vulkan API so you are left with the OpenGLES3 API.

Figure 14: Set the Minimum API Level to API level 24 or higher.

Figure 15: Uncheck Gradle Installed with Unity and set the Gradle location.

You can now spawn a single object and adjust its position and spawn multiple objects in your Scene. If you need to reposition an object, you can touch a previously instantiated object and drag it to a new position on the AR Planes. You are well on your way to mastering the basics of mobile AR interaction.  

Placing and Manipulating Objects in AR

1. Placing and Manipulating Objects in AR

2. Installing the AR Foundation Package

3. Configuring Your Scene for AR Foundation and Plane Detection

4. Creating the Interaction Script

5. Configuring Your Build Settings for Android

6. Conclusion

Complete this tutorial