2.1 - Audio and Haptics

2.2 - Activation Events

2.3 - Direct and Ray Interactors

2.4 - User Interface

Challenge 2 - 3D Painting

The XR hardware landscape

Lab 2 - Personal Project Events & Interactions

Submission 2 - Share your Work

Mission 2 Quiz - VR Events & Interactions

Learn how to implement more complex interactions in VR to make the experience more immersive, such as audio, haptics, and user interfaces.

In this mission, you will implement more complex interactions in VR to make the experience more immersive.

In these tutorials, you will do the following:

Apply new functionality to specific objects

Allow the user to toggle between multiple types of interactors

In the Challenge for this mission, you will apply your skills in a 3D painting prototype. Then, in the Lab, you'll implement the core functionality of your personal project. Finally, in the Quiz, you will test your new knowledge.

Events and Interactions

Unity VR Development

Dive into the world of virtual reality with Unity's VR Development Pathway. Learn to design immersive experiences, build VR games, and master Unity's VR tools. Start creating in VR today!

VR Development Pathway - Learn Unity VR Game Development | Unity Learn

 or have the equivalent experience, before starting Unity VR Development.

In addition, basic coding experience is recommended before starting the Custom VR Development mission, which can be obtained via the 

Ready to develop for VR? This guided learning Pathway will prepare you for a job in the VR industry!

Welcome to VR Development! This learning pathway is designed for anyone interested in learning to create experiences for VR. This pathway assumes a basic knowledge of Unity and basic knowledge of programming.

VR Development

Welcome to the VR Pathway

VR Software Setup 

1.1 - VR Project Setup

1.2 - VR Locomotion

1.3 - Grabbable Objects

1.4 - Sockets

Challenge 1 - Architecture Review

The VR software landscape

Lab 1 - VR Personal Project Basics

Submission 1 - Share your Work

Mission 1 Quiz 1 - VR Basics

Learn the basics of setting up a VR project and implementing simple interactivity like locomotion and grabbing objects.

In this mission, you will learn the basics of setting up a VR project and implementing simple interactivity.

Set up a VR-ready project with the room of your choice

Implement locomotion so that users can move around the scene

Add grabbable objects users can pick up and throw around

Set up sockets that objects can snap into

In the Challenge for this mission, you will apply your skills in an architectural review prototype. Then, in the Lab, you'll fill out a design document to lay out a concept for your own project, and then begin working on it. Finally, in the Quiz, you will test your new knowledge.

VR Basics

3.1 - Comfort and Accessibility

3.2 - Optimization

3.3 - Lighting

3.4 - Building and Sharing

Challenge 3 - Training Simulation

Keeping up with XR technology

Lab 3 - Personal Project Ergonomics & Optimization

Submission 3 - Share your Work

Mission 3 Quiz - VR Ergonomics & Optimization

Explore ergonomics and optimization for VR for making apps as accessible and comfortable as possible.

In this mission, you will focus on ergonomics and optimization for VR in order to make your app as accessible and comfortable as possible.In these tutorials, you will do the following:

In the Challenge for this mission, you will apply your skills in an industrial training simulation prototype. Then, in the Lab, you'll implement the core functionality of your personal project. Finally, in the Quiz, you will test your new knowledge.

Ergonomics and Optimization

What is in this mission?

Explore the sample scene

Set up the scanner

Code the scanning functionality

Balloon Inflator

Escape Room project overview

Number pad

Keycard reader

Sliding Door

Mission 4 Quiz - Custom VR Development

Clone with a twist!

Submit your final project

Learn to write scripts for advanced interactions in VR applications, and create your own unique VR project.

In the previous missions, you used pre-made interaction scripts provided to you as part of the Create with VR project. This mission will teach you to write scripts specifically for VR applications. You’ll write these scripts from scratch in the context of three separate projects.

In project 1, the XRI example scene created by the XR Interaction Toolkit team, you'll reference existing code and documentation to program some more advanced, customized interactables.

In project 2, you’ll follow guidelines from a project brief to create part of a VR escape room. Rather than following step-by-step instructions here, you’ll only receive hints.

In project 3, which you’ll submit to receive your pathway badge, you’ll create your own unique VR project. The challenge here is to create a clone with a twist: a version of an established VR experience, but with a unique alteration.

, you should already have a good foundational knowledge of scripting in the Unity engine to make the most out of this learning content.

If you don’t already have a foundational understanding of scripting, now is an excellent time to learn. We recommend you complete the 

If you feel almost ready but want to brush up on a few skills without doing the entire Junior Programmer pathway, why not check out the 

Custom VR Development

1b5d63fc-9513-463f-bb28-156cca268942:30fc6b34ba5d

Add a world space UI into the room

Edit the welcome text

Add an OK button to the panel

Make the OK button remove the welcome panel

Make a reset UI canvas

Show reset panel on secondary button press

Teleport back to the starting position on button press

Recap

Extension Activities

Comp-L2-Prog.VRp: Beginner VR Development

Beginner VR Development

aaron.sharp@unity3d.com bCXcG*RnEp9O!6@q

2.4.ext - Real-world text.mp4

2.4.ext - Multi-step UI.mp4

2.4.ext - Contextual tooltips.mp4

2_4_4_v2.mp4

2_4_recap_v2.mp4

2_4_6_v2.mp4

2_4_5_v2.mp4

2_4_2_v2.mp4

2_4_3_v2.mp4

2_4_7_v2.mp4

2_4_1_v2.mp4

In this lesson, you will learn how to implement world space user interfaces in VR. By the end of this lesson, the user will be greeted by a welcome screen that provides basic instructions. They will also be able to bring up a simple reset menu that allows them to reload the scene. 

This lesson is part of the Create with VR course. 

By the end of this lesson, you will be able to:

Recall best practices for UI in VR in order to design an experience that is comfortable and intuitive for the user.

Add a simple world space UI into the scene with text and a button in order to allow the user to read and interact with a user interface.

VR Developer Pathway Facilitator Kit.zip

VR Developer Pathway Facilitator Kit (Google Drive)

Unity Educator Hub

The VR Developer Pathway Facilitator Kit includes everything you need to successfully bring this Pathway into your learning context including a syllabus, complete lesson plans, standards alignment, teacher preparation guide, and more.  

Games

Film

Automotive

Skill-L2-Prog.VRp-2: Develop a VR app that demonstrates common interactions using Unity's XR interaction toolkit.

o-L2-Prog.VRp-2.1: Implement locomotion in VR.

o-L2-Prog.VRp-2.2: Implement grabbable objects and sockets in VR.

o-L2-Prog.VRp-2.3: Implement a worldspace UI in VR.

o-L2-Prog.VRp-2.4: Implement controller- and object-based interaction events in VR.

o-L2-Prog.VRp-2.5: Implement spatial audio in VR.

Develop a VR app that demonstrates common interactions using Unity's XR interaction toolkit.

2 - VR Events and Interactions

VR Events & Interactions

Unit 3: VR Events and Interactions

To create some welcome screen text, the first thing you need to do is add a canvas with text and position it in the room.

Add a new empty object in your Hierarchy, reset its position, and rename it “INTERFACE”.

Create an XR > UI Canvas object within that organizer object.


2.  Position the canvas appropriately in the room:

In the Canvas’ Rect Transform component, set the XYZ Scale to 0.01.

Set the Pos Y and Pos Z properties so the canvas is at the back of the room


3.  Add a semi-transparent black background for the UI:

In the Hierarchy, create a UI > Image and rename it “Welcome Background”.  

In the Image component, click the Color box.

Use the Alpha (A) slider to reduce the color’s transparency. 


4.  If your windows are rendering on top of your text:

In the Canvas component, set the Order in Layer property to “1”.


5.  Add text to the panel as a child object:

In the Hierarchy, right-click Welcome Background and create UI > Text - TextMeshPro as a child object.

Note: you may have to click “Import TMP Essentials” if prompted.

You should now have a semi-transparent box in the room with huge off-center text that says “New Text”.

In the Hierarchy, under an INTERFACE object, there is a Canvas object, which has a Welcome_Background child object, which has a Welcome Text child object. In the Scene view, there is a black square with large white text on top of it that says, “New Text”. 

Now that you have the canvas in place, it is time to make a more useful welcome message.

1.  Edit the shape and placement of the background image:

In the image object’s Rect Transform component, edit the Width, Height, Pos X, and Pos Y properties.

On the text object, in the TextMeshPro - Text (UI) component, change the Font Asset, Font Size, Vertex Color, and Alignment properties.

In the TextMeshPro - Text (UI) component, change “New Text” to a short, but informative welcome message about the scene. 


4.  Edit the size and spacing of the text box:

In the Rect Transform component., set the Width, Height, Pos X, and Pos Y to position in your text’s Rect Transform component. 

Note: Make sure to leave some margins and space for an “OK” button. 

Your welcome text should now look the way you want it in the scene.

In the Hierarchy, the Welcome Text object is selected. In the Scene view, there is a larger rectangular black box with text inside of it that says, “Welcome to your VR Room! Press the thumbstick or primary button to toggle your rays.”

You don’t want the welcome text displayed forever, so you will add an “OK” button that hides it.

1.  Add a button to the panel as a child object:

In the Hierarchy, right-click the Welcome Background and click UI > Button - TextMeshPro.

Change the text to “OK” or “Got it!”. 

Edit the Text settings to match your other text.

In the Rect Transform component, edit the button’s position, width, and height.


4.  If you want to change the color of the button as you interact with it: 

In the Button component, edit the Normal, Highlighted, and Pressed Color properties.


5.  Prevent your ray from appearing active when it is over the background panel:

In the Background Image component, disable the Raycast Target setting. 

In the Text object’s TextMeshPro component, in the Extra Settings section, disable the Raycast Target setting.

You should now have an “OK” button that changes color when it is highlighted and clicked with the trigger.

In the Hierarchy, the Button object is selected. In the Scene view, there is a button that says “OK” in the bottom-right corner of the text panel.

Now that the button looks the way you want, you should make it remove the welcome panel when clicked.

1.  Locate the On Click event for the button.

On the Button object, at the bottom of the Button component, locate the On Click  event. 

In the On Click event, click the + button to add a new action. 

Assign the Welcome Background to the Object slot.

From the “No Function” drop-down, select GameObject > Set Active (bool) function and make sure the check box is deselected so that it is deactivated.

When you select the OK button with the trigger, the  welcome panel should disappear.

In the Button component, in the On Click event, the Welcome_Background object is assigned, with the function set to GameObject.SetActive. The checkbox underneath GameObject.SetActive is not selected.

Now that the welcome UI works perfectly, it will be easy to duplicate and repurpose the UI elements to make a Reset UI that reloads the scene.

In the Hierarchy, duplicate the Welcome_Background object and rename the new object “Reset_Background”.

Temporarily deactivate the Welcome Background To be able to edit it more easily.

Edit the text to be about resetting the scene to its original state.


2.  Add a second button for your reset screen: 

Duplicate the button, then reposition it next to the original. 

Rename the buttons and edit their text to make one a “Cancel” button and the other an affirmative “Yes” button.


3.  Make the Yes button actually reset the scene:

Add a Load Scene component to the Yes button object.

In the On Click event, assign the Load Scene component and choose the Load Scene > ReloadCurrentScene () function.

From the Reset canvas, you should now be able to be able to click Cancel to hide the panel or click Yes to reload the current scene.

In Scene view, the Yes button is selected. In the On Click event, the Load Script component is assigned to the GamObject property, with the function set to LoadScene.ReloadCurrentScene.

There’s currently no way to return to the reset screen. To execute a reset, you can teleport the player back to the starting point when they press the secondary button.

1.  Only show the welcome panel at start:

Re-enable the Welcome Background object and disable the Reset_Background object.

On the XR Rig object, add an On Button Press component.

Assign the binding path to XR Controller > Optional Controls > secondaryButton.

Note: Different controllers have different buttons, triggers, and pads on them. If you’re not using an Oculus Quest, you will likely have to choose a different binding path that works with your device. For example, check out the OpenXR controller profiles for the HTC Vive or the Valve Index. 


3.  Show the reset panel on the button press:

In the On Press event, click the + to add a new action.

Select the function GameObject > Set Active (bool), and make sure the check box is enabled.


4.  Hide the welcome panel on the button press:

Select the GameObject > Set Active (bool) function, and make sure the check box is disabled.

When you press the secondary button, the welcome panel should disappear and the reset panel should appear. 

In the On Button Press event, in the Action section, the SecondaryButton (XR Controller) is assigned. In the On Press event, the Reset_Background object is assigned with the function GameObject.SetActive set to true and the Welcome_Background object is assigned with the function GameObject.SetActive set to false. 

If the player is not at the starting position when they press the secondary button, they need to be teleported back to the starting position to view the Reset panel.

1.  Make sure you have a teleportation anchor at the start of your scene:

If you don’t already have one, duplicate and reposition a teleportation anchor at the position you want your player to start in the room.


2.  Make your player start at the correct location:

Match the position and rotation of the XR Rig object to the position and rotation of the starting anchor.

2.4 - User Interface

Overview Video

1. Add a world space UI into the room

2. Edit the welcome text

3. Add an OK button to the panel

4. Make the OK button remove the welcome panel

5. Make a reset UI canvas

6. Show reset panel on secondary button press

7. Teleport back to the starting position on button press

8. Recap

9. Extension Activities

Complete this tutorial