All content in this course uses:

Challenge — MR Interaction

In this challenge, you will display information about and manipulate a Rover using HoloLens interactions.

Tutorial22_InteractionChallenge.zip

Set up your Scene for Mixed Reality development

Display information to the user when they click on the intractable object

Configure the PointerClick event to hide display information

Create a Voice Manager to handle keyword inputs

Add voice controls to the Rover to recenter the object on command

Add the ability to scale and rotate the object

Overview

Check the following checkboxes and leave the others unchecked. 

Set Up Your Scene for Mixed Reality Development

Add the Event Trigger component to the Interaction Sphere and configure its Mesh Renderer Material to highlight upon gaze. 

Highlighting an object is a common design pattern to indicate interactivity. If one can interact with an object, typically there will be some type of feedback as one gets close to that object. Sometimes it’s visual feedback; other times it’s haptic or auditory feedback. 

For this challenge, we use visual feedback to signal interactivity and do so by changing the Material upon gaze.

Add a Highlight Material to the Sphere

Add the Pointer Exit Event to the Interaction Sphere and configure it so the object returns to the default Material when the user looks looks away. 

Implement the Return State after the Highlight Interaction

Configure the information UI to display with a PointerClick

event so the user can access the informational page by airtapping (clicking) on the Sphere.

Display Information During an Air Tap

Configure another PointerClick event to hide, or disable, the informational UI when the user clicks on the page.

Configure the UI-Disable Interaction

Create an empty GameObject named Voice Manager, add a Speech Input Source component, and add “recenter” to the keywords list.

Configure Voice Commands with a Keyword

Add a Speech Input Handler component to the Rover and add the “recenter” keyword to the keywords list. This will allow you to implement functionality when the user says “recenter.” 

 button and using the drop-down to select 

Add the Recenter functionality to the Response event by using the drop-down to select 

Add Voice Control to the Rover

Add the Bounding Box Rig to the Rover and configure the Bounding Box Prefab.

Holotoolkit > UX > Prefabs > BoundingBoxes > BoundingBoxBasic.prefab

Add the Ability to Rotate and Scale

Congratulations! You've now configured the Mars Rover to work with HoloLens interaction. The interaction patterns integrated in this challenge are the most common types of HoloLens interaction and are especially useful in pre-authored training applications.

By completing this challenge, you've learned core HoloLens interactions:

In-editor HoloLens interaction simulation

Gaze interactions to highlight interactable objects

Gestures to display additional information

Voice commands to recenter the object of interest

Use the Bounding Box Prefab to rotate and scale the object of interest with the HoloLens

Unity Version 2018.4