Welcome to Magic Leap 2 Development 

Get started creating for the Magic Leap 2

Controller input

Voice commands

Media player

Plane detection

Global dimming

Segmented dimming 

Marker tracking 

Spatial audio 

Hand tracking and gestures 

Meshing and occlusion

Eye tracking

Spatial anchors

The Magic Leap 2 is an immersive augmented reality (AR) headset built for enterprise solutions. The device allows you to seamlessly blend the physical world with the digital world to create immersive experiences. The Magic Leap 2 is used across multiple industries for training, collaboration, remote support, visualization, creativity, and more. 

In this course, you will learn the fundamentals of creating applications using the Magic Leap 2. 

The course is made up of a series of standalone tutorials, each covering a different topic related to developing for the Magic Leap 2. First, you will get your hardware and software set up for development, but after that, you can explore the tutorials in whichever order you like. 

Unity Development for Magic Leap 2

3f8ff9d2-7a54-5920-b6d8-4421d41c0e6a:zx7pohSEomVRos4yXEpyVR

Overview

Before you begin

Basic media player setup

Video options

Media player in context

Next steps and additional resources

ml-2.0-simple-media-player.mp4

prototype-1-final.mp4

Media players are incredibly useful for mixed-reality experiences like those you might want to design for the Magic Leap 2, whether you’re displaying instructional videos or entertainment content. Plus, in mixed reality, there’s no limit to the number or the size of the screens you can add. 

In this tutorial, you will learn how to add a media player to your Unity scenes, including an example of a typical use case where the user combines the media player with global dimming and voice commands. 

Automotive

Media players can provide a convenient way for users to consume multimedia content within the mixed reality environment. For example, a user in a virtual museum might use a media player to watch a video about a particular exhibit.

Or if you’re designing a training application for medical technicians or factory employees, for example, step-by-step video walkthroughs could be highly beneficial. 

In this tutorial, you will learn how to add a media player to your Unity scenes. 

Before you begin working through this tutorial, you should make sure your development environment is set up for Magic Leap 2 development and download the example prototype project.

If this is your first time developing in Unity for the Magic Leap 2, make sure you have your development environment configured properly using one of the following guided options: 

Follow the Unity: Getting started guide from the Magic Leap 2 developer documentation.

Follow the Magic Leap 2 in-Editor tutorial project in the Unity Editor. 

This tutorial will guide you through the implementation of this feature in your own application using an example prototype. If you want to explore the code of the prototype yourself, download the accompanying prototype project and open it in Unity.


Export Magic Leap 2’s MediaPlayer prefab 

Magic Leap 2 provides a very useful media player prefab in their example scene. You can follow the instructions in this tutorial to install and set up the SDK examples project. You can then export the MediaPlayer prefab as a UnityPackage. 

The MediaPlayer prefab should look something like the image below when you import it into your own project. You’ll notice the prefab has all of the basic functionality you would want in a media player, including playback and volume controls.

A screen capture showing the user selecting Export Package option. 

A screen capture of the media player GameObject in the Unity Editor.

With the media player in your scene, you can select how you want to embed your chosen video in your scene. The provided prefab’s Magic Leap Media Player Behavior script allows for the following Path Source Types:

Web: simply enter the URL for the video. This link cannot be a YouTube or Vimeo video — it has to be a link to an actual hosted file (for example, ending in .mp4).

Streaming Assets: you can create a folder in your project assets folder named “StreamingAssets”, then place a video inside it. Then for the Source path, enter the path relative to that folder (refer to the example image below). 

Important: You must include the file extension in the path (for example, video.mp4).

You can find the list of supported video and audio codecs in Magic Leap’s Media Codecs documentation.

The Stereo Mode property allows you to play 3D video with either Side by Side 3D or Over Under 3D.

However, as is mentioned in the Media Player documentation, in order for stereo rendering to function, the shader used as the video render material must support the Video Stereo Mode property. An example of this functionality is provided in the Magic Leap/Stereo Video Render shader.

A screen capture showing the MLMediaPlayerBehaviour GameObject selected in the Hierarchy. In the Inspector, the Path Source type option of the ML Media Player Behaviour component is highlighted and set to Streaming Assets.

A screen capture showing the Stereo Mode of the media set to Over Under 3D.

Now that you know how to set up a simple media player, let’s check out an example of how this feature can be combined with other interactive functionality.

In this example, plane detection is used to place the video, the controller bumper is used to play and pause a video, the menu button toggles Global Dimming, and the Y value on the touchpad dynamically controls the dimming value. 

To learn how to implement this functionality yourself, the code is provided below. You can review all of the code for this demo in the example prototype project.

In this tutorial, you learned about the Media Player on the Magic Leap 2. You can learn more about the Media Player with the following resources:

Magic Leap’s media player example scene from the samples project

Magic Leap’s scripting documentation on the Media Player

You may also want to learn more about out the other features highlighted in the example prototype:

Otherwise, feel free to go back to the overview page, where you can explore other tutorials and resources.

Media player

1. Overview

2. Before you begin

3. Basic media player setup

4. Video options

5. Media player in context

6. Next steps and additional resources

Complete this tutorial