- This course provides the user with a basic understanding of all the foundational elements of MRTK.
By the end of this module, you'll be able to:
- Import the MRTK into your Unity Windows Mixed Reality Project.
- Configure basic object interactions without the need to create your own custom scripts.
- This course provides you with an understanding of placing objects and tracking objects using solvers.
By the end of this module, you'll be able to:
- Position objects in the scene.
- Use solvers to direct the user to objects.
- Use solvers to reposition objects.
- This course will provide steps and procedures to follow on how to manipulate and interact with 3D objects.
By the end of this module, you'll be able to:
- Learn how to configure 3D objects so users can interact with them.
- Learn how to add bounds control to 3D objects.
- Learn how to organize buttons in a collection.
- Learn how to use MRTK's menu prefabs.
- Learn how to interact with holograms using UI menus and buttons.
- Learn how to add text elements.
- This course provides the user an overall understanding on how to use eye tracking and voice commands
By the end of this module, you'll be able to:
- Learn how to enable eye tracking for HoloLens 2.
- Learn how to use eye tracking to trigger action.
- Learn how to create speech commands.
- Learn how to control speech commands globally and locally.
- This course explores the use of Azure speech services by integrating to a hololens2 application. You can also deploy your project to a HoloLens.
By the end of this module, you'll be able to:
- Implement speech recognition powered by Azure with Mixed Reality ToolKit (MRTK).
- Implement speech commands powered by Azure.
- Successfully translate the words you speak into several different languages.
- Integrate AI-powered speech commands, allowing your application to recognize the users' intent even if they don't utter precise commands.
- Activate spatial audio for your HoloLens 2 application
By the end of this module, you'll be able to:
- Import the Mixed Reality Toolkit (MRTK).
- Import and enable the Microsoft Spatializer plugin and also enable the spatial audio on your workstation.
- Spatialize the button interaction sounds and use an audio clip to test spatialized button interaction.
- Spatialize audio from a video source and try out your app on a HoloLens 2 or in the Unity editor. You'll see and hear the video, and the audio from the video is spatialized.
- Enable and disable spatialization at run time, test out the app on a HoloLens 2 or in the Unity editor. In the app, you can now click the button to activate and deactivate spatialization of the audio.
- Add Azure Cloud Services such as Azure Storage and Azure Custom Vision for your mixed reality application.
By the end of this module, you'll be able to:
- Build a HoloLens 2 application that can detect objects from images and find its spatial location.
- Use Azure Custom Vision to train and detect images in the HoloLens 2 application.
- Integrate Azure Storage as the persistence solution for the demo application.
- This course explores the use of PC holographic remoting by integrating to a HoloLens 2 application.
By the end of this module, you'll be able to:
- Build a mixed reality experience demonstrating UI elements, 3D model manipulation, model clipping, and eye-tracking features.
- Create a Holographic Remoting remote app and connect to HoloLens 2 at any point, providing a way to visualize 3D content in mixed reality.
Overview
Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Syllabus
- Introduction to the Mixed Reality Toolkit-Set Up Your Project and Use Hand Interaction
- Introduction to the Mixed Reality Toolkit - Set Up Your Project and Use Hand Interaction
- Exercise - Configure Unity for Windows Mixed Reality
- Import and configure resources
- Exercise - Import and configure resources
- Interaction models
- Exercise - Add hand interaction scripts to an object
- Module assessment
- Summary
- Place a Mars Rover object in the scene and work with grids and intelligent object tracking
- Introduction
- Position game objects and set visibility
- Exercise - Position game objects and set visibility
- Organize and lay out objects with collections
- Exercise - Organize and lay out objects with collections
- Create intelligent object placements with solvers
- Exercise - Create intelligent object placements with solvers
- Module assessment
- Summary
- Getting started with 3D object interaction
- Introduction
- Panel of buttons and dynamic menus
- Exercise - Panel of buttons and dynamic menus
- Provide description to objects using text on scene
- Exercise - Provide description to objects using text on scene
- Manipulate 3D objects using bounds control
- Exercise - Manipulate 3D objects using bounds control
- Module assessment
- Summary
- Enable eye tracking and voice commands for objects on the HoloLens 2
- Introduction
- Use eye tracking
- Exercise - Use eye tracking
- Use voice commands
- Exercise - Use voice commands
- Module assessment
- Summary
- Add Azure AI services to your mixed reality project
- Introduction
- Integrate and use speech recognition and transcription
- Exercise - Integrate and use speech recognition and transcription
- Execute commands using Azure speech recognition
- Exercise - Execute commands using Azure speech recognition
- Add the Azure AI Speech translation component
- Exercise - Add the Azure AI Speech translation component
- Set up intent and natural language understanding
- Exercise - Set up intent and natural language understanding
- Module assessment
- Summary
- Activate spatial audio for your HoloLens 2 application
- Introduction
- Add spatial audio to your unity project
- Exercise - Add spatial audio to your unity project
- Spatialize button interaction sounds
- Exercise - Spatialize button interaction sounds
- Spatialize audio from a video
- Exercise - Spatialize audio from a video
- Enable and disable spatialization at run time
- Exercise - Enable and disable spatialization at run time
- Use reverb to add distance to spatial audio
- Exercise - Use reverb to add distance to spatial audio
- Module assessment
- Summary
- Integrate Azure Cloud Services to your Unity project on HoloLens 2
- Introduction
- Azure Cloud Services for HoloLens 2
- Exercise - Azure Cloud Services for HoloLens 2
- Integrate Azure storage
- Exercise - Integrate Azure storage
- Integrate Azure Custom Vision
- Exercise - Integrate Azure Custom Vision
- Module assessment
- Summary
- Create a Holographic Remoting app to visualize 3D content on HoloLens 2
- Introduction
- Get started with PC Holographic Remoting
- Exercise - Get started with PC Holographic Remoting
- Create a Holographic Remoting PC application
- Exercise - Create a Holographic Remoting PC application
- Module assessment
- Summary