Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Microsoft

HoloLens 2 fundamentals: develop mixed reality applications

Microsoft via Microsoft Learn

Overview

Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
  • This course provides the user with a basic understanding of all the foundational elements of MRTK.

    By the end of this module, you'll be able to:

    • Import the MRTK into your Unity Windows Mixed Reality Project.
    • Configure basic object interactions without the need to create your own custom scripts.
  • This course provides you with an understanding of placing objects and tracking objects using solvers.

    By the end of this module, you'll be able to:

    • Position objects in the scene.
    • Use solvers to direct the user to objects.
    • Use solvers to reposition objects.
  • This course will provide steps and procedures to follow on how to manipulate and interact with 3D objects.

    By the end of this module, you'll be able to:

    • Learn how to configure 3D objects so users can interact with them.
    • Learn how to add bounds control to 3D objects.
    • Learn how to organize buttons in a collection.
    • Learn how to use MRTK's menu prefabs.
    • Learn how to interact with holograms using UI menus and buttons.
    • Learn how to add text elements.
  • This course provides the user an overall understanding on how to use eye tracking and voice commands

    By the end of this module, you'll be able to:

    • Learn how to enable eye tracking for HoloLens 2.
    • Learn how to use eye tracking to trigger action.
    • Learn how to create speech commands.
    • Learn how to control speech commands globally and locally.
  • This course explores the use of Azure speech services by integrating to a hololens2 application. You can also deploy your project to a HoloLens.

    By the end of this module, you'll be able to:

    • Implement speech recognition powered by Azure with Mixed Reality ToolKit (MRTK).
    • Implement speech commands powered by Azure.
    • Successfully translate the words you speak into several different languages.
    • Integrate AI-powered speech commands, allowing your application to recognize the users' intent even if they don't utter precise commands.
  • Activate spatial audio for your HoloLens 2 application

    By the end of this module, you'll be able to:

    • Import the Mixed Reality Toolkit (MRTK).
    • Import and enable the Microsoft Spatializer plugin and also enable the spatial audio on your workstation.
    • Spatialize the button interaction sounds and use an audio clip to test spatialized button interaction.
    • Spatialize audio from a video source and try out your app on a HoloLens 2 or in the Unity editor. You'll see and hear the video, and the audio from the video is spatialized.
    • Enable and disable spatialization at run time, test out the app on a HoloLens 2 or in the Unity editor. In the app, you can now click the button to activate and deactivate spatialization of the audio.
  • Add Azure Cloud Services such as Azure Storage and Azure Custom Vision for your mixed reality application.

    By the end of this module, you'll be able to:

    • Build a HoloLens 2 application that can detect objects from images and find its spatial location.
    • Use Azure Custom Vision to train and detect images in the HoloLens 2 application.
    • Integrate Azure Storage as the persistence solution for the demo application.
  • This course explores the use of PC holographic remoting by integrating to a HoloLens 2 application.

    By the end of this module, you'll be able to:

    • Build a mixed reality experience demonstrating UI elements, 3D model manipulation, model clipping, and eye-tracking features.
    • Create a Holographic Remoting remote app and connect to HoloLens 2 at any point, providing a way to visualize 3D content in mixed reality.

Syllabus

  • Introduction to the Mixed Reality Toolkit-Set Up Your Project and Use Hand Interaction
    • Introduction to the Mixed Reality Toolkit - Set Up Your Project and Use Hand Interaction
    • Exercise - Configure Unity for Windows Mixed Reality
    • Import and configure resources
    • Exercise - Import and configure resources
    • Interaction models
    • Exercise - Add hand interaction scripts to an object
    • Module assessment
    • Summary
  • Place a Mars Rover object in the scene and work with grids and intelligent object tracking
    • Introduction
    • Position game objects and set visibility
    • Exercise - Position game objects and set visibility
    • Organize and lay out objects with collections
    • Exercise - Organize and lay out objects with collections
    • Create intelligent object placements with solvers
    • Exercise - Create intelligent object placements with solvers
    • Module assessment
    • Summary
  • Getting started with 3D object interaction
    • Introduction
    • Panel of buttons and dynamic menus
    • Exercise - Panel of buttons and dynamic menus
    • Provide description to objects using text on scene
    • Exercise - Provide description to objects using text on scene
    • Manipulate 3D objects using bounds control
    • Exercise - Manipulate 3D objects using bounds control
    • Module assessment
    • Summary
  • Enable eye tracking and voice commands for objects on the HoloLens 2
    • Introduction
    • Use eye tracking
    • Exercise - Use eye tracking
    • Use voice commands
    • Exercise - Use voice commands
    • Module assessment
    • Summary
  • Add Azure AI services to your mixed reality project
    • Introduction
    • Integrate and use speech recognition and transcription
    • Exercise - Integrate and use speech recognition and transcription
    • Execute commands using Azure speech recognition
    • Exercise - Execute commands using Azure speech recognition
    • Add the Azure AI Speech translation component
    • Exercise - Add the Azure AI Speech translation component
    • Set up intent and natural language understanding
    • Exercise - Set up intent and natural language understanding
    • Module assessment
    • Summary
  • Activate spatial audio for your HoloLens 2 application
    • Introduction
    • Add spatial audio to your unity project
    • Exercise - Add spatial audio to your unity project
    • Spatialize button interaction sounds
    • Exercise - Spatialize button interaction sounds
    • Spatialize audio from a video
    • Exercise - Spatialize audio from a video
    • Enable and disable spatialization at run time
    • Exercise - Enable and disable spatialization at run time
    • Use reverb to add distance to spatial audio
    • Exercise - Use reverb to add distance to spatial audio
    • Module assessment
    • Summary
  • Integrate Azure Cloud Services to your Unity project on HoloLens 2
    • Introduction
    • Azure Cloud Services for HoloLens 2
    • Exercise - Azure Cloud Services for HoloLens 2
    • Integrate Azure storage
    • Exercise - Integrate Azure storage
    • Integrate Azure Custom Vision
    • Exercise - Integrate Azure Custom Vision
    • Module assessment
    • Summary
  • Create a Holographic Remoting app to visualize 3D content on HoloLens 2
    • Introduction
    • Get started with PC Holographic Remoting
    • Exercise - Get started with PC Holographic Remoting
    • Create a Holographic Remoting PC application
    • Exercise - Create a Holographic Remoting PC application
    • Module assessment
    • Summary

Reviews

Start your review of HoloLens 2 fundamentals: develop mixed reality applications

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.