HoloLens 2 fundamentals: develop mixed reality applications

By the end of this module you'll be able to:

• Import the MRTK into your Unity Windows Mixed Reality Project.
• Configure basic object interactions without the need to create your own custom scripts.

By the end of this module you'll be able to:

• Position objects in the scene
• Use the Mixed Reality Toolkit (MRTK) feature called Grid Object Collection
• Use solvers to direct the user to objects
• Use solvers to reposition objects

By the end of this module you will be able to:

• Learn how to configure 3D objects so they can be interacted with
• Learn how to add bounds control to 3D objects
• Learn how to organize buttons in a collection
• Learn how to use MRTK's menu prefabs
• Learn how to interact with holograms using UI menus and buttons
• Learn how to add text elements
• Learn how to spawn tooltips on objects dynamically

By the end of this module you will be able to:

• Learn how to enable eye-tracking for HoloLens 2
• Learn how to use eye-tracking to trigger action
• Learn how to create speech commands
• Learn how to control speech commands globally and locally

By the end of this module you will be able to:

• You would have learned the fundamentals of Azure Spatial Anchors
• You explored various steps required to start and stop an Azure Spatial Anchors session. Also, to create, upload, and download Azure Spatial Anchors on a single device.
• You learned how to persist Azure Spatial Anchors between app sessions and app restarts by saving the Azure Spatial Anchor ID to the local disk on HoloLens.
• You also learned how to share Azure Spatial Anchors between multiple devices for a basic multi-user, static hologram shared experience.

By the end of this module you will be able to:

• You would have implemented speech recognition powered by Azure with Mixed Reality ToolKit(MRTK).
• Implemented speech commands powered by Azure.
• Our project can now successfully translate the words you speak into several different languages.
• Our project now have AI-powered speech commands, allowing our application to recognize the users' intent even if they do not utter precise commands.

By the end of this module you will be able to:

• import Mixed Reality Toolkit (MRTK)
• import and enable the Microsoft Spatializer plugin and also to enable the spatial audio on your workstation.
• spatialize the button interaction sounds and to use an audio clip to test spatialized button interaction.
• spatialize audio from an video source Try out your app on a HoloLens 2 or in the Unity editor. You'll see and hear the video, and the audio from the video is spatialized.
• enable and disable spatialization at run time, test out the app on a HoloLens 2 or in the Unity editor. In the app, you can now click the button to activate and deactivate spatialization of the audio.

By the end of this module you will be able to:

• Build a HoloLens 2 application that can detect objects from images and find its spatial location.
• Use Azure Custom Vision to train and detect images in the HoloLens 2 application
• Integrating Azure Storage as the persistence solution for the demo application.
• Learn basics of Azure Bot Service with LUIS

By the end of this module you will be able to:

• Build a mixed reality experience demonstrating UI elements, 3D model manipulation, model clipping, and eye-tracking features.
• Create a Holographic Remoting remote app and connect to HoloLens 2 at any point, providing a way to visualize 3D content in mixed reality.

• Introduction to the Mixed Reality Toolkit--Set Up Your Project and Use Hand Interaction
• Set up a mixed reality project in Unity with the Mixed Reality Toolkit
• Exercise - Configure Unity for Windows Mixed Reality
• Import and configure resources
• Exercise - Import and configure resources
• Interaction models
• Exercise - Add hand interaction with object manipulator
• Knowledge check
• Summary

• Introduction
• Position game objects and set visibility
• Exercise - Position game objects and set visibility
• Organize and lay out objects with collections
• Exercise - Organize and lay out objects with collections
• Create intelligent object placements with solvers
• Exercise - Create intelligent object placements with solvers
• Knowledge check
• Summary

• Introduction
• Panel of buttons and dynamic menus
• Exercise - Panel of buttons and dynamic menus
• Provide description to objects using text on scene and tooltips
• Exercise - Provide description to objects using text on scene and tooltips
• Manipulate 3D objects using bounds control
• Exercise - Manipulate 3D objects using bounds control
• Knowledge check
• Summary

• Introduction
• Use eye-tracking
• Exercise - Use eye-tracking
• Use voice commands
• Exercise - Use voice commands
• Knowledge check
• Summary

• Introduction
• Get started with Azure Spatial Anchors
• Exercise - Get started with Azure Spatial Anchors
• Save, retrieve, and share Azure Spatial Anchors
• Exercise - Save, retrieve, and share Azure Spatial Anchors
• Display feedback from Azure Spatial Anchors
• Exercise - Display feedback from Azure Spatial Anchors
• Azure Spatial Anchors for android and iOS
• Exercise - Azure Spatial Anchors for android and iOS
• Knowledge check
• Summary

• Introduction
• Integrate and use speech recognition and transcription
• Exercise - Integrate and use speech recognition and transcription
• Execute commands using Azure speech recognition
• Exercise - Execute commands using Azure speech recognition
• Add the Azure Cognitive Services speech translation component
• Exercise - Add the Azure Cognitive Services speech translation component
• Set up intent and natural language understanding
• Exercise - Set up intent and natural language understanding
• Knowledge check
• Summary

• Introduction
• Add spatial audio to your unity project
• Exercise - Add spatial audio to your unity project
• Spatialize button interaction sounds
• Exercise - Spatialize button interaction sounds
• Spatialize audio from a video
• Exercise - Spatialize audio from a video
• Enable and disable spatialization at run time
• Exercise - Enable and disable spatialization at run time
• Use reverb to add distance to spatial audio
• Exercise - Use reverb to add distance to spatial audio
• Knowledge check
• Summary

• Introduction
• Azure Cloud Services for HoloLens 2
• Exercise - Azure Cloud Services for HoloLens 2
• Integrate Azure storage
• Exercise - Integrate Azure storage
• Integrate Azure Custom Vision
• Exercise - Integrate Azure Custom Vision
• Integrate Azure Spatial Anchors
• Exercise - Integrate Azure Spatial Anchors
• Integrate Azure Bot Service
• Exercise - Integrate Azure Bot Service
• Knowledge check
• Summary

• Introduction
• Get started with PC Holographic Remoting
• Exercise - Get started with PC Holographic Remoting
• Create a Holographic Remoting PC application
• Exercise - Create a Holographic Remoting PC application
• Knowledge check
• Summary