This is a hololens application that uses the Microsoft Computer Vision API and overlays the result in a style similar to the movie Terminator. It can detect objects, faces, and OCR text.
See the Windows Blog post for more information
Some setup instructions
-
Sign up for a Cognitive Services account and generate a subscription key for the Computer Vision API.
If you already have an Azure account you can skip that and setup a Computer Vision App directly in your Azure subscription. To do that go directly to the Azure portal. -
Clone this repository with the --recursive flag. This will also get the appropriate version of the MRTK in the root folder for this project.
-
Open a command prompt, navigate to the root folder for this project and execute this command:
mklink /j .\Assets\HoloToolkit .\MixedRealityToolkit-Unity\Assets\HoloToolkit
This will create a linked folder to the HoloToolkit in the Assets folder of the project. Now the MRTK is included in the project.
-
Open the root folder of the project in Unity
-
Open the main scene, which you kind find in the root of the Assets folder
-
Select the HUD game object in the hierarchy and enter these fields for the Hud script:
- Computer Vision key
Get a key from the Keys page under Resource Management for your Computer Vision app in the Azure portal you created in step 1. - Computer Vision Endpoint
The endpoint for your Computer Vision app in the Azure portal created in step 1. This can be found on the Overview page.
- Computer Vision key
-
Set the project settings using the Mixed Reality Toolkit menu Configure - Apply Mixed Reality Project Settings. Keep the defaults selected and click Apply.
-
Open the Build Settings dialog File | Build Settings. Click on Add Open Scenes to add the main scene to your build.
-
Build the UWP app from the Build Settings dialog. Create a new folder called Builds and select it.
-
Open the solution in the Builds folder with Visual Studio.
-
Set the configuration in the top bar to Debug and x86. Select Device if your Hololens is connected with a cable, Remote Machine if it's connected over WiFi or the Hololens Emulator.
-
Build the solution in Visual Studio and deploy to your Hololens.