Azure Kinect Unity

Posted on by



Azure kinect unity3d

Examples

SimpleVisualizer

The k4a-tools package includes the Azure Kinect Viewer, the Azure Kinect Recorder, and the Azure Kinect Firmware Tool. To install the package, run: sudo apt install k4a-tools This command installs the dependency packages that are required for the tools to work correctly, including the latest version of libk4a. Use Microsoft's Azure Kinect SDK in Unity3D and C#. Supports the Camera and Body Tracking SDKs. AVATEERING; VIDEO RECORDING; FITTING ROOM; PLUG & PLAY; EASY TO USE; NO INSTALLATION REQUIRED. UnityでAzureKinect BodyTracking; そもそもUnityで使えるのか.？ (前述のとおり)Unityの公式BodyTrakcingSDKなんてものはない しかし情報を漁ると色々出てくる →たぶんできそう(本日の軽率ポイント) 検証環境 Unity：2018.4.x Azure Kinect SDK：1.4.0 Azure Kinect Body Tracking SDK：1.0.0.

OrientationEstimator

Tested environment

  • Unity 2018.4.21f1
  • Azure Kinect SDK 1.4.0
  • Windows 10

Azure Kinect Unity Point Cloud

Initial setup for a new project

1. Install Azure Kinect SDK

2. Setup a Unity project

2.1. Create a new Unity project

2.2. Download and import NuGetForUnity (NuGetForUnity.2.0.0.unitypackage)
https://github.com/GlitchEnzo/NuGetForUnity/releases/tag/v2.0.0

2.3. Install Microsoft.Azure.Kinect.Sensor package

2.4. Copy dll files from the SDK folder
Copy “depthengine_2_0.dll” and “k4a.dll” from the SDK installation folder to Plugins folder.

Azure Kinect Unity

SDK installation folder
C:Program FilesAzure Kinect SDK v1.4.0sdkwindows-desktopamd64releasebin

Plugins folder

2.5. Import AzureKinect4Unity

Third party assets

Azure Kinect Unity Plugin

このプロジェクトには、以下のアセットが含まれています。
The following assets are included in this project.

  • Microsoft Azure Kinect Sensor SDK
    Microsoft Azure Kinect Sensor SDK files (the .dll files contained in the Assets/Plugins/AzureKinectSDK.1.4.0 directory) are distributed under the Microsoft Software License Terms.

    Please see the following license page for complete terms.
    https://www.nuget.org/packages/Microsoft.Azure.Kinect.Sensor/1.4.0/License

  • System.Buffers.4.4.0
    Licensed under the MIT License. Copyright © .NET Foundation and Contributors.

  • Torrentz2 movie download 2018 hd. System.Memory.4.5.3
    Licensed under the MIT License. Copyright © .NET Foundation and Contributors.

  • System.Numerics.Vectors.4.5.0
    Licensed under the MIT License. Copyright © .NET Foundation and Contributors.

  • System.Runtime.CompilerServices.Unsafe.4.5.2
    Licensed under the MIT License. Copyright © .NET Foundation and Contributors.

Kinect

Azure Kinect Unity3d

License

Azure Kinect Face Tracking

このプロジェクトは、サードパーティのアセットを除き、MIT Licenseでライセンスされています。
This project is licensed under the MIT License excluding third party assets.

Azure Kinect Unity Body Tracking

This is a set of Azure Kinect (aka ‘Kinect for Azure’, K4A) examples that use several major scripts, grouped in one folder. The package currently contains over thirty five demo scenes. Apart of the Azure Kinect sensor (aka K4A), the K4A-package supports the 'classic' Kinect-v2 (aka Kinect for Xbox One) sensor, as well as Intel RealSense D400-series sensors.
Web | Forum | Twitter | Docs | Tips&Tricks
The avatar-demo scenes show how to utilize Kinect-controlled avatars in your scenes, gesture demo – how to use discrete and continuous gestures in your projects, fitting room demos – how to overlay or blend the user’s body with virtual models, background removal demo – how to display user silhouettes on virtual background, point cloud demos - how to show the environment or users as meshes in your scene, etc. Short descriptions of all demo-scenes are available in the online documentation.
This package works with Azure Kinect (aka Kinect for Azure, K4A), Kinect-v2 (aka Kinect for Xbox One) and Intel RealSense D400-series sensors. It can be used with all versions of Unity – Free, Plus & Pro.
How to Run the Demo Scenes:
1. (Azure Kinect) Download and install the latest release of Azure-Kinect Sensor SDK. The download link is below. Then open 'Azure Kinect Viewer' to check, if the sensor works as expected.
2. (Azure Kinect) Follow the instructions on how to download and install the latest release of Azure-Kinect Body Tracking SDK and its related components. The link is below. Then open 'Azure Kinect Body Tracking Viewer' to check, if the body tracker works as expected.
3. (Kinect-v2) Download and install Kinect for Windows SDK 2.0. The download link is below.
4. (RealSense) Download and install RealSense SDK 2.0. The download link is below.
5. Import this package into a new Unity project.
6. Open ‘File / Build settings’ and switch to ‘PC, Mac & Linux Standalone’, Target platform: ‘Windows’ & Architecture: 'x86_64'.
7. Make sure that 'Direct3D11' is the first option in the ‘Auto Graphics API for Windows’-list setting, in 'Player Settings / Other Settings / Rendering'.
8. Open and run a demo scene of your choice from a subfolder of the 'AzureKinectExamples/KinectDemos'-folder. Short descriptions of all demo-scenes are available in the online documentation.
* The latest Azure Kinect Sensor SDK (v1.4.1) can be found here.
* The latest Azure Kinect Body Tracking SDK (v1.1.0) can be found here.
* Older releases of Azure Kinect Body Tracking SDK can be found here.
* Instructions how to install the body tracking SDK can be found here.
* Kinect for Windows SDK 2.0 can be found here.
* RealSense SDK 2.0 can be found here.
One request:
Please don't share this package or its demo scenes in source form with others, or as part of public repositories, without my explicit consent.
Troubleshooting:
* If Unity editor freezes or crashes at the scene start, please make sure the path where the Unity project resides does not contain any non-English characters.
* If you get syntax errors in console like 'The type or namespace name 'UI' does not exist..', please open the Package manager (menu Window / Package Manager) and install the 'Unity UI' package. The UI elements are extensively used in the K4A-asset demo scenes.
* If the Azure Kinect sensor cannot be started, because StartCameras()-method fails, please check again #6 in 'How to run the demo scenes'-section above.
* If you get a 'Can't create the body tracker'-error message, please check again #2 in 'How to run the demo scenes'-section above.
* Regarding RealSense, if you'd like to try its integration with the Cubemos skeleton tracking, please look at this tip.
* If there are errors like 'Shader error in [System 1]..', while importing the K4A-asset, please note this is not an error, but rather shader issues due to missing HDRP & VFX packages. You only need these packages for the VFX point-cloud demo. All other scenes should be started without any issues.
* If there are compilation errors in the console, or the demo scenes remain in 'Waiting for users'-state, make sure you have installed the respective sensor SDKs and the other needed components. Please also check, if the sensor is connected.
* For other known issues, please look here.
Documentation, Tips & Tricks:
* The basic documentation is available in the Readme-pdf file in the package.
* The online documentation is available here.
* Many K4A-package tips, tricks and examples are available here.
Third-Party Software:
This asset uses Azure Kinect Sensor SDK under MIT License, RealSense SDK 2.0 under Apache License Version 2.0 and Kinect SDK 2.0 under Microsoft Kinect for Windows v2 SDK License. See Third-Party Notices.txt file in the package for details.