Azure Kinect DK
Azure Kinect DK is a developer kit and PC peripheral with advanced artificial intelligence (AI) sensors for sophisticated computer vision and speech models. It combines a best-in-class depth sensor and a spatial microphone array with a video camera and orientation sensor—all in one small device with multiple modes, options, and SDKs.
-
Legacy Body Tracking (like Kinect v2!!)
Lets face it.. using machine learning for body tracking is cool and exciting, but we all miss the speed, efficiency, and reliability of the good old Kinect v2 body tracking.
You don’t need an expensive gaming rig to run Kinect v2 body tracking, it isn’t riddled with latency, it runs way faster and is often more accurate.
Azure Kinect body tracking currently uses a DNN model to derive the skeleton, the Kinect v2 uses a ‘random forest’ model.
Here are 7 reasons why we need a legacy ‘random forest’ body tracking option on the Azure Kinect:
1) SPEED
When you…214 votesThank you for your suggestion. We would like to get more input from the community for this proposal.
-
Fully articulated hand tracking and classifiers for hand states.
Please provide a classifier for the hand states (at least for 'open' & 'closed' hands) for each hand. Of course, other hand and finger poses may be added as well. A hand state classifier would provide good means for interaction with virtual objects and UI elements.
This suggestion is referring to the unfinished part of this (now closed) feature request: https://feedback.azure.com/forums/920053-azure-kinect-dk/suggestions/38154784-hands-support-in-body-tracking
158 votesThank you for the interest! If more customers will vote for this issue, we will consider adding the support.
-
body tracker configuration for laptop
One of the big limitation of the current body tracker is the hardware requirement.
In our use case, we need to assess the motion of peoples in different environment, so we need to perform these motion captures with laptop.
Unfortunately such hardware requirement (e.g. GTX 1070 or RTX 2070), is only embedded in gaming laptop and need too much power to work in mobility (in battery mode).
We think it is very important to add more configuration possibilities for the body tracking. For example à lighter model compatible with lower grade graphics cards (GTX 1650 for example).46 votes -
Gesture Recognition Tool
Years ago, Kinect v2 was available with a great tool to anotate gesture on a video recording and perform complexe gesture recognition (like golf swing) it would be great to have a similar tool for Azure Kinect DK
22 votes -
Unreal Engine support / Live-Link plugin
Access pose data from the body tracking SDK within Unreal Engine to drive character animation in realtime.
11 votesWe are looking for more community feedback to prioritize this feature request.
We also encourage you to take advantage of our open source sensor SDK to implement new features. -
Baby body tracking support
Azure Kinect body tracking currently doesn't work with babies(especially newborns).
If it works, we can use it in use-cases like monitoring babies for safety and supporting baby's health care.Please consider to update Azure Kinect body tracking DNN models for baby body tracking.
Thank you.
9 votes -
Body motion Heat Map
Provide a sample to track bodies on there motion on a plan. Like tracking people moving in a shop. And build a heatmap
5 votesThank you for the suggestion. We are currently investigating this opportunity.
-
Support for 30 series RTX
Please add support for the 30 series nvidia GFX cards.
Right now body tracking does not work at all.
4 votesThe team is currently working on a new release of the BT SDK which includes NVIDIA 30 series card support.
-
Sample with 3D Model (using tranformation matrix)
All coordinates are computed from the kinect location. Can you build in a transformation matrix or a sample to be able to use a real rigged 3D model.
3D models have joint rotation, location computed from other joint not from absolute position.
This computation cost CPU and is complicated, a sample would be great. A sample with Microsoft BabylonJS would be awesome !
4 votesThank you for the ask. We would consider adding the sample if more customers will vote for it.
-
Body tracking on HoloLens2.
My team needs to implement body tracking on the HoloLens2.
Will MS release a market standard that works on HL2 or will we have to engineer our own solution?
Love the idea of how it could be done Chris posted on GitHub: https://github.com/microsoft/Azure-Kinect-Sensor-SDK/issues/1253
Would very much appreciate knowing whether or not there will be a solution provided by MS so my team doesn't have to waste time running in front of the train.
Thanks!3 votes -
Track the lower body only
I'm in the UK and haven't had a chance to test the system yet. The Kinect only worked with a full body skeleton - it couldn't track if it couldn't see the upper body.
I'm doing gait analysis and can only see the lower body - does the current system work with lower body only? If not, please add it :)
2 votesWe will investigate and respond shortly.
-
Person detection and tracking from a top view angle
Is the Azure able to detect and track people in a top down view?
I need to use it in a dark room setting so color information will not be available1 vote -
Please support RTX 30XX cards
or update your system requirements for the Kinect (Body) SDK !!!!!!!
1 voteBT SDK v1.1 release with support for RTX 30xx card is immanent.
-
Body tracking for head first postures
I am starting my master thesis on detecting a gymnastic routine (parallel-bar), However, for now, as soon as the shoulders are below the hips, the body is not detected anymore. Which is needed for e.g. a handstand.
I would like to change that and retrain the deep neural network by providing the needed data. Can I somehow participate and improve the .onnx file?1 vote -
Best compatible GPU for body tracking?
Which is the best Nvidia GPU currently supported by the body tracking SDK? I tried with an RTX 3070 but the program gets stuck on creation of the tracker object unless I run it in CPU mode (which works but is slow). Upon searching online, I found out that this is a common issue with the RTX 30 series card. Before I buy a new card, I just want to make sure it's compatible.
OS: Ubuntu 18.04
Body tracking SDK: v1.0.0
Nvidia Driver version for 3070: Tried with both 455 and 4601 vote -
custom object tracking
Using point cloud data i want to track a custom object if i can upload its 3d object file somewhere. Ideally it would provide 6 degrees of freedom and be compatible with game engines like unity.
1 vote -
The ability to get the Body Parts Segmentation from the CNN
The AKBT SDK creates a body parts segmentation map for each body it detects when performing body pose estimation. Making these maps accessible through the API would open up the possibility for us developers to use this in our applications.
1 vote -
3d joint position and body poses similarity
- I get the joint position in the sample of simple3dviewer at line 174. I would like to ask which coordinate system does the joint position correspond to? Is it the camera coordinate system?
2.Please provide an example about measuring the similarity between two human poses
1 vote - I get the joint position in the sample of simple3dviewer at line 174. I would like to ask which coordinate system does the joint position correspond to? Is it the camera coordinate system?
-
Sample video files of multi-camera Skeleton Tracking
Hi Kinect Team,
I wanted to ask if the Azure Kinect Documentation could provide sample video of two synced cameras with a subject preforming simple actions.This would help development teams with only one camera or teams that currently don't have access to record themselves.
I appreciate your teams work,
Adrian Babilinski1 voteWe have recordings already and working on the legal approval to make them publicly available.
-
1 vote
- Don't see your idea?