Azure Kinect DK

Azure Kinect DK is a developer kit and PC peripheral with advanced artificial intelligence (AI) sensors for sophisticated computer vision and speech models. It combines a best-in-class depth sensor and a spatial microphone array with a video camera and orientation sensor—all in one small device with multiple modes, options, and SDKs.

 
You can also learn  our collaboration and triage process here: https://github.com/microsoft/Azure-Kinect-Sensor-SDK/blob/develop/CONTRIBUTING.md
  • Hot ideas
  • Top ideas
  • New ideas
  • My feedback
  1. Support for Ubuntu 20.04 LTS

    Ubuntu 20.04 LTS has been released. It appears that the packages for 18.04 LTS do not work properly on 20.04 LTS. It would be great if Azure Kinect DK can be supported on Ubuntu 20.04 LTS too.

    106 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    under review  ·  56 comments  ·  Flag idea as inappropriate…  ·  Admin →
  2. Legacy Body Tracking (like Kinect v2!!)

    Lets face it.. using machine learning for body tracking is cool and exciting, but we all miss the speed, efficiency, and reliability of the good old Kinect v2 body tracking.

    You don’t need an expensive gaming rig to run Kinect v2 body tracking, it isn’t riddled with latency, it runs way faster and is often more accurate.

    Azure Kinect body tracking currently uses a DNN model to derive the skeleton, the Kinect v2 uses a ‘random forest’ model.

    Here are 7 reasons why we need a legacy ‘random forest’ body tracking option on the Azure Kinect:

    1) SPEED
    When you…

    182 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    31 comments  ·  body tracking sdk  ·  Flag idea as inappropriate…  ·  Admin →
  3. Please provide a Visual Inertial Odometry (VIO) method to get position and orientation of the camera

    It is very important for vision application (robotics, mobile tracking) to provide a VIO (visual inertial odometry) method in order to get position and orientation of the camera.
    All the hardware components are already embedded in the Kinect Azure (IMU, depth camera, color camera), it would be a shame not to use them.
    All the competitor already provide such feature with the SDK of their depth cameras (intel realsense, Zed stereo-camera) and a lot of AR mobile development kit also (ArKit, ArCore,...).
    Do you plan to develop such feature ?

    44 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    need-feedback  ·  9 comments  ·  sensor sdk  ·  Flag idea as inappropriate…  ·  Admin →
  4. Fully articulated hand tracking and classifiers for hand states.

    Please provide a classifier for the hand states (at least for 'open' & 'closed' hands) for each hand. Of course, other hand and finger poses may be added as well. A hand state classifier would provide good means for interaction with virtual objects and UI elements.

    This suggestion is referring to the unfinished part of this (now closed) feature request: https://feedback.azure.com/forums/920053-azure-kinect-dk/suggestions/38154784-hands-support-in-body-tracking

    140 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    21 comments  ·  body tracking sdk  ·  Flag idea as inappropriate…  ·  Admin →
  5. Please allow for macOS support. ( should be minimal port from linux ).

    I have been trying the linux install instructions on macOS.

    It seems that most steps in CMake work, but the DepthEngine is Windows/Nix only.

    Would be amazing if you could release the DepthEngine for macOS.
    The rest should be achievable by the community / via Pull Request etc.

    A huge number of our community ( openFrameworks ) would make good use of macOS support.

    Thank you!
    Theo

    226 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    unplanned  ·  72 comments  ·  sensor sdk  ·  Flag idea as inappropriate…  ·  Admin →
  6. Please start selling the Azure Kinect in Canada

    We would like to develop on the Azure Kinect for our research projects in Canada and were wondering when the product will be available for purchase in Canada. Hopefully soon, I don't understand why it can be bought in the States but not in Canada.

    4 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    10 comments  ·  hardware  ·  Flag idea as inappropriate…  ·  Admin →
  7. Baby body tracking support

    Azure Kinect body tracking currently doesn't work with babies(especially newborns).
    If it works, we can use it in use-cases like monitoring babies for safety and supporting baby's health care.

    Please consider to update Azure Kinect body tracking DNN models for baby body tracking.

    Thank you.

    8 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    under review  ·  0 comments  ·  body tracking sdk  ·  Flag idea as inappropriate…  ·  Admin →
  8. Kinect data on GPU with `gpu::GpuMat`, `ogl::Buffer`, `ogl::Texture2D`, or OpenGL handles

    Add access to Kinect data via cv::gpu::GpuMat, ogl::Buffer, cv::ogl::Texture2D, and/or OpenGL handles to keep data on GPU and greatly reduce GPU<->CPU memory churn for image processing, computation, etc. As I so far understand the codebase, almost all work by this SDK codebase is done on the CPU. (depthengine is not part of this SDK codebase)

    For the same reasons that depth engine is written for GPU usage...our apps need to use the GPU. Developers on tiny industrial platforms up to workstations need the Kinect data to stay on the GPU to scale across the variety of computing platforms. Forcing download…

    10 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    need-feedback  ·  0 comments  ·  sensor sdk  ·  Flag idea as inappropriate…  ·  Admin →
  9. Support headless OpenGL on Linux using EGL for the depthengine library

    EGL can be used to avoid the X11 dependency.

    "With the arrival of EGL, taking advantage of OpenGL on a headless server has become even simpler, making it unnecessary to run an X server or any other tools. It does, however, require some slight modifications to your OpenGL context management code using EGL functions, as described in a previous post."
    - https://developer.nvidia.com/blog/linking-opengl-server-side-rendering/

    As the article suggest GLVND might be useful for accomplishing this.

    4 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  10. ARM Support for Linux

    Support the Azure Kinect Sensor SDK for Linux on ARM on NVIDIA Jetson Nano or similar embedded dev platforms.

    152 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    24 comments  ·  sensor sdk  ·  Flag idea as inappropriate…  ·  Admin →
  11. Body Tracking without cuDNN

    The Body Tracking use cuDNN and a powerful gamer PC with an NVidia wheras KInect 1 and 2 worked on simple core I3 / core i5 laptop years ago.

    Any chance to have a workaround with a lighter skeletal tracking ?
    It seems also the skeletal tracking is less accurate

    96 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    planned  ·  11 comments  ·  hardware  ·  Flag idea as inappropriate…  ·  Admin →
  12. Release a V2 with integrated body tracking

    In light of the long-running discussions about body tracking latency, as well as the request for the prior Xbox Kinect body tracking algorithms to avoid the difficulty of using a GPU in every system, the only complete solution is to integrate the CUDA cores and some RAM into the sensor. This would allow direct communication between the sensors internal processor and the CUDA array, without the delay of routing through the computer; this will both reduce latency and remove the requirement for a discrete GPU in the computer. And, this will finally enable the 'killer app' feature of the sensors:…

    5 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  hardware  ·  Flag idea as inappropriate…  ·  Admin →
  13. body tracker configuration for laptop

    One of the big limitation of the current body tracker is the hardware requirement.
    In our use case, we need to assess the motion of peoples in different environment, so we need to perform these motion captures with laptop.
    Unfortunately such hardware requirement (e.g. GTX 1070 or RTX 2070), is only embedded in gaming laptop and need too much power to work in mobility (in battery mode).
    We think it is very important to add more configuration possibilities for the body tracking. For example à lighter model compatible with lower grade graphics cards (GTX 1650 for example).

    42 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    under review  ·  5 comments  ·  body tracking sdk  ·  Flag idea as inappropriate…  ·  Admin →
  14. Azure Kinect DK Unreal 4 Support

    Support for Unreal 4 would be greatly appreciated, even if it is something as a curious pass. Unity is easy and all, but shouldn't be the only one to get your attention.

    I myself have gotten body tracking to work in UE4, but I'm like an amateur trying to scuba for the first time in an underwater cave. Conversions to drive a virtual body turn out to be something that is beyond me. On the flip side, so long as I'm not asking for direct rotations, my little plugin works fairly well.

    28 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    18 comments  ·  sensor sdk  ·  Flag idea as inappropriate…  ·  Admin →
  15. Python support

    Let developers use Python on Windows and Linux to build machine learning applications based on Azure Kinect more easily.

    97 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    under review  ·  6 comments  ·  sensor sdk  ·  Flag idea as inappropriate…  ·  Admin →
  16. Body tracking on HoloLens2.

    My team needs to implement body tracking on the HoloLens2.
    Will MS release a market standard that works on HL2 or will we have to engineer our own solution?
    Love the idea of how it could be done Chris posted on GitHub: https://github.com/microsoft/Azure-Kinect-Sensor-SDK/issues/1253
    Would very much appreciate knowing whether or not there will be a solution provided by MS so my team doesn't have to waste time running in front of the train.
    Thanks!

    3 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    need-feedback  ·  0 comments  ·  body tracking sdk  ·  Flag idea as inappropriate…  ·  Admin →
  17. Gesture Recognition Tool

    Years ago, Kinect v2 was available with a great tool to anotate gesture on a video recording and perform complexe gesture recognition (like golf swing) it would be great to have a similar tool for Azure Kinect DK

    18 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    need-feedback  ·  3 comments  ·  body tracking sdk  ·  Flag idea as inappropriate…  ·  Admin →
  18. Azure Kinect Andriod Support

    Azure Kinect Android Support. There are a number of fitness devices that could leverage body tracking but those run on Android based devices today and would have to re-platform to leverage Kinect.

    11 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    3 comments  ·  sensor sdk  ·  Flag idea as inappropriate…  ·  Admin →
  19. Start selling in the whole of Europe

    Many votes for "Start selling it in Europe" came from people outside germany and the uk.
    Please consider to start selling to all of us sooner.

    11 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    9 comments  ·  Flag idea as inappropriate…  ·  Admin →
  20. UWP Support

    Enable UWP applications to get access to the Azure Kinect Sensor data.

    68 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    unplanned  ·  11 comments  ·  sensor sdk  ·  Flag idea as inappropriate…  ·  Admin →
← Previous 1 3
  • Don't see your idea?

Azure Kinect DK

Categories

Feedback and Knowledge Base