Azure Kinect DK

Azure Kinect DK is a developer kit and PC peripheral with advanced artificial intelligence (AI) sensors for sophisticated computer vision and speech models. It combines a best-in-class depth sensor and a spatial microphone array with a video camera and orientation sensor—all in one small device with multiple modes, options, and SDKs.

 
You can also learn  our collaboration and triage process here: https://github.com/microsoft/Azure-Kinect-Sensor-SDK/blob/develop/CONTRIBUTING.md
  • Hot ideas
  • Top ideas
  • New ideas
  • My feedback
  1. Please allow for macOS support. ( should be minimal port from linux ).

    I have been trying the linux install instructions on macOS.

    It seems that most steps in CMake work, but the DepthEngine is Windows/Nix only.

    Would be amazing if you could release the DepthEngine for macOS.
    The rest should be achievable by the community / via Pull Request etc.

    A huge number of our community ( openFrameworks ) would make good use of macOS support.

    Thank you!
    Theo

    217 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    unplanned  ·  67 comments  ·  sensor sdk  ·  Flag idea as inappropriate…  ·  Admin →
  2. Legacy Body Tracking (like Kinect v2!!)

    Lets face it.. using machine learning for body tracking is cool and exciting, but we all miss the speed, efficiency, and reliability of the good old Kinect v2 body tracking.

    You don’t need an expensive gaming rig to run Kinect v2 body tracking, it isn’t riddled with latency, it runs way faster and is often more accurate.

    Azure Kinect body tracking currently uses a DNN model to derive the skeleton, the Kinect v2 uses a ‘random forest’ model.

    Here are 7 reasons why we need a legacy ‘random forest’ body tracking option on the Azure Kinect:

    1) SPEED
    When you…

    165 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    28 comments  ·  body tracking sdk  ·  Flag idea as inappropriate…  ·  Admin →
  3. ARM Support for Linux

    Support the Azure Kinect Sensor SDK for Linux on ARM on NVIDIA Jetson Nano or similar embedded dev platforms.

    149 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    24 comments  ·  sensor sdk  ·  Flag idea as inappropriate…  ·  Admin →
  4. Fully articulated hand tracking and classifiers for hand states.

    Please provide a classifier for the hand states (at least for 'open' & 'closed' hands) for each hand. Of course, other hand and finger poses may be added as well. A hand state classifier would provide good means for interaction with virtual objects and UI elements.

    This suggestion is referring to the unfinished part of this (now closed) feature request: https://feedback.azure.com/forums/920053-azure-kinect-dk/suggestions/38154784-hands-support-in-body-tracking

    132 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    21 comments  ·  body tracking sdk  ·  Flag idea as inappropriate…  ·  Admin →
  5. Body Tracking without cuDNN

    The Body Tracking use cuDNN and a powerful gamer PC with an NVidia wheras KInect 1 and 2 worked on simple core I3 / core i5 laptop years ago.

    Any chance to have a workaround with a lighter skeletal tracking ?
    It seems also the skeletal tracking is less accurate

    92 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    planned  ·  11 comments  ·  hardware  ·  Flag idea as inappropriate…  ·  Admin →
  6. Python support

    Let developers use Python on Windows and Linux to build machine learning applications based on Azure Kinect more easily.

    90 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    under review  ·  6 comments  ·  sensor sdk  ·  Flag idea as inappropriate…  ·  Admin →
  7. UWP Support

    Enable UWP applications to get access to the Azure Kinect Sensor data.

    68 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    unplanned  ·  11 comments  ·  sensor sdk  ·  Flag idea as inappropriate…  ·  Admin →
  8. Please provide a Visual Inertial Odometry (VIO) method to get position and orientation of the camera

    It is very important for vision application (robotics, mobile tracking) to provide a VIO (visual inertial odometry) method in order to get position and orientation of the camera.
    All the hardware components are already embedded in the Kinect Azure (IMU, depth camera, color camera), it would be a shame not to use them.
    All the competitor already provide such feature with the SDK of their depth cameras (intel realsense, Zed stereo-camera) and a lot of AR mobile development kit also (ArKit, ArCore,...).
    Do you plan to develop such feature ?

    44 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    need-feedback  ·  8 comments  ·  sensor sdk  ·  Flag idea as inappropriate…  ·  Admin →
  9. body tracker configuration for laptop

    One of the big limitation of the current body tracker is the hardware requirement.
    In our use case, we need to assess the motion of peoples in different environment, so we need to perform these motion captures with laptop.
    Unfortunately such hardware requirement (e.g. GTX 1070 or RTX 2070), is only embedded in gaming laptop and need too much power to work in mobility (in battery mode).
    We think it is very important to add more configuration possibilities for the body tracking. For example à lighter model compatible with lower grade graphics cards (GTX 1650 for example).

    41 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    under review  ·  5 comments  ·  body tracking sdk  ·  Flag idea as inappropriate…  ·  Admin →
  10. Azure Kinect DK Unreal 4 Support

    Support for Unreal 4 would be greatly appreciated, even if it is something as a curious pass. Unity is easy and all, but shouldn't be the only one to get your attention.

    I myself have gotten body tracking to work in UE4, but I'm like an amateur trying to scuba for the first time in an underwater cave. Conversions to drive a virtual body turn out to be something that is beyond me. On the flip side, so long as I'm not asking for direct rotations, my little plugin works fairly well.

    23 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    14 comments  ·  sensor sdk  ·  Flag idea as inappropriate…  ·  Admin →
  11. No microphone access available in API recorder (k4arecorder).

    There is no ability of your API recorder to record video and audio simultaneously from this camera. Whether or not another program can separately access the microphones through DirectShow or WASAPI is irrelevant. If it's not natively synced with the video through the API recorder then it doesn't matter, especially with multiple cameras, where that desynchronization will only compound. What's worse, is that the relevant programming for synchronous microphone access is available across platforms on the viewer, but is not mirrored in the recorder. What's the point if we can't even record audio and video together?

    22 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    2 comments  ·  sensor sdk  ·  Flag idea as inappropriate…  ·  Admin →
  12. Enable composite volumetric video from multiple sensors

    There is no clear example of how depth and video content can be combined to create a single volumetric video from multiple sensors. It is unclear if this is presently possible, and if it is, how it would be accomplished (a reference implementation example is needed).

    22 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    2 comments  ·  Flag idea as inappropriate…  ·  Admin →
  13. IMU example or API

    Please provide SDK API or at least example how to get the device rotation and change in position, according to the raw IMU data coming from device.

    21 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    7 comments  ·  sensor sdk  ·  Flag idea as inappropriate…  ·  Admin →
  14. Support Azure Spatial Anchors

    Given how these two features were marketed together, and conceptually work together in an obvious way, it's very surprising that the Azure Kinect DK doesn't work with Azure Spatial Anchors.

    We were counting on this for our product when the technologies were first announced. Disappointing to see spatial anchors only work on phones.

    20 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    4 comments  ·  sensor sdk  ·  Flag idea as inappropriate…  ·  Admin →
  15. Gesture Recognition Tool

    Years ago, Kinect v2 was available with a great tool to anotate gesture on a video recording and perform complexe gesture recognition (like golf swing) it would be great to have a similar tool for Azure Kinect DK

    17 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    need-feedback  ·  3 comments  ·  body tracking sdk  ·  Flag idea as inappropriate…  ·  Admin →
  16. Adjustable MJPG compression

    The MJPG is the fastest format for our works, the problem is the file size, as it said in the sdk (k4atypes.h)
    "Each MJPG encoded image in a stream may be of differing size depending on the compression efficiency."
    But, for now, we can't adjust the compression factor, it would be very helpful to integrate a simple method to make adjustable the compression of the MJPG format.

    15 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  sensor sdk  ·  Flag idea as inappropriate…  ·  Admin →
  17. Add SLAM function

    I was just asking myself, if the Azure could also provide a SLAM functionality, given the fact the Azure has a good visual camera and an IMU as well

    14 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  18. Publish CAD/3D data for the new Azure Kinect

    It would be cool if there was a public 3D model for the Kinect

    14 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    3 comments  ·  Flag idea as inappropriate…  ·  Admin →
  19. Support for Ubuntu 20.04 LTS

    Ubuntu 20.04 LTS has been released. It appears that the packages for 18.04 LTS do not work properly on 20.04 LTS. It would be great if Azure Kinect DK can be supported on Ubuntu 20.04 LTS too.

    12 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    under review  ·  2 comments  ·  Flag idea as inappropriate…  ·  Admin →
  20. Azure Kinect Andriod Support

    Azure Kinect Android Support. There are a number of fitness devices that could leverage body tracking but those run on Android based devices today and would have to re-platform to leverage Kinect.

    11 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    3 comments  ·  sensor sdk  ·  Flag idea as inappropriate…  ·  Admin →
← Previous 1 3
  • Don't see your idea?

Azure Kinect DK

Categories

Feedback and Knowledge Base