Azure Data Explorer

How can we improve Azure Data Explorer?

(thinking…)

Enter your idea and we'll search to see if someone has already suggested it.

If a similar idea already exists, you can support and comment on it.

If it doesn't exist, you can post your idea so others can support it.

Enter your idea and we'll search to see if someone has already suggested it.

  1. Provide out of the box resource governance for Kusto clusters

    Our Kusto cluster is used for production site and tools and needs to have 99.99% availability. However, as our cluster is open to tens of thousands of users across the company for ad-hoc queries, we often suffer from unexpected cluster wide outages due to misbehaved customers. We have tried both cluster-wide query limits as well as customized approaches, however, neither is helping us much. We would like to see Kusto to provide the resource governance solution out of box.

    12 votes
    Sign in
    Check!
    (thinking…)
    Reset
    or sign in with
    • facebook
    • google
      Password icon
      Signed in as (Sign out)

      We’ll send you updates on this idea

      1 comment  ·  Flag idea as inappropriate…  ·  Admin →
    • Row level security

      Add read and write access at row level within a table

      7 votes
      Sign in
      Check!
      (thinking…)
      Reset
      or sign in with
      • facebook
      • google
        Password icon
        Signed in as (Sign out)

        We’ll send you updates on this idea

        0 comments  ·  Flag idea as inappropriate…  ·  Admin →
      • Add option to ingest from Azure Data Lake Store

        It would be great if we could ingest from Azure Data Lake Store instead of just Azure Blob Storage.

        7 votes
        Sign in
        Check!
        (thinking…)
        Reset
        or sign in with
        • facebook
        • google
          Password icon
          Signed in as (Sign out)

          We’ll send you updates on this idea

          0 comments  ·  Flag idea as inappropriate…  ·  Admin →
        • Duplicate removal during ingestion

          enable configurable capability to remove duplicate rows during ingestion

          6 votes
          Sign in
          Check!
          (thinking…)
          Reset
          or sign in with
          • facebook
          • google
            Password icon
            Signed in as (Sign out)

            We’ll send you updates on this idea

            0 comments  ·  Flag idea as inappropriate…  ·  Admin →
          • Geo data types and spatial queries

            Natively support geo data types and spatial queries to enable geospatial analytics

            4 votes
            Sign in
            Check!
            (thinking…)
            Reset
            or sign in with
            • facebook
            • google
              Password icon
              Signed in as (Sign out)

              We’ll send you updates on this idea

              0 comments  ·  Flag idea as inappropriate…  ·  Admin →
            • 4 votes
              Sign in
              Check!
              (thinking…)
              Reset
              or sign in with
              • facebook
              • google
                Password icon
                Signed in as (Sign out)

                We’ll send you updates on this idea

                0 comments  ·  Flag idea as inappropriate…  ·  Admin →
              • Add option to ingest Azure Storage folders

                It would be great if we could ingest a folder containing multiples files in Azure Storage, for example by using wildcards, instead of having to ingest all files individually.

                4 votes
                Sign in
                Check!
                (thinking…)
                Reset
                or sign in with
                • facebook
                • google
                  Password icon
                  Signed in as (Sign out)

                  We’ll send you updates on this idea

                  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                • Add option to define separator and escape characters for Csv ingest

                  It would be great if we could customize the separator and escape characters when ingesting Csv files because sometimes the Csv aren't according to the general rules for Csv.

                  4 votes
                  Sign in
                  Check!
                  (thinking…)
                  Reset
                  or sign in with
                  • facebook
                  • google
                    Password icon
                    Signed in as (Sign out)

                    We’ll send you updates on this idea

                    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
                  • Kafka sync

                    The ability to stream data from Kafka, either on premise on in the cloud.

                    3 votes
                    Sign in
                    Check!
                    (thinking…)
                    Reset
                    or sign in with
                    • facebook
                    • google
                      Password icon
                      Signed in as (Sign out)

                      We’ll send you updates on this idea

                      1 comment  ·  Flag idea as inappropriate…  ·  Admin →
                    • Have an desktop client that allows sharing of queries, i.e. integration with data studio

                      It would be awesome to have the capability to connect to Azure Data Explorer from Azure Data Studio so I can use one IDE for all my data style analytics.

                      2 votes
                      Sign in
                      Check!
                      (thinking…)
                      Reset
                      or sign in with
                      • facebook
                      • google
                        Password icon
                        Signed in as (Sign out)

                        We’ll send you updates on this idea

                        0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                      • Add syntax for aggregation over partitions

                        It would be helpful to have KQL syntax for expressing aggregation over a partition without summarization.

                        Something like adding a "by" to an "extend" clause:

                        StormEvents
                        | project State, EventId, StartTime, DeathsDirect
                        | extend TotalDeathsDirectInState = sum(DeathsDirect) by State

                        Currently the only way to do this in KQL is by joining to a subquery. The equivalent SQL is like:

                        SELECT
                        State,
                        EventId,
                        StartTime,
                        DeathsDirect,
                        SUM(DeathsDirect) OVER (PARTITION BY State) AS TotalDeathsDirectInState
                        FROM StormEvents

                        2 votes
                        Sign in
                        Check!
                        (thinking…)
                        Reset
                        or sign in with
                        • facebook
                        • google
                          Password icon
                          Signed in as (Sign out)

                          We’ll send you updates on this idea

                          0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                        • Time Discrete view for power bi.

                          We use ADX as time series DB and
                          a BI dashboarding tool (power bi)

                          But BI don't like non Discrete time events, no calculations are possible, and the Bi aggregation are calculated not correctly (group by, avg)

                          If we have a time discrete view , every BI tool will work very lovely.

                          Comment:
                          Make series are nice, but will not work , because it's in the pipelines before power bi, and the query optimizer will fail, an calculating a make series for all our 3 million device's an than lock to the power bi where time and device filter.

                          Maybe…

                          2 votes
                          Sign in
                          Check!
                          (thinking…)
                          Reset
                          or sign in with
                          • facebook
                          • google
                            Password icon
                            Signed in as (Sign out)

                            We’ll send you updates on this idea

                            0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                          • Make series with optional limit

                            Make series have only 100.000 Points, it will be nice if we Can increase limit with a optional parameter like how is done by mvexpand.

                            We done some 2time resampling on time data, and in the first step 100.000 are not enough.

                            2 votes
                            Sign in
                            Check!
                            (thinking…)
                            Reset
                            or sign in with
                            • facebook
                            • google
                              Password icon
                              Signed in as (Sign out)

                              We’ll send you updates on this idea

                              1 comment  ·  Flag idea as inappropriate…  ·  Admin →
                            • Add full XML support

                              the EU is using XML for all financial reporting, it would be great if Azure Data Explorer could ingest and flattten the XML data

                              2 votes
                              Sign in
                              Check!
                              (thinking…)
                              Reset
                              or sign in with
                              • facebook
                              • google
                                Password icon
                                Signed in as (Sign out)

                                We’ll send you updates on this idea

                                0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                              • WithAadUserPromptAuthentication method not available in .NetStandard library

                                In Kusto.data Nuget for .NET framework WithAadUserPromptAuthentication method is available in KustoCOnnectionStringBuilder class.

                                However this is missing from .NetStandard Nuget library.

                                Can this be added?

                                Eg:

                                KustoConnectionStringBuilder($"https://{serviceName}.kusto.windows.net") .WithAadUserPromptAuthentication(authority);

                                1 vote
                                Sign in
                                Check!
                                (thinking…)
                                Reset
                                or sign in with
                                • facebook
                                • google
                                  Password icon
                                  Signed in as (Sign out)

                                  We’ll send you updates on this idea

                                  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                                • add ContainsAnyOfTheFollowing operator

                                  Just need the following native kusto function:

                                  Mytable
                                  | where field1 containsAnyOfTheFollowing (“a”, “b”, “c”)

                                  1 vote
                                  Sign in
                                  Check!
                                  (thinking…)
                                  Reset
                                  or sign in with
                                  • facebook
                                  • google
                                    Password icon
                                    Signed in as (Sign out)

                                    We’ll send you updates on this idea

                                    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                                  • Downsampling data over time

                                    As data ages, storage and query could be further optimized by down sampling the data. There should be a process or method to provide an aggregate query that could run on data older than X time. Example: My database retention is 365 days and i ingest 3 samples per minute. After data is 31 days old i can provide a query that will aggregate by MAX value over 1 minute. After 90 days, another aggregate runs that finds the Max value over 5 minutes. Raw data is of course deleted after aggregate runs.

                                    1 vote
                                    Sign in
                                    Check!
                                    (thinking…)
                                    Reset
                                    or sign in with
                                    • facebook
                                    • google
                                      Password icon
                                      Signed in as (Sign out)

                                      We’ll send you updates on this idea

                                      0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                                    • Copy Permissions from one ADE DB to another

                                      I have multiple ADE databases within the same cluster, i would like to have the ability to copy permissions from one DB to another using an internal tool instead of doing so manually.

                                      1 vote
                                      Sign in
                                      Check!
                                      (thinking…)
                                      Reset
                                      or sign in with
                                      • facebook
                                      • google
                                        Password icon
                                        Signed in as (Sign out)

                                        We’ll send you updates on this idea

                                        0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                                      • Table Level Security

                                        Add read and write access at table level

                                        1 vote
                                        Sign in
                                        Check!
                                        (thinking…)
                                        Reset
                                        or sign in with
                                        • facebook
                                        • google
                                          Password icon
                                          Signed in as (Sign out)

                                          We’ll send you updates on this idea

                                          0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                                        • R sdk

                                          In r studio, we want to get our time series data,

                                          1 vote
                                          Sign in
                                          Check!
                                          (thinking…)
                                          Reset
                                          or sign in with
                                          • facebook
                                          • google
                                            Password icon
                                            Signed in as (Sign out)

                                            We’ll send you updates on this idea

                                            0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                                          ← Previous 1
                                          • Don't see your idea?

                                          Azure Data Explorer

                                          Feedback and Knowledge Base