Azure Data Explorer

  1. Provide out of the box resource governance for Kusto clusters

    Our Kusto cluster is used for production site and tools and needs to have 99.99% availability. However, as our cluster is open to tens of thousands of users across the company for ad-hoc queries, we often suffer from unexpected cluster wide outages due to misbehaved customers. We have tried both cluster-wide query limits as well as customized approaches, however, neither is helping us much. We would like to see Kusto to provide the resource governance solution out of box.

    31 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    planned  ·  5 comments  ·  Flag idea as inappropriate…  ·  Admin →
  2. Row level security

    Add read and write access at row level within a table

    22 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  3. LINQ support / Fluent Query Builder APIs for .NET and Python

    The Kusto SDKs are very good, but it would be even better if instead of handling Kusto queries as strings, we could write them using a fluent query builder library. It would be awesome if Kusto supported LINQ for .NET, meanwhile for Python, a simple query builder DSL should be possible.

    18 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  4. Permissions by views

    I would be useful to be able to restrict specific users to only be able to access data to a specific view
    (without direct access underlying tables). This could enable use to limit specific users access to time series data for a specific period or specific equipment.

    15 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  5. Add option to ingest from Azure Data Lake Store

    It would be great if we could ingest from Azure Data Lake Store instead of just Azure Blob Storage.

    15 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  6. Add ".update" management command to allow correct wrong ingested data

    When data gets wrongly ingested into ADX, it very hard to correct this data afterwards. -> I know ADX is a append-only store.

    Let's say a sending machine had issues with daylight saving time and all data is shifted and after some days, it gets recognized and the machine is sending correct values. There is small slice of data, which needs to be aligned.

    Or some properties where wrongly set over some time. Same as above.

    Currently, we use the ".purge" command and re-ingest the data, which leads to a wrong "ingestion-time". Another option is completely re-ingest the data into…

    14 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  7. Geo data types and spatial queries

    Natively support geo data types and spatial queries to enable geospatial analytics

    14 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    2 comments  ·  Flag idea as inappropriate…  ·  Admin →
  8. Table Level Security

    Add read and write access at table level

    13 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    2 comments  ·  Flag idea as inappropriate…  ·  Admin →
  9. Duplicate removal during ingestion

    enable configurable capability to remove duplicate rows during ingestion

    12 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  10. Mapping EventData properties during Event Hub ingestion

    When configuring a JSON Ingestion Mappings pre-created on a table, we couldn't map and access Properties which are set by Event Hub service in the EventData.SystemPropertiesCollection structure of each received message. These Properties are:
    • PartitionId
    • SequenceNumber
    • Offset
    • EnqueuedTimeUtc

    But also we could have to map any custom properties that we want to store in the same collection when sending messages to event hub.

    8 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  11. Add syntax for aggregation over partitions

    It would be helpful to have KQL syntax for expressing aggregation over a partition without summarization.

    Something like adding a "by" to an "extend" clause:

    StormEvents
    | project State, EventId, StartTime, DeathsDirect
    | extend TotalDeathsDirectInState = sum(DeathsDirect) by State

    Currently the only way to do this in KQL is by joining to a subquery. The equivalent SQL is like:

    SELECT
    State,
    EventId,
    StartTime,
    DeathsDirect,
    SUM(DeathsDirect) OVER (PARTITION BY State) AS TotalDeathsDirectInState
    FROM StormEvents

    8 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  12. Add option to define separator and escape characters for Csv ingest

    It would be great if we could customize the separator and escape characters when ingesting Csv files because sometimes the Csv aren't according to the general rules for Csv.

    7 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  13. Allow creation of Tables & Data Maps in ARM template

    It doesn't make much sense that ARM template deploy of AzDEx allows for creation of Clusters, Databases, and DataConnections when DataConnections expliclity depend on a Table and DataMap to exist. In fact the error message is simply "Bad Input" with an "Internal Server Error" if somebody mistakenly tries to do this..

    DEx should be able to be fully-configurable via ARM including Tables and Datamaps so the existing capability of creating DataConnections via ARM is able to actually be used.

    6 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  14. Autoscale form 1 VM on Azure Data Explorer's Data Management cluster

    Autoscale form 1 VM on Azure Data Explorer's Data Management cluster

    6 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  15. Add Azure Data Explorer to Azure Stack

    Provide ability to run Azure Data Explorer on Azure Stack

    6 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  16. Add something like ingestion_time() for follower databases

    Our data pipeline is very sensitive to how long it takes data to arrive. The ingestion_time() feature is incredibly useful for understanding the distribution of ingestion delays for each table. Now that we're using follower databases more frequently, we don't have good insight into how long it takes for the data to be queryable from our follower database. It's something like ingestion_time() + metadataRefreshDuration... but there's no additional field that we can query to get that metadataRefreshDuration. Adding this information would give us a lot more ability to tune our pipeline to the characteristics of each situation.

    5 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  17. Integration with Azure portal dashboard. Create a tile in portal.azure.com that queries a kusto cluster.

    I'd like to be able to create a dashboard on the Azure portal that executes kusto queries against any kusto cluster. Today, you can pin any azure monitor kusto query to the dashboard. I'd like to do the same for my own kusto cluster.

    There is a feature to export to Power BI, but it would be great if there was integration Azure portal as well

    5 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  18. Ability to view and change data management endpoint SKU from Azure Portal

    Currently it's required to create a support ticket in order to change the data management endpoint SKU when there is a need for scaling the ingestion through event hub to a database table in ADX. The ability to view and change the endpoint scaling from the portal would be a great feature.

    5 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  19. WithAadUserPromptAuthentication method not available in .NetStandard library

    In Kusto.data Nuget for .NET framework WithAadUserPromptAuthentication method is available in KustoCOnnectionStringBuilder class.

    However this is missing from .NetStandard Nuget library.

    Can this be added?

    Eg:

    KustoConnectionStringBuilder($"https://{serviceName}.kusto.windows.net") .WithAadUserPromptAuthentication(authority);

    5 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  20. Add option to ingest Azure Storage folders

    It would be great if we could ingest a folder containing multiples files in Azure Storage, for example by using wildcards, instead of having to ingest all files individually.

    5 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
← Previous 1 3 4
  • Don't see your idea?

Azure Data Explorer

Categories

Feedback and Knowledge Base