Azure Data Explorer

  1. Provide out of the box resource governance for Kusto clusters

    Our Kusto cluster is used for production site and tools and needs to have 99.99% availability. However, as our cluster is open to tens of thousands of users across the company for ad-hoc queries, we often suffer from unexpected cluster wide outages due to misbehaved customers. We have tried both cluster-wide query limits as well as customized approaches, however, neither is helping us much. We would like to see Kusto to provide the resource governance solution out of box.

    63 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    planned  ·  6 comments  ·  Flag idea as inappropriate…  ·  Admin →
  2. Azure Data Explorer setting to display datetime values in local timezone

    Can Azure Data Explorer support displaying datetime values in local timezone with a setting?
    I'm a bit tired of extending all queries by doing time arithmetic myself (e.g. | extend localT = timestamp - 8h) which is not daylight saving proof as well :)

    37 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    3 comments  ·  Flag idea as inappropriate…  ·  Admin →
  3. Push rows to EventHub

    Enable pushing rows to EventHubs.
    * individual or batched messages

    Example (alerting):
    * IoT data being consumed by ADX
    * An update policy is in place that checks the incoming
    * If the check fails then a notification should be sent to an EventHub
    -> picked up from there by other components

    24 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    planned  ·  1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  4. Export data from one ADX cluster to a second ADX Cluster

    Add ADX as a destination for the .export capability to be able to move data from one cluster to another. This should work both for one time export and for continuous export.

    19 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  5. External tables column mapping gets mixed-up when the underlying file column structure is updated for some files

    When using external tables to map files on a storage account, if one has many files already mapped to an external table, and the file structure changes for new files provided to the same storage account location, such as a new column is added to the new files, then the external table mapping get mixed up. We drop the external table and recreated it, adding the new column (which is not added to the end of the new file structure). When querying the external table, ADX provides the new file data in the correct columns, but shows the previous file…

    16 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  6. Make "Ingest from query" work from ADX function body

    Functions in ADX are limited to read only operations, but sometimes it will be really helpful if a function is capable of inserting data to a table or external table (logs or function results). In case when the function is executed from API as query it is not possible to use managing operations like .set, .append, .set-or-append, .set-or-replace.
    Due to this limitation alternative solution of mentioned commands, which work from function body, would be really useful. Please consider it.

    16 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  7. Add ADX as Trusted Microsoft service on firewall

    Please consider to add ADX as a trusted Microsoft service on Azure Event Hubs' (or any other data source service's) firewall or publish IP address range of ingest service.
    For now, we have to deploy the cluster with VNet in order to restrict access of Event Hubs but it seems unnecessary since the traffic between Azure service is completed inside Azure network.
    This option makes it simple/easier for the users to create secure environment.

    16 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  8. Make http_request and http_request_post plugins work and supported.

    Calling to external resource to download data through HTTP(S) protocols is an awsome idea, unfortunately the plugins do not work correctly and are not supported yet. Consider to speed up the work on it, please.

    15 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  9. Provide support to render timepivot / timeline view

    The Timepivot visualization is one of the best visualizations we have come across when analyzing data across hundreds of different tables. It tells the story of “what happened” in a beautiful manner.

    It helps us generates multiple different views of the “same data” by allowing us to pick multiple levels of slicing options views (in this case I have 10 slice options, so for two levels I can get about 90 different views). In addition, clicking on the cells shows the actual activity in detail.

    Given that Kusto is time-optimized and practically every log has timestamps associated with them, we…

    15 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    2 comments  ·  Flag idea as inappropriate…  ·  Admin →
  10. Translate IP addresses to geo coordinates


    • Given an IP-Address

    • There should be a native KQL function to translate the IP address to a coordinate

    • This will enable the user to enrich telemetry from server/app logs with the corresponding location

    15 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  11. Rename Azure Data Explorer to Kusto

    Searching the Internet for Azure Data Explorer is hard because the name matches too many othe things. Pleasu just take the old name Kusto to make searching for answers easier

    14 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  12. Create clone of a Kusto Database.

    I would like to have the capability of creating a clone of the database, where the newly created database is exactly the same as one it is cloned from (including permissions, folder structures of tables/functions, etc).

    14 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  13. WithAadUserPromptAuthentication method not available in .NetStandard library

    In Kusto.data Nuget for .NET framework WithAadUserPromptAuthentication method is available in KustoCOnnectionStringBuilder class.

    However this is missing from .NetStandard Nuget library.

    Can this be added?

    Eg:

    KustoConnectionStringBuilder($"https://{serviceName}.kusto.windows.net") .WithAadUserPromptAuthentication(authority);

    13 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    3 comments  ·  Flag idea as inappropriate…  ·  Admin →
  14. Scheduled Jobs

    We are utilizing ADX to stream data from event hubs. This is awesome because we can get a large amount of data with very little work.

    The challenge, is that we sometimes want to "aggregate" multiple (like 100s-1000s) events into summary style tables. We could use ASA or other tools, but it would be really nice to have the ability to schedule jobs in ADX. That way we can keep all of the work close to the data (rather than extract it out and then put it back in)

    11 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  15. Allow mapping from Properties, SystemProperties collections on Event Hub data ingestion

    For data ingestion connections which point to Event Hub sources, allow the mapping definitions to access the Properties and SystemProperties collections on the underlying EventData object. Presently, only the Body property is accessible - it is define as the root/$ of the path in mappings.

    11 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  16. Add Azure Data Explorer to Azure Stack

    Provide ability to run Azure Data Explorer on Azure Stack

    11 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  17. Allow accessing other databases within a RLS let statement

    New RLS functionality has allowed our team to create RLS functions that are data driven; identity to permission associations come from a table.

    However, tables and objects in other databases may not be accessed from within the let statement of the RLS function. In our case, that means we need to copy two tables to each of up to 10+ databases in our two clusters.

    Can the restrictions against the "database" notation be relaxed within the let statement of RLS functions?

    10 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  18. Query builder using Fluent Interface pattern in Kusto SDK

    I think it would be great if you add a query builder to the SDK that uses Fluent Interface for building Kusto queries. Something very similar to how you can query SQL databases using Entity Framework.

    10 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  19. Include more node memory details for E_LOW_MEMORY_CONDITION errors.

    When a query or command fails with one of the ELOWMEMORY_CONDITION errors, please include information about the node's memory consumption at that point in time. How much was allocated to the current query, to other queries and commands, and how much was remaining available. I think it could help with the diagnostics of such errors.

    10 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  20. Downsampling data over time

    As data ages, storage and query could be further optimized by down sampling the data. There should be a process or method to provide an aggregate query that could run on data older than X time. Example: My database retention is 365 days and i ingest 3 samples per minute. After data is 31 days old i can provide a query that will aggregate by MAX value over 1 minute. After 90 days, another aggregate runs that finds the Max value over 5 minutes. Raw data is of course deleted after aggregate runs.

    10 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
← Previous 1 3 4 5 8 9
  • Don't see your idea?

Azure Data Explorer

Categories

Feedback and Knowledge Base