Azure Data Explorer

How can we improve Azure Data Explorer?

(thinking…)

Enter your idea and we'll search to see if someone has already suggested it.

If a similar idea already exists, you can support and comment on it.

If it doesn't exist, you can post your idea so others can support it.

Enter your idea and we'll search to see if someone has already suggested it.

  1. Ability to create user defined functions accepting variable # of arguments

    Some Kusto built-in functions accept a variable number of arguments, like:

    print strcat("foo", "bar")
    print strcat("foo", "bar", "baz")

    Please add the ability to create user-defined functions that accept a variable number of arguments as well.

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  2. 6 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  3. Autoscale form 1 VM on Azure Data Explorer's Data Management cluster

    Autoscale form 1 VM on Azure Data Explorer's Data Management cluster

    6 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  4. Ignore (cold) cached data

    When perf testing a query, it would be useful to wipe out any cold data that has been temporarily cached on the local disk so that I can get apples-to-apples comparisons between subsequent runs. I can imagine it either being something where I just set a flag to ignore any of the cold cached data or a command that would completely wipe out any of that type of cached data. Note that I would not expect any of this to affect the standard hot cache data which always lives on the disk.

    2 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  5. allow metadata (to specify Service Tree attribution) at the database level

    Several teams share clusters which makes assigning the streams challenging and they go to the cluster owner/creator vs the actual DB or table owner. We need a way to assign DBs to individual services so we can allow more granular service attribution. I know metadata can be done at a table level but that's too granular. We need it at a DB level as well. This scenario is important for GDPR and data governance as there are teams who are shying away from registering their shared clusters so they do not get all the action items assigned to them

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  6. tableifexists or other way to query if a table exists (without access to . control commands)

    There appears to be a "columnifexists" function that allows for queries where a column might not exist. But there doesn't seem to be a similar way to check if a table exists? (without having access to .show tables, etc)

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  7. Autocomplete on categorical string column values

    Let's say that your table has a column called SomeColumn that only has 10 different possible string values. Then, I think it would be useful to have autocomplete when trying to do a string match:

    SomeTable
    | where SomeColumn == '[Show autocomplete options]

    This would avoid having to do a "distinct" operator to figure out the values and then copy that value into another query.

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  8. Follow at the table level

    We love the database follower feature but it would be fantastic if we could follow at a table level.

    2 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  9. Support .create-or-alter external table

    .create external table command causes an error if the table already exists. This is inconvenient for automated deployment. Would be nice if -create-or-alter was supported!

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  10. Invoke a function from another database

    Currently I can only invoke a function if it is in the same database. I would like to invoke functions in other databases (and ideally in other clusters.) There are two main use cases:
    1) We have some useful helper functions that use the invoke pattern. We have to copy them to all of our databases.
    2) When doing .set-or-append commands, I'm stuck if my query involves a an invoked function on database A but I want the results written to database B.

    2 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  11. Supply syntax to use Service-specific schemas no general the Top-level diagnostic logs schema

    Can we supply syntax to use the [Service-specific schemas](https://docs.microsoft.com/en-us/azure/azure-monitor/platform/diagnostic-logs-schema#service-specific-schemas-for-resource-diagnostic-logs) template for specific Azure services, not general the [Top-level diagnostic logs schema](https://docs.microsoft.com/en-us/azure/azure-monitor/platform/diagnostic-logs-schema#top-level-diagnostic-logs-schema). I don't want to type each column property with `project operator` all the time. Is it possible?

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  12. Add a new function to convert a base64 string to a dynamic array of 0-255 values

    Currently there is a function to convert a base64 string to utf8 string i.e. base64_decodestring. However if there is no valid string output, that function fails and returns nothing.

    e.g. print base64_decodestring("igAAAAAAAACDAAAAACAAAA==")

    There are cases where we need a byte representation of a base64 string. Having a function like base64_decodearray that gives a dynamic array of 0-255 values allows us to get that.

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  13. Add ".update" management command to allow correct wrong ingested data

    When data gets wrongly ingested into ADX, it very hard to correct this data afterwards. -> I know ADX is a append-only store.

    Let's say a sending machine had issues with daylight saving time and all data is shifted and after some days, it gets recognized and the machine is sending correct values. There is small slice of data, which needs to be aligned.

    Or some properties where wrongly set over some time. Same as above.

    Currently, we use the ".purge" command and re-ingest the data, which leads to a wrong "ingestion-time". Another option is completely re-ingest the data into…

    11 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  14. Include function call stack trace in query error messages

    Picture this scenario: you are calling a Kusto function but get a syntax error. But where is the syntax error coming from exactly? The error message doesn't say. You inspect the code for the function only to find references to other functions inside, and the way to know which one of those is the culprit is to run them one by one. And then each of those functions might be calling other functions too!
    Wouldn't it be nice if the error message told you the exact function where the error is happening from?

    2 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  15. Create New Management Function to Create Data Connections

    You can script deployment of a Data Explorer cluster using an ARM template. Everything works, except data connections. This is because the validation requires target tables to exists before creating a data connection.

    I suggest a new management function is created that works something like this:

    .create data connection with (name="", kind="EventGrid", storageAccountResourceId="", eventHubResourceId="", consumerGroup="", tableName="", dataFormat="", mappingRuleName="")

    This way I can create data connection in a .csl file along with tables, functions, policies etc.

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  16. Create New Management Function to Create Data Connections

    You can script deployment of a Data Explorer cluster using an ARM template. Everything works, except data connections. This is because the validation requires target tables to exists before creating a data connection.

    I suggest a new management function is created that works something like this:

    .create data connection with (name="", kind="EventGrid", storageAccountResourceId="", eventHubResourceId="", consumerGroup="", tableName="", dataFormat="", mappingRuleName="")

    This way I can create data connection in a .csl file along with tables, functions, policies etc.

    0 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  17. Support drop all functions in a db.

    Please provide an easy way to drop all functions in a db.

    this does not work:
    ".drop function <| .show functions"

    The currently proposed workaround from the Kusto Team does not appear user friendly:

    a. Run the following command

    .show functions
    | summarize run_me_with_caution_after_carefully_reviewing = strcat_array(make_list(strcat(".drop function ['", Name, "']")), "\n")

    b. Copy the result and save as a script (text file)
    c. Use Kusto.Cli to run the `script`
    d. [hope your team members don’t get mad at you. or me. If anyone asks – a) I had nothing to do with functions getting unintentionally dropped; b) they can be…

    3 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  18. Support 0 as number of minimum node of cluster

    We sometimes use this query engine once a day or so. We want to avoid manage start up node. it's fine to it takes to start up and load data time and hope Azure Data Explorer support "0" (Zero) number as minimum cluster node.
    We want to get OPTION for that...

    Similar Services- Azure Machine Learning Services - AmlCompute.

    2 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  19. Azure data explorer ingesion: json mapping only in single line

    I’m ingesting data to Azure Data Explorer from Logstash and figured out a feature that makes uncomfortable to use.
    If I put ‘enter’ between query, it occurs syntax error.
    (e.g. .If I write [create table sampletable
    ingestion json mapping ‘samplemapping’ (…)], it doesn’t work. If I write with one line, it works with no error)

    If it fixed, it will be very helpful to introduce ADX to customers :)

    2 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  20. Cross-region follower support

    Our main way of doing resource governance is to rely on follower databases. We have a locked down production cluster which doesn't accept any non-production workload and then if anyone else needs access to the data, we have them set up a follower database. It sounds like ADX has a single-region restriction for those follower databases and this is going to put a pretty major kink in our arch. Please consider adding this feature.

    21 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    6 comments  ·  Flag idea as inappropriate…  ·  Admin →
← Previous 1 3
  • Don't see your idea?

Azure Data Explorer

Feedback and Knowledge Base