Stream Analytics

Azure Stream Analytics is a fully managed real-time stream computation service hosted in Microsoft Azure, which provides highly resilient, low latency, and scalable complex event processing of streaming data. Azure Stream Analytics enables developers to easily combine streams of data with historic records or reference data to derive business insights easily and quickly.

How can we improve Microsoft Azure Stream Analytics?

You've used all your votes and won't be able to post a new idea, but you can still search and comment on existing ideas.

There are two ways to get more votes:

  • When an admin closes an idea you've voted on, you'll get your votes back from that idea.
  • You can remove your votes from an open idea you support.
  • To see ideas you have already voted on, select the "My feedback" filter and select "My open ideas".
(thinking…)

Enter your idea and we'll search to see if someone has already suggested it.

If a similar idea already exists, you can support and comment on it.

If it doesn't exist, you can post your idea so others can support it.

Enter your idea and we'll search to see if someone has already suggested it.

  • Hot ideas
  • Top ideas
  • New ideas
  • My feedback
  1. Multiple queries in a single SA job

    Multiple queries in a single SA job, where the queries are the stages in the job. This is mostly a UI presentation problem. I would like to see my SA job represent the complete stream processing for my solution. This would allow better software management practices as well as easier starting and stopping of 'chained' queries.

    32 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  4 comments  ·  Flag idea as inappropriate…  ·  Admin →
  2. Allow creating and configuring stream analytics from the azure CLI

    It is stunningly difficult to automate a deployment of Stream Analytics from a devops scenario. ARM templates seem to either not be supported or not work very well and there is no support for the Azure CLI. The sole option is to drop down to powershell which means that our deployments now need to make use of yet another technology. Please support the Azure CLI

    31 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  3. Add a GETDATE() Function

    It might be useful to drop old events.

    28 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    5 comments  ·  Flag idea as inappropriate…  ·  Admin →
  4. Please add Split method

    Please Add Split methods to the Azure stream analytics Query language

    27 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  2 comments  ·  Query Language  ·  Flag idea as inappropriate…  ·  Admin →
  5. Support wildcards in blob input path pattern

    You can currently use several supported path variables like {date} and {time}.
    Could you please add support for wildcards so that such a pattern will be valid:
    users/*/{date}/{time}

    Using the "*" symbol will currently cause an error (property 'pathPattern' cannot contain the value '*')

    26 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  6. Support to Bitwise Operators

    When using Event Hub with IOT usually we have to send binary data. We would like to use Stream Analytics to transform this binary information into a JSON, but Stream Analytics doesn't support Bitwise Operators.

    25 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  7. Azure Data Lake Store dynamic output path

    We want to store events to different folders based on a field - in a query.
    I can imagine the output as a function that can take some parameters

    e.g.
    SELECT * INTO [out($type)] FROM Input

    24 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  8. Add sql as a data stream input with change data capture

    It would be nice to support sql as a data stream input such that any rows added to a table are picked up and streamed, this allows realtime dashboard on existing applications without any recoding!

    24 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →

    We are exploring the possibility of supporting CosmosDB change feed as ingress to Stream Analytics which will solve this scenario. For reference data, we already provide a mechanism to refresh reference data in Azure Blob storage using Azure Data Factory. More details about this here: https://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-use-reference-data

    We are listening and committed to making Stream Analytics even better! Keep your feedback coming.

  9. Allow more flexible file formats for blob storage inputs

    Blob storage inputs shouldn't be limited to UTF8 encoding. CSVs should not be required to provide a header row, especially when you do block boundary (since that means putting header rows in the middle of the file) and the CREATE TABLE statement in your query should be where you define the column names when you mark an input as having no header row.

    Also, you should be able to skip header rows. For example, IIS website logs have two header rows in a strange format that would be good to skip (only on the initial block, there are no headers…

    24 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  10. notification hub as output

    Can we add Notification Hub as output to Stream Analytics

    24 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  11. 23 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  12. Add calls to C# custom code

    We think that can call to c# assembly inside a ASA query, or perhaps, make ASA query syntax like U-SQL

    22 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  13. Cosmos DB as Reference Data

    I think Cosmos DB is the best solution for low latency reference data. For our IoT use case, we need to maintain state after certain condition met, and subsequent DeviceId will use that reference data in query.

    22 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  14. output to different Azure Tables based on time

    When you choose Azure Table as output sync, you can set a static table name in the configuration. What about to choose a dynamic name like TableName-YYYY-MM? It could be really useful in scenario when you have to delete old data without occurring in the azure table delete rows pain

    21 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  15. Increase late arrival tolerance window

    Right now, this dropdown list allows up to 20 days of tolerance.

    We have a requirement to "catch up" on old events. If for some reason our Event Hub publisher is down, when we start sending old events again, the timestamps may go back to the start of the month.

    It would be great to increase this tolerance level to a full month (31 days), if possible (or longer).

    Is this 20 day limit a restriction of memory buffer used by Stream Analytics, or would this be a simple change in the GUI?

    20 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    3 comments  ·  Flag idea as inappropriate…  ·  Admin →
  16. Ability to declare variables

    There are certain situations that calls for declaring a variable in Azure Stream analytics. It would be great if we can add support for variables in Azure stream analytics.

    20 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  17. Add support for ASA in Python SDK

    It would be create to have support for ASA in the Python Azure SDK. https://github.com/Azure/azure-sdk-for-python

    It would make automated updating streams much easier.

    20 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    planned  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  18. Use of functions like format, convert, getdate.. etc should be supported

    In case of data is in encoding format.
    I need to decode it using some sql functions.
    Suppose I'm getting date "Thu,%2029%20Oct%202015%2012:15:52%20GMT" in this format.
    Need to replace %20 by space or need to convert.

    20 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    2 comments  ·  Query Language  ·  Flag idea as inappropriate…  ·  Admin →
  19. Rename Inputs and Outputs

    Please can you let us rename the input and outputs of a stream. Thanks

    19 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  20. 19 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  5 comments  ·  Flag idea as inappropriate…  ·  Admin →
  • Don't see your idea?

Stream Analytics

Feedback and Knowledge Base