Stream Analytics

Azure Stream Analytics is a fully managed real-time stream computation service hosted in Microsoft Azure, which provides highly resilient, low latency, and scalable complex event processing of streaming data. Azure Stream Analytics enables developers to easily combine streams of data with historic records or reference data to derive business insights easily and quickly.

How can we improve Microsoft Azure Stream Analytics?

You've used all your votes and won't be able to post a new idea, but you can still search and comment on existing ideas.

There are two ways to get more votes:

  • When an admin closes an idea you've voted on, you'll get your votes back from that idea.
  • You can remove your votes from an open idea you support.
  • To see ideas you have already voted on, select the "My feedback" filter and select "My open ideas".
(thinking…)

Enter your idea and we'll search to see if someone has already suggested it.

If a similar idea already exists, you can support and comment on it.

If it doesn't exist, you can post your idea so others can support it.

Enter your idea and we'll search to see if someone has already suggested it.

  • Hot ideas
  • Top ideas
  • New ideas
  • My feedback
  1. Autoscale for streaming unit

    At present, Stream analytics throws memory exception when there is not enough streaming units. It should automatically scale based on the streaming unit requirement.

    243 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  2 comments  ·  Flag idea as inappropriate…  ·  Admin →
  2. Take input from CosmosDB

    Currently Stream Analytics accepts data from Blob storage. Support to get data from DocumentDB should be added.

    156 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  10 comments  ·  Inputs and Outputs  ·  Flag idea as inappropriate…  ·  Admin →
  3. Stream into existing Power BI Datasets

    Hey,
    it would be great to have the possibility to create a dataset in PowerBi Desktop and use as output in ASA.

    97 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  4 comments  ·  Flag idea as inappropriate…  ·  Admin →
  4. Have a smaller unit size (i.e. for lab/demo environments)

    Stream Analytics is great - but it's a bit much to pay for a full unit hour when you have very low processing requirements. I've got a couple demo and lab environments I'm working with now and have to keep stopping the jobs as each costs about $80/month to run.

    The simplest fix for this would be to have a smaller unit size ("shared" unit?) to make it easier to get started with projects.

    91 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    6 comments  ·  Flag idea as inappropriate…  ·  Admin →
  5. Stream Analytics VNet support

    Stream Analytics should integrate into Virtual Network (VNet) so I can access my services seemlessly without requiring cross-internet access.

    56 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Security  ·  Flag idea as inappropriate…  ·  Admin →
  6. Add HDInsight (HBase) to output

    Adding HDInsight (HBase) as an output for an job. HBase provides random, realtime read/write access.

    51 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  7. Add an output sync to Azure Operational Insights

    Azure Operational Insights provides a very fast search and indexing mechanism to data. Its a perfect visualization experience on top of the data we are sending from EventHub->StreamAnalytics

    43 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  3 comments  ·  Flag idea as inappropriate…  ·  Admin →
  8. Time series database sink

    It would be great to be able to stream the data into a time series database. Currently Azure does not have support for time series, but it would be nice to see support for KairosDB or OpenTSB

    41 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    2 comments  ·  Inputs and Outputs  ·  Flag idea as inappropriate…  ·  Admin →
  9. Ability to output data to dynamically generated tables.

    We want incomming data for multiple of our customers input through one event hub and then output to a table per customer. The tables don't need to be created by stream analytics, we can do that from code when the customer creates an account with us. I just need to be able to direct the output to the correct table from my Stream Analytics query.

    40 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  5 comments  ·  Flag idea as inappropriate…  ·  Admin →
  10. Access Device Twin properties for IoT Hub input

    It is possible to define custom properties for IoT Hub Device Twins (as documented here: https://azure.microsoft.com/en-us/documentation/articles/iot-hub-device-management-overview/) but these properties are not accessible in Stream Analytics jobs. Workaround is to define these properties in Reference BLOB Storage and JOIN it on device ID, but why not to have them in one place with (possibly) much faster access for large numbers of devices?

    32 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  2 comments  ·  Flag idea as inappropriate…  ·  Admin →
  11. Multiple queries in a single SA job

    Multiple queries in a single SA job, where the queries are the stages in the job. This is mostly a UI presentation problem. I would like to see my SA job represent the complete stream processing for my solution. This would allow better software management practices as well as easier starting and stopping of 'chained' queries.

    32 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  4 comments  ·  Flag idea as inappropriate…  ·  Admin →
  12. User Defined Python Functions

    Ability to define functions in python as part of a stream query similar to what has been done with Azure Machine Learning. The ability to then return the results back into the query would be great. Treat it like a SQL Stored Proc almost.

    30 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  13. Add a GETDATE() Function

    It might be useful to drop old events.

    28 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    5 comments  ·  Flag idea as inappropriate…  ·  Admin →
  14. Please add Split method

    Please Add Split methods to the Azure stream analytics Query language

    27 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  2 comments  ·  Query Language  ·  Flag idea as inappropriate…  ·  Admin →
  15. Support to Bitwise Operators

    When using Event Hub with IOT usually we have to send binary data. We would like to use Stream Analytics to transform this binary information into a JSON, but Stream Analytics doesn't support Bitwise Operators.

    25 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  16. Allow more flexible file formats for blob storage inputs

    Blob storage inputs shouldn't be limited to UTF8 encoding. CSVs should not be required to provide a header row, especially when you do block boundary (since that means putting header rows in the middle of the file) and the CREATE TABLE statement in your query should be where you define the column names when you mark an input as having no header row.

    Also, you should be able to skip header rows. For example, IIS website logs have two header rows in a strange format that would be good to skip (only on the initial block, there are no headers…

    24 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  17. notification hub as output

    Can we add Notification Hub as output to Stream Analytics

    24 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  18. Add calls to C# custom code

    We think that can call to c# assembly inside a ASA query, or perhaps, make ASA query syntax like U-SQL

    22 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  19. Rename Inputs and Outputs

    Please can you let us rename the input and outputs of a stream. Thanks

    19 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  20. Ability to check for EXISTS when peforming a query over JSON with arrays

    My data has a data field that can have no value, a single value or an array of values. I need to be able to parse that field into single column with either a single row (for no value and single value) and into multiple rows (using, say GetElements for array) dynamically based on whether that data field is an array or not.
    Currently I get an error - "The expression outputStep experienced an error: Unable to cast type 'string' to 'Record'.. It will be disabled"

    18 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  4 comments  ·  Flag idea as inappropriate…  ·  Admin →
← Previous 1 3
  • Don't see your idea?

Stream Analytics

Feedback and Knowledge Base