Stream Analytics

Azure Stream Analytics is a fully managed real-time stream computation service hosted in Microsoft Azure, which provides highly resilient, low latency, and scalable complex event processing of streaming data. Azure Stream Analytics enables developers to easily combine streams of data with historic records or reference data to derive business insights easily and quickly.

How can we improve Microsoft Azure Stream Analytics?

You've used all your votes and won't be able to post a new idea, but you can still search and comment on existing ideas.

There are two ways to get more votes:

  • When an admin closes an idea you've voted on, you'll get your votes back from that idea.
  • You can remove your votes from an open idea you support.
  • To see ideas you have already voted on, select the "My feedback" filter and select "My open ideas".
(thinking…)

Enter your idea and we'll search to see if someone has already suggested it.

If a similar idea already exists, you can support and comment on it.

If it doesn't exist, you can post your idea so others can support it.

Enter your idea and we'll search to see if someone has already suggested it.

  • Hot ideas
  • Top ideas
  • New ideas
  • My feedback

  1. Take input from CosmosDB

    Currently Stream Analytics accepts data from Blob storage. Support to get data from DocumentDB should be added.

    156 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Forgot password?
    Create a password
    Signed in as (Sign out)
    Close
    Close
    You have left! (?) (thinking…)
    under review  ·  10 comments  ·  Inputs and Outputs  ·  Flag idea as inappropriate…  ·  Admin →

  2. Time series database sink

    It would be great to be able to stream the data into a time series database. Currently Azure does not have support for time series, but it would be nice to see support for KairosDB or OpenTSB

    41 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Forgot password?
    Create a password
    Signed in as (Sign out)
    Close
    Close
    You have left! (?) (thinking…)
    2 comments  ·  Inputs and Outputs  ·  Flag idea as inappropriate…  ·  Admin →

  3. Allow REST Endpoints as reference data input

    Possibility to define REST endpoints as reference data inputs. Including refresh rate settings similar to SQL Database.

    39 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Forgot password?
    Create a password
    Signed in as (Sign out)
    Close
    Close
    You have left! (?) (thinking…)
    0 comments  ·  Inputs and Outputs  ·  Flag idea as inappropriate…  ·  Admin →

  4. Output to ADLS gen 2

    Support for output to ADLS gen 2 in addition to existing inputs.

    19 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Forgot password?
    Create a password
    Signed in as (Sign out)
    Close
    Close
    You have left! (?) (thinking…)
    started  ·  1 comment  ·  Inputs and Outputs  ·  Flag idea as inappropriate…  ·  Admin →

  5. Foresee event grid output for Azure Stream Analytics

    Azure Event Grid really helps in building distributed, event-driven, applications on Azure. Having out of the box support to publish selected events from Azure Stream Analytics to Azure Event Grid would be awesome!

    To achieve this today, I have to call (and deploy + pay) an Azure function that takes the message and call the actual Azure Event Grid API... It would be so much easier to have this out of the box and this would benefit for future out of the box event grid subscribers.

    3 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Forgot password?
    Create a password
    Signed in as (Sign out)
    Close
    Close
    You have left! (?) (thinking…)
    0 comments  ·  Inputs and Outputs  ·  Flag idea as inappropriate…  ·  Admin →

  6. Add support for compressed output

    I have historic data imported through spark in avro format to our Gen 1 Data Lake. I am now using ASA to stream the live data.
    Spark defaults to uses snappy to compress avro files where as ASA doesn't compress. This has resulted in a 10 fold increase in storage size and a slow down in access speed. Can you add support for compression of the outputs in ASA?

    3 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Forgot password?
    Create a password
    Signed in as (Sign out)
    Close
    Close
    You have left! (?) (thinking…)
    0 comments  ·  Inputs and Outputs  ·  Flag idea as inappropriate…  ·  Admin →

  7. reference data

    Allow TIMESTAMP BY OVER with reference data

    3 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Forgot password?
    Create a password
    Signed in as (Sign out)
    Close
    Close
    You have left! (?) (thinking…)
    1 comment  ·  Inputs and Outputs  ·  Flag idea as inappropriate…  ·  Admin →

  8. Output to PostgreSQL

    Native output to Azure Database for PostgreSQL

    3 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Forgot password?
    Create a password
    Signed in as (Sign out)
    Close
    Close
    You have left! (?) (thinking…)
    0 comments  ·  Inputs and Outputs  ·  Flag idea as inappropriate…  ·  Admin →

  9. Monitor overall SU usage over time, not just per individual SA job.

    Spinning a new stream analytics job can occur at many times. Sometime you risk reaching your SU limit (200 by default). It happened to me... I am missing the ability to monitor how many SU I am currently using. Something similar to SU% utilization that is available per SA job- but on the subscription level.

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Forgot password?
    Create a password
    Signed in as (Sign out)
    Close
    Close
    You have left! (?) (thinking…)
    0 comments  ·  Inputs and Outputs  ·  Flag idea as inappropriate…  ·  Admin →

  10. Support IoTHub.* in Azure Stream Analytics Tools for Visual Studio

    When authoring a query in the portal, I use the IoTHub object to get at items like IoTHub.EnqueuedTime (discussed here: https://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-define-inputs#stream-data-from-iot-hub) These do not work in the ASA tools for Visual Studio.

    When you use stream data from an IoT Hub, you have access to the following metadata fields in your Stream Analytics query:
    Property
    Description
    EventProcessedUtcTime
    The date and time that the event was processed.
    EventEnqueuedUtcTime
    The date and time that the event was received by the IoT Hub.
    PartitionId
    The zero-based partition ID for the input adapter.
    IoTHub.MessageId
    An ID that's used to correlate two-way communication in…

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Forgot password?
    Create a password
    Signed in as (Sign out)
    Close
    Close
    You have left! (?) (thinking…)
    1 comment  ·  Inputs and Outputs  ·  Flag idea as inappropriate…  ·  Admin →

  11. Duplicate Outputs

    If i want to insert data to sql table from different query then query editor won't allow to use same output to use in different queries even though destination must be same. It will be duplication of output.

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Forgot password?
    Create a password
    Signed in as (Sign out)
    Close
    Close
    You have left! (?) (thinking…)
    0 comments  ·  Inputs and Outputs  ·  Flag idea as inappropriate…  ·  Admin →

  12. SQL connection Failure

    When output failed due to SQL server unavailability then SA doesn't have re connection logic to connect back once SQL Server is up.

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Forgot password?
    Create a password
    Signed in as (Sign out)
    Close
    Close
    You have left! (?) (thinking…)
    0 comments  ·  Inputs and Outputs  ·  Flag idea as inappropriate…  ·  Admin →

  13. Input from Cosmos DB changefeed

    Support direct input from Cosmos DB changefeed.

    0 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: oidc
    Forgot password?
    Create a password
    Signed in as (Sign out)
    Close
    Close
    You have left! (?) (thinking…)
    0 comments  ·  Inputs and Outputs  ·  Flag idea as inappropriate…  ·  Admin →
  • Don't see your idea?

Stream Analytics

Feedback and Knowledge Base

(thinking…)
Hosted by UserVoice