Stream Analytics

Azure Stream Analytics is a fully managed real-time stream computation service hosted in Microsoft Azure, which provides highly resilient, low latency, and scalable complex event processing of streaming data. Azure Stream Analytics enables developers to easily combine streams of data with historic records or reference data to derive business insights easily and quickly.

How can we improve Microsoft Azure Stream Analytics?

You've used all your votes and won't be able to post a new idea, but you can still search and comment on existing ideas.

There are two ways to get more votes:

  • When an admin closes an idea you've voted on, you'll get your votes back from that idea.
  • You can remove your votes from an open idea you support.
  • To see ideas you have already voted on, select the "My feedback" filter and select "My open ideas".
(thinking…)

Enter your idea and we'll search to see if someone has already suggested it.

If a similar idea already exists, you can support and comment on it.

If it doesn't exist, you can post your idea so others can support it.

Enter your idea and we'll search to see if someone has already suggested it.

  1. use SQL Azure as reference data

    it would be nice to use a table in a SQL Azure DB as reference data

    328 votes
    Vote
    Sign in
    Check!
    (thinking…)
    Reset
    or sign in with
    • facebook
    • google
      Password icon
      I agree to the terms of service
      Signed in as (Sign out)
      You have left! (?) (thinking…)
      9 comments  ·  Flag idea as inappropriate…  ·  Admin →
    • Add a REST API call as an output (with an interface to format the call)

      Lots of real time dashboard solutions allow users to push data via REST API calls and JSON payloads. Thse are services such as Power BI Dashboards, Leftronic or Actoboard (I named these because they have nice documentations that you can check for their push APIs).

      Note that a killer feature would be to add an interface that allows to play a little with the format of the call and the payload, so that it can conforms to a specific API.

      That and/or you can pre-configure some services to match their API structures (but please not limited to Power BI Dasboards…

      218 votes
      Vote
      Sign in
      Check!
      (thinking…)
      Reset
      or sign in with
      • facebook
      • google
        Password icon
        I agree to the terms of service
        Signed in as (Sign out)
        You have left! (?) (thinking…)
        under review  ·  11 comments  ·  Flag idea as inappropriate…  ·  Admin →
      • Provide better ways to debug.

        My query isn't producing any results but there's no easy way for me to figure it out. Operational logs don't help.

        190 votes
        Vote
        Sign in
        Check!
        (thinking…)
        Reset
        or sign in with
        • facebook
        • google
          Password icon
          I agree to the terms of service
          Signed in as (Sign out)
          You have left! (?) (thinking…)
          started  ·  6 comments  ·  Flag idea as inappropriate…  ·  Admin →
        • Autoscale for streaming unit

          At present, Stream analytics throws memory exception when there is not enough streaming units. It should automatically scale based on the streaming unit requirement.

          164 votes
          Vote
          Sign in
          Check!
          (thinking…)
          Reset
          or sign in with
          • facebook
          • google
            Password icon
            I agree to the terms of service
            Signed in as (Sign out)
            You have left! (?) (thinking…)
            under review  ·  2 comments  ·  Flag idea as inappropriate…  ·  Admin →
          • Take input from DocumentDb

            Currently Stream Analytics accepts data from Blob storage. Support to get data from DocumentDB should be added.

            114 votes
            Vote
            Sign in
            Check!
            (thinking…)
            Reset
            or sign in with
            • facebook
            • google
              Password icon
              I agree to the terms of service
              Signed in as (Sign out)
              You have left! (?) (thinking…)
              under review  ·  8 comments  ·  Flag idea as inappropriate…  ·  Admin →
            • Support InsertOrUpdate for AzureTableStorage

              If a RowKey value already exists the SendEvents fails with the following error

              Remove 30 duplicate rowkey element in a partition

              We need an option to update the existing row with the new data coming in.

              103 votes
              Vote
              Sign in
              Check!
              (thinking…)
              Reset
              or sign in with
              • facebook
              • google
                Password icon
                I agree to the terms of service
                Signed in as (Sign out)
                You have left! (?) (thinking…)
                under review  ·  4 comments  ·  Flag idea as inappropriate…  ·  Admin →
              • Make Stream Analitics fully configurable from ARM template

                Now on a portal we can easily configure setting from output/input and the UI is nice. But we don't find the way to configure input from IoT hub using arm only.

                In quick state templates we neither input, nor output not demonstrated now https://github.com/Azure/azure-quickstart-templates/tree/master/101-streamanalytics-create

                We already requested more templates with examples on GitHub https://github.com/Azure/azure-quickstart-templates/issues/2635 , but maybe somebody will read this request here too.

                Example of my issues - I can't find the way to set SharedAccessPolicyKey from IoTHub in ASA

                "inputs": [
                {
                "Name": "IoTHub",
                "Properties": {
                "DataSource": {
                "Properties": {
                "ConsumerGroupName": "$Default",
                "IotHubNamespace": "igorsychhub",
                "SharedAccessPolicyKey": null,
                "SharedAccessPolicyName": "iothubowner" …

                92 votes
                Vote
                Sign in
                Check!
                (thinking…)
                Reset
                or sign in with
                • facebook
                • google
                  Password icon
                  I agree to the terms of service
                  Signed in as (Sign out)
                  You have left! (?) (thinking…)
                  1 comment  ·  Flag idea as inappropriate…  ·  Admin →
                • Support Power BI embedded as an output

                  As Power BI Embedded allows people to embed dashboards in their applications, it would be nice to have the ability of managing near real-time dashboarding by having ASA being able to push to Power BI Embedded

                  81 votes
                  Vote
                  Sign in
                  Check!
                  (thinking…)
                  Reset
                  or sign in with
                  • facebook
                  • google
                    Password icon
                    I agree to the terms of service
                    Signed in as (Sign out)
                    You have left! (?) (thinking…)
                    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
                  • Provide PowerShell and REST API for creating Power BI output

                    Currently you have PowerShell and REST APIs for creating outputs, but I don't believe it supports creating a Power BI output. You can only do that via the management portal. I need to be able to do this programmatically including the authentication with Power BI during setup.

                    80 votes
                    Vote
                    Sign in
                    Check!
                    (thinking…)
                    Reset
                    or sign in with
                    • facebook
                    • google
                      Password icon
                      I agree to the terms of service
                      Signed in as (Sign out)
                      You have left! (?) (thinking…)
                      planned  ·  6 comments  ·  Flag idea as inappropriate…  ·  Admin →
                    • Input from Azure Table Storage

                      Input from Azure Table Storage is a much better event source than Azure Blob Storage

                      79 votes
                      Vote
                      Sign in
                      Check!
                      (thinking…)
                      Reset
                      or sign in with
                      • facebook
                      • google
                        Password icon
                        I agree to the terms of service
                        Signed in as (Sign out)
                        You have left! (?) (thinking…)
                        6 comments  ·  Flag idea as inappropriate…  ·  Admin →
                      • Stream into existing Power BI Datasets

                        Hey,
                        it would be great to have the possibility to create a dataset in PowerBi Desktop and use as output in ASA.

                        78 votes
                        Vote
                        Sign in
                        Check!
                        (thinking…)
                        Reset
                        or sign in with
                        • facebook
                        • google
                          Password icon
                          I agree to the terms of service
                          Signed in as (Sign out)
                          You have left! (?) (thinking…)
                          under review  ·  3 comments  ·  Flag idea as inappropriate…  ·  Admin →
                        • Call to a REST endpoint to invoke custom code

                          Call from my query to a REST endpoint to invoke custom code.

                          61 votes
                          Vote
                          Sign in
                          Check!
                          (thinking…)
                          Reset
                          or sign in with
                          • facebook
                          • google
                            Password icon
                            I agree to the terms of service
                            Signed in as (Sign out)
                            You have left! (?) (thinking…)
                            planned  ·  4 comments  ·  Flag idea as inappropriate…  ·  Admin →
                          • Allow to read/write event data properties from/to eventhub input/output

                            For example when we want to duplicate data from one event hub to another (for example from production to development event hub), the only option is to copy the event data payload, but no option to copy the event data properties as well.

                            see http://stackoverflow.com/questions/35590255/stream-analytics-and-azure-eventhub for similar issue others had.

                            59 votes
                            Vote
                            Sign in
                            Check!
                            (thinking…)
                            Reset
                            or sign in with
                            • facebook
                            • google
                              Password icon
                              I agree to the terms of service
                              Signed in as (Sign out)
                              You have left! (?) (thinking…)
                              0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                            • Data type: bit or boolean

                              Necessary as output into sql table

                              56 votes
                              Vote
                              Sign in
                              Check!
                              (thinking…)
                              Reset
                              or sign in with
                              • facebook
                              • google
                                Password icon
                                I agree to the terms of service
                                Signed in as (Sign out)
                                You have left! (?) (thinking…)
                                under review  ·  2 comments  ·  Flag idea as inappropriate…  ·  Admin →
                              • Data type: GUID

                                I consider it necessary to have such data.

                                51 votes
                                Vote
                                Sign in
                                Check!
                                (thinking…)
                                Reset
                                or sign in with
                                • facebook
                                • google
                                  Password icon
                                  I agree to the terms of service
                                  Signed in as (Sign out)
                                  You have left! (?) (thinking…)
                                  under review  ·  1 comment  ·  Flag idea as inappropriate…  ·  Admin →
                                • Add HDInsight (HBase) to output

                                  Adding HDInsight (HBase) as an output for an job. HBase provides random, realtime read/write access.

                                  51 votes
                                  Vote
                                  Sign in
                                  Check!
                                  (thinking…)
                                  Reset
                                  or sign in with
                                  • facebook
                                  • google
                                    Password icon
                                    I agree to the terms of service
                                    Signed in as (Sign out)
                                    You have left! (?) (thinking…)
                                    under review  ·  1 comment  ·  Flag idea as inappropriate…  ·  Admin →
                                  • Save Job Query to Source Control

                                    It must be possible to save the query in source control and/or as part of a Visual Studio project.

                                    48 votes
                                    Vote
                                    Sign in
                                    Check!
                                    (thinking…)
                                    Reset
                                    or sign in with
                                    • facebook
                                    • google
                                      Password icon
                                      I agree to the terms of service
                                      Signed in as (Sign out)
                                      You have left! (?) (thinking…)
                                      2 comments  ·  Flag idea as inappropriate…  ·  Admin →
                                    • On-prem SQL as input and output

                                      Would like to push my data from on prem SQL -> Stream analytics + ML model -> Output of ML model back to on-prem SQL table -> Host power BI on corp. By this way, any PII/HBI data can still be on-prem and other numeric data can flow via the cloud and back. If the channel from cloud to on-prem sql can be secure and easily established, it would greatly help.

                                      48 votes
                                      Vote
                                      Sign in
                                      Check!
                                      (thinking…)
                                      Reset
                                      or sign in with
                                      • facebook
                                      • google
                                        Password icon
                                        I agree to the terms of service
                                        Signed in as (Sign out)
                                        You have left! (?) (thinking…)
                                        under review  ·  3 comments  ·  Flag idea as inappropriate…  ·  Admin →
                                      • Output to mail notification

                                        would like to mail notification at output data appeared.
                                        I want to develop log analytics & alert system by Stream Analytics

                                        47 votes
                                        Vote
                                        Sign in
                                        Check!
                                        (thinking…)
                                        Reset
                                        or sign in with
                                        • facebook
                                        • google
                                          Password icon
                                          I agree to the terms of service
                                          Signed in as (Sign out)
                                          You have left! (?) (thinking…)
                                          under review  ·  1 comment  ·  Flag idea as inappropriate…  ·  Admin →
                                        • Can we add an output to a Signalr client

                                          Can we have stream analytics acts as a notification hub and sent results out to clients.

                                          Use case:

                                          Filtering incoming Event Hub events and forwarding a select few to listening clients

                                          45 votes
                                          Vote
                                          Sign in
                                          Check!
                                          (thinking…)
                                          Reset
                                          or sign in with
                                          • facebook
                                          • google
                                            Password icon
                                            I agree to the terms of service
                                            Signed in as (Sign out)
                                            You have left! (?) (thinking…)
                                            under review  ·  1 comment  ·  Flag idea as inappropriate…  ·  Admin →
                                          ← Previous 1 3 4 5 11 12
                                          • Don't see your idea?

                                          Stream Analytics

                                          Feedback and Knowledge Base