Update: Microsoft will be moving away from UserVoice sites on a product-by-product basis throughout the 2021 calendar year. We will leverage 1st party solutions for customer feedback. Learn more here.

Stream Analytics

Azure Stream Analytics is a fully managed real-time stream computation service hosted in Microsoft Azure, which provides highly resilient, low latency, and scalable complex event processing of streaming data. Azure Stream Analytics enables developers to easily combine streams of data with historic records or reference data to derive business insights easily and quickly.

  • Hot ideas
  • Top ideas
  • New ideas
  • My feedback
  1. use SQL Azure as reference data

    it would be nice to use a table in a SQL Azure DB as reference data

    352 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    13 comments  ·  Flag idea as inappropriate…  ·  Admin →
  2. Add a REST API call as an output (with an interface to format the call)

    Lots of real time dashboard solutions allow users to push data via REST API calls and JSON payloads. Thse are services such as Power BI Dashboards, Leftronic or Actoboard (I named these because they have nice documentations that you can check for their push APIs).

    Note that a killer feature would be to add an interface that allows to play a little with the format of the call and the payload, so that it can conforms to a specific API.

    That and/or you can pre-configure some services to match their API structures (but please not limited to Power BI Dasboards…

    217 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    15 comments  ·  Flag idea as inappropriate…  ·  Admin →

    We recently added the possibility to call Azure Functions using an HTTP trigger. Then, in Azure function, it is possible to have custom code to call any specific API.

    See more information here:
    https://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-with-azure-functions

    Let us know if you have scenarios that can’t be done with the current implementation if you think we should reconsider this item.

  3. Provide better ways to debug.

    My query isn't producing any results but there's no easy way for me to figure it out. Operational logs don't help.

    191 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    6 comments  ·  Flag idea as inappropriate…  ·  Admin →

    We have listened to your feedback and made significant improvements to the developer experience over the last many months. Stream Analytics tools for Visual Studio is now available and being iterated upon. More information about this can be found at: https://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-tools-for-visual-studio

    We are continuing to listen your feedback and always looking to improve the developer experience of Stream Analytics!

  4. Stream Analytics VNet support

    Stream Analytics should integrate into Virtual Network (VNet) so I can access my services seemlessly without requiring cross-internet access.

    145 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    9 comments  ·  Security  ·  Flag idea as inappropriate…  ·  Admin →
  5. Can we add an Output to DocumentDb?

    The body of an event may be unstructured Json - storing this as a document in DocumentDB makes sense

    144 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    completed  ·  2 comments  ·  Flag idea as inappropriate…  ·  Admin →
  6. Provide PowerShell and REST API for creating Power BI output

    Currently you have PowerShell and REST APIs for creating outputs, but I don't believe it supports creating a Power BI output. You can only do that via the management portal. I need to be able to do this programmatically including the authentication with Power BI during setup.

    121 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    11 comments  ·  Flag idea as inappropriate…  ·  Admin →
  7. 106 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    7 comments  ·  Flag idea as inappropriate…  ·  Admin →

    Documentation for geospatial functions: https://msdn.microsoft.com/en-us/library/mt778980.aspx

    We recently announced the General Availability of Geospatial Functions in Azure Stream Analytics to enable real-time analytics on streaming geospatial data. This will make it possible to realize scenarios such as fleet monitoring, asset tracking, geofencing, phone tracking across cell sites, connected manufacturing, ridesharing solutions, etc. with production grade quality with a few lines of code.

    The new functions include:
    CreatePoint – Identifies a GeoJSON point.
    CreateLineString – Identifies a GeoJSON line string.
    CreatePolygon – Identifies a GeoJSON polygon.
    ST_DISTANCE – Determines the distance between two points in meters.
    ST_OVERLAPS – Determines if one polygon overlaps with another.
    ST_INTERSECTS – Determines if two line strings intersect.
    ST_WITHIN – Determines if one polygon is contained inside another.

  8. Make Stream Analitics fully configurable from ARM template

    Now on a portal we can easily configure setting from output/input and the UI is nice. But we don't find the way to configure input from IoT hub using arm only.

    In quick state templates we neither input, nor output not demonstrated now https://github.com/Azure/azure-quickstart-templates/tree/master/101-streamanalytics-create

    We already requested more templates with examples on GitHub https://github.com/Azure/azure-quickstart-templates/issues/2635 , but maybe somebody will read this request here too.

    Example of my issues - I can't find the way to set SharedAccessPolicyKey from IoTHub in ASA

    "inputs": [
    {
    "Name": "IoTHub",
    "Properties": {
    "DataSource": {
    "Properties": {
    "ConsumerGroupName": "$Default",
    "IotHubNamespace": "igorsychhub",
    "SharedAccessPolicyKey": null,
    "SharedAccessPolicyName": "iothubowner"…

    103 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  9. Allow setting the Properties when outputting to Service Bus Topic

    Currently there is an output type of Service Bus Topic. Would be great if we could control which of the data from the stream get into the values of Properties. Then the clients subscribed on that Topic could use SqlFilter to listen only on data they need.
    Example:
    20 fields come with the telemetry data where DeviceID and DataPointID are to be put into Properties.

    103 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    6 comments  ·  Flag idea as inappropriate…  ·  Admin →
  10. Support InsertOrUpdate for AzureTableStorage

    If a RowKey value already exists the SendEvents fails with the following error

    Remove 30 duplicate rowkey element in a partition

    We need an option to update the existing row with the new data coming in.

    103 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    4 comments  ·  Flag idea as inappropriate…  ·  Admin →
  11. Integration with Azure Machine Learning

    Would like to be able to score incoming streaming data in real time.

    100 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    6 comments  ·  Flag idea as inappropriate…  ·  Admin →
  12. Allow user defined functions in queries

    For example, my IoT devices are sending Unix timestamps (1429197495) to the Azure Event Hub. I need to convert the Unix epoch into a DateTime data type that stream analytics (SA) understands. I would like to be able to do that in the SELECT part of the SA query, via a user defined function..

    98 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    3 comments  ·  Flag idea as inappropriate…  ·  Admin →
  13. Blob output partitioning per custom attribute

    An option to partition the output Blobs according to GROUP BY Statements (or something similar) would be really useful. For example group by customer_id -> results in prefixed blob CSVs for each customer. Something like that would be greatly appreciated!

    89 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    7 comments  ·  Inputs and Outputs  ·  Flag idea as inappropriate…  ·  Admin →
  14. Support Power BI embedded as an output

    As Power BI Embedded allows people to embed dashboards in their applications, it would be nice to have the ability of managing near real-time dashboarding by having ASA being able to push to Power BI Embedded

    78 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  15. Parquet Support

    Would be great to support Parquet file format for output from Stream Analytics. This format seems to be trending up in popularity within the Spark and Hadoop ecosystem.

    75 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    5 comments  ·  Flag idea as inappropriate…  ·  Admin →
  16. Please provide support for Azure Data Lake Store output via ARM templates

    Currently we are not able to create Azure Data Lake (or Power BI) output's via ARM templates because ADL and PowerBI require interactive authentication currently.

    For our continious delivery we would like you to enable this.

    68 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    6 comments  ·  Flag idea as inappropriate…  ·  Admin →
  17. Either support uniqueidentifier type or support conversion on load to the destination type.

    For a SQL Database destination the load will fail if the if the query outputs a string type and the target table has a uniqueidentifier.

    Even though SQL Server allows an implicit conversion in this case. eg

    declare @t table(id uniqueidentifier)
    declare @v varchar(200) = cast(newid() as varchar(200))
    insert into @t(id) values (@v)

    works fine. SO either add the uniqeuidentifer type or make the loading more permissive on type differences.

    68 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  18. Allow creating and configuring stream analytics from the azure CLI

    It is stunningly difficult to automate a deployment of Stream Analytics from a devops scenario. ARM templates seem to either not be supported or not work very well and there is no support for the Azure CLI. The sole option is to drop down to powershell which means that our deployments now need to make use of yet another technology. Please support the Azure CLI

    64 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  19. Data type: bit or boolean

    Necessary as output into sql table

    56 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    3 comments  ·  Flag idea as inappropriate…  ·  Admin →
  20. Data type: GUID

    I consider it necessary to have such data.

    51 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
← Previous 1 3 4 5
  • Don't see your idea?

Stream Analytics

Categories

Feedback and Knowledge Base