Update: Microsoft will be moving away from UserVoice sites on a product-by-product basis throughout the 2021 calendar year. We will leverage 1st party solutions for customer feedback. Learn more here.

Stream Analytics

Azure Stream Analytics is a fully managed real-time stream computation service hosted in Microsoft Azure, which provides highly resilient, low latency, and scalable complex event processing of streaming data. Azure Stream Analytics enables developers to easily combine streams of data with historic records or reference data to derive business insights easily and quickly.

  • Hot ideas
  • Top ideas
  • New ideas
  • My feedback
  1. Ability to Query Lineage Information like Job Start Time, Job Name, …

    Ability to query JobName, JobStartTime, ExtractStartTime metadata information from Stream Analytics jobs and put it into output. For example: SELECT System.JobName, System.JobStartTime INTO Output FROM Input;

    2 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  2. Allow datatype precision

    I'd like a Stream Analytics Job to be able to insert events into a SQL-table and be able to use a NVARCHAR[n] column instead of NVARCHAR(MAX). This would be so these columns could be used in an index.

    Also, mapping a SA 'FLOAT' to a SQL 'DECIMAL(p,s)' should be possible.

    Ideally, I'd like to be able to set these data type precisions in a CREATE TABLE statement of a SA-query. Any event with a defnied property that exceeds the defined precision/length should be reduced to fit. F.e.;

    event:
    { "ArticleNumber" : "ABCDEFGH12345678" }

    CREATE TABLE article
    ( ArticleNumber NVARCHAR(12)
    );

    5 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  3. Add support for ASA in Python SDK

    It would be create to have support for ASA in the Python Azure SDK. https://github.com/Azure/azure-sdk-for-python

    It would make automated updating streams much easier.

    20 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    planned  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  4. Please add Split method

    Please Add Split methods to the Azure stream analytics Query language

    34 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    2 comments  ·  Query Language  ·  Flag idea as inappropriate…  ·  Admin →

    The scenario can be addressed via a User Defined Function that will convert the string into an array. Followed by CROSS APPLY GetArrayElements() that will split the array into multiple rows.

    Javascript UDF: https://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-javascript-user-defined-functions

    With the JS function:

    function main(arg1) {
    return arg1.split(“,”);
    }

    Convert array elements into separate events: https://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-parsing-json#convert-array-elements-into-separate-events

    With the query:

    WITH CTE AS (
    SELECT
    UDF.myFunction(I.myString) AS myNewArray
    FROM Input I
    )
    SELECT
    A.ArrayValue AS myValue
    FROM CTE
    CROSS APPLY GetArrayElements(myNewArray) AS A

  5. Aggregate functions should support strings

    Min/Max should support strings as well.
    In our scenarios this is needed because we are dealing with table storage output and Partition/Row key can only be strings. So sometimes it's really needed to take min/max of a string.

    5 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  6. Allow Functions like CAST after TIMESTAMP BY

    My incoming timestamps have to be converted to ISO 8601 but only columns (and no functions) are allowed after the TIMESTAMP BY statement.
    Please allow all kind of functions in order to provide a conversion. I think some guys here needed also a unix datetime converter :)

    3 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  7. IsLast

    Support for IsLast which is opposite of IsFirst

    3 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  8. Search array elements

    Ability to search through array elements.

    My json data is as follows into the eventhub

    {
    "customerid":"ifslabs",
    "deviceid":"car1",
    "starttime":"2015-08-21 08:19:40.362983",
    "eventtime":"2015-08-21 08:19:55.045514",
    "SensorData": [
    {"SensorId":"gps", "SensorType":"latitude", "SensorValue":"1.1"},
    {"SensorId":"gps","SensorType":"longitude","SensorValue":"9.9"},
    {"SensorId":"Fuel System Stat","SensorType":"","SensorValue":"NORESPONSE"},
    {"SensorId":"Calc Load Value","SensorType":"","SensorValue":"NORESPONSE"},
    {"SensorId":"Coolant Temp","SensorType":"F","SensorValue":"NORESPONSE"},
    {"SensorId":"Engine RPM","SensorType":"","SensorValue":"NORESPONSE"},
    {"SensorId":"Vehicle Speed","SensorType":"MPH","SensorValue":"NORESPONSE"},
    {"SensorId":"Intake Air Temp","SensorType":"F","SensorValue":"NORESPONSE"}
    ]
    }

    Using stream analytics function GetArrayElement I can get array elements of SensorData flattend but I want to search through the array and filter only some specific SensorType for example:

    select inputeventhub.starttime as starttime,
    inputeventhub.eventtime as eventtime,
    FilterArrayElement(inputeventhub.SensorData, SensorType, 'latitude') as latitude,
    FilterArrayElement(inputeventhub.SensorData, SensorType, 'longitude') as longitude
    outputcarlocation from inputeventhub

    Using a new function like FilterArrayElement(array,…

    7 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  9. automation

    Have an output into Azure Automation

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  10. Ability to identify reference data from data in the input

    Ability to identify reference data from data in the input, something like a SELECT DISTINCT in SQL

    6 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  11. Allow writing to a SQL DB Elastic Scale shard

    Please add a method of writing to a SQL DB shard by looking up the mapping from within the query.

    5 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  12. Testing query should not require reference data as input

    At present testing a query requires all the input including the "reference data" to be included. But there is a limitation of size of input data. Instead of that, testing should require only the input data stream to be included. Reference data should be taken from the reference blob

    3 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  13. Support to Bitwise Operators

    When using Event Hub with IOT usually we have to send binary data. We would like to use Stream Analytics to transform this binary information into a JSON, but Stream Analytics doesn't support Bitwise Operators.

    25 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  14. Ability to check for EXISTS when peforming a query over JSON with arrays

    My data has a data field that can have no value, a single value or an array of values. I need to be able to parse that field into single column with either a single row (for no value and single value) and into multiple rows (using, say GetElements for array) dynamically based on whether that data field is an array or not.
    Currently I get an error - "The expression outputStep experienced an error: Unable to cast type 'string' to 'Record'.. It will be disabled"

    21 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  4 comments  ·  Flag idea as inappropriate…  ·  Admin →
  15. Add sql as a data stream input with change data capture

    It would be nice to support sql as a data stream input such that any rows added to a table are picked up and streamed, this allows realtime dashboard on existing applications without any recoding!

    24 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →

    We are exploring the possibility of supporting CosmosDB change feed as ingress to Stream Analytics which will solve this scenario. For reference data, we already provide a mechanism to refresh reference data in Azure Blob storage using Azure Data Factory. More details about this here: https://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-use-reference-data

    We are listening and committed to making Stream Analytics even better! Keep your feedback coming.

  16. Rename Inputs and Outputs

    Please can you let us rename the input and outputs of a stream. Thanks

    22 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  17. Provide API App DataSource

    Output of some API App can be used as input data stream in ASA job.

    6 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  18. See how much data sent per output

    In Monitor tab see how much data sent per output.
    And even be able to give same output to different queries.

    2 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  19. Merge Inputs/Queries/Outputs Tab

    When I am writing my query, if I waant to add an input or an output I have to save my query leave the tab, go to a different tab, add it, back to the query tab...

    If I forget my Inputname I have to go back to the input tab, and there is now way to copy the input name to the clipboard. Other option would be to at least list inputs and outputs somewhere on query tab...

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  20. Autoformat Query in Query Window

    Have a button that will auto format the query in the query window like in an IDE.

    4 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  • Don't see your idea?

Stream Analytics

Categories

Feedback and Knowledge Base