Update: Microsoft will be moving away from UserVoice sites on a product-by-product basis throughout the 2021 calendar year. We will leverage 1st party solutions for customer feedback. Learn more here.

Stream Analytics

Azure Stream Analytics is a fully managed real-time stream computation service hosted in Microsoft Azure, which provides highly resilient, low latency, and scalable complex event processing of streaming data. Azure Stream Analytics enables developers to easily combine streams of data with historic records or reference data to derive business insights easily and quickly.

  • Hot ideas
  • Top ideas
  • New ideas
  • My feedback
  1. 7 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  2. date

    Enable dates to be provided in local date time rather than UTC. Useful for outputs to PowerBI to create reports that reflect the local time the data was captured and not UTC

    7 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  3. running aggregates

    I'd like to be able to sum counts from all records since a fixed time in the past, rather than use fixed windows.

    This would be like a sliding window, but with a fixed beginning, and an end that follows the last sample.

    Input stream
    sesID TIME count
    session1 time 1
    session2 time 2
    session2 time 3

    The first step would be to create an subquery that uses LAG to find where the sesID changes, and then store that time.

    That time then could be used as the start of the window, let's call it fixedStartWindow(StartTime, last(time)) and allow group…

    7 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  4. Check data loss happened or not when transient error occurs

    We understand that when transient errors happen, data loss would not happen in Stream analytics since all transient errors are retried regardless of the output error handling policy configuration.

    Although data loss would not happen, we would like to check if data loss happened or not in Stream Analytics.

    Enable diagnostic logs might work for some data conversion error but still could not check if data loss happened due to transient errors.

    7 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  5. request of the feature which is able to append csv header feature on Azure Stream Analytics

    When csv file without header is inputed to ASA, 1st records is regarded as "header" automatically. it is inconvinient when the user needs to use these kind of file because each 1st value isn't same.
    I want the feature which is able to append and customize the header of csv

    7 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  6. Stream Analytics cluster stop/start options

    Request stop/start options for Stream Analytics cluster.
    Currently, Stream Analytics cluster cannot stop even during jobs are not running.
    To reduce cost and enhance convenience, stop/start cluster features should be added.
    Please consider improvement.

    7 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Advanced Analytics  ·  Flag idea as inappropriate…  ·  Admin →
  7. Define a specific partition of a n eventhub as input to stream analytics query

    Define a specific partition of a n eventhub as input to stream analytics query

    7 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  8. Define SerializerDeserializer for input reference data from blob storage

    Possibility to define (in some language) a Serializer/Deserializer for proprietary input file formats from reference blob data.

    As it is today I had to write a cloud service that parses the data and send it to an eventhub but if stream analytics could accept any file format this way, provided that I somehow define a parser for my special data format, than I could skip that step.

    7 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  9. Search array elements

    Ability to search through array elements.

    My json data is as follows into the eventhub

    {
    "customerid":"ifslabs",
    "deviceid":"car1",
    "starttime":"2015-08-21 08:19:40.362983",
    "eventtime":"2015-08-21 08:19:55.045514",
    "SensorData": [
    {"SensorId":"gps", "SensorType":"latitude", "SensorValue":"1.1"},
    {"SensorId":"gps","SensorType":"longitude","SensorValue":"9.9"},
    {"SensorId":"Fuel System Stat","SensorType":"","SensorValue":"NORESPONSE"},
    {"SensorId":"Calc Load Value","SensorType":"","SensorValue":"NORESPONSE"},
    {"SensorId":"Coolant Temp","SensorType":"F","SensorValue":"NORESPONSE"},
    {"SensorId":"Engine RPM","SensorType":"","SensorValue":"NORESPONSE"},
    {"SensorId":"Vehicle Speed","SensorType":"MPH","SensorValue":"NORESPONSE"},
    {"SensorId":"Intake Air Temp","SensorType":"F","SensorValue":"NORESPONSE"}
    ]
    }

    Using stream analytics function GetArrayElement I can get array elements of SensorData flattend but I want to search through the array and filter only some specific SensorType for example:

    select inputeventhub.starttime as starttime,
    inputeventhub.eventtime as eventtime,
    FilterArrayElement(inputeventhub.SensorData, SensorType, 'latitude') as latitude,
    FilterArrayElement(inputeventhub.SensorData, SensorType, 'longitude') as longitude
    outputcarlocation from inputeventhub

    Using a new function like FilterArrayElement(array,…

    7 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  10. 6 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  11. Integrate Stream Analytics operation logs with Application Insight.

    Integrate Stream Analytics operation logs with Azure Application Insight. This makes monitoring and troubleshooting easier.

    6 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  12. Allow acces to AMQP message application properties and properties

    Currently only payload of stream messages is queried and can be used for filtering and analysis purposes, AMQP (and any other messaging protocol) defines some ways to "annotate" message payloads with various headers and properties - this is mostly the place where message routing information should be placed and therefore Stream Analytics should be able to access it.
    This would also allow serialized/compressed payload to be processed by Stream Analytics, not only JSON, Avro and CSV formats.

    6 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    3 comments  ·  Flag idea as inappropriate…  ·  Admin →
  13. ASA to partitioned documentdb

    Is the recent update to ASA to output to a partitioned DocumentDB collection now generally available and production ready?

    6 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  14. Delete blob inputs in blob input stream

    If I do have a blob input stream, I do want my file to be deleted after it is processed in the stream analytics job. It's a stream, I do not need all my compressed original data. I do want to be able to enable this when I create a new Blob input stream.

    6 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  15. True "pay by use" pricing for Power-BI Embedded (with stream analytics)

    Azure has become so popular partly due to the fair "pay by use" policy that it claims as one of its principles. Where is this with Power-BI Embedded (with stream analytics). I can't even get started with a real product for under 600 $/month? What if i need to start with 50 customers? In this case, I have to use something other than Power-BI, and it will be a pain, at least, to move to Power-BI once I am up to 1000 customers or so... Please stick to the Azure principles and make the "pay to play" game reasonable for…

    6 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  16. Obfuscation or encryption of query code

    Will it be possible in a future release of Stream Analytics to either obfuscate or encrypt the query (or javascript or C#) code of SA jobs. We are looking into the possibility to implement our SA jobs/models, which we use for predictive maintenance for instance, besides our own subscriptions, in subscriptions of customers as well. But we would not want them to be able to see the code of our queries or, because these contain proprietary logic, rules or definitions.

    6 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  17. Allow ASA to acquire bearer token for authenticating itself to Azure Function protected by App Service Authentication

    A possible output sink for an ASA job is Azure Functions. However, if the Function is protected by App Service Authentication (or any type of OAuth authentication), the flow will not work since ASA doesn't have the functionality to fetch bearer tokens.

    6 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Security  ·  Flag idea as inappropriate…  ·  Admin →
  18. Which input caused the issue

    ASA ran into runtime error and we want to know which input/field caused this problem, so that we can fix the source to make sure these values arent emitted.

    The input deserialization errors are already captured as part of the logs and only runtime errors are not captured as part of the logs (e.g cast errors).

    6 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Inputs and Outputs  ·  Flag idea as inappropriate…  ·  Admin →
  19. Output to LogStash

    When consuming logdata from blob it would be great to output them to logstash.

    6 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  20. Provide API App DataSource

    Output of some API App can be used as input data stream in ASA job.

    6 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  • Don't see your idea?

Stream Analytics

Categories

Feedback and Knowledge Base