Stream Analytics

Azure Stream Analytics is a fully managed real-time stream computation service hosted in Microsoft Azure, which provides highly resilient, low latency, and scalable complex event processing of streaming data. Azure Stream Analytics enables developers to easily combine streams of data with historic records or reference data to derive business insights easily and quickly.

  • Hot ideas
  • Top ideas
  • New ideas
  • My feedback
  1. reference data

    Allow TIMESTAMP BY OVER with reference data

    3 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Inputs and Outputs  ·  Flag idea as inappropriate…  ·  Admin →
  2. 3 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  3. Output to LogStash

    When consuming logdata from blob it would be great to output them to logstash.

    3 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  4. Option to overwrite output files in Azure Blob Storage

    When you need to restart a job, historical data not being important (like in a lot of real time scenario), but consuming services being already hooked on the filename.

    Right now you have to manually change every consuming services parameters, and some are not scriptable.

    3 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  5. Allow concatenating properties in AzureTable

    We should be able to build the partition and row keys from composite properties of the stream

    3 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  6. Azure Stream Analytics required major improvement

    Azure Stream analytics is good for smal and simple use case but still far away with CEP (Spark, Flink and google Flow). As of now we used stream analytics 1 out of 20 projects because of limited feature like Join in Stream (2 devices), Manage Custom State, Job crash etc.) I love Azure PaaS service, request you to add more feature so we don't need to go other cloud providers or IaaS :)

    3 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  7. Early output for windowed grouping

    Aggregates are only emitted after a event is received which falls after this window.

    This means that the current grouping is never outputted if no new data is received.
    It would be nice if there was an option to allow early output of a group when the first event is received which falls within the window. And new events are outputted when new data is received for this group.

    This way I can show the (current) aggregated value for the current day. instead of only the previous day.

    3 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  8. Managed identity for event hub output

    When the output is an event hub, we can currently only use SAS keys for authentication/authorization. Adding support for managed identity would significantly simplify and secure our setup.

    3 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Inputs and Outputs  ·  Flag idea as inappropriate…  ·  Admin →
  9. percentile

    Provide easy Percentile functions such as PERCENTILE(foo, 95) in ASA queries

    3 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  10. IsLast

    Support for IsLast which is opposite of IsFirst

    3 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  11. in clause

    Provide the ability to use the "in" clause when constructing ASA queries.'

    SELECT
    *
    INTO
    output1, output2
    FROM
    input
    WHERE event in ('a', 'b', 'c')

    3 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  12. Add ability to use something other than time for windowing

    It would be great to provide functionality where you can window (tumbling, sliding or hopping) on something in the input stream other than time.

    Having the ability to compute aggregates based on a different item in the input stream opens up other opportunities.

    Currently I have to do this in another processing engine which removes the need to use Stream Analytics in the solution.

    2 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  13. Provide a way to switch off and on the resource

    Currently I see no way to really temporarily switch the resource off. Please make it possible to temporarily switch the resource off and back on again.

    2 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  14. Active (auto-learning) dimensional lookups

    When taking events form external entities and manipulating them for String based dimensions from the sources need to be converted into dimension keys for storing in Azure SQL DW. However, in an adaptive system, new dimensions need to be learnt (added) on the fly so a writeback mechanism needs to be supported. Without this the columnstores in the DW would be string based, bloated and lack performance.

    2 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  15. Ability to Query Lineage Information like Job Start Time, Job Name, …

    Ability to query JobName, JobStartTime, ExtractStartTime metadata information from Stream Analytics jobs and put it into output. For example: SELECT System.JobName, System.JobStartTime INTO Output FROM Input;

    2 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  16. Ability to invoke Azure Notification Services for push notification

    Many real time streaming application require notification. I have a scenario where GPS devices are sending data to cloud. This data needs to be displayed on a dashboard to show locations of vehicles owned by a business. Another requirement we have to meet is to have a way to notify one or more registered devices. Azure notification with its ability to send push notification to any platform will meet our needs.
    Ability to send text messages(twilio) and emails would be helpful as well.

    2 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  17. More advance input path patterns for date and time.

    Currently, streaming inputs only support basic file path patterns for date and time. (yyyy/dd/mm, hh, etc). Unfortunately, many blob input prefixes do not fit that layout. For instance the native azure cloud likes write prefixes as follows: y={Year}/m={month}/d={day}/h={hour}/m={minute}.

    It would be good to be able to have finer grain control of the input pattern for time, similar to the way input patterns can be handled in data factory.

    2 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Inputs and Outputs  ·  Flag idea as inappropriate…  ·  Admin →
  18. How to check for data loss in Stream Analytics

    ◾️Configuration
    In the steps Azure IoT Hub-Azure Stream Analytics-Azure Data Lake Storage, the data of Device-to-Cloud Messaging of Azure IoT Hub is accumulated in Table Storage and Data Lake Storage.

    ◾️Problem
    When Runtime Errors occur in Stream Analytics in this configuration, I can see the details of the error in the activity log, but I don't know how to determine if this error is causing data loss.

    ◾️Request
    Instead of comparing the number of input and output data of Stream Analytics, I would like to compare the contents of data output from the IoT Hub with the contents of data…

    2 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Inputs and Outputs  ·  Flag idea as inappropriate…  ·  Admin →
  19. See how much data sent per output

    In Monitor tab see how much data sent per output.
    And even be able to give same output to different queries.

    2 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  20. Function to check for point in- or outside a circle

    For use of geofencing, it would be nice to have a function to check whether a point is inside or outside a circle (or square, or polygon)

    An extension of ST_WITHIN to accept a point and a circle would do.

    2 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  • Don't see your idea?

Stream Analytics

Categories

Feedback and Knowledge Base