Stream Analytics

Azure Stream Analytics is a fully managed real-time stream computation service hosted in Microsoft Azure, which provides highly resilient, low latency, and scalable complex event processing of streaming data. Azure Stream Analytics enables developers to easily combine streams of data with historic records or reference data to derive business insights easily and quickly.

  • Hot ideas
  • Top ideas
  • New ideas
  • My feedback
  1. Multiple queries in a single SA job

    Multiple queries in a single SA job, where the queries are the stages in the job. This is mostly a UI presentation problem. I would like to see my SA job represent the complete stream processing for my solution. This would allow better software management practices as well as easier starting and stopping of 'chained' queries.

    32 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  4 comments  ·  Flag idea as inappropriate…  ·  Admin →
  2. Add a GETDATE() Function

    It might be useful to drop old events.

    28 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    5 comments  ·  Flag idea as inappropriate…  ·  Admin →
  3. Enhance Security for ASA, Managed Services Identities , Key Vault Bindings

    Add support for managed services identities and storing input and output configuration details and secrets in Key Vault.

    28 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    2 comments  ·  Security  ·  Flag idea as inappropriate…  ·  Admin →
  4. Please add Split method

    Please Add Split methods to the Azure stream analytics Query language

    28 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  2 comments  ·  Query Language  ·  Flag idea as inappropriate…  ·  Admin →
  5. Support wildcards in blob input path pattern

    You can currently use several supported path variables like {date} and {time}.
    Could you please add support for wildcards so that such a pattern will be valid:
    users/*/{date}/{time}

    Using the "" symbol will currently cause an error (property 'pathPattern' cannot contain the value '')

    26 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  6. Support to Bitwise Operators

    When using Event Hub with IOT usually we have to send binary data. We would like to use Stream Analytics to transform this binary information into a JSON, but Stream Analytics doesn't support Bitwise Operators.

    25 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  7. Azure Data Lake Store dynamic output path

    We want to store events to different folders based on a field - in a query.
    I can imagine the output as a function that can take some parameters

    e.g.
    SELECT * INTO [out($type)] FROM Input

    24 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  8. Add sql as a data stream input with change data capture

    It would be nice to support sql as a data stream input such that any rows added to a table are picked up and streamed, this allows realtime dashboard on existing applications without any recoding!

    24 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →

    We are exploring the possibility of supporting CosmosDB change feed as ingress to Stream Analytics which will solve this scenario. For reference data, we already provide a mechanism to refresh reference data in Azure Blob storage using Azure Data Factory. More details about this here: https://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-use-reference-data

    We are listening and committed to making Stream Analytics even better! Keep your feedback coming.

  9. Allow more flexible file formats for blob storage inputs

    Blob storage inputs shouldn't be limited to UTF8 encoding. CSVs should not be required to provide a header row, especially when you do block boundary (since that means putting header rows in the middle of the file) and the CREATE TABLE statement in your query should be where you define the column names when you mark an input as having no header row.

    Also, you should be able to skip header rows. For example, IIS website logs have two header rows in a strange format that would be good to skip (only on the initial block, there are no headers…

    24 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  10. notification hub as output

    Can we add Notification Hub as output to Stream Analytics

    24 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  11. Enable a dynamic conversion from UTC to the local time

    When working with streaming data generated by a sensor. We used IoT Hub as the input for our Stream Analytics job and Power BI as the output.
    We wish to have Local time in our streaming dashboard in order to satisfy our customer’s needs. For the time being, we are using the DATEADD (Azure Stream Analytics) function to add the missing hours.

    We wish the solution to be a dynamic conversion between UTC (Coordinated Universal Time) and the user's local time.

    23 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    4 comments  ·  Flag idea as inappropriate…  ·  Admin →
  12. Increase late arrival tolerance window

    Right now, this dropdown list allows up to 20 days of tolerance.

    We have a requirement to "catch up" on old events. If for some reason our Event Hub publisher is down, when we start sending old events again, the timestamps may go back to the start of the month.

    It would be great to increase this tolerance level to a full month (31 days), if possible (or longer).

    Is this 20 day limit a restriction of memory buffer used by Stream Analytics, or would this be a simple change in the GUI?

    23 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    3 comments  ·  Flag idea as inappropriate…  ·  Admin →
  13. 23 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  14. Cosmos DB as Reference Data

    I think Cosmos DB is the best solution for low latency reference data. For our IoT use case, we need to maintain state after certain condition met, and subsequent DeviceId will use that reference data in query.

    23 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  15. Use of functions like format, convert, getdate.. etc should be supported

    In case of data is in encoding format.
    I need to decode it using some sql functions.
    Suppose I'm getting date "Thu,%2029%20Oct%202015%2012:15:52%20GMT" in this format.
    Need to replace %20 by space or need to convert.

    23 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    2 comments  ·  Query Language  ·  Flag idea as inappropriate…  ·  Admin →
  16. Add calls to C# custom code

    We think that can call to c# assembly inside a ASA query, or perhaps, make ASA query syntax like U-SQL

    22 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  17. 22 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  18. Output to ADLS gen 2

    Support for output to ADLS gen 2 in addition to existing inputs.

    22 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    started  ·  2 comments  ·  Inputs and Outputs  ·  Flag idea as inappropriate…  ·  Admin →
  19. output to different Azure Tables based on time

    When you choose Azure Table as output sync, you can set a static table name in the configuration. What about to choose a dynamic name like TableName-YYYY-MM? It could be really useful in scenario when you have to delete old data without occurring in the azure table delete rows pain

    21 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  20. Add support for ASA in Python SDK

    It would be create to have support for ASA in the Python Azure SDK. https://github.com/Azure/azure-sdk-for-python

    It would make automated updating streams much easier.

    20 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    planned  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  • Don't see your idea?

Stream Analytics

Categories

Feedback and Knowledge Base