Stream Analytics

Azure Stream Analytics is a fully managed real-time stream computation service hosted in Microsoft Azure, which provides highly resilient, low latency, and scalable complex event processing of streaming data. Azure Stream Analytics enables developers to easily combine streams of data with historic records or reference data to derive business insights easily and quickly.

  • Hot ideas
  • Top ideas
  • New ideas
  • My feedback
  1. Add Dropbox as an output for CSV and JSON

    Some dashboard services use Dropbox as a platform to exchange/load data sets.

    It could be usefull to add it alongside Azure Blob Storage.

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  2. Sample data time-range selection

    The date displayed in the "Select time range" dialog is in US date format. My browser and OS are set to NZ format, the international normal of dd-mm-yyyy. Please change the date display to match.

    Also, the time input is rather finicky, suggest an improvement on this one too. Would be good to specify the time as UTC as well as local time.

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Inputs and Outputs  ·  Flag idea as inappropriate…  ·  Admin →
  3. Improvements in Reference Input

    Following are my Inputs for Stream Analytics:

    Input 1: Stream Input from IoT Hub
    Input 2: Reference Data from Azure Blob Storage

    My Query:
    SELECT

    din.deviceid as streamdeviceid,
    
    din.heartrate as streamheartrate,
    refin.deviceid as refdeviceid,
    refin.patientid as refpatientid,
    din.srcdatetime,
    din.EventProcessedUtcTime

    FROM

    [asa-in-iot-healthcare-rpm] din 
    
    TIMESTAMP BY srcdatetime

    Left outer JOIN

    [asa-ref-in-patient-device-mapping] refin
    
    ON refin.deviceid = din.deviceid

    Giving Error:
    The join predicate is not time bounded. JOIN operation between data streams requires specifying max time distances between matching events. Please add DATEDIFF to the JOIN condition. Example: SELECT input1.a, input2.b FROM input1 JOIN input2 ON DATEDIFF(minute, input1, input2) BETWEEN 0 AND 10

    Modified…

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Inputs and Outputs  ·  Flag idea as inappropriate…  ·  Admin →
  4. power bi

    some sql like features in stream analytics. creating storeproc or function in sql would be great.

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  5. Please add feature that can use "Identity" at Stream Analytics side

    This "Identity" is the feature of SQL Database. Like a "Identity(1,1)".
    when I use both outputs different from SQL DB and SQL DB, I want to assign the same ID number, so please implement this Identity function on SA side.

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  6. Bug: Reading the reference data test input from CSV file does not work. Switching back to JSON works well.

    Tried to test my query with IoT Hub as a Data Stream Source and SQL Database as a reference input. I have added the JSON message as a Data Stream test input and CSV file as the reference file input. Testing the query does not provide any results, neither errors. Converting the CSV file to JSON and re-running the test, works well.

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Inputs and Outputs  ·  Flag idea as inappropriate…  ·  Admin →
  7. Allow CI/CD deployment without start

    Please make it possible to run a CI/CD deployment with the possibility to have the job stopped/not started after deployment

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  8. When creating an ASA job input, the 'value must not be empty' warning for Event Hub Policy Name field is inconsistent


    • If no policies are created, it defaults to RootManagerSharedAccessKey, and has a warning on the side that 'must not be empty', which disables creation


    • After updating the policies in another window, this window won't reupdate automatically; my solution was to select a different Service Bus Namespace, then revert the namespace back to the one I wanted. After doing this, the Event Hub Policy Name updates to my newly created policy, but the warning is still there (and create is still disabled)


    • I can now manually select RootManagerSharedAccessKey, which removes the warning and allows creation


    • I can go back to my…

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  9. Better diagnostics

    I can see input, run queries, and test the output, but no data comes into the output. Diagnostics won't show any content, so all that's left is to give up trying to get this to work.

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Inputs and Outputs  ·  Flag idea as inappropriate…  ·  Admin →
  10. Read Application Properties (Device Properties) from Iot Hub event endpoint in StreamAnalytic

    I want store telemetry in azure sql db.so I got input from Iot Hub built-in event endpoint in stream analytics (Integrated in sql db) and want to process application properpties that attached to telemetry from iot hub message enrichemnt. I research alot in UDF, UDA, built-in function stream analytics but couldnt even see application properties in stream analytic. So how can i do that? Is this possible?

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Inputs and Outputs  ·  Flag idea as inappropriate…  ·  Admin →
  11. 1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  12. Enable output message size of 1MB from Azure Stream Analytics to Premium Service Bus

    Premium Service Bus allows messages of up to 1MB but Stream Analytics only allows to send messages of 256KB to Premium Service Bus

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  13. Include complete analytics offerings in Free Subscription for Evaluation

    I had signed in for the Microsoft Azure ML Free trial. However, as I researched further, I found Azure Streaming Analytics very interesting and wanted to setup an end to end ML + Streaming Architecture as suggested in one of the Tutorial Architecture documents.

    However, since Streaming Analytics cannot be included in the ML Free subscription, I am not able to build an end to end architecture.

    Would be great if a complete analytics set of services is made available under the Free subscription for research.

    Thanks.

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  14. Conversion errors

    When a conversion error happens it would be great to to know wich column was the error source.

    Encountered error trying to write 1 event(s): Conversion from 'System.Int16' to 'System.String' failed.

    is not very helpful

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  15. 1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  16. Blob

    Infer timestamps from blob filenames instead of metadata. I just bulk uploaded my back data in order to test (one blob per day of data, with YYYY-MM-DD names). But ASA appears to be using the blob LastModified timestamp property to determine whether the data should be included or not. The problem is that the LastModified dates ended up out of order, and worse, are from today, not from the previous months from when the data was collected originally.

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  17. BUG: Reference Data from SQL database not working well

    I have a query where I use JOIN clause to join the reference data. Running the test with test files works. Reference Input SQL Query works and retrieves the results so that query is not the problem.
    When testing the ASA Job with real data, it does not retrieve the results, even I send the same message as in the test. Switching reference input to JSON file from BLOB storage makes it working

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Inputs and Outputs  ·  Flag idea as inappropriate…  ·  Admin →
  18. Service Bus Relay as output

    Add service bus relay as an output

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    2 comments  ·  Flag idea as inappropriate…  ·  Admin →
  19. I would prefer for a given windowing mechanism, to operate across rows that are extracted from the inputs

    Today a UDF function operates on row by row it would be good to have a udf that can created and operate across rows. This enbles in writing more powerful function.

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  20. Add comments, display file names and change title of query


    1. In job diagram, can we allow option to add mark up/comments , 2- Display file names if reference is chosen, Define query as "Process". It is defined as output

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  • Don't see your idea?

Stream Analytics

Categories

Feedback and Knowledge Base