Stream Analytics
Azure Stream Analytics is a fully managed real-time stream computation service hosted in Microsoft Azure, which provides highly resilient, low latency, and scalable complex event processing of streaming data. Azure Stream Analytics enables developers to easily combine streams of data with historic records or reference data to derive business insights easily and quickly.
-
56 votesunplanned ·
AdminAzure Stream Analytics Team on UserVoice
(Product Manager, Microsoft Azure)
responded
At this time, we are not planning to add a direct connection to Elastic Search. However, as a workaround, you can output data to blob storage or SQL tables, and index them with Elastic Search. More information here: https://docs.microsoft.com/en-us/azure/search/search-semi-structured-data
Please let the feedback keep coming. We are listening!
-
Please add Split method
Please Add Split methods to the Azure stream analytics Query language
34 votesunplanned ·AdminAzure Stream Analytics Team on UserVoice
(Product Manager, Microsoft Azure)
responded
The scenario can be addressed via a User Defined Function that will convert the string into an array. Followed by CROSS APPLY GetArrayElements() that will split the array into multiple rows.
Javascript UDF: https://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-javascript-user-defined-functions
With the JS function:
function main(arg1) {
return arg1.split(“,”);
}Convert array elements into separate events: https://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-parsing-json#convert-array-elements-into-separate-events
With the query:
WITH CTE AS (
SELECT
UDF.myFunction(I.myString) AS myNewArray
FROM Input I
)
SELECT
A.ArrayValue AS myValue
FROM CTE
CROSS APPLY GetArrayElements(myNewArray) AS A -
Add sql as a data stream input with change data capture
It would be nice to support sql as a data stream input such that any rows added to a table are picked up and streamed, this allows realtime dashboard on existing applications without any recoding!
24 votesunplanned ·AdminAzure Stream Analytics Team on UserVoice
(Product Manager, Microsoft Azure)
responded
We are exploring the possibility of supporting CosmosDB change feed as ingress to Stream Analytics which will solve this scenario. For reference data, we already provide a mechanism to refresh reference data in Azure Blob storage using Azure Data Factory. More details about this here: https://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-use-reference-data
We are listening and committed to making Stream Analytics even better! Keep your feedback coming.
-
Azure Data Lake Store dynamic output path
We want to store events to different folders based on a field - in a query.
I can imagine the output as a function that can take some parameterse.g.
SELECT * INTO [out($type)] FROM Input24 votesunplanned ·AdminAzure Stream Analytics Team on UserVoice
(Product Manager, Microsoft Azure)
responded
Unfortunately we don’t have a way to support this scenario today. We are working on supporting a similar scenario for output to Blob storage which could be used as an alternative when it goes live. We are always looking for feedback to make Stream Analytics even better!
-
23 votesunplanned ·AdminAzure Stream Analytics Team on UserVoice
(Product Manager, Microsoft Azure)
responded
At this time, we don’t plan to implement this feature.
Please let the feedback keep coming, we are listening and may reconsider this decision in the future. -
Usean Azure Service Bus Topic as Stream Analytics Input Source
We have a number of Services which are Ingressed into Azure using Service Bus Topics, the use of topics is due to a the data stream being used in a number of different parallel processing paths, It would be great to be able to use use a topic as an input to a stream analytics job, (currently to achieve the same effect we have to use an API APP web role to receive the data from the topic and then immediately send the message onwards to a separate event hub which is then setup to be an input to a…
22 votesunplanned ·AdminAzure Stream Analytics Team on UserVoice
(Product Manager, Microsoft Azure)
responded
The alternative of using a separate event hub is a workaround we recommend. At this point in time, we don’t have plans of adding ingress support for Azure Service Bus Topic. But we will keep listening and incorporate feedback to our product roadmap!
-
Array or Record To String built in function
The portal displays arrays and records as a json string but if you try to save the entire array as a json string to a field in an SQL table it is not possible. A built in function to convert and array or record data type to a json string would be useful.
18 votesunplanned ·AdminAzure Stream Analytics Team on UserVoice
(Product Manager, Microsoft Azure)
responded
If the ask if to support JSON string to output, then JavaScript user-defined functions can be used. More info:
https://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-javascript-user-defined-functionsWe are continuously listening to make Stream Analytics even better. Keep your feedback coming!
-
Add Output to Azure Storage Queue
Allow output to be sent to an azure storage queue. The use case would be to trigger an azure function/signalr from the azure storage queue when a certain condition is found in the stream. Currently we are writing data to azure table storage and if a specific condition is found, we would like to trigger another action or further processing of the row. Right now we have to write to a service bus topic/queue, develop a listener/trigger function application, and then process the record. Enabling storage queue allows us to use only 1 storage account to hold the raw data,…
15 votesunplanned ·AdminAzure Stream Analytics Team on UserVoice
(Product Manager, Microsoft Azure)
responded
We added support for calling into Azure functions from Stream Analytics jobs. More info about this can be found here:
https://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-with-azure-functionsWe are continuously listening to make Stream Analytics even better. Keep your feedback coming!
-
New output sink LogicApp would be nice...
To be flexible to do what ever we like to do... (alerting via Mail, SMS ...)
6 votesunplanned ·AdminAzure Stream Analytics Team on UserVoice
(Product Manager, Microsoft Azure)
responded
At this time we don’t plan to add Logic App. For SMS, Email, etc. we suggest to use our Azure Function output.
We will continue to monitor this item, so don’t hesitate to vote for it if you think this is something still needed for your scenarios. -
IsLast
Support for IsLast which is opposite of IsFirst
3 votesunplanned ·AdminAzure Stream Analytics Team on UserVoice
(Product Manager, Microsoft Azure)
responded
At this point we are not planning to implement IsLast.
The main reason is that it would delay output of the event (since we need to wait to make sure it is indeed last one)
All other analytic functions we have, do not delay output of events. -
Ability to invoke Azure Notification Services for push notification
Many real time streaming application require notification. I have a scenario where GPS devices are sending data to cloud. This data needs to be displayed on a dashboard to show locations of vehicles owned by a business. Another requirement we have to meet is to have a way to notify one or more registered devices. Azure notification with its ability to send push notification to any platform will meet our needs.
Ability to send text messages(twilio) and emails would be helpful as well.2 votesunplanned ·AdminAzure Stream Analytics Team on UserVoice
(Product Manager, Microsoft Azure)
responded
At this time, we don’t plan to implement this feature but we recommend users to use our output to Azure function as workaround (which have connection to email or Twilio API).
More information on the integration with Azure function here: https://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-with-azure-functionsPlease let the feedback keep coming, we are listening!
-
1 voteunplanned ·AdminAzure Stream Analytics Team on UserVoice
(Product Manager, Microsoft Azure)
responded
This is already possible today but due to the way the backend is implemented it is not visible in the UX.
When you create a new route in IoT Hub, you need to create an endpoint to a source supported by Azure Stream Analytics such as Event Hub.
Then you can connect to this Event Hub like any other Event Hub.
I’m marking this item as “unplanned” at this time, but we will continue to monitor this item, so don’t hesitate to give more feedback or vote for it so we can reconsider it in the future.
- Don't see your idea?