Stream Analytics
Azure Stream Analytics is a fully managed real-time stream computation service hosted in Microsoft Azure, which provides highly resilient, low latency, and scalable complex event processing of streaming data. Azure Stream Analytics enables developers to easily combine streams of data with historic records or reference data to derive business insights easily and quickly.
-
Take input from CosmosDB
Currently Stream Analytics accepts data from Blob storage. Support to get data from DocumentDB should be added.
174 votes -
Azure Stream Analytics to handle case sensitive columns (currently getting InputDeserializerError)
Azure Stream Analytics currently does not support two column with names only differing by case as input.
//input data
""shopperId"":""1234567"",
""shopperid"":"""",//ASA returns InputDeserializerError error in input
{"Source":"eventhubinput","Type":"DataError","DataErrorType":"InputDeserializerError.InvalidData","BriefMessage":"Could not deserialize the input event(s) from resource 'Partition: [0], Offset: [12894685888], SequenceNumber: [104569]' as Json. Some possible reasons: 1) Malformed events 2) Input source configured with incorrect serialization format","Message":"Input Message Id: Partition: [0], Offset: [12894685888], SequenceNumber: [104569] Error: Index was out of range. Must be non-negative and less than the size of the collection.\r\nParameter name: index","ExampleEvents
ASK to Azure Stream Analytics team
Please consider to change Azure Stream Analytics to…
71 votes -
Time series database sink
It would be great to be able to stream the data into a time series database. Currently Azure does not have support for time series, but it would be nice to see support for KairosDB or OpenTSB
49 votesunder review ·
AdminAzure Stream Analytics Team on UserVoice
(Product Manager, Microsoft Azure)
responded
We see more and more demand for output to time series databases so reopening this item.
Let us know which database you are using. -
Allow REST Endpoints as reference data input
Possibility to define REST endpoints as reference data inputs. Including refresh rate settings similar to SQL Database.
41 votes -
Please add feature that can set Path pattern time zone as a JST.
At now, when output at Azure Blob Storage/ADLS gen2, the path pattern time zone is UTC.
But I want to set this time zone as a JST.
Please add feature that can set Path pattern time zone as a JST.23 votes -
Output to ADLS gen 2
Support for output to ADLS gen 2 in addition to existing inputs.
23 votes -
Support SQL DB stored procedures as ASA Output
Allow native support to Stored Procedures to be called from Stream Analytics. This way, we don't need to build custom solutions to trigger Stored Procedures when ASA generates O/P.
20 votes -
Foresee event grid output for Azure Stream Analytics
Azure Event Grid really helps in building distributed, event-driven, applications on Azure. Having out of the box support to publish selected events from Azure Stream Analytics to Azure Event Grid would be awesome!
To achieve this today, I have to call (and deploy + pay) an Azure function that takes the message and call the actual Azure Event Grid API... It would be so much easier to have this out of the box and this would benefit for future out of the box event grid subscribers.
19 votes -
Invoke Functions in Batch & Parallel
Current Functions Output executes one by one and ensures ordering. In our scenario, ordering is not important & we would like output to support.
- Batching & invoke function for each batch (Array as input)
- Invoke functions in parallel for non-ordering scenarios (may be as a configuration for output)
15 votes -
Output to PostgreSQL
Native output to Azure Database for PostgreSQL
15 votes -
11 votes
-
Input from Cosmos DB changefeed
Support direct input from Cosmos DB changefeed.
6 votes -
Azure Key Vault as reference data input
I need to apply some values to my stream analytics query that are considered "secret" by our customer. So it would be great if I don't have to store them in plaintext but could just input them from Azure Key Vault into my query.
4 votes -
Add support for compressed output
I have historic data imported through spark in avro format to our Gen 1 Data Lake. I am now using ASA to stream the live data.
Spark defaults to uses snappy to compress avro files where as ASA doesn't compress. This has resulted in a 10 fold increase in storage size and a slow down in access speed. Can you add support for compression of the outputs in ASA?4 votes -
Allow Azure Data Explorer (ADX) as a ouput
We use Stream Analytics for alerting in combination with Azure functions and Azure Data Explorer is our central data store. Life would be easier, if we can output our alerts directly to Azure Data Explorer (ADX). This would also safe money, as for now we are putting an additional EventHub in place to mitigate the issue.
4 votes -
Allow Azure Data Explorer (ADX) as a reference input
We leverage Azure data explorer (ADX) as our main reporting database, and as such, we want to be able to use it as an input for reference data (as we store it there)
4 votes -
Job Diagram
This Job Diagram holds real promise as visual intuitive view of job execution and metrics especially during development. In it current form it's anything but that. When I select an output it seems to default to out of order events only.
3 votes -
For Service bus topic (as output) with session enabled subscription and when set Session Id as System property then the state set as degrade
For Service bus topic (as output) with session enabled subscription and when set Session Id as System property then the state set as degrade. However, the messages are still passes to those subscriptions but this is really confusing. Please let us know the reason for this
3 votes -
Output to Azure Postgres
Similarly how Azure SQL is supported it would be great to have an output connector to Azure Postgres.
3 votes -
Stream Analytics for IoT Edge removes custom message properties / doesn't allow setting message properties
Stream Analytics for IoT Edge seems to strip out custom IoT message properties set by other modules, and I can't seem to work out anyway in Stream Analytics Edge to set these properties again.
I see for Cloud Hosted Stream Jobs you can configure these properties on the Output...but I can't work out how to do this for Edge jobs https://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-define-outputs?#custom-metadata-properties-for-output
I've opened an issue on Github IoT Edge repo with more details https://github.com/Azure/iotedge/issues/2846
3 votes
- Don't see your idea?