“Output contains multiple rows …” warning
I'm not totally sure I'm right here; please let me know if this should go anywhere else. I posted a question on Stackoverflow yesterday (https://stackoverflow.com/questions/45979008/azure-stream-analytics-output-contains-multiple-rows-warning) and was redirected here.
We're using a Stream Analytics component in Azure to send data (log messages from different web apps) to a table storage account. The messages are retrieved from an Event Hub, but I think this doesn't matter here.
Within the Stream Analytics component we defined an output for the table storage account including partition and row key settings. As of now the partition key will be the name of the app that sent the log message in the first place. The row key will be a unique id of the specific log message.
Now when I watch the Stream Analytics Output within the Azure portal the following warning message pops up very frequently (and sometimes disappears for a couple of seconds):
Warning: Output contains multiple rows and just one row per partition key. If the output latency is higher than expected, consider choosing a partition key that splits output into multiple partitions while maintaining about 100 records per partition.
Now looking at maybe hundreds of rows sent within a short period of time they all share just three partition keys (three apps logging to the Event Hub), pretty much equally divided. That's why I don't get the "Output contains multiple rows and just one row per partition key" thing.
So here's my question: Does this warning really apply in our situation? And if so: What can we do about it?
Thanks in advance.
João Maia commented
I have the same issue, i think this only a warning advising on how to properly send data do azure storage table.
We are also having same issue, only one ASA job is showing this warning message.