Stream Analytics

Azure Stream Analytics is a fully managed real-time stream computation service hosted in Microsoft Azure, which provides highly resilient, low latency, and scalable complex event processing of streaming data. Azure Stream Analytics enables developers to easily combine streams of data with historic records or reference data to derive business insights easily and quickly.

  • Hot ideas
  • Top ideas
  • New ideas
  • My feedback
  1. ASA to partitioned documentdb

    Is the recent update to ASA to output to a partitioned DocumentDB collection now generally available and production ready?

    6 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  2. Delete blob inputs in blob input stream

    If I do have a blob input stream, I do want my file to be deleted after it is processed in the stream analytics job. It's a stream, I do not need all my compressed original data. I do want to be able to enable this when I create a new Blob input stream.

    6 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  3. True "pay by use" pricing for Power-BI Embedded (with stream analytics)

    Azure has become so popular partly due to the fair "pay by use" policy that it claims as one of its principles. Where is this with Power-BI Embedded (with stream analytics). I can't even get started with a real product for under 600 $/month? What if i need to start with 50 customers? In this case, I have to use something other than Power-BI, and it will be a pain, at least, to move to Power-BI once I am up to 1000 customers or so... Please stick to the Azure principles and make the "pay to play" game reasonable for…

    6 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  4. New output sink LogicApp would be nice...

    To be flexible to do what ever we like to do... (alerting via Mail, SMS ...)

    6 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  5. Output to PostgreSQL

    Native output to Azure Database for PostgreSQL

    6 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Inputs and Outputs  ·  Flag idea as inappropriate…  ·  Admin →
  6. Aggregate functions should support strings

    Min/Max should support strings as well.
    In our scenarios this is needed because we are dealing with table storage output and Partition/Row key can only be strings. So sometimes it's really needed to take min/max of a string.

    5 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  7. Allow writing to a SQL DB Elastic Scale shard

    Please add a method of writing to a SQL DB shard by looking up the mapping from within the query.

    5 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  8. New functions needed

    I've had a client request for a MEDIAN function.

    Other functions I seem to be missing would be analytic functions like LAG, LEAD, FIRSTVALUE, and LASTVALUE. For example, how can I find a 10 second window where Speed>0 on at least 50% of the rows in the window and where the first measurement in the window is >0. FIRST_VALUE would accomplish that for me.

    5 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  9. 5 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  10. visual studio extension badly needs Power BI output support

    The Visual Studio extension is great, but we now need support for Power BI, which is not only a common use-case, but what that is supported by the tutorials on IoT and the like.
    In the meantime, it seems as if it would be helpful to not just refuse to output Power BI output projects, but just do so with limitations.
    I have several days work I would like to have just exported off of Azure and been able to recreate later, but the current state of the extension gives me no ability to export.
    -thanks
    -e

    5 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  11. support IN keyword

    Support sqls IN keyword to check if a value exists inside a table or storage blob.

    5 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  12. Query Testing Stream Analytics

    I want to test my query in the Query Editor of Stream Analytics, when i'm using an Azure ML Function. Currently there is no way of testing a query which includes an ML function

    5 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  13. Improve DocumentDb output JSON structured formatting

    It appears the DocumentDb formatting from Stream Analytics can't create JSON documents more than one level deep.

    Is there anyway to describe the JSON output, so we can create a document that looks like this? (i.e. where an emitted value is put inside the "payload" object?)

    {
    "resourceId" : "2acabbd1-7f0a-4775-851b-2c0db47689ac",
    "payload" : {
    "cost" : 1,
    }
    }

    5 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  14. Provide a Query Builder tool to improve accuracy and speed

    In tools like SSIS, you can use a tool to quickly see your input and output fields and map them. I recently had a very large nested JSON file and had to literally type and edit each field as I tested it plus there was no real easy way to validate I was entering the arrays and properties correctly.

    5 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  15. download results to csv

    add ability to download results from test as CSV. JSON doesn't import into Excel well and CSV would be easier to check data quickly.

    5 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  16. Allow datatype precision

    I'd like a Stream Analytics Job to be able to insert events into a SQL-table and be able to use a NVARCHAR[n] column instead of NVARCHAR(MAX). This would be so these columns could be used in an index.

    Also, mapping a SA 'FLOAT' to a SQL 'DECIMAL(p,s)' should be possible.

    Ideally, I'd like to be able to set these data type precisions in a CREATE TABLE statement of a SA-query. Any event with a defnied property that exceeds the defined precision/length should be reduced to fit. F.e.;

    event:
    { "ArticleNumber" : "ABCDEFGH12345678" }

    CREATE TABLE article
    ( ArticleNumber NVARCHAR(12)
    );

    5 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  17. Automated Query Testing

    Testing ASA queries requires manual interaction through the portal as described in https://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-test-query

    It would be nice to be able to create automated tests.

    ie: an API to pass test input that returns output.

    5 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  18. Way better feedback is needed when there is a problem

    I have an issue right now. no matter what I do the job starts and goes immediately IDLE. There is ZERO feedback anywhere. The query passes, all connection tests pass. The logs show there are zero issues but its running.. however it doesn't DO anything at all.

    5 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    planned  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  19. Allow union operator with a wildcard

    I do want to merge two input streams to one, as of I have one stream with all my data. For this I want to do:
    SELECT * FROM FirstStream UNION SELECT * FROM Secondstream.
    I do not know all the column names in my case, so I want to do this dynamically.

    4 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  20. There should be Boolean support between Azure Stream Analytics and the Machine Learning Services

    The Stream Analytic Job doesn't support Boolean variables as input (they are treated as strings), I had to transform them into viable inputs in the ML Studio, its not a breakable problem but it took me a while to understand that my machine learning service was expecting a Boolean and that the stream job wasn't able to provide it.

    4 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  • Don't see your idea?

Stream Analytics

Categories

Feedback and Knowledge Base