How can we improve Microsoft Azure Stream Analytics?

On-prem SQL as input and output

Would like to push my data from on prem SQL -> Stream analytics + ML model -> Output of ML model back to on-prem SQL table -> Host power BI on corp. By this way, any PII/HBI data can still be on-prem and other numeric data can flow via the cloud and back. If the channel from cloud to on-prem sql can be secure and easily established, it would greatly help.

55 votes
Vote
Sign in
(thinking…)
Sign in with: Microsoft
Signed in as (Sign out)
You have left! (?) (thinking…)
Kavitha shared this idea  ·   ·  Flag idea as inappropriate…  ·  Admin →

Reopening this item since we have additional votes and heard about more comments related to this.
Few comments/workaround in the meantime:
- For PII/HBI data: ASA on IoT Edge and Azure Stack for PII – this allows pre-processing at the Edge without sending data to the cloud.
- Streaming + DB can work side-by-side on ASDE (Azure SQL Database Edge)

3 comments

Sign in
(thinking…)
Sign in with: Microsoft
Signed in as (Sign out)
Submitting...
  • Dan Probert commented  ·   ·  Flag as inappropriate

    Any update on this? I'm looking at the case where we're running BizTalk 2016 in IaaS (VM) using Business Activity Monitoring. We'd like to import the BAM data (as it's updated) into SA. Yes we could do it via ADF, but trying to reduce friction on this - having the ability to specify an existing SQL DB as an input source would help greatly.

  • Bob commented  ·   ·  Flag as inappropriate

    Can you please at least start with SQL Server on an Azure VM if doing on-premises is too hard.

  • AdminAzure Stream Analytics Team on UserVoice (Product Manager, Microsoft Azure) commented  ·   ·  Flag as inappropriate

    Thank you for your interest in using Stream Analytics. We are looking for more details on this scenario. For those of you that are interested in an input for On-prem SQL, are you looking to use the SQL data as reference data to be joined with another incoming data stream? Or looking to using the SQL data as a data stream? In the reference data case, you can use Azure Data Factory to take periodic snapshots of the relevant reference data and copy it to blobs that can then be used by Azure Stream Analytics.

    For those of you looking for a direct output to On-Prem SQL, while we don't yet support this scenario directly, it is possible as a workaround to use Azure SQL DB as an output from Stream Analytics and setup a scheduled data move using Azure Data Factory to move the data from Azure DB to your On-Prem SQL database and accomplish a similar pattern.

Feedback and Knowledge Base