Pause/Start Azure SQL Data Warehouse from ADF
Pause/Start Azure SQL Data Warehouse from ADF
Jorg Klein
shared this idea
Thank you for your feedback. We are now evaluating this ask as part of our product roadmap.
5 comments
-
MaFisHH
commented
This can be very easily in an ADF Pipeline natively, without other Azure resources.
Just call the API via HTTP requests for scaling or for Resume/Pause.An example for Analysis Services is here: https://github.com/furmangg/automating-azure-analysis-services/tree/master/ADFv2
You just need to replace it with the resource IDs to your SQL DW instead of AAS.
That's it. -
Sergio Zenatti Filho
commented
With ADF v2 you can use Azure SQL DW APIs and Logic Apps to Pause, Resume and Scale Azure SQL DW.
See how below: https://zenatti.net/2018/04/02/using-azure-data-factory-v2-to-pause-and-resume-azure-sql-data-warehouse/
-
Andrew Dale commented
Given that Microsoft suggest you pause and resume compute resources to save costs, then having an easy way to do so in Data Factory would be a great idea. At Present it looks like we need to use a custom activity calling a POWERSHELL script.
-
Luis Simoes
commented
Please also allow scaling up / down.
This is critical for people that are using SQL DW since it's one of the biggest advantages in terms of consumption and performance.Using Azure Functions is a pain since its maximum timeout is 10 minutes and currently it takes more than that to scale up/down, not to mention it is painful to keep checking if the scale has already finished due to the async.
Anyone had alternatives?
-
Neil Palmer
commented
This would be great natively - I'm currently using Azure batch and the management api to do this.
Only problem is if you have concurrent pipelines, or more than one activity running on the DWH then you need to be really careful to avoid killing other processes. Easy in C#, but might complicate things inside ADF. Especially if you have any processes that use DWH externally (such as a cube build).