Add a feature to "shut down" an HD Insight cluster instead of deleting it when not in use.
With HDinsight clusters being promoted as something that one can disable or turn off when not in use (cost concerns), I would like to suggest a way to just "shut down" or "deallocate" a cluster when not in use to avoid charges. This can work out pretty much the same as VMs. Users would expect to be billed for the SQL and/or storage parts while the cluster is disabled.
Thanks, This is a common ask from our customers and something we are seriously thinking about. In the meantime you can use Azure Data Factory to “delete” the cluster and you can use persistent metastore using Azure SQL and persistent store like Azure Data Lake Store or Azure Blob which will make it seem like it is “shut down”. Thanks for your feedback. Rashim Gupta (HDInsight Engineering team)
Any update it is been long time since people are asking about this
Priyanshu Kumar (ADMPKU183) commented
Its been more than 2 year for this request..still no progress on start and stop.
I think its high time to provide this service out of the box. Otherwise HDInsight will start lagging more in comparison to Databricks
+1 please add this to align with VM shutdowns.
Raphael Nash commented
+1. This would make thinks a whole lot easier plus it is supported in AWS Elastic Map Reduce.
I second that. There should be a shutdown feature.