Allow on-demand option for Azure Batch as it does for HDInsight
The Data Factory service does not support an on-demand option for Azure Batch as it does for HDInsight. You can only use your own Azure Batch pool in an Azure data factory.
Please allow Azure Batch to be on-demand. Customer rarely wants to have Azure Batch VMs running all the time.
Hi Aaron, try this - I read about it, but don't know if it works 100%.
It’s possible to create an azure batch pool with 0 dedicated VMs and an autoscale formula based on the number of pending tasks, e.g.
pendingTaskSampleVector=$PendingTasks.GetSample(600 * TimeInterval_Second);$TargetDedicated = max(pendingTaskSampleVector);
Here’s more info: https://azure.microsoft.com/en-us/documentation/articles/batch-automatic-scaling/#create-a-pool-with-automatic-scaling-enabled