Batch

How can we improve Azure Batch? Do you have an idea, suggestion or feedback based on your experience? We would love to hear it!

  1. Implement local Batch emulation

    Please allow full emulation of Batch jobs to facilitate local development and testing prior to deployment.

    221 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    unplanned  ·  3 comments  ·  Flag idea as inappropriate…  ·  Admin →
  2. Support Managed Service Identity

    We made application that uses Managed Service Identity.
    It's easy and friendly way to access Azure Key Vault that contains some secrets.

    Actually, Azure Batch is not support Managed Service Identity.
    In this situation, We have to make another application between MSI enabled environment (Azure VM, Web Apps) and disabled environment (Azure Batch).

    We don't want writing secrets in application package, environment variables and clear text configuration.
    We want strongly Managed Service Identity in Azure Batch.

    219 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    planned  ·  8 comments  ·  Flag idea as inappropriate…  ·  Admin →
  3. Support for allocating Azure Batch nodes using containers instead of VMs

    It would be great if Azure Batch could use the upcoming Windows Containers to allocate new nodes as containers instead of VMs, with an appropriate increase in auto-scale formula evaluation frequency.

    This could potentially reduce the time from job submission to executing at full capacity from the current 5-10 minutes to well under a minute.

    These are some of the scenarios where this would benefit us:

    In scenario one a customer might use hundreds of nodes to run a large job in a few minutes, but the wait for nodes to be allocated and then become available can tripple the…

    80 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  4. Add diagnostics support for Azure Batch

    Currently Azure Batch does not support diagnostics/telemetry/performance counters. It would be really useful to have something like a New relic or an App insights integration.

    56 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  5. Support on Premise Batch Nodes

    It would be great to have support for on-premise nodes to support hybrid workloads. This could help with connectivity issues for specific types of specialized data sources. Having a "Batch Agent" that could be installed on any server so it can register in a pool and be sent work would be really valuable.

    54 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  6. Per-node resource statistics (CPU usage etc.)

    Currently the API allows to fetch resource stats for a whole pool, returning averages of cpu usage etc. See https://docs.microsoft.com/en-us/rest/api/batchservice/get-information-about-a-pool

    It would be great if one could query those statistics per-node as well. This is especially useful if you run only a single task per node and want to see how well it utilizes the node (by parallelisation etc.)

    49 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  7. Need reimage support on VirtualMachineConfiguration-based pool

    Hi Batch Team, we would like to have reimage support on VirtualMachineConfiguration-based pools as well. We know that currently it is supported on CloudServiceConfiguration-based pools. This would greatly reduce the effort to maintain the nodes in the pool as we want to regularly reimage the nodes to keep them healthy without deleting the pool and recreating again. Thanks so much!

    45 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  3 comments  ·  Flag idea as inappropriate…  ·  Admin →
  8. Visual Studio Project - Batch Application

    There needs to be a simpler way to deploy Batch Applications, preferably directly from Visual Studio.

    Having a mechanism to deploy my Azure Batch programs directly to my Batch Applications with a method similar to deploying Azure Web Apps would save heaps of time.

    32 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  9. Deploy certificate from Azure Key Vault to compute node

    Rather than having to associate a certificate with a pool, being able to associate a certificate in a Key Vault that's been created with the -EnabledForDeployment flag would help centralize management of certificates being deployed to both VM's and Batch nodes.

    29 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    unplanned  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  10. Allow initial value for TargetDedicated when autoscale is enabled for a pool.

    Otherwise it takes at least 5 minutes to start the tasks!

    26 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  11. Azured Batch Job Scheduling: Custom Scheduling

    Currently, Azure batch job scheduling allows for scheduling with a recurrence interval. However, I have customer requests where they would like to run Azure Batch jobs on a specific day of each month, year around. The current recurrence interval settings are too stringent to be able to do this easily. Ideally, this feature would allow for custom schedules to accommodate a wide variety of scheduling needs.

    25 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    2 comments  ·  Flag idea as inappropriate…  ·  Admin →
  12. Notification to users on outages and VM SKU availability.

    We had configured to use Azure Batch Service in Batch Service Allocation Mode. (and not user Subscription Mode)
    We have been using Azure Batch Services for past 11 months and things were fine until we hit few issues recently--

    1 Network Ouages
    2 F2SV2 Series of VM un-available for usage

    Now as service user's this were serious issues impact our business. And we would like to be notified for such outages and unavailability of VM's.
    Since Batch Service was provisioned to have sufficient dedicated core quota for F and other series of VM, suddenly un-availability without any notification was a…

    24 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  13. 22 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  14. Jobs of equal priority should be executed in submission order

    If I have a fixed number of dedicated VMs, then it is important that queued jobs run in submission order. Sure I could use the priority to achieve this, but then I can't use priority for real business use case prioritisation. Sure I could reserve priority ranges, but this is getting complicated when it should just process them in submission order.

    21 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  15. Support Shared Image Galleries across subscriptions

    According to the Azure Batch documentation, (https://docs.microsoft.com/en-us/azure/batch/batch-custom-images#prerequisites) using a Shared Image Gallery to create a pool requires the Shared Image Gallery to be in the same subscription as the Batch account.

    Other services across Azure (such a Virtual Machines) support using a Shared Image Gallery in other subscriptions, and even across tenants (https://docs.microsoft.com/en-us/azure/virtual-machines/windows/share-images-across-tenants).

    Azure Batch should support Shared Image Galleries in any subscription.

    18 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  16. Add support for Azure Batch in Azure Stack

    I'm working with a client that requires extensive batch processing and does not want to utilize Azure cloud at this time. We are designing a system that incorporates Azure Service Fabric (on-premises) as part of the overall data integration framework. It would be great if we could add a native batch-processing facility that utilizes Azure tooling and design, but runs in legacy infrastructure (Windows AD networks).

    18 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  17. Support Azure Batch in hybrid cloud environment possibly via kubernetes

    We have some customers who want us to deploy to their own infrastructure or another vendor's infrastructure. Batch is a terrific product, and it would be nice to be able to leverage it on different environments when necessary. This is similar to the suggestions to run nodes on prem or run in Azure Stack, but those are insufficient solutions for some of our customers.

    18 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  18. Azure batch node disk encryption

    It would be helpful for azure batch to have encryption at rest for a layer of protection for task temporary files.

    The discussion here illustrates it's overly tricky:

    https://social.msdn.microsoft.com/Forums/azure/en-US/71bc46a7-593a-447c-912b-b95754198c6b/does-batch-use-encrypted-local-storage?forum=azurebatch

    14 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    started  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  19. Allow B-Series VMs to be chosen

    I understand that the main use case of Batch is for high performance computing, but we have a use case where we have jobs that are I/On (disk / network) dependent, so don't take an awful lot of processing power and would run easily in Bingley Series VMs

    14 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  20. Add support for ceil, round, floor functions in auto-scaling formula

    Auto-scaling formulas should add support for these rounding functions:

    round()
    ceil()
    floor()

    9 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
← Previous 1 3
  • Don't see your idea?

Batch

Categories

Feedback and Knowledge Base