Batch

How can we improve Azure Batch? Do you have an idea, suggestion or feedback based on your experience? We would love to hear it!

  1. Option to base Pool on job topology rather than VM Type

    Have the option to specify on the job/task level the CPU, Memory, Disk, network, optional GPUs topology and have the Batch service select the best VM type based on price (OD, Azure Spot) and/or capacity/performance rather than asking the user to specify the VM type upfront.

    21 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  2. Support Multiple VM Types in a Batch Pool

    Ability to support multiple VM types in a Pool, If my job/task can be fulfilled by multiple VM types, I would like to collect them in a single Pool and the Batch service can pick the cheapest based on spot and capacity. It will help with diversifying capacity requests, especially for GPU enabled workloads.

    21 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  3. Support Shared Image Galleries across subscriptions

    According to the Azure Batch documentation, (https://docs.microsoft.com/en-us/azure/batch/batch-custom-images#prerequisites) using a Shared Image Gallery to create a pool requires the Shared Image Gallery to be in the same subscription as the Batch account.

    Other services across Azure (such a Virtual Machines) support using a Shared Image Gallery in other subscriptions, and even across tenants (https://docs.microsoft.com/en-us/azure/virtual-machines/windows/share-images-across-tenants).

    Azure Batch should support Shared Image Galleries in any subscription.

    27 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  4. Add outbound storage account list

    In the documentation you have to allow all outbound traffic when going to Storage Account in the Azure Batch. However, when using Azure Firewall, we can narrow down the access to specific storage accounts. I would like to have a list of Storage Accounts to whitelist instead of whitelisting all storage accounts.

    8 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  5. Add Azure function triggers for batch

    It would be great to have these triggers on job/task started/ended.

    9 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  6. Pool allocation in the user subscription mode via "az batch account create" is confusing

    Pool allocation in the user subscription mode via "az batch account create" is confusing.


    • There is no explicit flag/option for batch or user subscription mode

    • unclear why the key vault is needed

    • confusing/inconsistent behavior of "az batch account create" - it uses user subscription pools if called with a key vault, but batch allocation when called without a key vault.

    • unclear why pool allocation mode is predefined at batch account level and not at pool level.

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  7. Azure Batch: Job schedule missing applicationPackageReferences in Azure Portal

    applicationPackageReferences property is missing from Azure Batch job schedule JSON file. Unable to assign applications to the job manager through Azure Portal.

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  8. Notification to users on outages and VM SKU availability.

    We had configured to use Azure Batch Service in Batch Service Allocation Mode. (and not user Subscription Mode)
    We have been using Azure Batch Services for past 11 months and things were fine until we hit few issues recently--

    1 Network Ouages
    2 F2SV2 Series of VM un-available for usage

    Now as service user's this were serious issues impact our business. And we would like to be notified for such outages and unavailability of VM's.
    Since Batch Service was provisioned to have sufficient dedicated core quota for F and other series of VM, suddenly un-availability without any notification was a…

    24 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  9. Azured Batch Job Scheduling: Custom Scheduling

    Currently, Azure batch job scheduling allows for scheduling with a recurrence interval. However, I have customer requests where they would like to run Azure Batch jobs on a specific day of each month, year around. The current recurrence interval settings are too stringent to be able to do this easily. Ideally, this feature would allow for custom schedules to accommodate a wide variety of scheduling needs.

    25 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    2 comments  ·  Flag idea as inappropriate…  ·  Admin →
  10. Support Azure Batch in hybrid cloud environment possibly via kubernetes

    We have some customers who want us to deploy to their own infrastructure or another vendor's infrastructure. Batch is a terrific product, and it would be nice to be able to leverage it on different environments when necessary. This is similar to the suggestions to run nodes on prem or run in Azure Stack, but those are insufficient solutions for some of our customers.

    18 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  11. Specify Blob ContentType when uploading task output via CloudTask.OutputFile

    I'm using OutputFiles with a file pattern to upload a collection of .jpg files from my CloudTask to Blob storage. It would be great to provide an option to define the content type (e.g. "image/jpeg"). For my needs, implementation of an auto content type (like that used in Storage Explorer) would suffice.

    Thanks.

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  12. Allow more than 20 applications in a Batch account

    Currently, a Batch account can have no more than 20 applications. This limit is too constraining and should preferrably be removed or at least raised considerably.

    3 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  13. Allow using custom data to calculate scale formula

    I want to be able to grow/shrink number of nodes in anticipation to external data - e.g. I know that based on an event I'll need a few nodes up and running an hour from now. I wish the formula could allow making a call to Azure function/REST/take a value from a Storage blob etc.

    3 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  14. Support Managed Service Identity

    We made application that uses Managed Service Identity.
    It's easy and friendly way to access Azure Key Vault that contains some secrets.

    Actually, Azure Batch is not support Managed Service Identity.
    In this situation, We have to make another application between MSI enabled environment (Azure VM, Web Apps) and disabled environment (Azure Batch).

    We don't want writing secrets in application package, environment variables and clear text configuration.
    We want strongly Managed Service Identity in Azure Batch.

    252 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    planned  ·  9 comments  ·  Flag idea as inappropriate…  ·  Admin →
  15. Task metrics based on type of node

    Right now task metrics like ActiveTasks, RunningTasks providing info based on all nodes(dedicated, low priority). It will be good if metrics are provided based on type of node separately. This feature will be useful while creating auto scale formula based on combination of dedicated/low priority nodes.

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  16. Automatically docker pull on node reboot

    It would be EXTREMELY helpful if Azure Batch automatically did a docker pull on reboot or at least added the credentials to docker so a pull works from a start task without needing to login to the private docker registry with credentials. The password for the registry seems impossible to find via rest or environment variables.

    3 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  17. Remove hard 15min timeout on job release task

    We use Job release task to combine/zip intermediate result from each VM before sending them to blob storage. We were shocked to find that there is a hard 15 min timeout on job release task

    First of all, when we design this feature, we never came across this limitation. If we knew, we would have a better mechanism to monitor the runtime as our data keeps growing and being terminated mean we will lose large amount of data. All documentation of this feature should have a big warning sign saying that your code will be terminated if it runs more…

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  18. Set Hybrid Benefit license cap for auto-scaling on pools

    When using Hybrid Benefit for Windows Server on a batch pool, it would be great if it was possible to register a max number of licenses to use under Hybrid Benefit, so that the auto-scaling feature will use only nodes under Hybrid Benefit up to the registered number, and beyond that use nodes at full cost.

    3 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  19. Misleading error message when using a custom image

    I tried to create a pool for Azure Batch (from python) with a custom image. I got this error message:

    "AuthenticationErrorDetail: The specified type of authentication SharedKey is not allowed when external resources of type Compute are linked."

    The real problem seems to be using a custom image, which makes SharedKey auth not usable. The "external resources of type Compute" didn't have any meaning for me; something like "using a custom image with Azure Batch requires AAD/ServicePrincipal auth" would have been more helpful.

    4 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  20. Show in Pool view in Portal (and over API therefore Batch Explorer) when nodes require recovery or are recovering

    Currently when a node requires recovery or is recovering, it shows up as Idle in the portal and in Batch Explorer. It should be made clear that this node is not available for use.

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    planned  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
← Previous 1 3
  • Don't see your idea?

Batch

Categories

Feedback and Knowledge Base