Batch

How can we improve Azure Batch? Do you have an idea, suggestion or feedback based on your experience? We would love to hear it!

  1. Option to base Pool on job topology rather than VM Type

    Have the option to specify on the job/task level the CPU, Memory, Disk, network, optional GPUs topology and have the Batch service select the best VM type based on price (OD, Azure Spot) and/or capacity/performance rather than asking the user to specify the VM type upfront.

    33 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  2. Allow Azure Batch to access a locked down Storage Account

    Currently when using a storage account for persisting job output this storage account can not be locked down by using the Firewall and/or Private Endpoint/VNET service endpoint. Therefore the security of the data depends solely on the secrecy of the access keys.
    If Azure Batch would have VNET integration or similar capability we would be able to add an additional layer of security. An alternative would be if Azure Batch is a 'trusted service' for the storage account. (https://docs.microsoft.com/en-in/azure/storage/common/storage-network-security#trusted-microsoft-services)

    3 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  3. Add metric for active task

    Can you add a metric for 'Active' Task? Then we can monitor it and know when we need to scale up.

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  4. Add outbound storage account list

    In the documentation you have to allow all outbound traffic when going to Storage Account in the Azure Batch. However, when using Azure Firewall, we can narrow down the access to specific storage accounts. I would like to have a list of Storage Accounts to whitelist instead of whitelisting all storage accounts.

    8 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  5. persist stdout and stderr to one file

    I would like to have a single file with both stderr and stdout combined (want a single log file and have it ordered according to what was outputted first).

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  6. Azure .NET BatchClient parameterless constructor support

    Azure Batch libraries for .NET, BatchClient does'ot implement IBatchClient and doesn't provide a parameterless constructor, so building a mocking library is very difficult without the parameterless constructor. Other classes such as BobClient() and CosmosClient() has parameterless constructor, please implement it in BatchClient too.

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  7. Azure batch service should display details of previous run of task instead of overwriting while re-queuing

    Azure batch service should display details of previous run of task instead of overwriting while re queuing from low priority pool instances.
    This will help to calculate overall task/application usage. Or there should be some way to calculate overall Job/task usage including VM + storage +network etc. per job/task.

    3 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  8. Add Azure function triggers for batch

    It would be great to have these triggers on job/task started/ended.

    9 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  9. Notification to users on outages and VM SKU availability.

    We had configured to use Azure Batch Service in Batch Service Allocation Mode. (and not user Subscription Mode)
    We have been using Azure Batch Services for past 11 months and things were fine until we hit few issues recently--

    1 Network Ouages
    2 F2SV2 Series of VM un-available for usage

    Now as service user's this were serious issues impact our business. And we would like to be notified for such outages and unavailability of VM's.
    Since Batch Service was provisioned to have sufficient dedicated core quota for F and other series of VM, suddenly un-availability without any notification was a…

    24 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  10. Azured Batch Job Scheduling: Custom Scheduling

    Currently, Azure batch job scheduling allows for scheduling with a recurrence interval. However, I have customer requests where they would like to run Azure Batch jobs on a specific day of each month, year around. The current recurrence interval settings are too stringent to be able to do this easily. Ideally, this feature would allow for custom schedules to accommodate a wide variety of scheduling needs.

    28 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    2 comments  ·  Flag idea as inappropriate…  ·  Admin →
  11. Support Azure Batch in hybrid cloud environment possibly via kubernetes

    We have some customers who want us to deploy to their own infrastructure or another vendor's infrastructure. Batch is a terrific product, and it would be nice to be able to leverage it on different environments when necessary. This is similar to the suggestions to run nodes on prem or run in Azure Stack, but those are insufficient solutions for some of our customers.

    18 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  12. Support Managed Service Identity

    We made application that uses Managed Service Identity.
    It's easy and friendly way to access Azure Key Vault that contains some secrets.

    Actually, Azure Batch is not support Managed Service Identity.
    In this situation, We have to make another application between MSI enabled environment (Azure VM, Web Apps) and disabled environment (Azure Batch).

    We don't want writing secrets in application package, environment variables and clear text configuration.
    We want strongly Managed Service Identity in Azure Batch.

    287 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    planned  ·  11 comments  ·  Flag idea as inappropriate…  ·  Admin →
  13. Show in Pool view in Portal (and over API therefore Batch Explorer) when nodes require recovery or are recovering

    Currently when a node requires recovery or is recovering, it shows up as Idle in the portal and in Batch Explorer. It should be made clear that this node is not available for use.

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    planned  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  14. Implement tags into Batch Pools, Jobs and Tasks

    It would be great to be able to create tags into batch resources like Pools, Jobs and Tasks, as we can do it with Batch Accounts.

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  15. Add features to the Azure BAtch mobile app

    The mobile app is currently not very helpful. Without the ability to remove jobs/tasks/pools, it's just a way to look at things without being able to impact any change.

    Please add the ability to look at multiple subscriptions at one, and the ability to manage Azure Batch resources.

    3 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  16. Add larger VMs

    Add support for high priority VMs in the M series. We require over 1TB of ram for a regular task at times, you currently have no VM (that cam't be preempted) that had this capability.

    Please add one, RAM requirements are only going up as the data grows and our problem is not embarrassingly parallel, so adding more machines adds both a time and financial cost (inter-node communication) that we do not want to incur.

    3 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    started  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  17. Improved error / fail sooner when pool removal is gated with a delete lock

    We recently had a case where a pool removal was 'stuck' and it appeared that the completion of the command was gated by the timeout value (which we inadvertently made very long).

    It turned out that the removal of the pool needed to delete a configuration on a subnet which was part of a VNet/RG that had a deletelock applied.

    It seems unreasonable to hang a process for a configuration change and would propose that in this case the resize should've failed once it determined it was blocked due to a delete lock on a 'sub resource'. Even better if…

    4 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  18. Add support for ceil, round, floor functions in auto-scaling formula

    Auto-scaling formulas should add support for these rounding functions:

    round()
    ceil()
    floor()

    24 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    2 comments  ·  Flag idea as inappropriate…  ·  Admin →
  19. Make it possible to set memory usage limitation for a batch task

    it would be nice if we can set the maximum memory usage for a specific task.
    This could help us protecting concurrent tasks from failing when one task is consuming a lot of memory.

    6 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  20. Add support for Azure Batch in Azure Stack

    I'm working with a client that requires extensive batch processing and does not want to utilize Azure cloud at this time. We are designing a system that incorporates Azure Service Fabric (on-premises) as part of the overall data integration framework. It would be great if we could add a native batch-processing facility that utilizes Azure tooling and design, but runs in legacy infrastructure (Windows AD networks).

    18 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
← Previous 1
  • Don't see your idea?

Batch

Categories

Feedback and Knowledge Base