Batch

How can we improve Azure Batch? Do you have an idea, suggestion or feedback based on your experience? We would love to hear it!

  1. Allow Azure Batch to access a locked down Storage Account

    Currently when using a storage account for persisting job output this storage account can not be locked down by using the Firewall and/or Private Endpoint/VNET service endpoint. Therefore the security of the data depends solely on the secrecy of the access keys.
    If Azure Batch would have VNET integration or similar capability we would be able to add an additional layer of security. An alternative would be if Azure Batch is a 'trusted service' for the storage account. (https://docs.microsoft.com/en-in/azure/storage/common/storage-network-security#trusted-microsoft-services)

    15 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  2. Support Foundry (Nuke) rendering application

    Are there any plans to add other rendering applications in Batch? I'm particularly interested in 2D compositing with Nuke.

    2 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  3. Option to base Pool on job topology rather than VM Type

    Have the option to specify on the job/task level the CPU, Memory, Disk, network, optional GPUs topology and have the Batch service select the best VM type based on price (OD, Azure Spot) and/or capacity/performance rather than asking the user to specify the VM type upfront.

    33 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  4. Allow custom destination paths for Resource Files

    Currently resource files are copied to (filePath)(blobPrefix). This causes issues with the length of the file path, especially on windows. Can support be added to allow a file or directory to be copied directly to a custom directory in the node.

    6 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  5. Cancel dependent tasks when upstream task fails.

    Allow option to cancel dependent tasks when the upstream task fails. This will complete the Job and shut down the Pool (if any), rather than how it currently works which leave the dependent tasks "Active" when the upstream task fails (in our case, it's timeout with exit code 130).
    Would also be nice to add option to allow certain dependent tasks to fail but allow others dependent tasks to continue. So, perhaps the setting would be at the dependent task level.

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  6. Add metric for active task

    Can you add a metric for 'Active' Task? Then we can monitor it and know when we need to scale up.

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  7. Add outbound storage account list

    In the documentation you have to allow all outbound traffic when going to Storage Account in the Azure Batch. However, when using Azure Firewall, we can narrow down the access to specific storage accounts. I would like to have a list of Storage Accounts to whitelist instead of whitelisting all storage accounts.

    8 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  8. Add Azure function triggers for batch

    It would be great to have these triggers on job/task started/ended.

    12 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  9. persist stdout and stderr to one file

    I would like to have a single file with both stderr and stdout combined (want a single log file and have it ordered according to what was outputted first).

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  10. Azure .NET BatchClient parameterless constructor support

    Azure Batch libraries for .NET, BatchClient does'ot implement IBatchClient and doesn't provide a parameterless constructor, so building a mocking library is very difficult without the parameterless constructor. Other classes such as BobClient() and CosmosClient() has parameterless constructor, please implement it in BatchClient too.

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  11. Azure batch service should display details of previous run of task instead of overwriting while re-queuing

    Azure batch service should display details of previous run of task instead of overwriting while re queuing from low priority pool instances.
    This will help to calculate overall task/application usage. Or there should be some way to calculate overall Job/task usage including VM + storage +network etc. per job/task.

    3 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  12. Notification to users on outages and VM SKU availability.

    We had configured to use Azure Batch Service in Batch Service Allocation Mode. (and not user Subscription Mode)
    We have been using Azure Batch Services for past 11 months and things were fine until we hit few issues recently--

    1 Network Ouages
    2 F2SV2 Series of VM un-available for usage

    Now as service user's this were serious issues impact our business. And we would like to be notified for such outages and unavailability of VM's.
    Since Batch Service was provisioned to have sufficient dedicated core quota for F and other series of VM, suddenly un-availability without any notification was a…

    24 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  13. Azured Batch Job Scheduling: Custom Scheduling

    Currently, Azure batch job scheduling allows for scheduling with a recurrence interval. However, I have customer requests where they would like to run Azure Batch jobs on a specific day of each month, year around. The current recurrence interval settings are too stringent to be able to do this easily. Ideally, this feature would allow for custom schedules to accommodate a wide variety of scheduling needs.

    28 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    2 comments  ·  Flag idea as inappropriate…  ·  Admin →
  14. Support Managed Service Identity

    We made application that uses Managed Service Identity.
    It's easy and friendly way to access Azure Key Vault that contains some secrets.

    Actually, Azure Batch is not support Managed Service Identity.
    In this situation, We have to make another application between MSI enabled environment (Azure VM, Web Apps) and disabled environment (Azure Batch).

    We don't want writing secrets in application package, environment variables and clear text configuration.
    We want strongly Managed Service Identity in Azure Batch.

    333 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    14 comments  ·  Flag idea as inappropriate…  ·  Admin →

    We appreciate everyone’s patience in this feature ask. There was quite a bit of complexity across different teams that needed to be resolved before we could begin. Although we have no ETA to share at this time, implementation of this feature has begun.

  15. Support Azure Batch in hybrid cloud environment possibly via kubernetes

    We have some customers who want us to deploy to their own infrastructure or another vendor's infrastructure. Batch is a terrific product, and it would be nice to be able to leverage it on different environments when necessary. This is similar to the suggestions to run nodes on prem or run in Azure Stack, but those are insufficient solutions for some of our customers.

    18 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  16. Implement tags into Batch Pools, Jobs and Tasks

    It would be great to be able to create tags into batch resources like Pools, Jobs and Tasks, as we can do it with Batch Accounts.

    4 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  17. Show in Pool view in Portal (and over API therefore Batch Explorer) when nodes require recovery or are recovering

    Currently when a node requires recovery or is recovering, it shows up as Idle in the portal and in Batch Explorer. It should be made clear that this node is not available for use.

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    planned  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  18. Add features to the Azure BAtch mobile app

    The mobile app is currently not very helpful. Without the ability to remove jobs/tasks/pools, it's just a way to look at things without being able to impact any change.

    Please add the ability to look at multiple subscriptions at one, and the ability to manage Azure Batch resources.

    3 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  19. Add larger VMs

    Add support for high priority VMs in the M series. We require over 1TB of ram for a regular task at times, you currently have no VM (that cam't be preempted) that had this capability.

    Please add one, RAM requirements are only going up as the data grows and our problem is not embarrassingly parallel, so adding more machines adds both a time and financial cost (inter-node communication) that we do not want to incur.

    3 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    started  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  20. Add support for ceil, round, floor functions in auto-scaling formula

    Auto-scaling formulas should add support for these rounding functions:

    round()
    ceil()
    floor()

    28 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    2 comments  ·  Flag idea as inappropriate…  ·  Admin →
← Previous 1
  • Don't see your idea?

Batch

Categories

Feedback and Knowledge Base