Batch

How can we improve Azure Batch? Do you have an idea, suggestion or feedback based on your experience? We would love to hear it!

How can we improve Azure Batch?

You've used all your votes and won't be able to post a new idea, but you can still search and comment on existing ideas.

There are two ways to get more votes:

  • When an admin closes an idea you've voted on, you'll get your votes back from that idea.
  • You can remove your votes from an open idea you support.
  • To see ideas you have already voted on, select the "My feedback" filter and select "My open ideas".
(thinking…)

Enter your idea and we'll search to see if someone has already suggested it.

If a similar idea already exists, you can support and comment on it.

If it doesn't exist, you can post your idea so others can support it.

Enter your idea and we'll search to see if someone has already suggested it.

  1. 5 votes
    Vote
    Sign in
    Check!
    (thinking…)
    Reset
    or sign in with
    • facebook
    • google
      Password icon
      I agree to the terms of service
      Signed in as (Sign out)
      You have left! (?) (thinking…)
      0 comments  ·  Flag idea as inappropriate…  ·  Admin →
    • Support for allocating Azure Batch nodes using containers instead of VMs

      It would be great if Azure Batch could use the upcoming Windows Containers to allocate new nodes as containers instead of VMs, with an appropriate increase in auto-scale formula evaluation frequency.

      This could potentially reduce the time from job submission to executing at full capacity from the current 5-10 minutes to well under a minute.

      These are some of the scenarios where this would benefit us:

      In scenario one a customer might use hundreds of nodes to run a large job in a few minutes, but the wait for nodes to be allocated and then become available can tripple the…

      10 votes
      Vote
      Sign in
      Check!
      (thinking…)
      Reset
      or sign in with
      • facebook
      • google
        Password icon
        I agree to the terms of service
        Signed in as (Sign out)
        You have left! (?) (thinking…)
        0 comments  ·  Flag idea as inappropriate…  ·  Admin →
      • Allow use of a container as single resource for a task

        Currently the resource files have a 32k character limitation which caps the number of files you can upload or nested folder structures. If you could supply just a container and use all the blobs in the container as a resource then it would simplify this.

        The current work around is to use/install zip utilities or use application packages which do not have a rest api.

        11 votes
        Vote
        Sign in
        Check!
        (thinking…)
        Reset
        or sign in with
        • facebook
        • google
          Password icon
          I agree to the terms of service
          Signed in as (Sign out)
          You have left! (?) (thinking…)
          0 comments  ·  Flag idea as inappropriate…  ·  Admin →
        • Visual Studio Project - Batch Application

          There needs to be a simpler way to deploy Batch Applications, preferably directly from Visual Studio.

          Having a mechanism to deploy my Azure Batch programs directly to my Batch Applications with a method similar to deploying Azure Web Apps would save heaps of time.

          9 votes
          Vote
          Sign in
          Check!
          (thinking…)
          Reset
          or sign in with
          • facebook
          • google
            Password icon
            I agree to the terms of service
            Signed in as (Sign out)
            You have left! (?) (thinking…)
            0 comments  ·  Flag idea as inappropriate…  ·  Admin →
          • Support deployment through Azure Resource Manager

            Setting up a new batch account together with a pool should be supported through Azure Resource Manager.

            4 votes
            Vote
            Sign in
            Check!
            (thinking…)
            Reset
            or sign in with
            • facebook
            • google
              Password icon
              I agree to the terms of service
              Signed in as (Sign out)
              You have left! (?) (thinking…)
              0 comments  ·  Flag idea as inappropriate…  ·  Admin →
            • Implement local Batch emulation

              Please allow full emulation of Batch jobs to facilitate local development and testing prior to deployment.

              63 votes
              Vote
              Sign in
              Check!
              (thinking…)
              Reset
              or sign in with
              • facebook
              • google
                Password icon
                I agree to the terms of service
                Signed in as (Sign out)
                You have left! (?) (thinking…)
                under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
              • Allow initial value for TargetDedicated when autoscale is enabled for a pool.

                Otherwise it takes at least 5 minutes to start the tasks!

                13 votes
                Vote
                Sign in
                Check!
                (thinking…)
                Reset
                or sign in with
                • facebook
                • google
                  Password icon
                  I agree to the terms of service
                  Signed in as (Sign out)
                  You have left! (?) (thinking…)
                  under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                • Allow a way to add RequestOptionsPolicy in CloudTask/CloudJob's CustomBehaviour Collection for calls to Blob Storage

                  We are encrypting the files before uploading to Blob Storage by specifying Encryption Policy in RequestOptions.

                  These files are later used as the ResourceFiles to the CloudTask but there is no way to specify the Encryption Policy.

                  https://social.msdn.microsoft.com/Forums/azure/en-US/c3806bd6-9e60-482a-89d6-40977c5bbe96/azure-batch-services-decrypt-resource-file?forum=azurebatch

                  3 votes
                  Vote
                  Sign in
                  Check!
                  (thinking…)
                  Reset
                  or sign in with
                  • facebook
                  • google
                    Password icon
                    I agree to the terms of service
                    Signed in as (Sign out)
                    You have left! (?) (thinking…)
                    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                    under review  ·  Yiding ZhouYiding Zhou responded

                    Thanks for the suggestion. For now you can use Azure Storage library to achieve this on your own. We are working with Azure storage team to deliver an end to end storage integration story. More to see in the future.

                  • Add diagnostics support for Azure Batch

                    Currently Azure Batch does not support diagnostics/telemetry/performance counters. It would be really useful to have something like a New relic or an App insights integration.

                    37 votes
                    Vote
                    Sign in
                    Check!
                    (thinking…)
                    Reset
                    or sign in with
                    • facebook
                    • google
                      Password icon
                      I agree to the terms of service
                      Signed in as (Sign out)
                      You have left! (?) (thinking…)
                      0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                      planned  ·  Yiding ZhouYiding Zhou responded

                      Thanks for the suggestion. We are actively working on diagnostic feature for Azure Batch service.

                    • Job cancellation support

                      Improve Batch API to support job cancellation in an async/await fashion.

                      4 votes
                      Vote
                      Sign in
                      Check!
                      (thinking…)
                      Reset
                      or sign in with
                      • facebook
                      • google
                        Password icon
                        I agree to the terms of service
                        Signed in as (Sign out)
                        You have left! (?) (thinking…)
                        1 comment  ·  Flag idea as inappropriate…  ·  Admin →
                      • Setting up Azure Batch needs to be easier

                        To start with, there should be no need to use any assemblies etc in order to create a new batch process.
                        All it should take is some configuration - could be some JSON payload - that can be transmitted using the Batch APIs.
                        That content should determine what executable file to start, what CLI parameters to pass on, etc. On top, it should all work like within a regular folder structure - whatever you need, you just drop it e. g. via FTP or APIs again to some location and then you have your dosomething.exe file in the root dir,…

                        2 votes
                        Vote
                        Sign in
                        Check!
                        (thinking…)
                        Reset
                        or sign in with
                        • facebook
                        • google
                          Password icon
                          I agree to the terms of service
                          Signed in as (Sign out)
                          You have left! (?) (thinking…)
                          0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                        • Support on Premise Batch Nodes

                          It would be great to have support for on-premise nodes to support hybrid workloads. This could help with connectivity issues for specific types of specialized data sources. Having a "Batch Agent" that could be installed on any server so it can register in a pool and be sent work would be really valuable.

                          30 votes
                          Vote
                          Sign in
                          Check!
                          (thinking…)
                          Reset
                          or sign in with
                          • facebook
                          • google
                            Password icon
                            I agree to the terms of service
                            Signed in as (Sign out)
                            You have left! (?) (thinking…)
                            0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                            under review  ·  Yiding ZhouYiding Zhou responded

                            Interesting idea. Hybrid scenario is definitely something we will look at. Have you tried Windows HPC?

                          • Deploy certificate from Azure Key Vault to compute node

                            Rather than having to associate a certificate with a pool, being able to associate a certificate in a Key Vault that's been created with the -EnabledForDeployment flag would help centralize management of certificates being deployed to both VM's and Batch nodes.

                            8 votes
                            Vote
                            Sign in
                            Check!
                            (thinking…)
                            Reset
                            or sign in with
                            • facebook
                            • google
                              Password icon
                              I agree to the terms of service
                              Signed in as (Sign out)
                              You have left! (?) (thinking…)
                              under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                            • Jobs of equal priority should be executed in submission order

                              If I have a fixed number of dedicated VMs, then it is important that queued jobs run in submission order. Sure I could use the priority to achieve this, but then I can't use priority for real business use case prioritisation. Sure I could reserve priority ranges, but this is getting complicated when it should just process them in submission order.

                              15 votes
                              Vote
                              Sign in
                              Check!
                              (thinking…)
                              Reset
                              or sign in with
                              • facebook
                              • google
                                Password icon
                                I agree to the terms of service
                                Signed in as (Sign out)
                                You have left! (?) (thinking…)
                                0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                              • 4 votes
                                Vote
                                Sign in
                                Check!
                                (thinking…)
                                Reset
                                or sign in with
                                • facebook
                                • google
                                  Password icon
                                  I agree to the terms of service
                                  Signed in as (Sign out)
                                  You have left! (?) (thinking…)
                                  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                                • Don't see your idea?

                                Batch

                                Feedback and Knowledge Base