Storage

How can we improve Azure Storage?

You've used all your votes and won't be able to post a new idea, but you can still search and comment on existing ideas.

There are two ways to get more votes:

  • When an admin closes an idea you've voted on, you'll get your votes back from that idea.
  • You can remove your votes from an open idea you support.
  • To see ideas you have already voted on, select the "My feedback" filter and select "My open ideas".
(thinking…)

Enter your idea and we'll search to see if someone has already suggested it.

If a similar idea already exists, you can support and comment on it.

If it doesn't exist, you can post your idea so others can support it.

Enter your idea and we'll search to see if someone has already suggested it.

  • Hot ideas
  • Top ideas
  • New ideas
  • My feedback
  1. Add functionality to check for queue with no entries (including invisible entries)

    When a queue becomes empty I want to kick off some processing. However queue empty does not equal complete empty as there might be invisible objects on the queue that might come back. Thus it is not truly empty.

    Functionality to check a queue _really_ empty i.e. no objects invisible or visible would be very useful.

    Currently what I'm using is "peekMessage" returning null but this returns null even if there are invisible objects on the queue

    3 votes
    Vote
    Sign in
    Check!
    (thinking…)
    Reset
    or sign in with
    • facebook
    • google
      Password icon
      I agree to the terms of service
      Signed in as (Sign out)
      You have left! (?) (thinking…)
      under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
    • Provide an archive storage service

      We need an archive storage, that can be used for DB backups, old log files and other stuff.

      It should be big and cheap.

      See Amazon Flacier (http://aws.amazon.com/glacier/) for a reference.

      35 votes
      Vote
      Sign in
      Check!
      (thinking…)
      Reset
      or sign in with
      • facebook
      • google
        Password icon
        I agree to the terms of service
        Signed in as (Sign out)
        You have left! (?) (thinking…)
        under review  ·  5 comments  ·  Blobs  ·  Flag idea as inappropriate…  ·  Admin →
      • HTTP compression support for Azure Storage Services (via Accept-Encoding/Content-Encoding fields)

        Add support for 'Accept-Encoding' and 'Content-Encoding' fields in the HTTP request in Azure Storage Services with supported compression schemes gzip and deflate. This should helps reduce network payload by 10x-50x in some cases like saving/loading bulk records to Azure Table Storage.

        62 votes
        Vote
        Sign in
        Check!
        (thinking…)
        Reset
        or sign in with
        • facebook
        • google
          Password icon
          I agree to the terms of service
          Signed in as (Sign out)
          You have left! (?) (thinking…)
          under review  ·  4 comments  ·  Flag idea as inappropriate…  ·  Admin →
        • Diagnostics trace viewer in management portal

          Right now if you need to see logs, you have to query azure table WADLogsTable. This is a bit wired. I think it will be good addition to the management portal if it will show this logs in more adequate way. If it will also support search it will be even more awesome.

          13 votes
          Vote
          Sign in
          Check!
          (thinking…)
          Reset
          or sign in with
          • facebook
          • google
            Password icon
            I agree to the terms of service
            Signed in as (Sign out)
            You have left! (?) (thinking…)
            1 comment  ·  Tables  ·  Flag idea as inappropriate…  ·  Admin →
          • Support GZIP & DEFLATE Content-Encoding for List Blobs Responses

            For collections with large numbers of blobs, the XML response payload easily approaches 100s of MBs. In our testing, each block of 5000 objects resulted in a ~2.8MB response. This is without any other flags set (i.e. no snapshots, no metadata, no uncommitted blobs). The response XML is highly compressible. In our testing we saw a 93% size reduction. (2.8MB -> 210KB). This would be a huge improvement in transfer performance, and a large cost savings in egress bandwidth situations.

            19 votes
            Vote
            Sign in
            Check!
            (thinking…)
            Reset
            or sign in with
            • facebook
            • google
              Password icon
              I agree to the terms of service
              Signed in as (Sign out)
              You have left! (?) (thinking…)
              2 comments  ·  Blobs  ·  Flag idea as inappropriate…  ·  Admin →
            • Block deleting of Storage Accounts if Not Empty

              If I am supposed to store Terra Bytes of data, in Management Portal easy delete option is very dangerous. Along with no way to retrieve deleted data. Even accidentally it does happen, today I created a test blob storage to test media services and then decided to delete it. I noticed, I could easily have selected something else and deleted it.

              1. Two Factor Delete Operation, send a code to email and ask user to enter the code to delete.
              2. Perform delete after actual 24 hours.
              2. Use some sort of warning indication in email that delete request is…

              7 votes
              Vote
              Sign in
              Check!
              (thinking…)
              Reset
              or sign in with
              • facebook
              • google
                Password icon
                I agree to the terms of service
                Signed in as (Sign out)
                You have left! (?) (thinking…)
                1 comment  ·  Portal  ·  Flag idea as inappropriate…  ·  Admin →
              • Allow control of storage account DefaultServiceVersion through Azure Panel for true HTTP/1.1

                By default, when a new Storage Account is created, the DefaultServiceVersion property is set to 2009-09-19, which is really old. Many storage accounts created now don't need backwards compatibility with this very old version.
                It would be very useful to allow control of DefaultServiceVersion through Azure control panel or better, when creating a new Storage Account (same way you can select Windows release when creating VM) so that one can select it to a more recent version and thus allow storage account to respond to HTTP/1.1 Range request.

                14 votes
                Vote
                Sign in
                Check!
                (thinking…)
                Reset
                or sign in with
                • facebook
                • google
                  Password icon
                  I agree to the terms of service
                  Signed in as (Sign out)
                  You have left! (?) (thinking…)
                  under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                • Support $filter on merger, update.

                  Supporting $filter on merge and update would reduce the number of roundtrips when doing conditional mutation of an entity based on properties in addition to PK and RK.

                  3 votes
                  Vote
                  Sign in
                  Check!
                  (thinking…)
                  Reset
                  or sign in with
                  • facebook
                  • google
                    Password icon
                    I agree to the terms of service
                    Signed in as (Sign out)
                    You have left! (?) (thinking…)
                    under review  ·  0 comments  ·  Tables  ·  Flag idea as inappropriate…  ·  Admin →
                  • Secure Windows Azure Storage access using WAAD/ACS

                    I'd like to expose access to WAS resources directly to my tenants, but I need to use the same security mechanisms that my users use for accessing other parts of my system (e.g., web apps).

                    14 votes
                    Vote
                    Sign in
                    Check!
                    (thinking…)
                    Reset
                    or sign in with
                    • facebook
                    • google
                      Password icon
                      I agree to the terms of service
                      Signed in as (Sign out)
                      You have left! (?) (thinking…)
                      under review  ·  0 comments  ·  Blobs  ·  Flag idea as inappropriate…  ·  Admin →
                    • make it possible to use SSL on blob storage using custom domains

                      Currently you can use SSL but you have to user the standard URL. You can create a CNAME to your storage account but most browsers complain that the traffic was rerouted and is possibly an attack. There should be a way to install a domain certificate to your containers.

                      3,218 votes
                      Vote
                      Sign in
                      Check!
                      (thinking…)
                      Reset
                      or sign in with
                      • facebook
                      • google
                        Password icon
                        I agree to the terms of service
                        Signed in as (Sign out)
                        You have left! (?) (thinking…)
                        84 comments  ·  Blobs  ·  Flag idea as inappropriate…  ·  Admin →

                        You can now use the Azure CDN to access blobs with custom domains over HTTPS. See the following article for instructions on how to do so: https://docs.microsoft.com/en-us/azure/storage/storage-https-custom-domain-cdn. Having talked to a number of customers, we concluded that this solution addresses many scenarios where the need for HTTPS access to blobs with custom domains exists.

                        Native Azure Storage support for using SSL to access blobs at custom domains is still on our backlog. We would love to hear about your scenarios where using the Azure CDN is not an acceptable solution, either by posting on this thread or sending us an email at azurestoragefeedback@microsoft.com.

                      • Please give us Count(), TakeLast(int i), Skip(int i)

                        There are many Scenarios were count is useful. Ich I write logs to Azure Tables most of the time i want to retreive the last n entries. It would be great if there would be something like TakeLast(int i) or Skip(int i) for doing something like Skip(count - take).Take(take).

                        30 votes
                        Vote
                        Sign in
                        Check!
                        (thinking…)
                        Reset
                        or sign in with
                        • facebook
                        • google
                          Password icon
                          I agree to the terms of service
                          Signed in as (Sign out)
                          You have left! (?) (thinking…)
                          0 comments  ·  Tables  ·  Flag idea as inappropriate…  ·  Admin →
                        • Allow adding custom headers to Azure Queue messages to support tracking of distributed business transactions

                          AppDynamics, our Application Performance Monitoring software, needs to be able to add headers to Azure Queue messages, so we can track them as they are picked up and processed by worker roles. This will allow Azure users to see the full, profiled view of their business transactions as they go from role to queue and then to other roles that process them. Such insight into application performance can be invaluable for monitoring and debugging complex Azure deployments.

                          10 votes
                          Vote
                          Sign in
                          Check!
                          (thinking…)
                          Reset
                          or sign in with
                          • facebook
                          • google
                            Password icon
                            I agree to the terms of service
                            Signed in as (Sign out)
                            You have left! (?) (thinking…)
                            0 comments  ·  Queues  ·  Flag idea as inappropriate…  ·  Admin →
                          • Allow-Blob-Meta-Name with dash, as in Access-Control-Allow-Origin

                            Blob defined as CDN may need to send Access-Control-Allow-Origin header.

                            20 votes
                            Vote
                            Sign in
                            Check!
                            (thinking…)
                            Reset
                            or sign in with
                            • facebook
                            • google
                              Password icon
                              I agree to the terms of service
                              Signed in as (Sign out)
                              You have left! (?) (thinking…)
                              under review  ·  1 comment  ·  Blobs  ·  Flag idea as inappropriate…  ·  Admin →
                            • Azure Table Storage permissions to prevent deletion

                              It would be nice to be able to lock certain areas of Azure Storage to prevent operators/developers from deleting a table/container/queue by accident. Our specific need right now is for Azure Storage Tables but could potentially be for containers and queues. For example, it would be nice to lock a table to not allow deletion.

                              106 votes
                              Vote
                              Sign in
                              Check!
                              (thinking…)
                              Reset
                              or sign in with
                              • facebook
                              • google
                                Password icon
                                I agree to the terms of service
                                Signed in as (Sign out)
                                You have left! (?) (thinking…)
                                6 comments  ·  Tables  ·  Flag idea as inappropriate…  ·  Admin →
                              • Changing the maximum URL length for the development storage emulator REST api

                                I'm making a request to the local storage which is over 300 characters in length. (Pretend this request is over 300 characters)

                                http://127.0.0.1:10002/devstoreaccount1/MyTableName(PartitionKey='MyReallyLongPartitionKey',RowKey='MyReallyLongRowKey')

                                I receive the following error message:

                                Bad Request - Invalid URL
                                HTTP Error 400. The request URL is invalid.

                                Now, if I shorten the keys for a total length of 300 for the URL, I receive the ResourceNotFound error, which is fine, of course, as there is no such entity.

                                Obviously, it's allowable to have valid PartitionKeys and RowKeys queries exceeding the length of 300.

                                Is there any way to change the maximum URL length that the…

                                10 votes
                                Vote
                                Sign in
                                Check!
                                (thinking…)
                                Reset
                                or sign in with
                                • facebook
                                • google
                                  Password icon
                                  I agree to the terms of service
                                  Signed in as (Sign out)
                                  You have left! (?) (thinking…)
                                  under review  ·  1 comment  ·  Flag idea as inappropriate…  ·  Admin →
                                • Allow me to pay for increased entities/second from a table storage account

                                  Amazon's DynamoDB offers the ability to scale access to a single table, while Azure Table Storage is limited to 5000 entities/account. With Azure Federations now in place, this seems like the last remaining bottleneck for my application as it grows.

                                  Spreading my data across multiple accounts is a suboptimal solution because (1) it requires an additional layer of complexity in my application, (2) these accounts are not free in that I must request more of them from Microsoft myself every time I need more, (3) I'm not guaranteed to get more than 20 (5 to start, 20 if you go…

                                  82 votes
                                  Vote
                                  Sign in
                                  Check!
                                  (thinking…)
                                  Reset
                                  or sign in with
                                  • facebook
                                  • google
                                    Password icon
                                    I agree to the terms of service
                                    Signed in as (Sign out)
                                    You have left! (?) (thinking…)
                                    4 comments  ·  Tables  ·  Flag idea as inappropriate…  ·  Admin →
                                  • Increase the size of a BLOB Storage Account to an indefinite amount

                                    I'm currently working on a solution which will be using multiple storage accounts which will continue to grow indefinitely.
                                    The 100TB limit means that I have to continuously list the blobs in my container to workout what the total size used is and then determine if I need to create a new storage account on the fly. This is cumbersome and time consuming for the type of performance the business requires.

                                    It would be better to remove the account size limitation which would simplify the solution considerably and remove all the blob listing look-ups which seem counter intuitive. The only…

                                    9 votes
                                    Vote
                                    Sign in
                                    Check!
                                    (thinking…)
                                    Reset
                                    or sign in with
                                    • facebook
                                    • google
                                      Password icon
                                      I agree to the terms of service
                                      Signed in as (Sign out)
                                      You have left! (?) (thinking…)
                                      3 comments  ·  Blobs  ·  Flag idea as inappropriate…  ·  Admin →
                                      under review  ·  Jeff IrwinJeff Irwin responded

                                      While not yet indefinite, we have raised the limit today to 500TB per account and are continuing to look to improve this.

                                    • Provide Time to live feature for Blobs

                                      If I need to provide a user (or external system) some data (blob) which might be outcome of some processing (or other) and it has some expiration time I'd like to just put a new blob and set TTL property with TimeSpan (or set absolute DateTime). When the period is over my blob is deleted. So I don't have to pay for it and don't need to spin up some service for doing it myself.

                                      767 votes
                                      Vote
                                      Sign in
                                      Check!
                                      (thinking…)
                                      Reset
                                      or sign in with
                                      • facebook
                                      • google
                                        Password icon
                                        I agree to the terms of service
                                        Signed in as (Sign out)
                                        You have left! (?) (thinking…)
                                        17 comments  ·  Blobs  ·  Flag idea as inappropriate…  ·  Admin →
                                      • 81 votes
                                        Vote
                                        Sign in
                                        Check!
                                        (thinking…)
                                        Reset
                                        or sign in with
                                        • facebook
                                        • google
                                          Password icon
                                          I agree to the terms of service
                                          Signed in as (Sign out)
                                          You have left! (?) (thinking…)
                                          5 comments  ·  Blobs  ·  Flag idea as inappropriate…  ·  Admin →
                                        • Ability to delete from Table Storage by Partition

                                          There is no good way to delete multiple entries in Table Storage. All you can do is delete one at a time. For logging tables this can become VERY expensive. It would be great if we had the ability to use Partitions as a way to delete logical groups of data in Table Storage in a single transaction.

                                          This would allow for a partitioning scheme for grouping data in units that can easily be deleted. For example, logging data in WADLogsTable or rolling tables of data captured on a given partition can be archived easily and cleaned up.

                                          417 votes
                                          Vote
                                          Sign in
                                          Check!
                                          (thinking…)
                                          Reset
                                          or sign in with
                                          • facebook
                                          • google
                                            Password icon
                                            I agree to the terms of service
                                            Signed in as (Sign out)
                                            You have left! (?) (thinking…)
                                            4 comments  ·  Tables  ·  Flag idea as inappropriate…  ·  Admin →
                                          • Don't see your idea?

                                          Feedback and Knowledge Base