How can we improve Azure Storage?

Bulk upload to table storage

To have a fast way of uploading a large amount of data to a storage table. Trying to upload 5M entries (4M distinct partition keys) takes 20 to 60 hours (depending on where I run it) to upload single threaded.
Batch operations don't help much as they are limited to one partition per batch. Relaxing the restriction on batches to allow multiple partition keys in one batch and making batches larger would both help.
Alternatively uploading a CSV or JSON file as a single operation. It would be acceptable for this to create a new table.

2 votes
Vote
Sign in
Check!
(thinking…)
Reset
or sign in with
  • facebook
  • google
    Password icon
    I agree to the terms of service
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    Anonymous shared this idea  ·   ·  Flag idea as inappropriate…  ·  Admin →

    0 comments

    Sign in
    Check!
    (thinking…)
    Reset
    or sign in with
    • facebook
    • google
      Password icon
      I agree to the terms of service
      Signed in as (Sign out)
      Submitting...

      Feedback and Knowledge Base