Data Lake

You can use this set to communicate with the Azure Data Lake team. We are eager to hear your ideas, suggestions, or any other feedback that would help us improve the service to bet fit your needs.

If you have technical questions, please visit our forums.
If you are looking for tutorials and documentation, please visit http://aka.ms/AzureDataLake.

How can we improve Microsoft Azure Data Lake?

(thinking…)

Enter your idea and we'll search to see if someone has already suggested it.

If a similar idea already exists, you can support and comment on it.

If it doesn't exist, you can post your idea so others can support it.

Enter your idea and we'll search to see if someone has already suggested it.

  1. async

    Add async methods to all Microsoft.Azure.DataLake.Store methods. I have to use a sync method to enumerate directory entries, amongst other things..

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  2. Need better information in the Azure Portal and CLI on Data Lake gen2 feature availability

    We were trying to use a gen2 Data Lake as a capture endpoint for an Event Hub.

    The Azure Portal would not let us create a gen2 container as the capture resource for our Event Hub. It gave us an error telling us our selected container name was invalid (see attached) even though we tried a dozen or so valid, random names.
    After some research we found that there is currently no availability for most resources Data Lake gen2 could interact with:

    https://docs.microsoft.com/en-gb/azure/storage/blobs/data-lake-storage-upgrade?toc=%2fazure%2fstorage%2fblobs%2ftoc.json#azure-ecosystem

    There should be better errors shown when trying to use these unavailable connections.

    The error messages seem…

    2 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  3. About Azure Data Lake Analytics, pleaes add function that can access Azure Blob Storage which enabled fire wall.

    I am unsing Azure Blob Storage wich enabled fire wall.
    When I tried to access this Azure Blob Storage with Azure Data Lake Analytics. But It can not access this Azure Blob Storage.
    So, pleaes add function that can access Azure Blob Storage which enabled fire wall.

    2 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  4. 1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  5. RBAC + ACL Security for ADLS Gen2 is backward

    After reading the docs and speaking to a MS storage rep, I've learned that in ADLS Gen2 RBAC overrides ACL, and you *must* have at least a Reader role assigned via RBAC in order to even see the storage account. This is backwards and broken IMHO - it makes it impossible to allow someone access to only a single folder somewhere in a Filesystem. This is a show stopper for storing any kind of sensitive data (HR, Finance, etc) in ADLS Gen2 where you have a need to totally block access to some data for a person while simultaneously allowing…

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  6. C# API

    ADLS Gen2 definitely needs performant and easier to use "native" API's for C# .NET (and other languages), like the BLOB API that initially seemed to work but has now been disabled for Gen2.

    3 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  7. Data Lake Analytics Explorer does not have an icon

    See screenshot.
    All the tool window tabs display an icon if not enough place for a label. But Data Lake Analytics Explorer displays nothing

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  8. Add a U-SQL REPL interface to the data lake

    Add a U-SQL REPL interface similar to the Visual Studio C# Interactive Console. Or like the normal script interface you have in SQL Server Management Studio. The current process of running entire scripts is too slow.

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  9. 1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  10. Can we get Azure instance metadata for data disks

    Please add metadata for data disk as well so that its very easy to identify OS and Azure end.

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  11. 1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  12. Please Make Azure Data Lake Analytics available in US-West

    Our client has a policy to only use services out of the US-West region.
    Are there any plans to make this available in other regions in North America besides US-East and US-Central, particularly US-West?

    If not, could you please put this on your roadmap.

    Thank you.

    2 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  13. 5 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  14. EnumerateDirectory with Pattern matching & MultipleFiles download

    1. We need EnumerateDirectory with Pattern matching and capability to traverse sub-folders, to download only required files.
    2. Should have an option to download selected files by passing the names, like download('a.csv', 'b.csv')

    Really not sure, how the people are living without pattern matching on ADLS files :(

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  15. Add support for ADLS Gen2 to ADLA

    Would like the ability to use the ADL Analytics job-as-a-service to work with data in ADLS Gen2.

    64 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    10 comments  ·  Flag idea as inappropriate…  ·  Admin →
  16. Please fix the python reducer bug

    Script will fail when using multiple python.reducer.

    "message": "An unhandled exception from user code has been reported when invoking the method ' Constructor ' on the user type ' Extension.Python.Reducer '",
    "description": "Unhandled exception from user code: \"The file ' C: \\ Users \\ hoch \\ AppData \\ Local \\ Temp \\ 612352AA6C1B0F31 \\ tmp6AF1_932036913D6A93D5 \\ bridgeTests.py ' already exists.\"\nThe details includes more information including any inner exceptions and the stack trace where the exception was raised.",

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  17. Please fix the python reducer bug

    Script will fail when using multiple python.reducer.

    "message": "An unhandled exception from user code has been reported when invoking the method ' Constructor ' on the user type ' Extension.Python.Reducer '",
    "description": "Unhandled exception from user code: \"The file ' C: \\ Users \\ hoch \\ AppData \\ Local \\ Temp \\ 612352AA6C1B0F31 \\ tmp6AF1_932036913D6A93D5 \\ bridgeTests.py ' already exists.\"\nThe details includes more information including any inner exceptions and the stack trace where the exception was raised.",

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  18. Support .zip format in OUTPUT

    With FeaturePreviewMode we can now create a .gz output of a csv/txt/tsv file.
    .zip output format should be supported as well

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  19. Support for Download all files at Folder level

    Currently we can download individual files. But it would be easier to downlaod all files in a directory which belongs to the same category than downloading them individually,.

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  20. Can we have folder -file level search for Datalakestore account

    When Datalke store account has lot of Data, it would be easier to search the folder -subfolder and file level search with partial or full text.

    This would prevent expanding all folders of datalakestore account.

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
← Previous 1 3 4 5 16 17
  • Don't see your idea?

Feedback and Knowledge Base