Tool like azcopy but for Data Lake
The AdlCopy tool only allows you to copy a file from Azure Blob Storage to Azure Data Lake Store currently.
I would like a tool like azcopy which is able to upload a local file to Azure Data Lake Store and download a file from Azure Data Lake Store to a local file.
I also need it to accept credentials on the command line (maybe the AAD application client ID and secret?) so that it can be used in automation rather than only being run interactively like AdlCopy.
Ben Huntley commented
I'd also like the ability to copy data from Azure Data Lake to Azure Blob would be valuable - at present, the options only support copy from Blob into Data Lake, not the reverse.
Ivan Ignatiev commented
Peter Gadsby commented
Has there been any progress on this?
Sascha Dittmann commented
I started to write such a tool quite a while ago. Feel free to use it and/or contribute to the repo: https://github.com/SaschaDittmann/AdlTransfer
Greg Galloway commented
Another important consideration is that you shouldn't have to have any Azure subscription access to the Data Lake but only WebHDFS permission for this tool to work.