Atomic directory swaps (move directory over existing directory)
ADLS gen2 was built around an idea of a Filesystem-like hierarchical namespace, supporting atomic directory metadata operations.
Atopic substitution of an entire directory or its subdirectory (table partition) is a major load pattern for Data Lakes allowing a safe and performant mechanism for maintaining data integrity.
As of today (March 2021), based on our experimentation with Azure CLI, it does not allow atomic move of one directory on top of another existing directory (replacing it) - it throws an error. One is required to delete an old directory first, and then move the new one. This is a non-atomic process that in theory can fail in between.
A request is to support atomic directory move over existing target (Delete&Move), as you'd easily do in Linux/Unix inode-based filesystems ---- via backend REST APIs, and in Azure CLI front-ends (perhaps with an additional "--force" safety switch).