Filter set wildcard match in storage lifecycle management
Same feature like präfix but with a wildcards to filter for files that should be deleted.
Vitaliy Markitanov commented
Yes, this feature is needed a lot.
I have folder structure like tenant/yyyy/mm/dd/integrationTest_file1.txt
and need to delete files like tenant/**/integrationTest*.
Jonathan Åkerblom commented
Great idea and I was surprised to see that this was a feature request and not an existing feature to the lifecycle management. We'd like to combine rules around age of a file (last modified) with the load date of a file. So if we organize files as "stage/subject/yyyy/MM/dd/..." we could set rules that "cools" all files under "stage/*/2018/". We know that we will not be using these unless there is some special case, and migrating to datalake gen2 will make all files _new_ in the eyes of the lake, thereby making them hot by default.