Use partition in filefilter and filename
At the moment you can only use * and ? in the file filter. It would be very helpful if you could use the partitionedBy section which you can use for the folderpath in the filefilter or the filename as well.
This would allow scenarios where you need files like myName-2015-07-01.txt where the slice date and time is part of the filename.
Thank you for your feedback. This can be accomplished in ADF V2 by passing in the value of a trigger variable using pipeline parameter and dataset parameter. Then you can construct a parameterized folder path name and/or filename, e.g. myName-yyyy-MM-dd.txt in your example.
Please refer to this article for more details: https://docs.microsoft.com/en-us/azure/data-factory/how-to-read-write-partitioned-data
Nithin Sukumar commented
I came across a scenario where my folder names (container name in Blob storage account) need to have wild cards like copy all containers test*. Not sure if it would fall under this feature request
Also would be nice to control calculation on the dates (for ex, if you need Day-1, Month-1, etc).
I am facing the same problem :(
Is there any news about possible options to fix it ?
Any update on this feature? Really needed. please.
Saul Cruz commented
this is a very useful feature.
This is a really important feature that should be easy to implement.
Any update for this feature?