How can we improve Microsoft Azure Data Factory?

Use partition in filefilter and filename

At the moment you can only use * and ? in the file filter. It would be very helpful if you could use the partitionedBy section which you can use for the folderpath in the filefilter or the filename as well.

This would allow scenarios where you need files like myName-2015-07-01.txt where the slice date and time is part of the filename.

262 votes
Vote
Sign in
Check!
(thinking…)
Reset
or sign in with
  • facebook
  • google
    Password icon
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    Benny shared this idea  ·   ·  Flag idea as inappropriate…  ·  Admin →

    7 comments

    Sign in
    Check!
    (thinking…)
    Reset
    or sign in with
    • facebook
    • google
      Password icon
      Signed in as (Sign out)
      Submitting...
      • Nithin Sukumar commented  ·   ·  Flag as inappropriate

        I came across a scenario where my folder names (container name in Blob storage account) need to have wild cards like copy all containers test*. Not sure if it would fall under this feature request

      • Renan commented  ·   ·  Flag as inappropriate

        Also would be nice to control calculation on the dates (for ex, if you need Day-1, Month-1, etc).

      • Rony commented  ·   ·  Flag as inappropriate

        I am facing the same problem :(
        Is there any news about possible options to fix it ?

      Feedback and Knowledge Base