Support 'dynamic' output file names in ADLA
When reading files, it's easy to read from files, using the wildcard characters and dynamic parts of the URI. (see the Month variable)
EXTRACT Customer string,
USING new USQLExtractors.CustomExtractor();
I als want to have this behavior at the output side. I want to split out by customer (and don't know these customer upfront)
Please make this possible.
The private preview is in full swing and will soon become public preview. See https://github.com/Azure/AzureDataLake/blob/master/docs/Release_Notes/2018/2018_Spring/USQL_Release_Notes_2018_Spring.md#data-driven-output-partitioning-with-output-fileset-is-in-private-preview
Mike R commented
Hi Dror. It has slipped into the first half of 2017 train but is still on the books.
Dror Kremer commented
Any updates on this? :)
Expect this near the end of 2016 or in early 2017.
Any tentative date on the upcoming release ?
Tayyab Anwar commented
Looking forward to an update to this feature.
Any information when this feature will be enabled?
nitin bafna commented
Any timeline for this?
Michael Rys commented
We are currently reviewing this capability. There is a question on whether the file names need to be dynamically created, or if a compile time resolution of the names would suffice. Obviously dynamic sounds more powerful, but it is more difficult to do given the current OUTPUT semantics and implementation and thus may take longer.