XML file type in copy activity.. along with XML schema validation
can we have a copy activity for XML files, along with validating schema of an XML file against XSD.. this would be helpful.. if schema validation is success then copy else fail the activity.. this will be useful for below scenarios..
1. Blob to Blob
2. Blob to SQL
3. SQL to Blob
if all above can work with specified schema that would be great...
Azure Data factory now supports XML format in both copy activity and mapping data flow.
Learn more from https://techcommunity.microsoft.com/t5/azure-data-factory/azure-data-factory-adds-support-for-xml-format/ba-p/1529012.
John Balta commented
I have a copy activity in a pipeline where the source is big XML file and the sink is SQL table.
I have some issues with mapping the XML file due its hierarchical structure. I wonder if is possible to use XPath in the map to pick the xml nodes
Did anyone use the XPath in this circumstance?
Miles Cole commented
This was delivered
anu priya commented
Do we have any end date for this update?
Any good news on this?
Vasu Thota commented
waiting for this
Hi Azure Team, what's the planned release date of native XML as source format in Azure Data Facotry
Going to see what your competitors can do
This is still a problem I see. Shabby Shabby Shabby. Many hours wasted attempting to get to a end result quickly for customer needs and no easy way to get there. Only to find when you think you have a solution, the external table def ( without a proper metadata layer) is difficult to code for.... You need to do better or you will lose customer interest here. No database is worth this aggravation.
Anil TR commented
Can we copy xml data from http response to Azure blob storage?
Ryan Filho commented
Jeroen H commented
Many shortcomings of ADF can be circumvented using Python based Azure Functions. By using Python it's also easy to migrate away later.
Steve A Culshaw commented
Yeah, this is soooooo needed asap. We keep getting integration requirements and looking at ADF to do the work and then hitting the ... oh, but it's XML data. Ok, back to SSIS and add another technical debt item to our backlog of moving everything to the cloud :-(
Any idea, even vague, as to when it might be available? We've got work coming and it's so "ADF", apart from the XML blocker
How is this still missing?
This is pending since 2 years ? unbelievable !!! Is anyone even monitoring this basic requirement ?
Johny Prentice commented
When is this feature being released?
Daniel Bierza commented
Alex Martinez commented
Any update on what actually is planned and when? Already 2 months since the status changed....
We have been starting our first customer project on ADF basis. As being agile we now approach the requirement of feeding xml to our data warehouse. It is hard to belief that the suggested solution of using ADF does not support xml data sets. At very first we tried to use a logic app for ingestion, but were surprised not to find CSV support. Logic Apps do support XML but require another resource (integration resource). I have been working with Apache Camel and it seems to be much more mature.
We consider moving to databricks for data transformation tasks as it supports CSV, JSON, XML, XLSX, parquet, [...]. ADF would then be only used for binary copy and triggering databricks notebooks.