Can databricks Hive be connected to Data Catalog
Can databricks Hive be connected to Data Catalog ? anyone can give your idea on this ?
Azure Data Catalog gen1 allowed us to get metadata from tables inside a Databricks workspace, by using ODBC connection. Do we have have ODBC connectivity for Azure Purview too? If so, can someone share the details?
Nicholas Hurt commented
Would be good if Purview could capture the table and column level comments from Hive
Jules Hamelin Boyer commented
To enrich Ronieri Marques comment;
Thank you for the help with this. It also works if you replace the Driver "Microsoft Spark ODBC Driver" with the driver from Databricks documentation (Simba Spark ODBC Driver).
Ronieri Marques commented
Actually, it's is possible to get metadata from tables inside a Databricks workspace, by using ODBC connection available on current version of Azure Data Catalog, it would be much better a native connector, but for now if you wanna give it a try just fill up the info bellow (on the Azure Data Catalog publishing app):
Driver: Microsoft Spark ODBC Driver (it must be intalled on you system)
Connection String: host=eastus.azuredatabricks.net;port=443;SSL=1;HTTPPath=sql/protocolv1/o/XXXXXXXXXXXXXXX/XXXX-XXXXXX-XXXXXX;transportMode=http;AuthMech=8
And let Database field blank
Even i am intrested to know an answer for this pls. Whats the plan to support data catalog for databricks delta tables.
PARAS PAREKH commented
Is support to register Databricks parquet or delta tables with Azure Data Catalog on Microsoft's roadmap ?
It's spark and hive together. Ideally I'd like the metadata store of hive to be accessible to data catalog.
DataBricks sells Spark and not Hive :)