How can we improve Azure Data Catalog?

Capture metadata of ETL processes designed in Data Factory

Big data platform are mainly powered by two major components in their architecture; Source-to-target mapping and ETL processes. So the analyst performing analytics on a specific dataset needs to understand where the data came from, which business rules applied on the data while in transient,...etc. So, an analyst could create a lineage diagram to help them understand the data movement in details. In the same time, data engineers could generate an impact analysis on ETL procesees and target datasets in case any data source was changed.

The short version is Data Catalog to harvest metadata from Data Factory that describes the ETL process

45 votes
Sign in
(thinking…)
Sign in with: Microsoft
Signed in as (Sign out)

We’ll send you updates on this idea

Anonymous shared this idea  ·   ·  Flag idea as inappropriate…  ·  Admin →

1 comment

Sign in
(thinking…)
Sign in with: Microsoft
Signed in as (Sign out)
Submitting...

Feedback and Knowledge Base