Azure Purview
-
Scanning/Lineage of stored procedures in SQL Server and Azure SQL
We use stored procedures to transform our data. So we are not able to see these steps in the lineage visualization. Although it might be tough to analize all possible ways of transformations included in a stored procedure it would be great to get the information extracted. I think there will be a lot of customers who use stored prcedures who would benefit from it.
26 votes -
Support Data Factory lineage involving external data sources
Currently, if I have an Azure Data Factory pipeline which has an external source (such as a 3rd Party HTTP or FTP source), the lineage for this does not get pushed to Purview. This is a gap in the mapping of the end-to-end lineage of many business processes. In my view, I should be able to see that a data pipeline begins with an external data source.
10 votes -
Lineage should link External tables in Synapse to DataLake objects
I'd like to look at a data lake object and easily determine if there are any external tables referencing it. The Exernal table may be referenced by a view or PowerBI or DataFactory.... I'd like to see it all end-to-end through all the virtual layers
5 votes -
Have the lineage for PowerBI and such to link back to individual tables and views
I'd like to be able to look at a table and see how it is referenced by DataFactory and PowerBI processes
3 votes -
Allow Data Lineage to be performed on Azure Data Factory even when additional columns are set
Currently it appears that if you add additional columns to your Azure Data Factory copy activity, then Azure Purview cannot generate the data lineage. Refer to this StackOverflow post for details. https://stackoverflow.com/questions/65524449/how-does-azure-purview-perform-data-lineage-in-azure-data-factory-when-there-are/65525696#65525696
2 votes -
Create API / SDK to declare Lineage
Other than ADF there are numerous options to create and orchestrate a data pipeline in Azyre. Lineage information for all of these data pipelines should be available in Purview. There should be an SDK in which custom code (e.g. Azure function) and Azure services will be able to use to tell Purview about the lineage of their respective assets.
2 votes -
Power BI Lineage Field View
The process for Purview appears to breakdown data similar to the existing lineage process for Power BI right now where it creates a high level view of data connections, but you cannot seem to get to more granular details. What we spoke with our TAM and the engineering team about is adding the ability to break down datasets and dataflows and their respective sources by field level metadata.
Example is you have a dataflow that contains 10 tables within it and 100 columns, offer a manner to breakdown the individual classification of this data automatically since it's simply json on…
1 vote -
Synapse Workspace Integrate support for External Connections
I would like External Connections to consider supporting the Integrate pipeline in Synapse Analytics Workspace as well as the Data Factory.
1 vote -
Support lineage for data factory copy activity that uses dynamic parameters in source and sink dataset
the data factory pipelines with copy activities that use dynamic runtime parameters in the source and sink dataset does not show in the "browse assets".
1 vote -
support power bi dataset SQL DB data source to table level
Currently we can only see what reports are connecting to what Database but not able to see what tables or views in the database. This feature would help tremendously to track the dataflow from raw to visualisation
1 vote -
1 vote
-
Derive Lineage based on actual data using AI/ML
Lineage or show link or correlation between tables and cols with help of model or keys or values in each col, etc. it is hard to manually find it when there are too many interconnected systems. also want to see end to end lineage for col level.
1 vote
- Don't see your idea?