Azure Synapse Analytics
-
Support EXECUTE AS for stored procedures
As part of the ELT procedure the user staging data should be able to call a transform procedure to ingest the data without having read/write permissions to the production tables.
31 votesThanks for your feedback. Azure SQL Data Warehouse Support for EXECUTE AS feature is now in progress.
-
Connectivity to code repositories (similar to Data Factory)
It looks like the Azure Synapse suite is going to supplant Azure Data Factory. For completeness, Azure Synapse will have to be able to integrate with code repositories (Github / Azure DevOps Repos) and be able to align with the CI/CD process that ADF currently recommends (https://docs.microsoft.com/en-us/azure/data-factory/continuous-integration-deployment)
30 votes -
Need alert on number of queued queries and number of concurrency slots available in portal
The charts in the SQL DW blade in the portal and the ability to add alerts are very helpful. Please add additional metrics. The two metrics that I think would be helpful are:
Number of Queued Queries (meaning after you've exhausted your 32 concurrent queries or your concurrency slots or the queued query needs more concurrency slots than are available, queries get queued)
Number of Concurrency Slots Available (the sum of concurrency slots used by currently running queries... would help surface whether you need to scale to more DWUs)
30 votesThank you for voting for this folks! This is on our radar. We have plans to improve workload management for Azure SQL Data Warehouse which includes monitoring capabilities within the Azure portal. We’d love to hear your feedback so please comment on your scenario below.
-
Allow DBCC results (e.g. DBCC PDW_SHOWSPACEUSED..) to be copied into yet another table for programmatic interaction with those results?
IF OBJECTID('tempdb..#showspace_used') IS NOT NULL
DROP TABLE #show_space_usedCREATE TABLE #show_space_used
(
[ROWS] INT NULL
, [RESERVED_SPACE] INT NULL
, [DATA_SPACE] INT NULL
, [INDEX_SPACE] INT NULL
, [UNUSED_SPACE] INT NULL
, [PDW_NODE_ID] INT NULL
, [DISTRIBUTION_ID] INT NULL
)
WITH
(
DISTRIBUTION = HASH([ROWS])
, HEAP
)DECLARE @DynamicSQL nvarchar(4000)
SET @DynamicSQL = (SELECT CONVERT(NVARCHAR(100),'DBCC PDW_SHOWSPACEUSED("dbo.TableName");'))INSERT INTO #showspaceused ([ROWS], [RESERVEDSPACE], [DATASPACE], [INDEXSPACE], [UNUSEDSPACE], [PDWNODEID], [DISTRIBUTIONID])
EXEC spexecutesql @Dynamic_SQLMsg 103010, Level 16, State 1, Line 326
Parse error at line: 25, column: 1: Incorrect…29 votesThank you for your request. This item is on our backlog. We will update this thread when the status changes.
-
support for fixed width flat files in Polybase
Polybase currently only supports delimited flat files. It should support fixed width flat files.
29 votesThanks for the suggestion. We are looking into this scenario for a future release. 6891268
-
Polybase support for other cloud data sources
we currently has Polybase to Azure Blob Store.
we need Polybase to the following data stores:
HDInsight with push down compute?
SQL Azure with push down compute?
DocumentDB with push down compute?
Azure Data Lake Store with push down to Azure Data Lake Analytics?28 votesThanks for your suggestion. We are looking into this scenario for a future release. 10686397
-
JDBC connection to Spark Pool
Please support JDBC connection to Synapse Spark Pool.
26 votes -
Prevent DUPLICATE values. Allow Enforce constraints
Please allow to ENFORCE UNIQUE AND PRIMARY KEYS in order to PREVENT DUPLICATE values
25 votes -
column default
Support column default with expression. (E.g. Getdate())
25 votes -
Support "RDBMS" TYPE for Create External Data Source
Azure Synapse Analytics currently does not support creating external data sources to RDBMS databases such as Azure SQL, SQL Server, Orcale, etc.). However, this functionality is available in MS SQL Server 2019.
24 votes -
Add "DROP Partition" command
Having drop Partition command that automatically merges the partition boundaries and removes the partition would help a lot.
24 votesThank you for your request. This item is on our backlog. We will update this thread when the state changes.
-
Predicate pushdown for ADLS sources
As Azure SQL DW now also supports ADLS, it would be great if we could also leverage the distributed processing capabilities of ADLS to push computation down to ADLS in a similar way as it works for HDFS/Hadoop already
24 votes -
support for R notebook
Would love to have support for the language R in the notebook experience of Synapse Studio.
23 votes -
Re-instate geo-backup opt-out option for Gen2 DWs
We have several TBs of data in multiple DWs. The critical data is static. The data footprint of the DW grows and shrinks as analytics are peformed on the static data. Once analytics complete, results are exported out of the DW and no longer need to be retained in the DW. Should something happen the DW, all we require is the ability to restore back to the original static data image (any interrupted analytics can be resubmitted). Regularly scheduled geo-backups, snapshots, and restore points provide no benefit to us other than bloating our data storage costs in Azure.
According to…
23 votes -
OPENROWSET for dedicated pools
Please add the OPENROWSET functionality dedicated pools.
Advantages:
1. More (and faster) parser options over External File Format such as row delimiter
2. Can auto-infer schema
3. More convenient to define the file format directly
4. syntactical harmony between serverless and dedicated.22 votes -
Support of StorageTable as DataSource
Please add support of Azure TableStorage as PolyBase DataSource.
To be honest I can't believe its not already available. :O22 votesThanks for your suggestion. We are looking into this scenario for a future release. 10697404
-
SSDT: Row-level security
SSDT support for Row-level security
20 votes -
Allow for Local Timezone to be set for SQL Azure DB's
Allow for Local Time Zones to be set on SQL Azure DB's
20 votes -
Increase Concurrency limit as a tweakable system parameter
Increase the concurrency limit from 32 to unlimited and keep it tweakable , so the customers can vary it according to their needs
20 votesConcurrency was increased to 128. Unlimited concurrency requires further analysis.
-
Enable CDM support for Azure Synapse Analytics SQL on-demand
The "Common Data Model" (CDM) format is becoming increasingly popular. Therefore it would be important that this connector not only exists in the ADF, but that it is also possible to read and write (via CETAS) in CDM directly from SQL on-demand.
READ:
SELECT * FROMOPENROWSET(
BULK STORAGE ACCOUNT,
FORMAT = CDM
) AS [r];WRITE:
CREATE EXTERNAL TABLE cdm.cdm_table
WITH (
LOCATION = path_to_folder,
DATA_SOURCE = external_data_source_name
FILE_FORMAT = CDM) AS SELECT * FROM source
19 votes
- Don't see your idea?