Azure Synapse Analytics
-
MERGE statement support
Support the MERGE sql statement to support management of SCD1 / SCD2
420 votesMERGE support will be available this summer for preview.
-
[In preview] PolyBase: allow escaping string delimiters within string fields
This feedback item is currently in preview here:
https://docs.microsoft.com/sql/t-sql/statements/copy-into-transact-sql?view=azure-sqldw-latest
If you want to quote the string columns, and if one of the quoted columns has a quote character in it, the proper way to encode this is to double the quote character. (Build a CSV file in Excel and you will see that's how it saves it. I would say Excel is the authority on CSV formats.)
it appears it's impossible for Polybase to properly load that file. For example the following format is not interpreted right with STRING_DELIMITER = '"' since it divides the value 2.5" into two columns
…
233 votes -
[In preview] Polybase: allow field/row terminators within string fields
This feedback item is currently in preview here:
https://docs.microsoft.com/sql/t-sql/statements/copy-into-transact-sql?view=azure-sqldw-latest
If a line end is present within a text field (qualified) importing data using Polybase will fail.
Loading this line will work fine:
1;2.1;"zzzz"Loading this will fail:
1;2.1;"zz
zz"Code:
CREATE EXTERNAL FILE FORMAT textfileformat_raw
WITH
(FORMAT_TYPE = DELIMITEDTEXT,
FORMAT_OPTIONS
(
FIELD_TERMINATOR =';',
STRING_DELIMITER = '0x22',
USE_TYPE_DEFAULT = TRUE
));
CREATE EXTERNAL TABLE dbo.testexternal
(
col1 INT,
col2 DECIMAL(2,1),
col3 NVARCHAR(5)
)
WITH
(
LOCATION = 'testfailing.txt',
DATASOURCE = azurestorage,
FILEFORMAT = textfileformatraw
);CREATE TABLE dbo.test
WITH…225 votes -
User Defined Retention Periods for Restore Points
SQL DW doesn't have the capability to specify longer term retention capabilities as released for SQL DB recently. The workaround is to restore and pause. It would be great to have this capability for compliance and auditing requirements.
213 votesThank you for voting for this feature! We are aware of this scenario and are looking into ways of supporting this. In the meantime, stay tuned for an update and please continue voting for this feature.
-
Cross Database Querying
Enable elastic query for SQL DW - this would allow cross database query in SQL DataWarehouse.
198 votes -
Support for Entity Framework
Support for Entity Framework in Azure SQL Data Warehouse would allow for greater usability in general, but it would also allow for better support of other frameworks/protocols. Specifically, we have a need to serve our data through an OData feed, and Entity Framework's deferred execution would allow us to handle OData's Query Options in a much simpler way.
165 votesThank you for all the feedback folks. Unfortunately this is taking longer than we’d like. We will reach back out when it is on the roadmap and can share when we have an update.
-
Support for spatial data type
Spatial data shlould be supported by SQL Data Warehouse the same way it is supported by SQL Server.
140 votes -
ANSI joins support in UPDATE & DELETE statement
SQL DW does not support to usual way of joins (ANSI) in UPDATE, DELETE statement. This makes difficult in case of table data modification. Though there is a workaround provided for CTAS this seems to be a lengthy process of data modification. Please have this feature available in SQL DW.
136 votesThis feature will be available to users in coming months.
-
Allow DWU to scale without interruption
The scaling disrupts the current session, and it's often not allowable in the production. Instead, it should finish off the existing session (sqls), and scale after that. That way, the scaling up or down can be done without causing the production disruption.
134 votesThank you for voting for this feature! We are aware of this scenario and are looking into ways of supporting this. In the meantime, stay tuned for an update and please continue voting for this feature.
-
Support for Recursive CTE
It would be great if you can add support for recursive CTEs for computing hierarchical data
132 votes -
Rename a column name in SQLDW
Scenario: We want to change the column name as it is changed in the source. And in table where we are trying to do has more than 20Billion records.
Workaround: Since rename of column is not possible currently in SQL DW we are doing CTAS of that big table.
Issues With Work around: It is very slow because we can’t do CTAS on entire big table in single transaction because of transaction limits and we end up doing in CTAS and with multiple insert statements . Which is very time consuming process
ASK: Please support column Rename127 votes -
Expose File Properties as additional columns to load in SQL DW
It would be helpful if some of the properties of a BLOB file could be exposed in the external table such as: Last Modified, Filename, Size. It should be optional and could be defined in the EXTERNAL FILE FORMAT definition. Each Property should be appended to the end of the result set of an external table in the order given in the definition.
For instance, if we are loading a directory of several files we can read the filename and derive a new column. For example, we might have a directory with 20160504.csv and 20160505.csv and the contents of the…
119 votesThanks for your suggestion. We are looking into this scenario for a future release. 7633537
-
Lower scale points for Dev/Test environments
SQL Data Warehouse scale stepping should be much smaller (10 DWU or even 1 DWU), than 100 DWU!
Please fix that ASAP!
Thank you!114 votesThank you for all the feedback folks. We are currently evaluating options for lower click stops for SQL Data Warehouse. Please continue to vote and comment on your scenario below. Thank you for your patience.
-
@@ROWCOUNT Support
Please enable @@ROWCOUNT?
Furthermore considering that we cannot switch NOCOUNT on, then why should it be such a secret/coded mission to track the number of rows affected by the most recent snippet of code? The proposed work-around seems onerous and doesn't always work (for dynamic SQL) yet my query window still knows and always-prints the fact that it returned 15 rows to me, for example, so why can we not leverage this elementary information inside the selfsame query (?):
SELECT SUM(rowcount) AS rowcount
FROM sys.dmpdwsqlrequests
WHERE rowcount <> -1
AND request_id IN
…( SELECT107 votes -
Provide File Format to read and load JSON and XML data from Storage
Able to read the JSON and XML file as part of external system OR provide functionality like Extractor in Data Lake analytics so we can write our own Extractor to read respective data format.
97 votes -
96 votes
Thank you for your feedback. Please help us understand your scenario by filling out the following short survey if you haven’t already:
https://forms.office.com/Pages/ResponsePage.aspx?id=v4j5cvGGr0GRqy180BHbR15GEFq-UVhGoldBoL_LA9RURUhGVVRWTUFQSlVOQlgwSjE5MEVBUDhXNi4u -
Polybase: PARTITIONED BY functionality when creating external tables.
I have a large number of files which are read with Hive using a partitioning scheme. PARTITIONED BY functionality, which is so commonly used in HIVE is missing from polybase.
95 votesThank you for your request. I would like to understand if this request concerns SQL DW or SQL Server implementation of PolyBase?
-
offer a PaaS version of Master Data Services (MDS)
Master Data Services is vitally important for data governance and enterprise data warehousing. Microsoft has a great PaaS data warehouse offer. But for MDS, customers must deploy SQL Server Enterprise on a VM.
90 votes -
hash distribute fact table on multiple columns
A large fact table often has multiple join keys to multiple dimension table, so while it can be opitmised for one join it always creates data movement for other joins. The hash distribution should accept multiple columns so all joins are optimised and create no data movement for dimension joins.
90 votesThis support will be available to users this summer.
-
Shrinkdatabase command support
Shrinkdatabase command should to be supported even if TDE is on or off because extra cost is charged in case that the unallocated space is huge.
89 votesThank you for all the feedback folks. We understand the scenario and are actively working on improving this experience. We will reach back out when it is addressed and share when we have an update.
- Don't see your idea?