Azure Synapse Analytics
Do you have an idea or suggestion based on your experience with Azure Synapse Analytics? We would love to hear it!
Remember that this site is only for feature suggestions and ideas! If you have technical questions please try our documentation, MSDN forum, or StackOverflow. If you need support, please open a support ticket with us.
-
MERGE statement support
Support the MERGE sql statement to support management of SCD1 / SCD2
379 votesThank you for your suggestion. We are planning to support this feature.
-
[In preview] PolyBase: allow escaping string delimiters within string fields
This feedback item is currently in preview here:
https://docs.microsoft.com/sql/t-sql/statements/copy-into-transact-sql?view=azure-sqldw-latest
If you want to quote the string columns, and if one of the quoted columns has a quote character in it, the proper way to encode this is to double the quote character. (Build a CSV file in Excel and you will see that's how it saves it. I would say Excel is the authority on CSV formats.)
it appears it's impossible for Polybase to properly load that file. For example the following format is not interpreted right with STRING_DELIMITER = '"' since it divides the value 2.5" into two columns
…
227 votes -
[In preview] Polybase: allow field/row terminators within string fields
This feedback item is currently in preview here:
https://docs.microsoft.com/sql/t-sql/statements/copy-into-transact-sql?view=azure-sqldw-latest
If a line end is present within a text field (qualified) importing data using Polybase will fail.
Loading this line will work fine:
1;2.1;"zzzz"Loading this will fail:
1;2.1;"zz
zz"Code:
CREATE EXTERNAL FILE FORMAT textfileformat_raw
WITH
(FORMAT_TYPE = DELIMITEDTEXT,
FORMAT_OPTIONS
(
FIELD_TERMINATOR =';',
STRING_DELIMITER = '0x22',
USE_TYPE_DEFAULT = TRUE
));
CREATE EXTERNAL TABLE dbo.testexternal
(
col1 INT,
col2 DECIMAL(2,1),
col3 NVARCHAR(5)
)
WITH
(
LOCATION = 'testfailing.txt',
DATASOURCE = azurestorage,
FILEFORMAT = textfileformatraw
);CREATE TABLE dbo.test
WITH…225 votes -
Cross Database Querying
Enable elastic query for SQL DW - this would allow cross database query in SQL DataWarehouse.
177 votes -
User Defined Retention Periods for Restore Points
SQL DW doesn't have the capability to specify longer term retention capabilities as released for SQL DB recently. The workaround is to restore and pause. It would be great to have this capability for compliance and auditing requirements.
169 votesThank you for voting for this feature! We are aware of this scenario and are looking into ways of supporting this. In the meantime, stay tuned for an update and please continue voting for this feature.
-
Support for Entity Framework
Support for Entity Framework in Azure SQL Data Warehouse would allow for greater usability in general, but it would also allow for better support of other frameworks/protocols. Specifically, we have a need to serve our data through an OData feed, and Entity Framework's deferred execution would allow us to handle OData's Query Options in a much simpler way.
158 votesThank you for all the feedback folks. Unfortunately this is taking longer than we’d like. We will reach back out when it is on the roadmap and can share when we have an update.
-
Expose File Properties as additional columns to load in SQL DW
It would be helpful if some of the properties of a BLOB file could be exposed in the external table such as: Last Modified, Filename, Size. It should be optional and could be defined in the EXTERNAL FILE FORMAT definition. Each Property should be appended to the end of the result set of an external table in the order given in the definition.
For instance, if we are loading a directory of several files we can read the filename and derive a new column. For example, we might have a directory with 20160504.csv and 20160505.csv and the contents of the…
122 votesThanks for your suggestion. We are looking into this scenario for a future release. 7633537
-
ANSI joins support in UPDATE & DELETE statement
SQL DW does not support to usual way of joins (ANSI) in UPDATE, DELETE statement. This makes difficult in case of table data modification. Though there is a workaround provided for CTAS this seems to be a lengthy process of data modification. Please have this feature available in SQL DW.
120 votes -
Support for Recursive CTE
It would be great if you can add support for recursive CTEs for computing hierarchical data
112 votes -
Support for spatial data type
Spatial data shlould be supported by SQL Data Warehouse the same way it is supported by SQL Server.
111 votes -
Allow DWU to scale without interruption
The scaling disrupts the current session, and it's often not allowable in the production. Instead, it should finish off the existing session (sqls), and scale after that. That way, the scaling up or down can be done without causing the production disruption.
110 votesThank you for voting for this feature! We are aware of this scenario and are looking into ways of supporting this. In the meantime, stay tuned for an update and please continue voting for this feature.
-
Lower scale points for Dev/Test environments
SQL Data Warehouse scale stepping should be much smaller (10 DWU or even 1 DWU), than 100 DWU!
Please fix that ASAP!
Thank you!103 votesThank you for all the feedback folks. We are currently evaluating options for lower click stops for SQL Data Warehouse. Please continue to vote and comment on your scenario below. Thank you for your patience.
-
Rename a column name in SQLDW
Scenario: We want to change the column name as it is changed in the source. And in table where we are trying to do has more than 20Billion records.
Workaround: Since rename of column is not possible currently in SQL DW we are doing CTAS of that big table.
Issues With Work around: It is very slow because we can’t do CTAS on entire big table in single transaction because of transaction limits and we end up doing in CTAS and with multiple insert statements . Which is very time consuming process
ASK: Please support column Rename97 votes -
94 votes
Thank you for your feedback. Please help us understand your scenario by filling out the following short survey if you haven’t already:
https://forms.office.com/Pages/ResponsePage.aspx?id=v4j5cvGGr0GRqy180BHbR15GEFq-UVhGoldBoL_LA9RURUhGVVRWTUFQSlVOQlgwSjE5MEVBUDhXNi4u -
Provide File Format to read and load JSON and XML data from Storage
Able to read the JSON and XML file as part of external system OR provide functionality like Extractor in Data Lake analytics so we can write our own Extractor to read respective data format.
92 votes -
@@ROWCOUNT Support
Please enable @@ROWCOUNT?
Furthermore considering that we cannot switch NOCOUNT on, then why should it be such a secret/coded mission to track the number of rows affected by the most recent snippet of code? The proposed work-around seems onerous and doesn't always work (for dynamic SQL) yet my query window still knows and always-prints the fact that it returned 15 rows to me, for example, so why can we not leverage this elementary information inside the selfsame query (?):
SELECT SUM(rowcount) AS rowcount
FROM sys.dmpdwsqlrequests
WHERE rowcount <> -1
AND request_id IN
…( SELECT90 votes -
Shrinkdatabase command support
Shrinkdatabase command should to be supported even if TDE is on or off because extra cost is charged in case that the unallocated space is huge.
88 votesThank you for all the feedback folks. We understand the scenario and are actively working on improving this experience. We will reach back out when it is addressed and share when we have an update.
-
Polybase: PARTITIONED BY functionality when creating external tables.
I have a large number of files which are read with Hive using a partitioning scheme. PARTITIONED BY functionality, which is so commonly used in HIVE is missing from polybase.
82 votesThank you for your request. I would like to understand if this request concerns SQL DW or SQL Server implementation of PolyBase?
-
Resource Governance - Resource Pools - Control CPU, physical IO, memory, priority, run-time cap, max request, concurrency, request timeout..
- Ability to manage workloads effectively
- Enables to specify limits on the amount of CPU, physical IO and memory
- User-Defined Resource Pools
a. Memory size
b. Memory cap
c. CPU
d. Maximum requests
e. Grant time-out
f. Priority
g. Concurrency
h. Run-time cap
78 votesThis is available for public preview as announced at Ignite this November, 2019.
-
offer a PaaS version of Master Data Services (MDS)
Master Data Services is vitally important for data governance and enterprise data warehousing. Microsoft has a great PaaS data warehouse offer. But for MDS, customers must deploy SQL Server Enterprise on a VM.
77 votes
- Don't see your idea?