SQL Data Warehouse

Do you have an idea or suggestion based on your experience with SQL Data Warehouse? We would love to hear it! Please take a few minutes to submit your idea or vote up an idea submitted by another SQL Data Warehouse customer. All of the feedback you share in these forums will be monitored and reviewed by the SQL Data Warehouse engineering team. By suggesting or voting for ideas here, you will also be one of the first to know when we begin work on your feature requests and when we release the feature.

Remember that this site is only for feature suggestions and ideas! If you have technical questions please try our documentation, MSDN forum, or StackOverflow. If you need support, please open a support ticket with us.

  • Hot ideas
  • Top ideas
  • New ideas
  • My feedback
  1. [In preview] Database project from Visual Studio to support Azure SQL Data Warehouse

    Database project from Visual Studio is useful to manage DDLs, schema compare between the project and database, etc. Please create a project template dedicated for DW or support DW development from Database Project.

    Download the Visual Studio 2019 preview here: https://docs.microsoft.com/azure/sql-data-warehouse/sql-data-warehouse-install-visual-studio

    934 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    started  ·  103 comments  ·  Integration  ·  Flag idea as inappropriate…  ·  Admin →
  2. MERGE statement support

    Support the MERGE sql statement to support management of SCD1 / SCD2

    353 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    19 comments  ·  T-SQL  ·  Flag idea as inappropriate…  ·  Admin →
  3. Polybase: allow field/row terminators within string fields

    If a line end is present within a text field (qualified) importing data using Polybase will fail.

    Loading this line will work fine:
    1;2.1;"zzzz"

    Loading this will fail:
    1;2.1;"zz
    zz"

    Code:

    CREATE EXTERNAL FILE FORMAT text_file_format_raw
    WITH
    (
    FORMAT_TYPE = DELIMITEDTEXT,
    FORMAT_OPTIONS
    (
    FIELD_TERMINATOR =';',
    STRING_DELIMITER = '0x22',
    USE_TYPE_DEFAULT = TRUE
    )
    );

    CREATE EXTERNAL TABLE dbo.test_external
    (
    col1 INT,
    col2 DECIMAL(2,1),
    col3 NVARCHAR(5)
    )
    WITH
    (
    LOCATION = 'test_failing.txt',
    DATA_SOURCE = azure_storage,
    FILE_FORMAT = text_file_format_raw
    );

    CREATE TABLE dbo.test
    WITH (CLUSTERED COLUMNSTORE INDEX, DISTRIBUTION = ROUND_ROBIN)
    AS
    SELECT * FROM dbo.test_external;

    214 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    started  ·  21 comments  ·  Polybase  ·  Flag idea as inappropriate…  ·  Admin →
  4. PolyBase: allow escaping string delimiters within string fields

    If you want to quote the string columns, and if one of the quoted columns has a quote character in it, the proper way to encode this is to double the quote character. (Build a CSV file in Excel and you will see that's how it saves it. I would say Excel is the authority on CSV formats.)

    it appears it's impossible for Polybase to properly load that file. For example the following format is not interpreted right with STRING_DELIMITER = '"' since it divides the value 2.5" into two columns

    SizeDescription|SizeCode
    "3.5 feet"|"3.5 ft"
    "2.5 inches"|"2.5"""

    Please improve Polybase…

    213 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    started  ·  23 comments  ·  Polybase  ·  Flag idea as inappropriate…  ·  Admin →
  5. Cross Database Querying

    Enable elastic query for SQL DW - this would allow cross database query in SQL DataWarehouse.

    173 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    10 comments  ·  Other  ·  Flag idea as inappropriate…  ·  Admin →
  6. Support for Entity Framework

    Support for Entity Framework in Azure SQL Data Warehouse would allow for greater usability in general, but it would also allow for better support of other frameworks/protocols. Specifically, we have a need to serve our data through an OData feed, and Entity Framework's deferred execution would allow us to handle OData's Query Options in a much simpler way.

    148 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    13 comments  ·  Integration  ·  Flag idea as inappropriate…  ·  Admin →
  7. User Defined Retention Periods for Restore Points

    SQL DW doesn't have the capability to specify longer term retention capabilities as released for SQL DB recently. The workaround is to restore and pause. It would be great to have this capability for compliance and auditing requirements.

    147 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    21 comments  ·  Management  ·  Flag idea as inappropriate…  ·  Admin →
  8. 118 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    5 comments  ·  Security  ·  Flag idea as inappropriate…  ·  Admin →
  9. Expose File Properties as additional columns to load in SQL DW

    It would be helpful if some of the properties of a BLOB file could be exposed in the external table such as: Last Modified, Filename, Size. It should be optional and could be defined in the EXTERNAL FILE FORMAT definition. Each Property should be appended to the end of the result set of an external table in the order given in the definition.

    For instance, if we are loading a directory of several files we can read the filename and derive a new column. For example, we might have a directory with 20160504.csv and 20160505.csv and the contents of the…

    115 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    8 comments  ·  Polybase  ·  Flag idea as inappropriate…  ·  Admin →
  10. ANSI joins support in UPDATE & DELETE statement

    SQL DW does not support to usual way of joins (ANSI) in UPDATE, DELETE statement. This makes difficult in case of table data modification. Though there is a workaround provided for CTAS this seems to be a lengthy process of data modification. Please have this feature available in SQL DW.

    110 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    under review  ·  3 comments  ·  T-SQL  ·  Flag idea as inappropriate…  ·  Admin →
  11. Support for Recursive CTE

    It would be great if you can add support for recursive CTEs for computing hierarchical data

    103 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    under review  ·  5 comments  ·  Table Structure  ·  Flag idea as inappropriate…  ·  Admin →
  12. Support for spatial data type

    Spatial data shlould be supported by SQL Data Warehouse the same way it is supported by SQL Server.

    102 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    under review  ·  6 comments  ·  Table Structure  ·  Flag idea as inappropriate…  ·  Admin →
  13. Allow DWU to scale without interruption

    The scaling disrupts the current session, and it's often not allowable in the production. Instead, it should finish off the existing session (sqls), and scale after that. That way, the scaling up or down can be done without causing the production disruption.

    98 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    5 comments  ·  Flag idea as inappropriate…  ·  Admin →
  14. Lower scale points for Dev/Test environments

    SQL Data Warehouse scale stepping should be much smaller (10 DWU or even 1 DWU), than 100 DWU!
    Please fix that ASAP!
    Thank you!

    98 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    10 comments  ·  Management  ·  Flag idea as inappropriate…  ·  Admin →

    Thank you for all the feedback folks. We are currently evaluating options for lower click stops for SQL Data Warehouse. Please continue to vote and comment on your scenario below. Thank you for your patience.

  15. 94 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  Integration  ·  Flag idea as inappropriate…  ·  Admin →
  16. Provide File Format to read JSON and XML data from Storage

    Able to read the JSON and XML file as part of external system OR provide functionality like Extractor in Data Lake analytics so we can write our own Extractor to read respective data format.

    88 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    under review  ·  3 comments  ·  Table Structure  ·  Flag idea as inappropriate…  ·  Admin →
  17. Rename a column name in SQLDW

    Scenario: We want to change the column name as it is changed in the source. And in table where we are trying to do has more than 20Billion records.
    Workaround: Since rename of column is not possible currently in SQL DW we are doing CTAS of that big table.
    Issues With Work around: It is very slow because we can’t do CTAS on entire big table in single transaction because of transaction limits and we end up doing in CTAS and with multiple insert statements . Which is very time consuming process
    ASK: Please support column Rename

    87 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    under review  ·  5 comments  ·  T-SQL  ·  Flag idea as inappropriate…  ·  Admin →
  18. Shrinkdatabase command support

    Shrinkdatabase command should to be supported even if TDE is on or off because extra cost is charged in case that the unallocated space is huge.

    86 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    2 comments  ·  Management  ·  Flag idea as inappropriate…  ·  Admin →
  19. @@ROWCOUNT Support

    Please enable @@ROWCOUNT?

    Furthermore considering that we cannot switch NOCOUNT on, then why should it be such a secret/coded mission to track the number of rows affected by the most recent snippet of code? The proposed work-around seems onerous and doesn't always work (for dynamic SQL) yet my query window still knows and always-prints the fact that it returned 15 rows to me, for example, so why can we not leverage this elementary information inside the selfsame query (?):

    SELECT SUM(row_count) AS row_count
    FROM sys.dm_pdw_sql_requests
    WHERE row_count <> -1
    AND request_id IN
    ( SELECT TOP 1 request_id
    FROM sys.dm_pdw_exec_requests
    WHERE…

    82 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    under review  ·  3 comments  ·  T-SQL  ·  Flag idea as inappropriate…  ·  Admin →
  20. Resource Governance - Resource Pools - Control CPU, physical IO, memory, priority, run-time cap, max request, concurrency, request timeout..

    1. Ability to manage workloads effectively
    2. Enables to specify limits on the amount of CPU, physical IO and memory
    3. User-Defined Resource Pools
    a. Memory size
    b. Memory cap
    c. CPU
    d. Maximum requests
    e. Grant time-out
    f. Priority
    g. Concurrency
    h. Run-time cap

    75 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    7 comments  ·  Management  ·  Flag idea as inappropriate…  ·  Admin →
← Previous 1 3 4 5 12 13
  • Don't see your idea?

Feedback and Knowledge Base