SQL Data Warehouse

Do you have an idea or suggestion based on your experience with SQL Data Warehouse? We would love to hear it! Please take a few minutes to submit your idea or vote up an idea submitted by another SQL Data Warehouse customer. All of the feedback you share in these forums will be monitored and reviewed by the SQL Data Warehouse engineering team. By suggesting or voting for ideas here, you will also be one of the first to know when we begin work on your feature requests and when we release the feature.

Remember that this site is only for feature suggestions and ideas! If you have technical questions please try our documentation, MSDN forum, or StackOverflow. If you need support, please open a support ticket with us.

  • Hot ideas
  • Top ideas
  • New ideas
  • My feedback
  1. MERGE statement support

    Support the MERGE sql statement to support management of SCD1 / SCD2

    365 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    19 comments  ·  T-SQL  ·  Flag idea as inappropriate…  ·  Admin →
  2. [In preview] Polybase: allow field/row terminators within string fields

    This feedback item is currently in preview here:

    https://docs.microsoft.com/sql/t-sql/statements/copy-into-transact-sql?view=azure-sqldw-latest

    If a line end is present within a text field (qualified) importing data using Polybase will fail.

    Loading this line will work fine:
    1;2.1;"zzzz"

    Loading this will fail:
    1;2.1;"zz
    zz"

    Code:

    CREATE EXTERNAL FILE FORMAT text_file_format_raw
    WITH
    (
    FORMAT_TYPE = DELIMITEDTEXT,
    FORMAT_OPTIONS
    (
    FIELD_TERMINATOR =';',
    STRING_DELIMITER = '0x22',
    USE_TYPE_DEFAULT = TRUE
    )
    );

    CREATE EXTERNAL TABLE dbo.test_external
    (
    col1 INT,
    col2 DECIMAL(2,1),
    col3 NVARCHAR(5)
    )
    WITH
    (
    LOCATION = 'test_failing.txt',
    DATA_SOURCE = azure_storage,
    FILE_FORMAT = text_file_format_raw
    );

    CREATE TABLE dbo.test
    WITH (CLUSTERED COLUMNSTORE INDEX, DISTRIBUTION = ROUND_ROBIN)
    AS
    SELECT * FROM…

    223 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    started  ·  23 comments  ·  Loading  ·  Flag idea as inappropriate…  ·  Admin →
  3. [In preview] PolyBase: allow escaping string delimiters within string fields

    This feedback item is currently in preview here:

    https://docs.microsoft.com/sql/t-sql/statements/copy-into-transact-sql?view=azure-sqldw-latest

    If you want to quote the string columns, and if one of the quoted columns has a quote character in it, the proper way to encode this is to double the quote character. (Build a CSV file in Excel and you will see that's how it saves it. I would say Excel is the authority on CSV formats.)

    it appears it's impossible for Polybase to properly load that file. For example the following format is not interpreted right with STRING_DELIMITER = '"' since it divides the value 2.5" into two columns

    221 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    started  ·  25 comments  ·  Loading  ·  Flag idea as inappropriate…  ·  Admin →
  4. Cross Database Querying

    Enable elastic query for SQL DW - this would allow cross database query in SQL DataWarehouse.

    174 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    planned  ·  10 comments  ·  Other  ·  Flag idea as inappropriate…  ·  Admin →
  5. User Defined Retention Periods for Restore Points

    SQL DW doesn't have the capability to specify longer term retention capabilities as released for SQL DB recently. The workaround is to restore and pause. It would be great to have this capability for compliance and auditing requirements.

    156 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    21 comments  ·  Management  ·  Flag idea as inappropriate…  ·  Admin →
  6. Support for Entity Framework

    Support for Entity Framework in Azure SQL Data Warehouse would allow for greater usability in general, but it would also allow for better support of other frameworks/protocols. Specifically, we have a need to serve our data through an OData feed, and Entity Framework's deferred execution would allow us to handle OData's Query Options in a much simpler way.

    153 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    14 comments  ·  Integration  ·  Flag idea as inappropriate…  ·  Admin →
  7. Expose File Properties as additional columns to load in SQL DW

    It would be helpful if some of the properties of a BLOB file could be exposed in the external table such as: Last Modified, Filename, Size. It should be optional and could be defined in the EXTERNAL FILE FORMAT definition. Each Property should be appended to the end of the result set of an external table in the order given in the definition.

    For instance, if we are loading a directory of several files we can read the filename and derive a new column. For example, we might have a directory with 20160504.csv and 20160505.csv and the contents of the…

    118 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    8 comments  ·  Loading  ·  Flag idea as inappropriate…  ·  Admin →
  8. ANSI joins support in UPDATE & DELETE statement

    SQL DW does not support to usual way of joins (ANSI) in UPDATE, DELETE statement. This makes difficult in case of table data modification. Though there is a workaround provided for CTAS this seems to be a lengthy process of data modification. Please have this feature available in SQL DW.

    116 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    started  ·  3 comments  ·  T-SQL  ·  Flag idea as inappropriate…  ·  Admin →
  9. Support for Recursive CTE

    It would be great if you can add support for recursive CTEs for computing hierarchical data

    106 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    under review  ·  5 comments  ·  Table Structure  ·  Flag idea as inappropriate…  ·  Admin →
  10. Support for spatial data type

    Spatial data shlould be supported by SQL Data Warehouse the same way it is supported by SQL Server.

    106 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    under review  ·  6 comments  ·  Table Structure  ·  Flag idea as inappropriate…  ·  Admin →
  11. Allow DWU to scale without interruption

    The scaling disrupts the current session, and it's often not allowable in the production. Instead, it should finish off the existing session (sqls), and scale after that. That way, the scaling up or down can be done without causing the production disruption.

    105 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    5 comments  ·  Flag idea as inappropriate…  ·  Admin →
  12. Lower scale points for Dev/Test environments

    SQL Data Warehouse scale stepping should be much smaller (10 DWU or even 1 DWU), than 100 DWU!
    Please fix that ASAP!
    Thank you!

    101 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    10 comments  ·  Management  ·  Flag idea as inappropriate…  ·  Admin →

    Thank you for all the feedback folks. We are currently evaluating options for lower click stops for SQL Data Warehouse. Please continue to vote and comment on your scenario below. Thank you for your patience.

  13. Rename a column name in SQLDW

    Scenario: We want to change the column name as it is changed in the source. And in table where we are trying to do has more than 20Billion records.
    Workaround: Since rename of column is not possible currently in SQL DW we are doing CTAS of that big table.
    Issues With Work around: It is very slow because we can’t do CTAS on entire big table in single transaction because of transaction limits and we end up doing in CTAS and with multiple insert statements . Which is very time consuming process
    ASK: Please support column Rename

    94 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    under review  ·  5 comments  ·  T-SQL  ·  Flag idea as inappropriate…  ·  Admin →
  14. 94 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  Integration  ·  Flag idea as inappropriate…  ·  Admin →
  15. Provide File Format to read and load JSON and XML data from Storage

    Able to read the JSON and XML file as part of external system OR provide functionality like Extractor in Data Lake analytics so we can write our own Extractor to read respective data format.

    91 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    under review  ·  3 comments  ·  Loading  ·  Flag idea as inappropriate…  ·  Admin →
  16. @@ROWCOUNT Support

    Please enable @@ROWCOUNT?

    Furthermore considering that we cannot switch NOCOUNT on, then why should it be such a secret/coded mission to track the number of rows affected by the most recent snippet of code? The proposed work-around seems onerous and doesn't always work (for dynamic SQL) yet my query window still knows and always-prints the fact that it returned 15 rows to me, for example, so why can we not leverage this elementary information inside the selfsame query (?):

    SELECT SUM(row_count) AS row_count
    FROM sys.dm_pdw_sql_requests
    WHERE row_count <> -1
    AND request_id IN
    ( SELECT TOP 1 request_id
    FROM sys.dm_pdw_exec_requests
    WHERE…

    88 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    under review  ·  4 comments  ·  T-SQL  ·  Flag idea as inappropriate…  ·  Admin →
  17. Shrinkdatabase command support

    Shrinkdatabase command should to be supported even if TDE is on or off because extra cost is charged in case that the unallocated space is huge.

    86 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    2 comments  ·  Management  ·  Flag idea as inappropriate…  ·  Admin →
  18. Resource Governance - Resource Pools - Control CPU, physical IO, memory, priority, run-time cap, max request, concurrency, request timeout..

    1. Ability to manage workloads effectively
    2. Enables to specify limits on the amount of CPU, physical IO and memory
    3. User-Defined Resource Pools
    a. Memory size
    b. Memory cap
    c. CPU
    d. Maximum requests
    e. Grant time-out
    f. Priority
    g. Concurrency
    h. Run-time cap

    77 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    7 comments  ·  Management  ·  Flag idea as inappropriate…  ·  Admin →
  19. [In preview] More flexible date formats in Polybase

    This feedback item is currently in preview here:

    https://docs.microsoft.com/sql/t-sql/statements/copy-into-transact-sql?view=azure-sqldw-latest

    Polybase currently has very limited date format support. All of the acceptable date formats have dashes or slashes. For example, I can't define a date format of yyyyMMdd since it doesn't have slashes or dashes. Please allow any date format I can express.

    Also, please allow more than one date format per external table. For example, what if I have a date column as yyyyMMdd and then a different column as yyyyMMddHHmm. With only being able to define one date format in the CREATE EXTERNAL FILE FORMAT statement I think I…

    77 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    planned  ·  8 comments  ·  Loading  ·  Flag idea as inappropriate…  ·  Admin →
  20. offer a PaaS version of Master Data Services (MDS)

    Master Data Services is vitally important for data governance and enterprise data warehousing. Microsoft has a great PaaS data warehouse offer. But for MDS, customers must deploy SQL Server Enterprise on a VM.

    74 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    5 comments  ·  Flag idea as inappropriate…  ·  Admin →
← Previous 1 3 4 5 12 13
  • Don't see your idea?

Feedback and Knowledge Base