SQL Data Warehouse

Do you have an idea or suggestion based on your experience with SQL Data Warehouse? We would love to hear it! Please take a few minutes to submit your idea or vote up an idea submitted by another SQL Data Warehouse customer. All of the feedback you share in these forums will be monitored and reviewed by the SQL Data Warehouse engineering team. By suggesting or voting for ideas here, you will also be one of the first to know when we begin work on your feature requests and when we release the feature.

Remember that this site is only for feature suggestions and ideas! If you have technical questions please try our documentation, MSDN forum, or StackOverflow. If you need support, please open a support ticket with us.

  • Hot ideas
  • Top ideas
  • New ideas
  • My feedback
  1. [In preview] PolyBase: allow escaping string delimiters within string fields

    This feedback item is currently in preview here:

    https://docs.microsoft.com/sql/t-sql/statements/copy-into-transact-sql?view=azure-sqldw-latest

    If you want to quote the string columns, and if one of the quoted columns has a quote character in it, the proper way to encode this is to double the quote character. (Build a CSV file in Excel and you will see that's how it saves it. I would say Excel is the authority on CSV formats.)

    it appears it's impossible for Polybase to properly load that file. For example the following format is not interpreted right with STRING_DELIMITER = '"' since it divides the value 2.5" into two columns

    223 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    started  ·  25 comments  ·  Loading  ·  Flag idea as inappropriate…  ·  Admin →
  2. [In preview] Polybase: allow field/row terminators within string fields

    This feedback item is currently in preview here:

    https://docs.microsoft.com/sql/t-sql/statements/copy-into-transact-sql?view=azure-sqldw-latest

    If a line end is present within a text field (qualified) importing data using Polybase will fail.

    Loading this line will work fine:
    1;2.1;"zzzz"

    Loading this will fail:
    1;2.1;"zz
    zz"

    Code:

    CREATE EXTERNAL FILE FORMAT textfileformat_raw
    WITH
    (

    FORMAT_TYPE = DELIMITEDTEXT,
    
    FORMAT_OPTIONS
    (
    FIELD_TERMINATOR =';',
    STRING_DELIMITER = '0x22',
    USE_TYPE_DEFAULT = TRUE
    )

    );

    CREATE EXTERNAL TABLE dbo.testexternal
    (
    col1 INT,
    col2 DECIMAL(2,1),
    col3 NVARCHAR(5)
    )
    WITH
    (
    LOCATION = 'test
    failing.txt',
    DATASOURCE = azurestorage,
    FILEFORMAT = textfileformatraw

    );

    CREATE TABLE dbo.test
    WITH…

    222 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    started  ·  23 comments  ·  Loading  ·  Flag idea as inappropriate…  ·  Admin →
  3. ANSI joins support in UPDATE & DELETE statement

    SQL DW does not support to usual way of joins (ANSI) in UPDATE, DELETE statement. This makes difficult in case of table data modification. Though there is a workaround provided for CTAS this seems to be a lengthy process of data modification. Please have this feature available in SQL DW.

    116 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    started  ·  3 comments  ·  T-SQL  ·  Flag idea as inappropriate…  ·  Admin →
  4. Resource Governance - Resource Pools - Control CPU, physical IO, memory, priority, run-time cap, max request, concurrency, request timeout..


    1. Ability to manage workloads effectively

    2. Enables to specify limits on the amount of CPU, physical IO and memory

    3. User-Defined Resource Pools
      a. Memory size
      b. Memory cap
      c. CPU
      d. Maximum requests
      e. Grant time-out
      f. Priority
      g. Concurrency
      h. Run-time cap

    77 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    7 comments  ·  Management  ·  Flag idea as inappropriate…  ·  Admin →
  5. hash distribute fact table on multiple columns

    A large fact table often has multiple join keys to multiple dimension table, so while it can be opitmised for one join it always creates data movement for other joins. The hash distribution should accept multiple columns so all joins are optimised and create no data movement for dimension joins.

    72 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    3 comments  ·  Performance  ·  Flag idea as inappropriate…  ·  Admin →
  6. 55 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    started  ·  2 comments  ·  Loading  ·  Flag idea as inappropriate…  ·  Admin →
  7. Automatic Generation and Updating of table statistic

    It would be great if table statistics were automatically created and updated in Azure Data Warehouse.

    50 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    5 comments  ·  Management  ·  Flag idea as inappropriate…  ·  Admin →
  8. [In preview] Import files via single COPY command from blob store.

    This feedback item is currently in preview here:

    https://docs.microsoft.com/sql/t-sql/statements/copy-into-transact-sql?view=azure-sqldw-latest

    It shouldn't require 5+ unintelligible queries just to import a file from blob store. Redshift lets me import files (including zipped files) from S3 with a single COPY command.

    44 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    started  ·  0 comments  ·  Loading  ·  Flag idea as inappropriate…  ·  Admin →
  9. Resource class override

    Having a fixed resource class assigned to a user is too rigid. Most queries can be executed efficiently with a small resource class, but certain operations (e.g. rebuild index) should be run with a larger RC. I need to switch between several user accounts just to be able to have appropriate resources for whatever operation or query I need to run. Users assigned to xlargerc can only execute a single query at a time.

    Would be great to be able to set/change the resource class used for executing each statement. Alternatively, being able to execute as a different user could…

    42 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    4 comments  ·  Performance  ·  Flag idea as inappropriate…  ·  Admin →

    We announced workload isolation via workload groups for public preview at Ignite in Nov., 2019. Workload groups allow you to create your own custom resource classes (among other things). Check out workload classification that allows you to assign requests by more than just login information too!

  10. Support for Large Objects in External Tables

    While you can read and write to blob storage with large objects like varchar(max) now you can't read them via external tables.

    E.g. If you define a field with varchar(max) in an external table you can't use it you need to use BCP or SSIS to get it into a physical table that is a heap or supported indexed table.

    Msg 102048, Level 16, State 1, Line 56
    Columns with large object types are not supported in external tables.

    36 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    17 comments  ·  Loading  ·  Flag idea as inappropriate…  ·  Admin →
  11. Support EXECUTE AS for stored procedures

    As part of the ELT procedure the user staging data should be able to call a transform procedure to ingest the data without having read/write permissions to the production tables.

    26 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    4 comments  ·  Security  ·  Flag idea as inappropriate…  ·  Admin →
  12. Better Database & Query Monitoring through Azure Portal

    Enable a better experience when it comes to monitoring and analysis of queries and DWH/query performance. Currently the SQL DW blade in the Azure Portal does only show very basic information about queries and their execution as well as DTUs with no possibility to customize the charts or the (query) lists. Only the last 50 queries are shown in this list, there are no overall reports and statistics (long running queries), there is no possibility to filter this list or show other metrics. Please enable a similar experience for monitoring of query and DB performance like SQL DB offers (Query…

    23 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Performance  ·  Flag idea as inappropriate…  ·  Admin →

    We are actively improving our monitoring experience. We have future improvements on our road map such as Query Data Store and integrating with Azure Monitor (logs and metrics) for near real time troubleshooting in the Azure portal. If anyone has any other feedback, please elaborate on your scenario on this thread and have your team continue to vote. Thank you for your continued support!

  13. Assign a private IP from VNET

    The current VNET endpoint solution does not allow connections via expressroute.

    Allow a private IP from the VNET to be assigned to the data warehouse, so that we can easily route to the warehouse from on prem, via expressroute. Removing the need for any complex peering or other IT infrastructure involvement.

    9 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    started  ·  0 comments  ·  Management  ·  Flag idea as inappropriate…  ·  Admin →
  14. Support "DATEDIFF_BIG", like Azure SQL

    pretty useful for device data (IoT), often has in sub seconds

    8 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  T-SQL  ·  Flag idea as inappropriate…  ·  Admin →
  15. 6 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Performance  ·  Flag idea as inappropriate…  ·  Admin →

    We announced some of these capabilities for preview at Ignite this Nov., 2019. Workload groups allow for reserving and capping resources. You can also configure a query timeout to cancel a query.

  16. Support the sp_describe_undeclared_parameters system stored procedure

    SSIS scripts often use this system stored procedure to investigate parameter types.

    5 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  T-SQL  ·  Flag idea as inappropriate…  ·  Admin →
  17. challenges with concurrency model

    Challenges with concurrency model
    o The partner would like more control on how many concurrency slots a query has
    o The partner suggests that the concurrency slot choices are too limiting (1,2,4,8,16,32,64). They would like to choose the number of slots 1-80
    o The partner would like to be able to dynamically change the number of slots - or have the system dynamically change for them
    o An example of the rigidity is if the partner has 2000 DWUs - and thus 80 concurrency slots - and they have a large query running taking 64 slots, another large query would…

    5 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →

    We announced workload isolation with workload groups for preview at Ignite Nov., 2019. Workload groups allow you to specify a decimal amount of resources per request. There is no notion of concurrency slots anymore.

  18. CONCAT_WS

    Add CONCAT_WS in Azure SQL DW. It exists in SQL Azure but not in Azure DW.

    5 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    2 comments  ·  Flag idea as inappropriate…  ·  Admin →
  19. UPDATE FROM Support

    Updates/Deletes do not support FROM clause. To update a table with values from another we need to create temporary tables (CTAS) and run loops.

    3 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    started  ·  0 comments  ·  T-SQL  ·  Flag idea as inappropriate…  ·  Admin →
  • Don't see your idea?

Feedback and Knowledge Base