SQL Data Warehouse

Do you have an idea or suggestion based on your experience with SQL Data Warehouse? We would love to hear it! Please take a few minutes to submit your idea or vote up an idea submitted by another SQL Data Warehouse customer. All of the feedback you share in these forums will be monitored and reviewed by the SQL Data Warehouse engineering team. By suggesting or voting for ideas here, you will also be one of the first to know when we begin work on your feature requests and when we release the feature.

Remember that this site is only for feature suggestions and ideas! If you have technical questions please try our documentation, MSDN forum, or StackOverflow. If you need support, please open a support ticket with us.

How can we improve Microsoft Azure SQL Data Warehouse ?

(thinking…)

Enter your idea and we'll search to see if someone has already suggested it.

If a similar idea already exists, you can support and comment on it.

If it doesn't exist, you can post your idea so others can support it.

Enter your idea and we'll search to see if someone has already suggested it.

  • Hot ideas
  • Top ideas
  • New ideas
  • My feedback
  1. MERGE statement support

    Support the MERGE sql statement to support management of SCD1 / SCD2

    260 votes
    Sign in
    Check!
    (thinking…)
    Reset
    or sign in with
    • facebook
    • google
      Password icon
      Signed in as (Sign out)

      We’ll send you updates on this idea

      9 comments  ·  T-SQL  ·  Flag idea as inappropriate…  ·  Admin →
    • PolyBase: allow escaping string delimiters within string fields

      If you want to quote the string columns, and if one of the quoted columns has a quote character in it, the proper way to encode this is to double the quote character. (Build a CSV file in Excel and you will see that's how it saves it. I would say Excel is the authority on CSV formats.)

      it appears it's impossible for Polybase to properly load that file. For example the following format is not interpreted right with STRING_DELIMITER = '"' since it divides the value 2.5" into two columns

      SizeDescription|SizeCode
      "3.5 feet"|"3.5 ft"
      "2.5 inches"|"2.5"""

      Please improve Polybase…

      147 votes
      Sign in
      Check!
      (thinking…)
      Reset
      or sign in with
      • facebook
      • google
        Password icon
        Signed in as (Sign out)

        We’ll send you updates on this idea

        11 comments  ·  Polybase  ·  Flag idea as inappropriate…  ·  Admin →
      • Row-Level Security

        It would be great to implement Row-Level Security on SQL Data Warehouse.
        That would be a great solution for scenarios where (for example) we have clients like PowerBI using data from SQL warehouse, and persons who have limited data access.

        139 votes
        Sign in
        Check!
        (thinking…)
        Reset
        or sign in with
        • facebook
        • google
          Password icon
          Signed in as (Sign out)

          We’ll send you updates on this idea

          3 comments  ·  Security  ·  Flag idea as inappropriate…  ·  Admin →
        • Polybase: allow field/row terminators within string fields

          If a line end is present within a text field (qualified) importing data using Polybase will fail.

          Loading this line will work fine:
          1;2.1;"zzzz"

          Loading this will fail:
          1;2.1;"zz
          zz"

          Code:

          CREATE EXTERNAL FILE FORMAT text_file_format_raw
          WITH
          (
          FORMAT_TYPE = DELIMITEDTEXT,
          FORMAT_OPTIONS
          (
          FIELD_TERMINATOR =';',
          STRING_DELIMITER = '0x22',
          USE_TYPE_DEFAULT = TRUE
          )
          );

          CREATE EXTERNAL TABLE dbo.test_external
          (
          col1 INT,
          col2 DECIMAL(2,1),
          col3 NVARCHAR(5)
          )
          WITH
          (
          LOCATION = 'test_failing.txt',
          DATA_SOURCE = azure_storage,
          FILE_FORMAT = text_file_format_raw
          );

          CREATE TABLE dbo.test
          WITH (CLUSTERED COLUMNSTORE INDEX, DISTRIBUTION = ROUND_ROBIN)
          AS
          SELECT * FROM dbo.test_external;

          134 votes
          Sign in
          Check!
          (thinking…)
          Reset
          or sign in with
          • facebook
          • google
            Password icon
            Signed in as (Sign out)

            We’ll send you updates on this idea

            11 comments  ·  Polybase  ·  Flag idea as inappropriate…  ·  Admin →
          • Cross Database Querying

            Enable elastic query for SQL DW - this would allow cross database query in SQL DataWarehouse.

            120 votes
            Sign in
            Check!
            (thinking…)
            Reset
            or sign in with
            • facebook
            • google
              Password icon
              Signed in as (Sign out)

              We’ll send you updates on this idea

              6 comments  ·  Other  ·  Flag idea as inappropriate…  ·  Admin →
            • Support for Entity Framework

              Support for Entity Framework in Azure SQL Data Warehouse would allow for greater usability in general, but it would also allow for better support of other frameworks/protocols. Specifically, we have a need to serve our data through an OData feed, and Entity Framework's deferred execution would allow us to handle OData's Query Options in a much simpler way.

              115 votes
              Sign in
              Check!
              (thinking…)
              Reset
              or sign in with
              • facebook
              • google
                Password icon
                Signed in as (Sign out)

                We’ll send you updates on this idea

                9 comments  ·  Integration  ·  Flag idea as inappropriate…  ·  Admin →
              • 84 votes
                Sign in
                Check!
                (thinking…)
                Reset
                or sign in with
                • facebook
                • google
                  Password icon
                  Signed in as (Sign out)

                  We’ll send you updates on this idea

                  1 comment  ·  Integration  ·  Flag idea as inappropriate…  ·  Admin →
                • 76 votes
                  Sign in
                  Check!
                  (thinking…)
                  Reset
                  or sign in with
                  • facebook
                  • google
                    Password icon
                    Signed in as (Sign out)

                    We’ll send you updates on this idea

                    3 comments  ·  Security  ·  Flag idea as inappropriate…  ·  Admin →
                  • Add support of JSON format

                    Please add support of JSON data format like just happened for SQL Server 2016 and Azure SQL Database with JSON_VALUE, JSON_QUERY, etc.

                    75 votes
                    Sign in
                    Check!
                    (thinking…)
                    Reset
                    or sign in with
                    • facebook
                    • google
                      Password icon
                      Signed in as (Sign out)

                      We’ll send you updates on this idea

                      2 comments  ·  Table Structure  ·  Flag idea as inappropriate…  ·  Admin →
                    • Support for spatial data type

                      Spatial data shlould be supported by SQL Data Warehouse the same way it is supported by SQL Server.

                      75 votes
                      Sign in
                      Check!
                      (thinking…)
                      Reset
                      or sign in with
                      • facebook
                      • google
                        Password icon
                        Signed in as (Sign out)

                        We’ll send you updates on this idea

                        5 comments  ·  Table Structure  ·  Flag idea as inappropriate…  ·  Admin →
                      • Support for Recursive CTE

                        It would be great if you can add support for recursive CTEs for computing hierarchical data

                        73 votes
                        Sign in
                        Check!
                        (thinking…)
                        Reset
                        or sign in with
                        • facebook
                        • google
                          Password icon
                          Signed in as (Sign out)

                          We’ll send you updates on this idea

                          under review  ·  3 comments  ·  Table Structure  ·  Flag idea as inappropriate…  ·  Admin →
                        • ANSI joins support in UPDATE & DELETE statement

                          SQL DW does not support to usual way of joins (ANSI) in UPDATE, DELETE statement. This makes difficult in case of table data modification. Though there is a workaround provided for CTAS this seems to be a lengthy process of data modification. Please have this feature available in SQL DW.

                          71 votes
                          Sign in
                          Check!
                          (thinking…)
                          Reset
                          or sign in with
                          • facebook
                          • google
                            Password icon
                            Signed in as (Sign out)

                            We’ll send you updates on this idea

                            2 comments  ·  T-SQL  ·  Flag idea as inappropriate…  ·  Admin →
                          • data warehouse scaling

                            SQL Data Warehouse scale stepping should be much smaller (10 DWU or even 1 DWU), than 100 DWU!
                            Please fix that ASAP!
                            Thank you!

                            68 votes
                            Sign in
                            Check!
                            (thinking…)
                            Reset
                            or sign in with
                            • facebook
                            • google
                              Password icon
                              Signed in as (Sign out)

                              We’ll send you updates on this idea

                              8 comments  ·  Management  ·  Flag idea as inappropriate…  ·  Admin →

                              Thank you for all the feedback folks. We are currently evaluating options for lower click stops for SQL Data Warehouse. Please continue to vote and comment on your scenario below. Thank you for your patience.

                            • Provide File Format to read JSON and XML data from Storage

                              Able to read the JSON and XML file as part of external system OR provide functionality like Extractor in Data Lake analytics so we can write our own Extractor to read respective data format.

                              65 votes
                              Sign in
                              Check!
                              (thinking…)
                              Reset
                              or sign in with
                              • facebook
                              • google
                                Password icon
                                Signed in as (Sign out)

                                We’ll send you updates on this idea

                                3 comments  ·  Table Structure  ·  Flag idea as inappropriate…  ·  Admin →
                              • More flexible date formats in Polybase

                                Polybase currently has very limited date format support. All of the acceptable date formats have dashes or slashes. For example, I can't define a date format of yyyyMMdd since it doesn't have slashes or dashes. Please allow any date format I can express.

                                Also, please allow more than one date format per external table. For example, what if I have a date column as yyyyMMdd and then a different column as yyyyMMddHHmm. With only being able to define one date format in the CREATE EXTERNAL FILE FORMAT statement I think I can't handle both formats.

                                56 votes
                                Sign in
                                Check!
                                (thinking…)
                                Reset
                                or sign in with
                                • facebook
                                • google
                                  Password icon
                                  Signed in as (Sign out)

                                  We’ll send you updates on this idea

                                  8 comments  ·  Polybase  ·  Flag idea as inappropriate…  ·  Admin →
                                • @@ROWCOUNT Support

                                  Please enable @@ROWCOUNT?

                                  Furthermore considering that we cannot switch NOCOUNT on, then why should it be such a secret/coded mission to track the number of rows affected by the most recent snippet of code? The proposed work-around seems onerous and doesn't always work (for dynamic SQL) yet my query window still knows and always-prints the fact that it returned 15 rows to me, for example, so why can we not leverage this elementary information inside the selfsame query (?):

                                  SELECT SUM(row_count) AS row_count
                                  FROM sys.dm_pdw_sql_requests
                                  WHERE row_count <> -1
                                  AND request_id IN
                                  ( SELECT TOP 1 request_id
                                  FROM sys.dm_pdw_exec_requests
                                  WHERE…

                                  55 votes
                                  Sign in
                                  Check!
                                  (thinking…)
                                  Reset
                                  or sign in with
                                  • facebook
                                  • google
                                    Password icon
                                    Signed in as (Sign out)

                                    We’ll send you updates on this idea

                                    1 comment  ·  T-SQL  ·  Flag idea as inappropriate…  ·  Admin →
                                  • Allow DWU to scale without interruption

                                    The scaling disrupts the current session, and it's often not allowable in the production. Instead, it should finish off the existing session (sqls), and scale after that. That way, the scaling up or down can be done without causing the production disruption.

                                    47 votes
                                    Sign in
                                    Check!
                                    (thinking…)
                                    Reset
                                    or sign in with
                                    • facebook
                                    • google
                                      Password icon
                                      Signed in as (Sign out)

                                      We’ll send you updates on this idea

                                      4 comments  ·  Flag idea as inappropriate…  ·  Admin →
                                    • hash distribute fact table on multiple columns

                                      A large fact table often has multiple join keys to multiple dimension table, so while it can be opitmised for one join it always creates data movement for other joins. The hash distribution should accept multiple columns so all joins are optimised and create no data movement for dimension joins.

                                      46 votes
                                      Sign in
                                      Check!
                                      (thinking…)
                                      Reset
                                      or sign in with
                                      • facebook
                                      • google
                                        Password icon
                                        Signed in as (Sign out)

                                        We’ll send you updates on this idea

                                        3 comments  ·  Performance  ·  Flag idea as inappropriate…  ·  Admin →
                                      • PolyBase: Support newline/carriage return in delimited text

                                        Polybase fails to read rows if a [delimited] text column contains a newline/carriage return character even if they are within a text delimiters

                                        take this example: I write a line to a external table using CETAS and cannot read the very same table again:

                                        CREATE EXTERNAL TABLE stage.testNewLine WITH
                                        (
                                        LOCATION = 'archive/NewLine',
                                        DATA_SOURCE = myDatasource,
                                        FILE_FORMAT = myFormat
                                        )
                                        AS
                                        SELECT
                                        'regular Text' AS Col1,
                                        'Line1
                                        Line2' AS Col2

                                        SELECT *
                                        FROM stage.testNewLine

                                        Everything that is written to SQL DW using INSERT should be able to be retrieved again using SELECT

                                        45 votes
                                        Sign in
                                        Check!
                                        (thinking…)
                                        Reset
                                        or sign in with
                                        • facebook
                                        • google
                                          Password icon
                                          Signed in as (Sign out)

                                          We’ll send you updates on this idea

                                          1 comment  ·  Polybase  ·  Flag idea as inappropriate…  ·  Admin →
                                        • Add support for synonyms

                                          CTAS to a new table is often a pattern that's used in DW for data processing workloads. Instead of RENAME OBJECT operations from old tables to the new ones using CTAS, it would be great if we can add synonym support to DW, so that switching to the new table is an atomic operation, and is reliable.

                                          44 votes
                                          Sign in
                                          Check!
                                          (thinking…)
                                          Reset
                                          or sign in with
                                          • facebook
                                          • google
                                            Password icon
                                            Signed in as (Sign out)

                                            We’ll send you updates on this idea

                                            2 comments  ·  Other  ·  Flag idea as inappropriate…  ·  Admin →
                                          ← Previous 1 3 4 5
                                          • Don't see your idea?

                                          SQL Data Warehouse

                                          Feedback and Knowledge Base