SQL Data Warehouse

Do you have an idea or suggestion based on your experience with SQL Data Warehouse? We would love to hear it! Please take a few minutes to submit your idea or vote up an idea submitted by another SQL Data Warehouse customer. All of the feedback you share in these forums will be monitored and reviewed by the SQL Data Warehouse engineering team. By suggesting or voting for ideas here, you will also be one of the first to know when we begin work on your feature requests and when we release the feature.

Remember that this site is only for feature suggestions and ideas! If you have technical questions please try our documentation, MSDN forum, or StackOverflow. If you need support, please open a support ticket with us.

How can we improve Microsoft Azure SQL Data Warehouse ?

(thinking…)

Enter your idea and we'll search to see if someone has already suggested it.

If a similar idea already exists, you can support and comment on it.

If it doesn't exist, you can post your idea so others can support it.

Enter your idea and we'll search to see if someone has already suggested it.

  • Hot ideas
  • Top ideas
  • New ideas
  • My feedback
  1. Database project from Visual Studio to support Azure SQL Data Warehouse

    Database project from Visual Studio is useful to manage DDLs, schema compare between the project and database, etc. Please create a project template dedicated for DW or support DW development from Database Project.

    412 votes
    Sign in
    Check!
    (thinking…)
    Reset
    or sign in with
    • facebook
    • google
      Password icon
      I agree to the terms of service
      Signed in as (Sign out)

      We’ll send you updates on this idea

      43 comments  ·  Integration  ·  Flag idea as inappropriate…  ·  Admin →

      We apologize this is taking longer than we’d like. As soon as this is on our roadmap, we will periodically reach out with updates. Please continue voting for this feature and comment on your scenario below. Thank you for all the feedback! 6882139

    • MERGE statement support

      Support the MERGE sql statement to support management of SCD1 / SCD2

      219 votes
      Sign in
      Check!
      (thinking…)
      Reset
      or sign in with
      • facebook
      • google
        Password icon
        I agree to the terms of service
        Signed in as (Sign out)

        We’ll send you updates on this idea

        8 comments  ·  T-SQL  ·  Flag idea as inappropriate…  ·  Admin →
      • PolyBase: allow skipping header rows in delimited text files

        Setting reject rows in Polybase to ignore the header row is a hack. And if you have all string columns your header won't be rejected. Please add an IGNORE_HEADER_ROWS = <numRows> option to Polybase

        174 votes
        Sign in
        Check!
        (thinking…)
        Reset
        or sign in with
        • facebook
        • google
          Password icon
          I agree to the terms of service
          Signed in as (Sign out)

          We’ll send you updates on this idea

          16 comments  ·  Polybase  ·  Flag idea as inappropriate…  ·  Admin →
        • PolyBase: allow escaping string delimiters within string fields

          If you want to quote the string columns, and if one of the quoted columns has a quote character in it, the proper way to encode this is to double the quote character. (Build a CSV file in Excel and you will see that's how it saves it. I would say Excel is the authority on CSV formats.)

          it appears it's impossible for Polybase to properly load that file. For example the following format is not interpreted right with STRING_DELIMITER = '"' since it divides the value 2.5" into two columns

          SizeDescription|SizeCode
          "3.5 feet"|"3.5 ft"
          "2.5 inches"|"2.5"""

          Please improve Polybase…

          122 votes
          Sign in
          Check!
          (thinking…)
          Reset
          or sign in with
          • facebook
          • google
            Password icon
            I agree to the terms of service
            Signed in as (Sign out)

            We’ll send you updates on this idea

            6 comments  ·  Polybase  ·  Flag idea as inappropriate…  ·  Admin →
          • Row-Level Security

            It would be great to implement Row-Level Security on SQL Data Warehouse.
            That would be a great solution for scenarios where (for example) we have clients like PowerBI using data from SQL warehouse, and persons who have limited data access.

            108 votes
            Sign in
            Check!
            (thinking…)
            Reset
            or sign in with
            • facebook
            • google
              Password icon
              I agree to the terms of service
              Signed in as (Sign out)

              We’ll send you updates on this idea

              2 comments  ·  Security  ·  Flag idea as inappropriate…  ·  Admin →
            • Polybase: allow field/row terminators within string fields

              If a line end is present within a text field (qualified) importing data using Polybase will fail.

              Loading this line will work fine:
              1;2.1;"zzzz"

              Loading this will fail:
              1;2.1;"zz
              zz"

              Code:

              CREATE EXTERNAL FILE FORMAT text_file_format_raw
              WITH
              (
              FORMAT_TYPE = DELIMITEDTEXT,
              FORMAT_OPTIONS
              (
              FIELD_TERMINATOR =';',
              STRING_DELIMITER = '0x22',
              USE_TYPE_DEFAULT = TRUE
              )
              );

              CREATE EXTERNAL TABLE dbo.test_external
              (
              col1 INT,
              col2 DECIMAL(2,1),
              col3 NVARCHAR(5)
              )
              WITH
              (
              LOCATION = 'test_failing.txt',
              DATA_SOURCE = azure_storage,
              FILE_FORMAT = text_file_format_raw
              );

              CREATE TABLE dbo.test
              WITH (CLUSTERED COLUMNSTORE INDEX, DISTRIBUTION = ROUND_ROBIN)
              AS
              SELECT * FROM dbo.test_external;

              106 votes
              Sign in
              Check!
              (thinking…)
              Reset
              or sign in with
              • facebook
              • google
                Password icon
                I agree to the terms of service
                Signed in as (Sign out)

                We’ll send you updates on this idea

                9 comments  ·  Polybase  ·  Flag idea as inappropriate…  ·  Admin →
              • Support for Entity Framework

                Support for Entity Framework in Azure SQL Data Warehouse would allow for greater usability in general, but it would also allow for better support of other frameworks/protocols. Specifically, we have a need to serve our data through an OData feed, and Entity Framework's deferred execution would allow us to handle OData's Query Options in a much simpler way.

                101 votes
                Sign in
                Check!
                (thinking…)
                Reset
                or sign in with
                • facebook
                • google
                  Password icon
                  I agree to the terms of service
                  Signed in as (Sign out)

                  We’ll send you updates on this idea

                  9 comments  ·  Integration  ·  Flag idea as inappropriate…  ·  Admin →
                • Cross Database Querying

                  Enable elastic query for SQL DW - this would allow cross database query in SQL DataWarehouse.

                  99 votes
                  Sign in
                  Check!
                  (thinking…)
                  Reset
                  or sign in with
                  • facebook
                  • google
                    Password icon
                    I agree to the terms of service
                    Signed in as (Sign out)

                    We’ll send you updates on this idea

                    6 comments  ·  Other  ·  Flag idea as inappropriate…  ·  Admin →
                  • PolyBase: allow retrieving rejected rows in an error file

                    Let's say you define an external table with:

                    REJECT_VALUE = 1000,
                    REJECT_TYPE = value

                    That means that it can reject and discard 1000 rows without failing the entire command.

                    Please enhance Polybase to give us visibility into which rows were rejected and why. I would propose you can define an error output file where rejected rows get written. Either that or let us query some DMV to get a copy of the complete row as a string and the error reason.

                    96 votes
                    Sign in
                    Check!
                    (thinking…)
                    Reset
                    or sign in with
                    • facebook
                    • google
                      Password icon
                      I agree to the terms of service
                      Signed in as (Sign out)

                      We’ll send you updates on this idea

                      9 comments  ·  Polybase  ·  Flag idea as inappropriate…  ·  Admin →
                    • 76 votes
                      Sign in
                      Check!
                      (thinking…)
                      Reset
                      or sign in with
                      • facebook
                      • google
                        Password icon
                        I agree to the terms of service
                        Signed in as (Sign out)

                        We’ll send you updates on this idea

                        1 comment  ·  Integration  ·  Flag idea as inappropriate…  ·  Admin →
                      • Support for spatial data type

                        Spatial data shlould be supported by SQL Data Warehouse the same way it is supported by SQL Server.

                        67 votes
                        Sign in
                        Check!
                        (thinking…)
                        Reset
                        or sign in with
                        • facebook
                        • google
                          Password icon
                          I agree to the terms of service
                          Signed in as (Sign out)

                          We’ll send you updates on this idea

                          3 comments  ·  Table Structure  ·  Flag idea as inappropriate…  ·  Admin →
                        • 63 votes
                          Sign in
                          Check!
                          (thinking…)
                          Reset
                          or sign in with
                          • facebook
                          • google
                            Password icon
                            I agree to the terms of service
                            Signed in as (Sign out)

                            We’ll send you updates on this idea

                            3 comments  ·  Security  ·  Flag idea as inappropriate…  ·  Admin →
                          • Support for Recursive CTE

                            It would be great if you can add support for recursive CTEs for computing hierarchical data

                            58 votes
                            Sign in
                            Check!
                            (thinking…)
                            Reset
                            or sign in with
                            • facebook
                            • google
                              Password icon
                              I agree to the terms of service
                              Signed in as (Sign out)

                              We’ll send you updates on this idea

                              2 comments  ·  Table Structure  ·  Flag idea as inappropriate…  ·  Admin →
                            • Resource Governance - Resource Pools - Control CPU, physical IO, memory, priority, run-time cap, max request, concurrency, request timeout..

                              1. Ability to manage workloads effectively
                              2. Enables to specify limits on the amount of CPU, physical IO and memory
                              3. User-Defined Resource Pools
                              a. Memory size
                              b. Memory cap
                              c. CPU
                              d. Maximum requests
                              e. Grant time-out
                              f. Priority
                              g. Concurrency
                              h. Run-time cap

                              57 votes
                              Sign in
                              Check!
                              (thinking…)
                              Reset
                              or sign in with
                              • facebook
                              • google
                                Password icon
                                I agree to the terms of service
                                Signed in as (Sign out)

                                We’ll send you updates on this idea

                                8 comments  ·  Management  ·  Flag idea as inappropriate…  ·  Admin →
                              • Use SELECT for setting variables (SELECT @MyVar = Col1, @MyVar1 = Col2 ...)

                                Because we cannot do SELECT @MyVar = Col1, we are forced to utilize the same code to execute the exact same sql, to assign multiple variables.

                                56 votes
                                Sign in
                                Check!
                                (thinking…)
                                Reset
                                or sign in with
                                • facebook
                                • google
                                  Password icon
                                  I agree to the terms of service
                                  Signed in as (Sign out)

                                  We’ll send you updates on this idea

                                  started  ·  0 comments  ·  T-SQL  ·  Flag idea as inappropriate…  ·  Admin →
                                • Provide File Format to read JSON and XML data from Storage

                                  Able to read the JSON and XML file as part of external system OR provide functionality like Extractor in Data Lake analytics so we can write our own Extractor to read respective data format.

                                  53 votes
                                  Sign in
                                  Check!
                                  (thinking…)
                                  Reset
                                  or sign in with
                                  • facebook
                                  • google
                                    Password icon
                                    I agree to the terms of service
                                    Signed in as (Sign out)

                                    We’ll send you updates on this idea

                                    3 comments  ·  Table Structure  ·  Flag idea as inappropriate…  ·  Admin →
                                  • Add support of JSON format

                                    Please add support of JSON data format like just happened for SQL Server 2016 and Azure SQL Database with JSON_VALUE, JSON_QUERY, etc.

                                    52 votes
                                    Sign in
                                    Check!
                                    (thinking…)
                                    Reset
                                    or sign in with
                                    • facebook
                                    • google
                                      Password icon
                                      I agree to the terms of service
                                      Signed in as (Sign out)

                                      We’ll send you updates on this idea

                                      2 comments  ·  Table Structure  ·  Flag idea as inappropriate…  ·  Admin →
                                    • ANSI joins support in UPDATE & DELETE statement

                                      SQL DW does not support to usual way of joins (ANSI) in UPDATE, DELETE statement. This makes difficult in case of table data modification. Though there is a workaround provided for CTAS this seems to be a lengthy process of data modification. Please have this feature available in SQL DW.

                                      52 votes
                                      Sign in
                                      Check!
                                      (thinking…)
                                      Reset
                                      or sign in with
                                      • facebook
                                      • google
                                        Password icon
                                        I agree to the terms of service
                                        Signed in as (Sign out)

                                        We’ll send you updates on this idea

                                        2 comments  ·  T-SQL  ·  Flag idea as inappropriate…  ·  Admin →
                                      • data warehouse scaling

                                        SQL Data Warehouse scale stepping should be much smaller (10 DWU or even 1 DWU), than 100 DWU!
                                        Please fix that ASAP!
                                        Thank you!

                                        48 votes
                                        Sign in
                                        Check!
                                        (thinking…)
                                        Reset
                                        or sign in with
                                        • facebook
                                        • google
                                          Password icon
                                          I agree to the terms of service
                                          Signed in as (Sign out)

                                          We’ll send you updates on this idea

                                          7 comments  ·  Management  ·  Flag idea as inappropriate…  ·  Admin →
                                        • @@ROWCOUNT Support

                                          Please enable @@ROWCOUNT?

                                          Furthermore considering that we cannot switch NOCOUNT on, then why should it be such a secret/coded mission to track the number of rows affected by the most recent snippet of code? The proposed work-around seems onerous and doesn't always work (for dynamic SQL) yet my query window still knows and always-prints the fact that it returned 15 rows to me, for example, so why can we not leverage this elementary information inside the selfsame query (?):

                                          SELECT SUM(row_count) AS row_count
                                          FROM sys.dm_pdw_sql_requests
                                          WHERE row_count <> -1
                                          AND request_id IN
                                          ( SELECT TOP 1 request_id
                                          FROM sys.dm_pdw_exec_requests
                                          WHERE…

                                          47 votes
                                          Sign in
                                          Check!
                                          (thinking…)
                                          Reset
                                          or sign in with
                                          • facebook
                                          • google
                                            Password icon
                                            I agree to the terms of service
                                            Signed in as (Sign out)

                                            We’ll send you updates on this idea

                                            1 comment  ·  T-SQL  ·  Flag idea as inappropriate…  ·  Admin →
                                          ← Previous 1 3 4 5 9 10
                                          • Don't see your idea?

                                          SQL Data Warehouse

                                          Feedback and Knowledge Base