SQL Data Warehouse

Do you have an idea or suggestion based on your experience with SQL Data Warehouse? We would love to hear it! Please take a few minutes to submit your idea or vote up an idea submitted by another SQL Data Warehouse customer. All of the feedback you share in these forums will be monitored and reviewed by the SQL Data Warehouse engineering team. By suggesting or voting for ideas here, you will also be one of the first to know when we begin work on your feature requests and when we release the feature.

Remember that this site is only for feature suggestions and ideas! If you have technical questions please try our documentation, MSDN forum, or StackOverflow. If you need support, please open a support ticket with us.

How can we improve Microsoft Azure SQL Data Warehouse ?

(thinking…)

Enter your idea and we'll search to see if someone has already suggested it.

If a similar idea already exists, you can support and comment on it.

If it doesn't exist, you can post your idea so others can support it.

Enter your idea and we'll search to see if someone has already suggested it.

  • Hot ideas
  • Top ideas
  • New ideas
  • My feedback
  1. Add Split_part function to SQL DW

    Just enable what's already in SQL (STRING_SPLIT) - it's the closest I've found to Redshift SPLIT_PART.

    2 votes
    Sign in
    Check!
    (thinking…)
    Reset
    or sign in with
    • facebook
    • google
      Password icon
      I agree to the terms of service
      Signed in as (Sign out)

      We’ll send you updates on this idea

      0 comments  ·  Flag idea as inappropriate…  ·  Admin →
    • Allow Bulk insert from blob storage

      Due to the limitations currently in polybase its not an option for a lot of data sources. It would be great to be able to use bulk insert off blob storage like what is enabled in Azure SQL database as an option at least in the meantime.

      1 vote
      Sign in
      Check!
      (thinking…)
      Reset
      or sign in with
      • facebook
      • google
        Password icon
        I agree to the terms of service
        Signed in as (Sign out)

        We’ll send you updates on this idea

        0 comments  ·  Integration  ·  Flag idea as inappropriate…  ·  Admin →
      • Limit the size of ORC files produced by CREATE EXTERNAL TABLE AS SELECT command

        Recently I worked with Microsoft support on an issue using CREATE TABLE AS SELECT to import data from external tables using ORC file format. Most queries completed just fine, but some ran into errors like "Java heap space". Those queries were hitting external tables backed by huge ORC files (ranged from 17GB to 33GB per file). The product team confirmed there is a design limit that makes those files unqualified. I then split the files further down to less than 12GB per file (total data volume was kept the same) and the CTAS queries then ran just fine.
        So obviously…

        1 vote
        Sign in
        Check!
        (thinking…)
        Reset
        or sign in with
        • facebook
        • google
          Password icon
          I agree to the terms of service
          Signed in as (Sign out)

          We’ll send you updates on this idea

          0 comments  ·  Polybase  ·  Flag idea as inappropriate…  ·  Admin →
        • Grant DDL, DML rights with expiry date

          Some time, we need to give access on production environment for a certain time period, either its select, ddl or dml. Currently its a manual process to revoke the access or we have to develop a process and routines to revoke them. It will be good if we could provide an expiry date with the grant statement it self and DBMS engine should auto take care of expiry on that date.

          1 vote
          Sign in
          Check!
          (thinking…)
          Reset
          or sign in with
          • facebook
          • google
            Password icon
            I agree to the terms of service
            Signed in as (Sign out)

            We’ll send you updates on this idea

            1 comment  ·  T-SQL  ·  Flag idea as inappropriate…  ·  Admin →
          • database level firewall

            The following documentation states that a database level firewall works for Azure SQL DW databases:
            https://docs.microsoft.com/en-us/sql/relational-databases/system-stored-procedures/sp-set-database-firewall-rule-azure-sql-database

            However, running the syntax mentioned results in the error:
            Msg 15165, Level 16, State 1, Line 1
            Could not find object 'sp_set_database_firewall_rule' or you do not have permission.

            Please add or fix support for the database-level firewall in Azure SQL DW

            1 vote
            Sign in
            Check!
            (thinking…)
            Reset
            or sign in with
            • facebook
            • google
              Password icon
              I agree to the terms of service
              Signed in as (Sign out)

              We’ll send you updates on this idea

              0 comments  ·  Security  ·  Flag idea as inappropriate…  ·  Admin →
            • 2 votes
              Sign in
              Check!
              (thinking…)
              Reset
              or sign in with
              • facebook
              • google
                Password icon
                I agree to the terms of service
                Signed in as (Sign out)

                We’ll send you updates on this idea

                1 comment  ·  T-SQL  ·  Flag idea as inappropriate…  ·  Admin →
              • Add support for the truncate partition option

                Add support for the option to truncate a single partition in a table (as per sql azure and sql 2016).

                https://docs.microsoft.com/en-us/sql/t-sql/statements/truncate-table-transact-sql

                1 vote
                Sign in
                Check!
                (thinking…)
                Reset
                or sign in with
                • facebook
                • google
                  Password icon
                  I agree to the terms of service
                  Signed in as (Sign out)

                  We’ll send you updates on this idea

                  0 comments  ·  T-SQL  ·  Flag idea as inappropriate…  ·  Admin →
                • Hide schema objects based on role

                  We want to hide dbo and other custom schemas from users. We have stage, test, dbo, etc. objects in the DW. We would like to limit the schemas and/or objects that we expose to them through SQL Roles. We can limit their ability to query a certain schema, but I want to limit their ability to see it

                  2 votes
                  Sign in
                  Check!
                  (thinking…)
                  Reset
                  or sign in with
                  • facebook
                  • google
                    Password icon
                    I agree to the terms of service
                    Signed in as (Sign out)

                    We’ll send you updates on this idea

                    0 comments  ·  Security  ·  Flag idea as inappropriate…  ·  Admin →
                  • Support for Clustered Column Store indexes on large objects

                    Support clustered column store indexes on large objects like varchar(max)/nvarchar(max)

                    1 vote
                    Sign in
                    Check!
                    (thinking…)
                    Reset
                    or sign in with
                    • facebook
                    • google
                      Password icon
                      I agree to the terms of service
                      Signed in as (Sign out)

                      We’ll send you updates on this idea

                      1 comment  ·  Table Structure  ·  Flag idea as inappropriate…  ·  Admin →
                    • Support for Large Objects in External Tables

                      While you can read and write to blob storage with large objects like varchar(max) now you can't read them via external tables.

                      E.g. If you define a field with varchar(max) in an external table you can't use it you need to use BCP or SSIS to get it into a physical table that is a heap or supported indexed table.

                      Msg 102048, Level 16, State 1, Line 56
                      Columns with large object types are not supported in external tables.

                      5 votes
                      Sign in
                      Check!
                      (thinking…)
                      Reset
                      or sign in with
                      • facebook
                      • google
                        Password icon
                        I agree to the terms of service
                        Signed in as (Sign out)

                        We’ll send you updates on this idea

                        0 comments  ·  Polybase  ·  Flag idea as inappropriate…  ·  Admin →
                      • Polybase: PARTITIONED BY functionality when creating external tables.

                        I have a large number of files which are read with Hive using a partitioning scheme. PARTITIONED BY functionality, which is so commonly used in HIVE is missing from polybase.

                        5 votes
                        Sign in
                        Check!
                        (thinking…)
                        Reset
                        or sign in with
                        • facebook
                        • google
                          Password icon
                          I agree to the terms of service
                          Signed in as (Sign out)

                          We’ll send you updates on this idea

                          0 comments  ·  Polybase  ·  Flag idea as inappropriate…  ·  Admin →
                        • Enable Integrity and Privacy options for hadoop.rpc.protection setting

                          Enable Integrity and Privacy options for hadoop.rpc.protection setting.
                          Currently it only connects to Cloudera when set to Authentication, this doesn't provide sufficient security for storing/processing sensitive data.

                          MS Work Items: 9519053 and 10001755.

                          25 votes
                          Sign in
                          Check!
                          (thinking…)
                          Reset
                          or sign in with
                          • facebook
                          • google
                            Password icon
                            I agree to the terms of service
                            Signed in as (Sign out)

                            We’ll send you updates on this idea

                            1 comment  ·  Polybase  ·  Flag idea as inappropriate…  ·  Admin →
                          • Type as Functionality Like SQL

                            As provided in SQL, I want to use TYPE AS Table in DW stored procedure.

                            1 vote
                            Sign in
                            Check!
                            (thinking…)
                            Reset
                            or sign in with
                            • facebook
                            • google
                              Password icon
                              I agree to the terms of service
                              Signed in as (Sign out)

                              We’ll send you updates on this idea

                              0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                            • Load subset of files in Azure blob storage to SQL data warehouse

                              Let's say we have following files in Azure blob storage with same file format but different number/type of data in their columns:
                              fileA_1.csv
                              fileA_2.csv
                              fileB_1.csv
                              fileB_2.csv

                              If PolyBase supports defining data source to blob storage with defined file title format (for instance: WHERE file.name = 'fileA_*.csv'), we will be able to transfer various files from same location to desired external tables.

                              2 votes
                              Sign in
                              Check!
                              (thinking…)
                              Reset
                              or sign in with
                              • facebook
                              • google
                                Password icon
                                I agree to the terms of service
                                Signed in as (Sign out)

                                We’ll send you updates on this idea

                                0 comments  ·  Polybase  ·  Flag idea as inappropriate…  ·  Admin →
                              • unit test framework

                                The open source tsqlt framework requires CLR which is not available in Azure SQL DW. A framework to to write unit tests would increase trust in the queries.

                                5 votes
                                Sign in
                                Check!
                                (thinking…)
                                Reset
                                or sign in with
                                • facebook
                                • google
                                  Password icon
                                  I agree to the terms of service
                                  Signed in as (Sign out)

                                  We’ll send you updates on this idea

                                  1 comment  ·  Reliability  ·  Flag idea as inappropriate…  ·  Admin →
                                • Explain plan in SSMS returned as XML data type

                                  In SSDT if you connect a query window to Azure SQL DW and put EXPLAIN in front of a query and run it you get back an XML data type column and clicking on the XML pops open a new XML window.

                                  In SSMS when you do the same the column is a text column, not XML. As a result, most large explain plans get truncated because the length of a text column returned in SSMS is smaller than the length of an XML column.

                                  Please change EXPLAIN plan queries to return as XML data type so that it's more…

                                  2 votes
                                  Sign in
                                  Check!
                                  (thinking…)
                                  Reset
                                  or sign in with
                                  • facebook
                                  • google
                                    Password icon
                                    I agree to the terms of service
                                    Signed in as (Sign out)

                                    We’ll send you updates on this idea

                                    0 comments  ·  Management  ·  Flag idea as inappropriate…  ·  Admin →
                                  • Not to be locked at CREATE / DROP USER

                                    If you execute CREATE / DROP USER during updating query execution, a wait occurs when trying to acquire an exclusive lock.

                                    10 votes
                                    Sign in
                                    Check!
                                    (thinking…)
                                    Reset
                                    or sign in with
                                    • facebook
                                    • google
                                      Password icon
                                      I agree to the terms of service
                                      Signed in as (Sign out)

                                      We’ll send you updates on this idea

                                      0 comments  ·  T-SQL  ·  Flag idea as inappropriate…  ·  Admin →
                                    • Blend with azure sql as a node

                                      Would want to do this is restricted special curcumstances:

                                      Add Azure sql db as another worker mode so that queries can run across both the cold and hot data from one interface. Specify resource constraints on the hot data queries and automatic data migrations (based on rules?) between environments. Bonus if this could on on-prem environments.

                                      1 vote
                                      Sign in
                                      Check!
                                      (thinking…)
                                      Reset
                                      or sign in with
                                      • facebook
                                      • google
                                        Password icon
                                        I agree to the terms of service
                                        Signed in as (Sign out)

                                        We’ll send you updates on this idea

                                        0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                                      • Support of StorageTable as DataSource

                                        Please add support of Azure TableStorage as PolyBase DataSource.
                                        To be honest I can't believe its not already available. :O

                                        17 votes
                                        Sign in
                                        Check!
                                        (thinking…)
                                        Reset
                                        or sign in with
                                        • facebook
                                        • google
                                          Password icon
                                          I agree to the terms of service
                                          Signed in as (Sign out)

                                          We’ll send you updates on this idea

                                          0 comments  ·  Polybase  ·  Flag idea as inappropriate…  ·  Admin →
                                        • unicode compression

                                          Support Unicode compression or similar.

                                          As per https://docs.microsoft.com/en-us/sql/relational-databases/data-compression/data-compression unicode compression is not supported in SQL DW.

                                          We currently have to trade-off between significantly increased data size and support for non-latin characters. With predominantly latin data it would be good to not have to choose.

                                          1 vote
                                          Sign in
                                          Check!
                                          (thinking…)
                                          Reset
                                          or sign in with
                                          • facebook
                                          • google
                                            Password icon
                                            I agree to the terms of service
                                            Signed in as (Sign out)

                                            We’ll send you updates on this idea

                                            0 comments  ·  Performance  ·  Flag idea as inappropriate…  ·  Admin →
                                          ← Previous 1 3 4 5 8 9
                                          • Don't see your idea?

                                          Feedback and Knowledge Base