Azure Synapse Analytics

We would love to hear your ideas for new features for Azure Synapse Analytics. Below, enter a new idea or upvote an existing one. The Synapse engineering team pays attention to all requests.

If instead you need a technical question answered or help, try the these options: DocumentationMSDN forum, and StackOverflow. If you need support, please open a support ticket.

  • Hot ideas
  • Top ideas
  • New ideas
  • My feedback
  1. Polybase: PARTITIONED BY functionality when creating external tables.

    I have a large number of files which are read with Hive using a partitioning scheme. PARTITIONED BY functionality, which is so commonly used in HIVE is missing from polybase.

    103 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    15 comments  ·  SQL/Polybase  ·  Flag idea as inappropriate…  ·  Admin →
  2. Add support for "Delta Lake" file format in Azure Data Lake Store / HDFS

    Today we can query data stored in parquet files on ADLS. It would be fantastic to extend this to support the new "Delta Lake" file format recently open-sourced by the DataBricks team ( see https://delta.io )

    This would allow us to take advantage of ACID guarantees that the delta format brings to the data lake.

    74 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    6 comments  ·  SQL/Polybase  ·  Flag idea as inappropriate…  ·  Admin →
  3. Enable SQL DW as data source for external tables in SQL DB

    Querying SQL DW from SQL DB via external tables currently does not work due to an implicit SET LANGUAGE statement issued by the elastic queries component. It sets the Language to N'usenglish' (not supported) vs. usenglish (supported I guess). Same for SET NUMERICROUNDABORT, set to OFF (not supported). While you can explicitly set the NUMERICROUNDABORT to ON at run-time, you cannot do SET LANGUAGE us_english on SQL DB. Maybe other issuesd are to be found but this scenario is important.

    34 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    4 comments  ·  SQL/Polybase  ·  Flag idea as inappropriate…  ·  Admin →
  4. Polybase support for other cloud data sources

    we currently has Polybase to Azure Blob Store.

    we need Polybase to the following data stores:

    HDInsight with push down compute?
    SQL Azure with push down compute?
    DocumentDB with push down compute?
    Azure Data Lake Store with push down to Azure Data Lake Analytics?

    25 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  SQL/Polybase  ·  Flag idea as inappropriate…  ·  Admin →
  5. Predicate pushdown for ADLS sources

    As Azure SQL DW now also supports ADLS, it would be great if we could also leverage the distributed processing capabilities of ADLS to push computation down to ADLS in a similar way as it works for HDFS/Hadoop already

    24 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    2 comments  ·  SQL/Polybase  ·  Flag idea as inappropriate…  ·  Admin →
  6. Support of StorageTable as DataSource

    Please add support of Azure TableStorage as PolyBase DataSource.
    To be honest I can't believe its not already available. :O

    21 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  SQL/Polybase  ·  Flag idea as inappropriate…  ·  Admin →
  7. 21 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    2 comments  ·  SQL/Polybase  ·  Flag idea as inappropriate…  ·  Admin →
  8. ALTER EXTERNAL DATA SOURCE

    If a data source moves or changes then all external tables must be deleted, the data source deleted and recreated, then the external tables recreated.

    This may be experienced during a data warehouse migration, and during a disaster recovery.

    Support for ALTER EXTERNAL DATA SOURCE would make this a much more simple task.

    18 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    2 comments  ·  SQL/Polybase  ·  Flag idea as inappropriate…  ·  Admin →
  9. Enable AD authentication for Polybase

    Currently SAS is the only option for Polybase to access blob storage or datawarehouse.

    14 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  SQL/Polybase  ·  Flag idea as inappropriate…  ·  Admin →

    Thanks for the request! Currently PolyBase only supports Storage Account Keys when connecting to Azure Storage Blobs. SAS token support is on our backlog.
    Today, Storage does not support AD as an authentication method.

    We will update when we move this feature through the backlog.

  10. Support Append Blob

    Support for Azure storage Append Blob with PolyBase External tables

    14 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    4 comments  ·  SQL/Polybase  ·  Flag idea as inappropriate…  ·  Admin →
  11. Hive metastore integration for polybase / Azure SQL DW

    Hive metastore integration for polybase / Azure SQL DW
    I want to be able to seamless access/ import /join on tables that are already captured in my common hive metastore. This would significantly help integrating DW in our big data infrastructure and eliminate the huge duplicated maintenance effort of keeping external table definitions in sync.

    14 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  SQL/Polybase  ·  Flag idea as inappropriate…  ·  Admin →
  12. Support "RDBMS" TYPE for Create External Data Source

    Azure Synapse Analytics currently does not support creating external data sources to RDBMS databases such as Azure SQL, SQL Server, Orcale, etc.). However, this functionality is available in MS SQL Server 2019.

    9 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  SQL/Polybase  ·  Flag idea as inappropriate…  ·  Admin →
  13. Export data (simple custom export) to a single file

    Enable exporting data to a single file with custom export options: file format, max size, custom null, customer escape character, encryption, compression, etc

    9 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  SQL/Polybase  ·  Flag idea as inappropriate…  ·  Admin →
  14. PolyBase: Support String Columns For Predicate Pushdown

    Predicate pushdown to Hadoop sources in SQL Server 2017 and 2019 CTP 2.2 works for date, time, and numeric data types (as the documentation at https://docs.microsoft.com/en-us/sql/relational-databases/polybase/polybase-pushdown-computation?view=sql-server-2017 correctly notes). It would be great if we could also push down string predicates from VARCHAR or NVARCHAR data types.

    Supporting LIKE filters would be nice, but even exact matches and support just for what's covered for numeric data types could help.

    9 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    2 comments  ·  SQL/Polybase  ·  Flag idea as inappropriate…  ·  Admin →
  15. Support Avro format

    Please add support in Azure SQL DW for Avro files.

    8 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  SQL/Polybase  ·  Flag idea as inappropriate…  ·  Admin →
  16. polybase: allow s3 as external data source

    For building an on prem dwh it would be great, if polybase could add s3 as external data source. External tables could be used as the staging area and s3 object storage (e.g. open source minio) for the Persistent Staging Area (psa). Gzipped csv or parquet ly on s3 and could be queried on demand as a long time storage.

    8 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  SQL/Polybase  ·  Flag idea as inappropriate…  ·  Admin →
  17. PolyBase:allow encoding in file format and polybase will take care of encoding.

    PolyBase: Allow encoding in file format and polybase will take care of encoding.

    8 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  SQL/Polybase  ·  Flag idea as inappropriate…  ·  Admin →
  18. Improve row size!

    Polybase (at least on SQL Server 2016) is limited to a maximum row size of 32k. Request to increase largely this value!

    7 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  SQL/Polybase  ·  Flag idea as inappropriate…  ·  Admin →
  19. polybase:allow insert new data to existing exteranl table

    right now after an external table has been created we can't add data to it, please update the product so that would be possible

    7 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  SQL/Polybase  ·  Flag idea as inappropriate…  ·  Admin →
  20. Polybase old dates into ORC files fails

    The following CETAS statement fails. Apparently there's an issue with old dates and ORC files? Please fix.

    CREATE EXTERNAL FILE FORMAT ORC_Snappy
    WITH (

    FORMAT_TYPE = ORC  
    
    , DATA_COMPRESSION = 'org.apache.hadoop.io.compress.SnappyCodec'

    );

    create EXTERNAL TABLE dbo.testexternaltable WITH (DATASOURCE = myds, LOCATION = '/testexternaltable', FILEFORMAT = ORC_Snappy) AS
    select cast('1910-08-13' as date) as dt;

    6 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    3 comments  ·  SQL/Polybase  ·  Flag idea as inappropriate…  ·  Admin →
← Previous 1 3
  • Don't see your idea?

Feedback and Knowledge Base