Update: Microsoft will be moving away from UserVoice sites on a product-by-product basis throughout the 2021 calendar year. We will leverage 1st party solutions for customer feedback. Learn more here.

Azure Synapse Analytics

We would love to hear your ideas for new features for Azure Synapse Analytics. Below, enter a new idea or upvote an existing one. The Synapse engineering team pays attention to all requests.

If instead you need a technical question answered or help, try the these options: DocumentationMSDN forum, and StackOverflow. If you need support, please open a support ticket.

  • Hot ideas
  • Top ideas
  • New ideas
  • My feedback
  1. To insert data from CSV files blob to polybase table having delimiter type data into it using ADF v2

    0

    I am trying to load data into polybase table from csv flat file having "/,/|/^ data into it.

    I have create file format with the (STRING_DELIMITER = '"')

    CREATE EXTERNAL FILE FORMAT StringDelimiter WITH ( FORMATTYPE = DELIMITEDTEXT, FORMATOPTIONS ( FIELDTERMINATOR = ',', STRINGDELIMITER = '"', FIRST_ROW = 2, ENCODING = 'UTF8' ) );

    But throwing error while fetching from blob storage:- HdfsBridge::recordReaderFillBuffer - Unexpected error encountered filling record reader buffer: HadoopExecutionException: Could not find a delimiter after string delimiter.

    Any help will be appreciated.

    1 vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  SQL/Polybase  ·  Flag idea as inappropriate…  ·  Admin →
  2. Backup/Restore for Serverless SQL Pool

    Currently, Serverless SQL Pool does not have the ability to protect metadata.
    Please support backup/Restore.

    1 vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  SQL/Reliability  ·  Flag idea as inappropriate…  ·  Admin →
  3. Deploy Pipelines through ARM template in Synapse

    The ability to deploy synapse services such as pipelines, linked services, and datasets via arm templates like in ADF.

    1 vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Workspace/Pipelines  ·  Flag idea as inappropriate…  ·  Admin →
  4. Submit consecutive data flows to the same cluster

    The ability to link consecutive data flow in a pipeline together for submission to the same cluster to optimize away some start up time.

    This would be an alternative to setting TTL on the IR that also allows user to have more maintainable data flows.

    1 vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  5. Delta Lake support for Dedicated SQL Pool

    Delta Lake support for Serverless SQL Pool is in preview.
    How about support for DEDICATED SQL Pool?

    Also it would be nice, if automatic partition detection and partition prunig of Delta folders would be supported (just like in the OPEN ROWSET of serverless SQL)

    1 vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  SQL/Loading  ·  Flag idea as inappropriate…  ·  Admin →
  6. Synapse Error any one find it Please help

    synapse workspace

    "Delete Artifact not in template" function currently not working and

    synapse workspace remove the pipeline or dataflow in dev environment after publish and generate new template in azure devops , run cicd release pipeline next environment pipeline or dataflows not removed

    1 vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Workspace/Other  ·  Flag idea as inappropriate…  ·  Admin →
  7. Azure Synapse Analytics - Synapse Pipeline SSIS Integration Runtime Support

    Hi Team,

    Do we have any roadmap / SLA for having SSIS Integration Runtime support in Azure Synapse Analytics - Synapse Pipeline.

    We have a customer requirements, where we have to modernize their existing on-premise MSFT tech stack (SSIS, SSAS, SSRS) with Azure Synapse Analytics to support their future analytics requirements via the unified experience from Synapse Analytics.

    We are looking for an option to lift and shift their on-premise SSIS packages to Synapse Pipeline (Like how we have it for Azure Data Factory SSIS Integration Runtime)

    Any guidance / help would be much appreciated.

    1 vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  SQL/Integration  ·  Flag idea as inappropriate…  ·  Admin →
  8. Auto Refresh when Monitoring pipelines

    When I keep synapse Monitor section/blade open on another physical monitor, my intention is to monitor for any failures/warnings. It would be great if there is option for Auto-Refresh running pipelines (at least for 24 hours filter). sometimes I forget to click Refresh and dont realize if pipeline is failed or not.

    0 votes

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Workspace/Monitoring  ·  Flag idea as inappropriate…  ·  Admin →
  9. Auto Refresh on Monitor pipelines

    When I keep synapse Monitor section/blade open on another physical monitor, my intention is to monitor for any failures/warnings. It would be great if there is option for Auto-Refresh running pipelines (at least for 24 hours filter). sometimes I forget to click Refresh and dont realize if pipeline is failed or not

    0 votes

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Workspace/Monitoring  ·  Flag idea as inappropriate…  ·  Admin →
  10. Copy&Paste for Data Flow Transformations

    I wish I could Copy&Paste Transformations in Data Flows. Doing it via the Source code view is ... difficult (mildly put).

    2 votes

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Workspace/Other  ·  Flag idea as inappropriate…  ·  Admin →
  11. Provide - Synapse Details by users, groups, DWU, Memory, (I/O optional), volume usage information

    We are looking for users, groups, DWU, Memory, (I/O optional), volume usage information from synapse as it will help us to define strategic level plans for cost, usage and more plans.

    1 vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  SQL/Performance  ·  Flag idea as inappropriate…  ·  Admin →
  12. Row-Level Security in Synapse Serverless SQL Pools

    The title speaks for itself. It would be great to have full RLS capability in the Synapse Serverless SQL Pools.

    2 votes

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  13. Allow for GitHub Cloning for Workspace Redeployment

    Allow for users to clone from GitHub repos to redeploy a Git connected Synapse workspace.

    Right now, only users can sync with a GitHub repo, but the artifacts do not persist if the repo is disconnected. There are also a number of permissions issues with this path.

    Allowing a user to provide a GitHub url to simply CLONE not Sync, would be an amazing feature addition. This way users can clone from example repos.

    1 vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Workspace/Management  ·  Flag idea as inappropriate…  ·  Admin →
  14. rename dedicated sql pool name hosted by Synapse Workspace

    Required to maintain the application connection string in a restore scenario.
    I'm working on a restore scenario where I can restore the database from a restore point.

    In the case of SQL Server, Azure SQL and SQL Pool (previous DW), it was possible to restore the entire database by restoring it as an alias and switching the name.

    In the case of SQL Pool (under Synapse workspace), I would like to know what is the recommended procedure to restore the entire database.

    If I restore from a Geo backup after deleting the existing SQL Pool, RPO=24h, and I cannot utilize…

    1 vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  15. Nuget Feed Authentication for Synapse Spark.NET Notebooks

    Currently we are getting authentication errors when using Private nuget feeds.

    Unable to load the service index for source "json path for our Nuget feed" [/tmp/nuget/5730--f405c3cb-1015-48fa-ac09-a29344c71270/Project.fsproj]
    /usr/share/dotnet/sdk/3.1.409/NuGet.targets(128,5): error : Response status code does not indicate success: 401 (Unauthorized). [/tmp/nuget/5730--f405c3cb-1015-48fa-ac09-a29344c71270/Project.fsproj]

    Please add nuget feed authentication support for using nuget packages for private libraries

    ``` #i "nuget:https://pkgs.dev.azure.com/dnceng/public/_packaging/dotnet-tools/nuget/v3/index.json" "

    " #r "nuget:Microsoft.Spark, 1.0.0" ```

    Refer to a similar issue - https://docs.microsoft.com/en-us/answers/questions/426375/how-to-consume-nuget-package-in-azure-synapse-note.html

    5 votes

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Workspace/Spark/.NET for Spark  ·  Flag idea as inappropriate…  ·  Admin →
  16. Currently metrics are purged and have only for last 1 month, it will be nice to have summary for historical data

    We usually do optimizations in load patterns or the way we write queries . The only way to know if there is any impact, is based on looking at the trend of ADW metrics for last couple of months or may be for an year.

    Currently this trend analysis cannot be done, since the logs are purged which are older than a month. If purging cannot be avoided, it will be nice to save the summarized info and this will be very valuable information for any trend analysis.

    1 vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  SQL/Other  ·  Flag idea as inappropriate…  ·  Admin →
  17. Synapse Git integration support ipynb notebook file format

    Synapse had git integration, but when we need to save / commit our work of notebook, we can only get JSON definition file of notebook in git repo.
    Currently If we need to make ipynb source code, we can only use "Export" btn to generate ipynb file, but its not integrated with git repo, so it still lose source control ability of that ipynb file, also its hard to code review using JSON format file.
    It would be very helpful if we can also keep ipynb format when integrating with Git Repo

    7 votes

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Workspace/Notebooks  ·  Flag idea as inappropriate…  ·  Admin →
  18. Diagnose long running notebook cell

    Often a notebook cell runs for a long time and does not return. Is it due to a lot of CPU crunching? waiting on I/O? Something else?

    Currently there is no way to tell. It would be nice to be able to stop the cell and get a stacktrace, or to have some indication if it's waiting on I/O, and/or otherwise get information useful for diagnosing long running cells.

    1 vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Workspace/Notebooks  ·  Flag idea as inappropriate…  ·  Admin →
  19. Spark Single Node Clusters

    It should be possible to run spark single node, with 1 core dedicated for the driver and all the other cores as executors. This would be really useful for spark dev/prototyping.

    1 vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Workspace/Spark  ·  Flag idea as inappropriate…  ·  Admin →
  20. Add time-travel feature in Delta Lake

    Delta Lake format provides ability to run time-travel queries. This should be added to the existing Delta Lake support in Synapse pools.

    35 votes

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    4 comments  ·  SQL/Polybase  ·  Flag idea as inappropriate…  ·  Admin →
← Previous 1 3 4 5 27 28
  • Don't see your idea?

Feedback and Knowledge Base