Azure Databricks

Azure Databricks is an Apache Spark-based analytics platform optimized for the Microsoft Azure cloud services platform. Designed with the founders of Apache Spark, Databricks is integrated with Azure to provide one-click setup, streamlined workflows, and an interactive workspace that enables collaboration between data scientists, data engineers, and business analysts.

We would love to hear any feedback you have for Azure Databricks.
For more details about Azure Databricks, try our documentation page.

  1. Optimize ADLS queries with Query Acceleration

    For those Spark queries that read from an Azure Data Lake Storage mount or URL, take advantage of ADLS "query acceleration" to optimize filtered queries over sufficiently large data.

    https://docs.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-query-acceleration

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  2. Accept mounting NFS/SMB

    There's currently not a single way to link databricks to kubernetes.

    NFS/SMB would be the ideal method but it is currently blocked by apparmour.

    FUSE is not an option.

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  3. Sign In to Databricks Permissions fix: Contributor required.

    A databricks Admin user in Databricks clicks the link in the Azure Portal. The Azure Portal reports that the Databricks Admin user must be granted Owner or Contributor in the Azure Portal for launching the workspace resource. However, if the Databricks Admin user who is granted Azure portal Reader access copies the workspace link from the Azure Portal to a new tab, they can launch the databricks workspace with no issue.

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  4. Fix syntax highlighting in markdown cells in Azure Databricks

    In a few other tools there is support for syntax highlighting in markdown cells e.g. this

    ```yaml
    config:

    base: 1
    
    extended: more

    ```

    Would be displayed with YAML syntax nicely highlighted.

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  5. Allow databricks containers in new runtimes

    I've got a container image that I have for workloads however containers are not supported on the newer runtimes. It would be nice to enable containers to be used given that Spark 3 is on the horizon.

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Strong Feedback  ·  Flag idea as inappropriate…  ·  Admin →
  6. Speed up notebook editing for large notebooks

    We have a large notebook with 50+ cmd cells and a couple thousand lines of code. We find that our notebook becomes very slow when we are trying to edit the code and often stops responding. Please find a way to boost performance of the editor so that it doesn't lag all the time when we're editing large notebooks.

    Thanks,
    Sam+

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Strong Feedback  ·  Flag idea as inappropriate…  ·  Admin →
  7. Translate some of words like FUSE in Chinese is quite wrong

    Should Explaine more detail which FUSE is call Filesystem in Userspace

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  8. Display print messages in logs of Azure Databricks job

    Azure databricks job run does not show printed messages anymore. Earlier it was displaying, But now even downloaded log does not have printed messages.

    This will be useful and efficient than writing each and every results to some data source. For example, diplay 5 rows of dataframe results.

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  9. Support a notebook template in Databricks.

    Many notebooks need to access the same storage account ( e.g. Data Lake ). This requires each notebook to implement the same code to connect to the Data Lake. It would be great if, when creating a new blank notebook, you could select a pre-built template that included that connection code ( and other stuff like variables holding paths to various delta lake tables or csv folders ) in the first cell. The user could then begin coding their work without having to first enter or copy/paste that initial code that is common to many notebooks.

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  10. Databricks UI: Add Query Finished Notification (Push and/or Email)

    Some queries, even on Databricks, take a long time to run. I'd love to get a push notification through my android phone, Window 10, or via email that my query finished. Then I don't have to periodically babysit my queries and can shift gears to another task. Same thing for failed queries. Add a little check box next to the cell in the Notebook or a bit of code I can add to my query so I can easily decide when I want to be notified.

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  11. don't break lines

    The way you break lines in notebook is so confusing!

    Show some kind of continuation symbol as all modern IDE do.

    Leave user an option not to break line. God, even Microsoft notepad had this option in windows 98.

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Strong Feedback  ·  Flag idea as inappropriate…  ·  Admin →
  12. Worst documentation ever.

    If you're adding third party frameworks add legible insightful docs for it with examples covering every concept. Cant use half of the functionalities due to lack of docs explaining it. Makes me feel like quit coding. Uggggh!!

    My name is Akshay. R

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  13. test

    test

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  Strong Feedback  ·  Flag idea as inappropriate…  ·  Admin →
  14. Add Azure Devops Artifacts source and documentation for Cluster Libraries

    Add Azure Devops Artifacts source and documentation for Cluster Libraries. This would provide internal repository for cluster-installed and notebook-installed libraries for those which are supported by Azure Devops, for custom Python and Java libraries.

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  15. Cross WorkSpace Version Control

    Hi, I found the existing workspace does not support import notebook from a git link, so I cannot manage the notebook across different workspaces.
    Do you plan to have this kind of feature? Or there is another round way to achieve that?

    Thanks,


    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  16. Installing R packages that are not on CRAN

    Is there a way to install custom R packages on a cluster?

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  17. Show ephemeral job on portal

    Currently UI only shows job which were created from portal or REST api /create endpoint. We have scenario where we would create job on the fly using /api/runsubmit and it doesnt show on Job section of portal. We can only see details of specific run if we directly go to endpoint but not centralized view.

    Is this something coming up or at-least on road map?

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Strong Feedback  ·  Flag idea as inappropriate…  ·  Admin →
  18. Let Notebook attach n run to a terminated clusters while another cluster is running

    I connect my notebook to a cluster that is currently running and run some commands. Then I realize that I connected to the wrong cluster. So I attach it to another cluster that is currently shutdown and then run the command again. I expect that the shutdown cluster will auto start and will run my command but instead it tells me that there is another cluster that is currently running and the newly attached cluster is shutdown. It asks if it should attach to the active cluster and run the command there. The two options for this question is "Cancel"…

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  19. Multiple Cron schedules for one job

    Many simple schedules cannot be configured for a single job in Databricks due to the limitations of cron schedules. E.g. running a job every 40 minutes. Multiple schedules could provide such a frequency, but today, that would require having duplicate copies of the same job with different schedules.

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Strong Feedback  ·  Flag idea as inappropriate…  ·  Admin →
  20. Enable Azure AD credential passthrough to ADLS Gen2 from PowerBI

    At present, the PowerBI connector uses token authentication. It would be ideal if this used AD auth, and that auth was passed down to the underlying source (Data lake gen2).

    This is currently only available within the workspace using High Concurrency clusters. But we would like non-technical users to use PowerBI

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Strong Feedback  ·  Flag idea as inappropriate…  ·  Admin →
  • Don't see your idea?

Azure Databricks

Categories

Feedback and Knowledge Base