Azure Databricks

Azure Databricks is an Apache Spark-based analytics platform optimized for the Microsoft Azure cloud services platform. Designed with the founders of Apache Spark, Databricks is integrated with Azure to provide one-click setup, streamlined workflows, and an interactive workspace that enables collaboration between data scientists, data engineers, and business analysts.

We would love to hear any feedback you have for Azure Databricks.
For more details about Azure Databricks, try our documentation page.

We welcome user feedback and feature requests!

(thinking…)

Enter your idea and we'll search to see if someone has already suggested it.

If a similar idea already exists, you can support and comment on it.

If it doesn't exist, you can post your idea so others can support it.

Enter your idea and we'll search to see if someone has already suggested it.

  1. Git Integration with VSTS

    Azure Databricks should support Git Integration with VSTS. Right now there is only Github and Bitbucket.

    13 votes
    Sign in
    Check!
    (thinking…)
    Reset
    or sign in with
    • facebook
    • google
      Password icon
      Signed in as (Sign out)

      We’ll send you updates on this idea

      1 comment  ·  Flag idea as inappropriate…  ·  Admin →
    • ssh access to databricks cluster VMs

      It should be possible to ssh into azure databricks cluster VMs. It it possible on Databricks on AWS

      https://docs.databricks.com/user-guide/clusters/ssh.html

      8 votes
      Sign in
      Check!
      (thinking…)
      Reset
      or sign in with
      • facebook
      • google
        Password icon
        Signed in as (Sign out)

        We’ll send you updates on this idea

        0 comments  ·  Flag idea as inappropriate…  ·  Admin →
      • support low-priority VMs

        Azure Databricks and low-priority VMs are a great match. Their use cases overlap heavily: https://docs.microsoft.com/en-us/azure/batch/batch-low-pri-vms#use-cases-for-low-priority-vms.

        6 votes
        Sign in
        Check!
        (thinking…)
        Reset
        or sign in with
        • facebook
        • google
          Password icon
          Signed in as (Sign out)

          We’ll send you updates on this idea

          1 comment  ·  Flag idea as inappropriate…  ·  Admin →
        • support reading avro files from azure blob storage

          I use EventHub capture to storage account feature and want to load it's avro files from Azure Databricks, it works perfectly on dbfs, but when i try to load it directly from blob storage (based on this article https://docs.azuredatabricks.net/spark/latest/data-sources/azure/azure-storage.html) it fails with the following error:

          shaded.databricks.org.apache.hadoop.fs.azure.AzureException: shaded.databricks.org.apache.hadoop.fs.azure.AzureException: Container events in account pilfleetml.blob.core.windows.net not found, and we can't create it using anoynomous credentials, and no credentials found for them in the configuration.
          ---------------------------------------------------------------------------
          Py4JJavaError Traceback (most recent call last)
          <command-486363724788735> in <module>()
          ----> 1 avroDf = spark.read.format("com.databricks.spark.avro").load("wasbs://events@pilfleetml.blob.core.windows.net/pil-fleet-eh/pil-fleet-ml/0/2018/01/25/14/55/*")

          /databricks/spark/python/pyspark/sql/readwriter.py in load(self, path, format, schema, **options)
          157 self.options(**options)
          158 if…

          4 votes
          Sign in
          Check!
          (thinking…)
          Reset
          or sign in with
          • facebook
          • google
            Password icon
            Signed in as (Sign out)

            We’ll send you updates on this idea

            1 comment  ·  Flag idea as inappropriate…  ·  Admin →
          • Allow custom/CIDR ranges for deploying Databrick in VNET

            Current ARM template and implementation of Databricks being deployed in VNET only allows /16 CIDR before deployment and does not allow manipulation to shrink /16 CIDR after deployment. This is a huge problem in larger enterprises where a /16 takes up 64k IPs and VNET technology only allows 8192 MAX Private IPs in a VNET. This presents a challenge for enterprises carving huge swaths of /16 space especially when WAN routing comes into place for the organization. The ability to define and deploy your own VNET with a /22 or other /CIDR range should be allowed.

            3 votes
            Sign in
            Check!
            (thinking…)
            Reset
            or sign in with
            • facebook
            • google
              Password icon
              Signed in as (Sign out)

              We’ll send you updates on this idea

              1 comment  ·  Flag idea as inappropriate…  ·  Admin →
            • Any update on HIPAA + HITRUST compliance with this offering?

              Our team works in healthcare and this could be something to look into if it meets all the compliance checks.

              2 votes
              Sign in
              Check!
              (thinking…)
              Reset
              or sign in with
              • facebook
              • google
                Password icon
                Signed in as (Sign out)

                We’ll send you updates on this idea

                0 comments  ·  Flag idea as inappropriate…  ·  Admin →
              • Provide support for mrsdeploy on Azure databricks

                I wish to deploy R model to Azure ML server using mrsdeploy from Azure databricks

                1 vote
                Sign in
                Check!
                (thinking…)
                Reset
                or sign in with
                • facebook
                • google
                  Password icon
                  Signed in as (Sign out)

                  We’ll send you updates on this idea

                  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                • Don't see your idea?

                Azure Databricks

                Feedback and Knowledge Base