Azure Databricks

Azure Databricks is an Apache Spark-based analytics platform optimized for the Microsoft Azure cloud services platform. Designed with the founders of Apache Spark, Databricks is integrated with Azure to provide one-click setup, streamlined workflows, and an interactive workspace that enables collaboration between data scientists, data engineers, and business analysts.

We would love to hear any feedback you have for Azure Databricks.
For more details about Azure Databricks, try our documentation page.

  1. Dbutils.fs.mount doesn't support mounting Azure China Storage, seems endpoint .core.windows.net was hardcoded

    I created a Databricks env on Global Azure (portal.azure.com) and tried to access data stored in China (portal.azure.cn), when configured proper storage account name and key, I can access data in China Azure using dbutils.fs.ls. But trying to mount the storage account failed with below error. Apparently .core.windows.net was hardcoded somewhere.

    dbutils.fs.mount(
    source = "wasbs://mycontainer@<myaccount>.blob.core.chinacloudapi.cn/path",
    mountpoint = "/mnt/mymount",
    extra
    configs = {"fs.azure.account.key.<myaccount>.blob.core.chinacloudapi.cn": "ufU474A47XXXXXXXXXXXXXXXXXXXXXXXXXXZZU0LZmxQL5P1vLDH8FbGcdDGCVWX2cIGR"}
    )

    java.rmi.RemoteException: java.lang.IllegalArgumentException: Could not retrieve either the Azure storage account access key through option key fs.azure.account.key.<myaccount>.blob.core.chinacloudapi.cn.blob.core.windows.net or the SAS token for the Azure container through option key fs.azure.sas.mycontainer.<myaccount>.blob.core.chinacloudapi.cn.blob.core.windows.net.; nested exception is:

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
1 2 3 5 Next →
  • Don't see your idea?

Azure Databricks

Categories

Feedback and Knowledge Base