SQL Server - Big Data Clusters

Summary:


SQL Server Big Data Clusters is the multi-cloud, open data platform for analytics at any scale. Big Data Clusters (BDC) unites SQL Server with Apache Spark to deliver the best compute engines available for analytics in a single, easy to use deployment. With these engines, BDC is the ideal data platform for AI, ML, M/R, Streaming, BI, T-SQL, and Spark. Delivered as part of the SQL Server 2019 release, BDC is a cloud-native solution orchestrated by Kubernetes. Our mission is to accelerate, delight and empower our users as they quench their thirst for data driven insights.
 
More information about SQL Server Big Data Clusters is available in the documentation.

  1. Add alerting capabilities to SQL Elastic Job Agent

    As a SQL DBA, I would like SQL Elastic Job Agent to send email or webhook alert when a job fails, retries, starts, or finished.

    Integration with Azure Monitor would be preferred.

    Thank you!

    10 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  2. More access availabilty to Ceph-based cluster/pools

    Ceph is supported with K8s via CSI (Rados Block Device - RBD) as a storage class (and persistent volume/claims) for containers, but would be nice to see direct object/block access (beyond the general S3 rados gateway options) from the Storage/Data Pool perspective

    2 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Storage Pool  ·  Flag idea as inappropriate…  ·  Admin →
  3. Fix Knox authentication on default deployment

    Using SQL 2019 CU2, single node AKS, Knox is configured to use Shiro JDBCRealm with permissionLookupEnabled = true.

    However, no override defines permission query and there is no roles_permissions define in the controller database.

    This setting should be set to false.

    2 votes
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    under review  ·  2 comments  ·  Other  ·  Flag idea as inappropriate…  ·  Admin →
  4. Native SQL 2019 Support for External Tables pointing to the ADLS Gen 2 File System without using BDC

    It would be great if the native SQL 2019 without BDC can support External tables pointing to ADLS Gen 2 File System.

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  SQL Server  ·  Flag idea as inappropriate…  ·  Admin →
  5. Anaconda in BDC for Spark and ML Services

    Anaconda Enterprise lets you manage packages on a cluster and on your computer and keep them in sync.

    Can BDC include this? Some way to manage packages for spark

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Apache Spark  ·  Flag idea as inappropriate…  ·  Admin →
  6. SQL Server Big Data Cluster Download google chrome

    To Integrate configuration for Google system networking

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  SQL Server  ·  Flag idea as inappropriate…  ·  Admin →
  7. SQL Server Big Data Cluster Download google chrome

    To Integrate configuration for Google system networking

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  SQL Server  ·  Flag idea as inappropriate…  ·  Admin →
  8. Enhance execution plans for queries against data pool

    currently queries against data pool tables only show as "remote query" (which makes sense as it's an external table) but for data pool, it should be able to drill down to the next level and analyse the query happening on the data pool

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Data Pool  ·  Flag idea as inappropriate…  ·  Admin →
  9. BDC Bulk Data Loading utility

    Many customers coming from data warehouse appliances are used to have bulk data loading utility. To speed migration to BDC platform it would be nice feature to have native BDC utility included instead of having to write our own.

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Platform  ·  Flag idea as inappropriate…  ·  Admin →
  10. Run BDC Notebook Code Using ADF Directly (Automated Way)

    SQL 2019 (BDC) now supports Jupyter Notebook like Notebook. Can we write code and run them in an automated way using ADF (Azure Data Factory) like we can do it in Azure Data Bricks? If that support is not available now, HOW SOON can we get the feature?

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Other  ·  Flag idea as inappropriate…  ·  Admin →
  11. support sharding

    It will be good to add support for sharding.

    1 vote
    Sign in
    (thinking…)
    Sign in with: Microsoft
    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  SQL Server  ·  Flag idea as inappropriate…  ·  Admin →
  • Don't see your idea?

SQL Server - Big Data Clusters

Categories

Feedback and Knowledge Base