Community

Loading...

SQL Server - Big Data Clusters - Retired

63 Ideas

Add Delta Lake OSS to Spark API

Add functionality to Spark engines to better handle Upserts/Merges, data versioning/CDC functionality inside BDC cluster. Audit history is a plus.

Apache SparkSuggestions

Add PolyBase feature (CREATE EXTERNAL TABLE AS SELECT) to SQL Server 2019 and Big Data Clusters

Please add the PolyBase feature (CREATE EXTERNAL TABLE AS SELECT) which is only available on Azure Synapse Analytics (SQLDW) and PDW right now.We require this on SQL 2019 and Big Data Clusters for creating a data hub/catalog catalog from curated views that are federated across many SQL Server platforms or Big Data Clusters platforms. Thus extending the data virtualization capability to views for SQL Server as source and not just tables.

Data VirtualizationSuggestions

Ability to add more nodes and pods after the BDC installation.

SQL ServerSuggestions

Volume Management for SQL Server Big Data Clusters on AKS

Currently it is possible to customise storage volumes sizes and storage classes (AKS,Kubernetes) per pool (master, data, storage pool)But right now only 1 (one) volume per pod is available. It would be a game changer feature if you could have a volume management feature for Big Data Clusters to add, resize and change storage classes for multiple volumes per pod for all pool types.https://docs.microsoft.com/en-us/sql/big-data-cluster/concept-data-persistence?view=sql-server-ver15#customize-storage-configurations-for-each-poolhttps://docs.microsoft.com/en-us/azure/aks/concepts-storage#storage-classes

New

PlatformSuggestions

Backup of storage and data pool

Ability to backup entire Cluster, Storage and Data pool is good to have.

Storage PoolSuggestions

Add the ability to specify labels on the PVCs of each Pool

KubernetesSuggestions

BDC Bulk Data Loading utility

Many customers coming from data warehouse appliances are used to have bulk data loading utility. To speed migration to BDC platform it would be nice feature to have native BDC utility included instead of having to write our own.

PlatformSuggestions

Enhance execution plans for queries against data pool

currently queries against data pool tables only show as remote query (which makes sense as it's an external table) but for data pool, it should be able to drill down to the next level and analyse the query happening on the data pool

Data PoolSuggestions

support sharding

It will be good to add support for sharding.

SQL ServerSuggestions

Add support for SQL SCOM Management Pack to monitor at least Master Instance

Would be important to add to the SQL SCOM Management Pack the capability to monitor at least the master instance. Adding to the SQL SCOM MP guide the steps how to install and configure SCOM to monitor the Master Instance.

SQL ServerSuggestions

Filters