SQL Server 2019 Big Data Clusters cumulative updates history

Applies to: SQL Server 2019 (15.x)

The following release notes apply to SQL Server 2019 Big Data Clusters. The article lists cumulative update information for all the releases of SQL Server Big Data Clusters.

For the latest release notes, see SQL Server 2019 Big Data Clusters platform release notes.

CU23 (June 2023)

Cumulative Update 23 (CU23) release for SQL Server 2019 (15.x) Big Data Clusters, KB 5030333.

CU22 (August 2023)

Cumulative Update 22 (CU22) release for SQL Server 2019 (15.x) Big Data Clusters, KB 5027702.

CU21 (June 2023)

Cumulative Update 21 (CU21) release for SQL Server 2019 (15.x) Big Data Clusters, KB 5025808.

CU20 (April 2023)

Cumulative Update 20 (CU20) release for SQL Server 2019 (15.x) Big Data Clusters, KB 5024276.

CU19 (February 2023)

Cumulative Update 19 (CU19) release for SQL Server 2019 (15.x) Big Data Clusters, KB 5023049.

CU18 GDR (February 2023)

Cumulative Update 18 (CU18) GDR release for SQL Server 2019 (15.x) Big Data Clusters, KB 5021124.

CU18 (September 2022)

Cumulative Update 18 (CU18) release for SQL Server 2019 (15.x) Big Data Clusters, KB 5017593.

CU17 (August 2022)

Cumulative Update 17 (CU17) release for SQL Server 2019 (15.x) Big Data Clusters, KB 5016394.

CU16 GDR (June 2022)

Cumulative Update 16 (CU16) GDR release for SQL Server 2019 (15.x) Big Data Clusters

CU16 (May 2022)

Cumulative Update 16 (CU16) release for SQL Server 2019 (15.x) Big Data Clusters.

CU15 (January 2022)

Cumulative Update 15 (CU15) release for SQL Server 2019 (15.x) Big Data Clusters.

CU14 (November 2021)

Cumulative Update 14 (CU14) release for SQL Server Big Data Clusters.

CU13 (September 2021)

Cumulative Update 13 (CU13) release for SQL Server Big Data Clusters.

SQL Server Big Data Clusters CU13 includes important changes and capabilities:

• HDFS distributed copy capabilities through azdata

• Apache Spark 3.1.2 and the SQL Server Big Data Clusters runtime for Apache Spark

  Caution

  Before upgrading make sure to review the Spark 3 upgrade guide.

• Password rotation for Big Data Cluster's Auto Generated Active Directory service accounts during the BDC deployment

• New Advanced Encryption Standard (AES) optional parameter security.activeDirectory.enableAES for the automatically generated AD accounts

CU12 (August 2021)

Cumulative Update 12 (CU12) release for SQL Server Big Data Clusters.

SQL Server Big Data Clusters CU12 changes the operating system default python version from 3.5 to 3.6 on all its images. This has no impact on Spark and SQL Server Machine Learning Services, as those components use dedicated Python installations and don't rely on OS python.

CU11 (June 2021)

Cumulative Update 11 (CU11) release for SQL Server Big Data Clusters.

SQL Server Big Data Clusters CU11 includes important capabilities:

• Encryption at Rest with external key providers via BDC KMS, commonly known as bring your own key (BYOK). For more information, see Encryption at rest concepts and configuration guide.
• Several SQL Server PolyBase Hadoop fixes and SQL Server PolyBase support of the following data sources: Hortonworks HDP 3.1, Cloudera CDH 6.1, 6.2, 6.3, Azure Blob Storage (WASB[S]) and Azure Data Lake Storage Gen2 (ABFS[S]). For more information, see:
  • PolyBase Connectivity Configuration (Transact-SQL)
  • Configure PolyBase to access external data in Hadoop
  • CREATE EXTERNAL DATA SOURCE (Transact-SQL)

CU10 (April 2021)

Cumulative Update 10 (CU10) release for SQL Server Big Data Clusters.

SQL Server Big Data Clusters CU10 includes important capabilities:

• Upgraded base images from Ubuntu 16.04 to Ubuntu 20.04.

  Caution

  Ubuntu 20.04 has stricter security requirements, and you might see issues when using BDC to connect to SQL Server instances before SQL Server 2017. For more information, see Failed to connect to remote instance of SQL Server 2016 or older.

• High availability support for Hadoop KMS components.
• Additional configuration settings for SQL Server networking and process affinity at the resource-scope. See Master Pool resource-scope settings.
• Resource management for Spark-related containers through cluster-scope settings.

CU9 (February 2021)

Cumulative Update 9 (CU9) release for SQL Server Big Data Clusters.

SQL Server Big Data Clusters CU9 includes important capabilities:

• Support to configure BDC post deployment and provide increased visibility of system settings.

  Clusters using mssql-conf for SQL Server master instance configurations require additional steps after upgrading to CU9. Follow the instructions here.

• Improved Azure Data CLI (azdata) experience for encryption at rest.

• Ability to dynamically install Python Spark packages using virtual environments.

• Upgraded software versions for most of our OSS components (Grafana, Kibana, FluentBit, etc.) to ensure BDC images are up to date with the latest enhancements and fixes. See Open-source software reference.

• Other miscellaneous improvements and bug fixes.

OSS component versions

CU8-GDR (January 2021)

Cumulative Update 8 GDR (CU8-GDR) release for SQL Server Big Data Clusters.

OSS component versions

The table below shows the open-source projects in use as of SQL Server 2019 (15.x) CU8 and prior.

CU8 (September 2020)

Cumulative Update 8 (CU8) release for SQL Server Big Data Clusters.

This release includes several fixes and a couple of enhancements.

Added capabilities

• SQL Server Big Data Clusters encryption at rest using system-managed keys and certificates.

  Caution

  This is the initial release of SQL Server BDC encryption at rest. Review the following articles:

  • Security concepts for SQL Server Big Data Clusters
  • Encryption at rest concepts and configuration Guide

• Oracle Proxy User support to the Data Virtualization scenario.

CU6 (July 2020)

Cumulative Update 6 (CU6) release for SQL Server Big Data Clusters.

This release includes minor fixes and enhancements. The following articles include information related to these updates:

• Manage big data cluster access in Active Directory mode
• Deploy SQL Server Big Data Clusters in Active Directory mode
• Deploy SQL Server Big Data Clusters on AKS in Active Directory mode
• Deploy big data clusters with Azure Kubernetes Service (AKS) Private Cluster
• Restrict egress traffic of big data clusters in Azure Kubernetes Service (AKS) private cluster
• Deploy SQL Server Big Data Cluster with high availability
• Configure a SQL Server Big Data Cluster
• Configure Apache Spark and Apache Hadoop in Big Data Clusters
• SQL Server master instance configuration properties
• Apache Spark & Apache Hadoop (HDFS) configuration properties
• Kubernetes RBAC model & impact on users and service accounts managing BDC

CU5 (June 2020)

Cumulative Update 5 (CU5) release for SQL Server Big Data Clusters.

Added capabilities

• Support for Big Data Clusters deployment on Red Hat OpenShift. Support includes OpenShift container platform deployed on premises version 4.3 and up and Azure Red Hat OpenShift. See Deploy SQL Server Big Data Clusters on OpenShift
• Updated the BDC deployment security model so privileged containers deployed as part of BDC are no longer required. In addition to non-privileged, containers are running as non-root user by default for all new deployments using SQL Server Big Data Clusters CU5.
• Added support for deploying multiple big data clusters against an Active Directory domain.
• Azure Data CLI (azdata) has its own semantic version, independent from the server. Any dependency between the client and the server version of azdata is removed. We recommend using the latest version for both client and server to ensure you are benefiting from latest enhancements and fixes.
• Introduced two new stored procedures, sp_data_source_objects and sp_data_source_table_columns, to support introspection of certain External Data Sources. They can be used by customers directly via T-SQL for schema discovery and to see what tables are available to be virtualized. We leverage these changes in the External Table Wizard of the Data Virtualization Extension for Azure Data Studio, which allows you to create external tables from SQL Server, Oracle, MongoDB, and Teradata.
• Added support to persist customizations performed in Grafana. Before CU5, customers would notice that any edits in Grafana configurations would be lost upon metricsui pod (that hosts Grafana dashboard) restart. This issue is fixed and all configurations are now persisted.
• Fixed security issue related to the API used to collect pod and node metrics using Telegraf (hosted in the metricsdc pods). As a result of this change, Telegraf now requires a service account, cluster role, and cluster bindings to have the necessary permissions to collect the pod and node metrics. See Custer role required for pods and nodes metrics collection for more details.
• Added two feature switches to control the collection of pod and node metrics. In case you are using different solutions for monitoring your Kubernetes infrastructure, you can turn off the built-in metrics collection for pods and host nodes by setting allowNodeMetricsCollection and allowPodMetricsCollection to false in control.json deployment configuration file. For OpenShift environments, these settings are set to false by default in the built-in deployment profiles, since collecting pod and node metrics required privileged capabilities.

CU4 (April 2020)

Cumulative Update 4 (CU4) release for SQL Server Big Data Clusters. The SQL Server Database Engine version for this release is 15.0.4033.1.

CU3 (March 2020)

Cumulative Update 3 (CU3) release for SQL Server Big Data Clusters. The SQL Server Database Engine version for this release is 15.0.4023.6.

Resolved issues

SQL Server Big Data Clusters CU3 resolves the following issues from previous releases.

• Deployment with private repository
• Upgrade might fail due to timeout

CU2 (February 2020)

Cumulative Update 2 (CU2) release for SQL Server Big Data Clusters. The SQL Server Database Engine version for this release is 15.0.4013.40.

CU1 (January 2020)

Cumulative Update 1 (CU1) release for SQL Server Big Data Clusters. The SQL Server Database Engine version for this release is 15.0.4003.23.

GDR1 (November 2019)

SQL Server Big Data Clusters General Distribution Release 1 (GDR1) - introduces general availability for Big Data Clusters. The SQL Server Database Engine version for this release is 15.0.2070.34.

SQL Server 2019 servicing updates

For current information about SQL Server servicing updates, see https://support.microsoft.com/help/4518398.

Related content

For more information about SQL Server Big Data Clusters, see Introducing SQL Server 2019 Big Data Clusters