ALTER SHARE my_share ADD VIEW my_catalog.my_schema.my_view WITH HISTORY;
SELECT from_xml(xml_col, schema_of_xml('<record><id>1</id><name>foo</name></record>')) AS parsed
FROM my_table;
ug usage --all
df_summary = spark.table('events').groupBy('region').agg({'revenue': 'sum'})
df_summary.cache()
df_summary.show()
# subsequent actions on df_summary reuse the cached result
ALTER EXTENSION lakebase_tokenizer UPDATE;
CREATE OR REPLACE VIEW main.analytics.my_view NOCOPY * AS SELECT id, name FROM main.raw.source_table;
curl -X POST https://<workspace-host>/oidc/v1/token \
-H 'Content-Type: application/x-www-form-urlencoded' \
-d 'grant_type=client_credentials' \
-d 'client_id=<sp-client-id>' \
-d 'client_secret=<sp-client-secret>' \
-d 'scope=all-apis' \
-d 'custom_claim=alice@example.com'
CREATE OR REPLACE VIEW user_orders_view AS
SELECT * FROM orders
WHERE user_email = current_oauth_custom_identity_claim()
AND current_oauth_custom_identity_claim() IS NOT NULL;
CREATE OR REPLACE FUNCTION my_catalog.my_schema.fetch_api_key()
RETURNS STRING
LANGUAGE SCALA
SECRETS ('my_scope' = 'my_key')
ENVIRONMENT_VERSION 6
AS $$
dbutils.secrets.get(scope = "my_scope", key = "my_key")
$$;
spark.conf.set("spark.pythonWorkerEnv.MY_SECRET_PATH", "/dbfs/secrets/my_secret.txt")
SELECT truncate(price, 2) AS truncated_price FROM transactions;
SELECT trim_array(tags, 2) AS trimmed_tags FROM events;
-- After enabling Lakebase Search in project settings:
CREATE EXTENSION lakebase_vector;
CREATE EXTENSION lakebase_text;
-- Create a vector index (lakebase_ann) on an embeddings column
CREATE INDEX ON documents USING lakebase_ann (embedding);
-- Create a BM25 full-text index (lakebase_bm25) on a text column
CREATE INDEX ON documents USING lakebase_bm25 (body_tsvector);
curl -X POST https://<databricks-instance>/api/2.1/jobs/runs/submit \
-H 'Authorization: Bearer <token>' \
-H 'Content-Type: application/json' \
-d '{"performance_target": "STANDARD", "run_name": "my-one-time-run", "tasks": [{"task_key": "main", "existing_cluster_id": "<cluster-id>", "notebook_task": {"notebook_path": "/path/to/notebook"}}]}'
SHOW GOVERNED TAGS
CREATE CATALOG IDENTIFIER(:param)
%pip install databricks-feature-store
Summary
Databricks is a commercial data and AI platform, run as a cloud-hosted service, that organizes an organization's data in a lakehouse so analysts, data scientists, and engineers can query, model, and visualize it in one place rather than stitching together separate warehouses and notebooks. Teams build ETL pipelines, train and serve machine learning models through MLflow, and govern access and lineage centrally through Unity Catalog, while security and compliance controls such as ABACABACAttribute-based access control, where rules evaluate facts about the user, resource and request. Access can depend on conditions such as department, data sensitivity or device status. deny policies let platform and compliance owners enforce access restrictions that override individual grants. Dashboards built on this data support filtering, scheduling, and delivery to Slack or Teams, and Genie, its conversational layer, can run recurring prompts and cite live web sources. It is tagged in our records under lakehouse and security-data-lake, placing it closer to a data platform with SIEMSIEMSecurity information and event management, collecting logs from many systems and correlating events to find suspicious activity. Analysts use it to investigate alerts and incidents.-adjacent capabilities than a dedicated detection tool.
Databricks is a unified analytics platform for data engineering, data science, and machine learning built on Apache Spark.
Which rows in my tables actually changed since I last checked, without me having to enable tracking on every table ahead of time?
computes row-level changes at query time using row tracking, working across batch queries, streaming, and Delta Sharing without a manual per-table setup step
Can someone with owner rights on a table still grant away access control I meant to lock down?
lets a deny rule on the manage-access-control privilege override any grant, including ones made by the object's own owner
Which of my Salesforce pipelines will start pulling less data on their next run?
flags pipelines that relied on full snapshots for formula fields, since those will switch to incremental ingestion by default and change output on upgrade
Why did my change-tracking query slow down my writes before this?
removes the write-time overhead of maintaining change data by computing changes at read time instead, making merge and update operations faster on tables queried for changes
How do I get last night's dashboard numbers to someone who isn't going to log into the workspace?
delivers a scheduled snapshot straight to a Slack or Teams channel with the underlying data attached as a CSV, TSV, or Excel file
Do the filters I set on one chart actually apply to the other datasets on my dashboard?
carries filters, selections, and parameters across to widgets built on related datasets automatically once a relationship is defined between them
French, Portuguese
Release notes: French, Portuguese
French, Portuguese added in Databricks web interface is localized in Portuguese and French (Public Preview) (Jul 29, 2021)
Features
205 capabilities
across 7 capability groups
Built from Databricks's releases, docs, README and our own runs.
“Seen” marks the month we first spotted a release the vendor didn't date.
Group names and tags are our labels.
Databricks covers 7 of the 11 logs and telemetry capabilities we track.
What Databricks offers you
REST API10
Python scripting support7
Web management console7
Built-in AI assistant5
Scheduled jobs5
Scripting language support5
Natural-language query4
Administrative audit log2
CSV data export2
Import from a competing product2
MCP server2
S3 export2
SCIM provisioning API2
Command-line interface1
Disaster recovery1
High-availability clustering1
JSON data export1
ML-based detection1
Role-based access control1
Terraform provider1
No capabilities match.
＋Metrics collection5 featuresLogs and telemetrysince 2019▸
＋Usage Tracking and ReportingshippedEnhances usage monitoring with graphical dashboards showing DBUs grouped by workload type and detailed CSV exports for billing analysis.20 releases · 1 other source · first seen Jun 2019▸
Shared capability: Metrics collection
Also counts toward: CSV data export
release
20 total
The dashboard now supports tag-based spend attribution and expanded model and user spend analysis.
Unity Gateway Usage Dashboard v1.0 (2026-10-27) · Oct 2026
· source
· release history
Account admins can now import customizable, pre-built usage dashboards to monitor Databricks usage at the account and workspace levels
Databricks usage dashboard is now generally available · Mar 2026
· source
· release history
Synced tables usage is now automatically tracked in the system.billing.usage system table for billing purposes.
Synced tables are now metered and billed · Jul 2025
· source
· release history
query_history system table adds written_rows and written_files columns to track persistent storage writes
New columns available in query history system table · Jul 2025
· source
· release history
query_history system table now includes query_parameters struct showing named and positional parameters
New columns available in query history system table · Jul 2025
· source
· release history
Adds network_access system table to log events where internet access is denied from the account
Network access events system table is now available (Public Preview) · Dec 2024
· source
· release history
example
Navigate to the Unity Gateway Usage Dashboard to review coding-agent adoption and session spend broken down by tag, model, and user.$ In the Databricks console, go to Unity Gateway > Usage Dashboard to explore coding-agent adoption, harness usage, estimated session spend, and tag-based spend attribution.
Unity Gateway Usage Dashboard v1.0 (2026-10-27) · Oct 2026
· source
＋Structured Streaming monitoringshippedProvides a web UI and operation metrics for monitoring streaming jobs, including write, update, and delete counts.6 releases · first seen Apr 2020▸
Shared capability: Metrics collection
release
Adds support for querying Structured Streaming state data and metadata in Databricks Runtime 14.3 LTS and above
State store reader is now GA · Jan 2025
· source
· release history
Adds backlog seconds, backlog bytes, backlog records, and backlog files metrics visible in the DLT UI for each streaming flow.
View streaming workload metrics for your DLT pipeline updates (Public Preview) · Dec 2024
· source
· release history
View backlog seconds, backlog bytes, backlog records, and backlog files metrics for job runs with Spark Structured Streaming sources in the Jobs UI
View streaming workload metrics for your job runs (Public Preview) · Dec 2024
· source
· release history
Enables querying Structured Streaming state data and metadata for stateful streaming queries.
Databricks Runtime 14.3 LTS · Feb 2024
· source
· release history
Adds a Structured Streaming web UI for monitoring streaming jobs
Databricks Runtime 7.0 GA, powered by Apache Spark 3.0 · Jun 2020
· source
· release history
Exposes write, update, and delete operation metrics in Delta table history for all changes
Databricks Runtime 6.5 GA · Apr 2020
· source
· release history
＋Unity Gateway Usage DashboardshippedProvides a pre-built dashboard for tracking coding-agent adoption, harness usage, and estimated session spend across Unity Gateway services.3 releases · 2 other sources · first seen Oct 2026▸
Shared capability: Metrics collection
release
Track Unity Gateway Skill activity — list, load, and file fetch events — through audit logs recorded under the aiGatewaySkills service.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Track Unity Gateway skill usage with audit logs and the usage dashboard (2026-10-30) · Oct 2026
· source
· release history
View skill downloads, loads, and per-user activity in the new Skills tab of the usage dashboard.
Track Unity Gateway skill usage with audit logs and the usage dashboard (2026-10-30) · Oct 2026
· source
· release history
Databricks now offers the Unity Gateway Usage Dashboard v1.0 for tracking coding-agent adoption, harness usage, and estimated session spend.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Unity Gateway Usage Dashboard v1.0 (2026-10-27) · Oct 2026
· source
· release history
example
Audit which users are loading or fetching Unity Gateway Skills by filtering your audit log stream for the aiGatewaySkills service.$ In the Databricks console, go to Settings > Audit Logs and filter by service name `aiGatewaySkills` to see skill list, load, and file fetch events by user.
Track Unity Gateway skill usage with audit logs and the usage dashboard (2026-10-30) · Oct 2026
· source
Monitor download and load activity across all Unity Gateway Skills for capacity or compliance review.$ In the Databricks console, go to the Usage dashboard and select the Skills tab to view downloads, loads, and activity broken down by user.
Track Unity Gateway skill usage with audit logs and the usage dashboard (2026-10-30) · Oct 2026
· source
＋Compute utilization monitoringshippedAdds a node_timeline table to the system.compute schema for logging minute-by-minute compute resource utilization.5 releases · first seen Oct 2023▸
Shared capability: Metrics collection
release
node_types compute system table is now GA for all-purpose compute, jobs compute, and DLT pipelines insights.
The compute system tables are now generally available (GA) · Apr 2025
· source
· release history
node_timeline compute system table is now GA for all-purpose compute, jobs compute, and DLT pipelines insights.
The compute system tables are now generally available (GA) · Apr 2025
· source
· release history
clusters compute system table is now GA for all-purpose compute, jobs compute, and DLT pipelines insights.
The compute system tables are now generally available (GA) · Apr 2025
· source
· release history
Adds node_timeline table to the system.compute schema, logging minute-by-minute utilization for all-purpose and jobs compute resources.
Node timeline system table is now available (Public Preview) · Jul 2024
· source
· release history
system.compute.node_types table captures currently available node types with basic hardware information.
Compute system tables are now available (Public Preview) · Oct 2023
· source
· release history
＋Cluster metrics UIshippedProvides a new cluster metrics user interface accessible from clusters running Databricks Runtime 13.0 or above.2 releases · 1 other source · first seen Apr 2023▸
Shared capability: Metrics collection
release
Supports query profiling for serverless compute, SQL Warehouses, and Lakeflow Pipelines.
Improved Lakeflow Performance Observability will soon be available by default for workspaces with the compliance security profile enabled (2026-10-26) · Oct 2026
· source
· release history
Adds a new cluster metrics UI accessible from clusters running Databricks Runtime 13.0 or above, replacing the previous Ganglia monitoring tool.
New cluster metrics UI · Apr 2023
· source
· release history
example
Review job-level data volume and query performance metrics for a serverless Lakeflow job to identify slow queries before they affect SLAs.$ In the Lakeflow Jobs UI, open a job run, navigate to the 'Query Performance' tab to view metrics and insights, then click the `Optimize` button to open Genie Code for AI-assisted query improvements.
Improved Lakeflow Performance Observability will soon be available by default for workspaces with the compliance security profile enabled (2026-10-26) · Oct 2026
· source
＋Log collection3 featuresLogs and telemetrysince 2024▸
＋Lakeflow Connect ingestionshippedProvides high-throughput data ingestion into the lakehouse, including Apache Arrow Flight support for Zerobus Ingest.44 releases · 3 other sources · first seen Feb 2024▸
Shared capability: Log collection
release
44 total
Databricks' Zerobus Ingest in Lakeflow Connect now supports ingesting into tables backed by default storage at general availability.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Zerobus Ingest into default storage is now generally available (2026-11-02) · Nov 2026
· source
· release history
Ingest security alerts from Microsoft Defender XDR, Microsoft Sentinel, and other Microsoft security products into Databricks using the new managed Microsoft Graph Logs connector, now in Beta in Lakeflow Connect, with OAuth machine-to-machine authentication via a Microsoft Entra ID application and incremental…
Microsoft Graph Logs connector is available in Beta (2026-10-30) · Oct 2026
· source
· release history
Adds a managed PayPal connector (Beta) to Databricks Lakeflow Connect, supporting ingestion of transactions, disputes, invoices, balances, catalog products, and billing plans from PayPal into Databricks via OAuth client credentials with incremental ingestion.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
PayPal connector is available in Beta (2026-10-24) · Oct 2026
· source
· release history
Adds a managed Google Analytics Aggregated connector to Lakeflow Connect (Beta), supporting incremental ingestion of Google Analytics 4 report data — user activity, acquisition, engagement, monetization, demographics, and tech reports.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Google Analytics Aggregated connector is available in Beta (2026-10-23) · Oct 2026
· source
· release history
Adds the Box Audit Logs connector in Lakeflow Connect (Beta) to ingest enterprise audit events from Box into Databricks.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Box Audit Logs managed ingestion connector (Beta) (2026-10-23) · Oct 2026
· source
· release history
Adds a managed Asana connector in Lakeflow Connect (Beta) to ingest Asana work management data — workspaces, teams, projects, tasks, portfolios, and goals — into Databricks using OAuth U2M authentication; workspace admins enable it from the Previews page.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Asana connector is available in Beta (2026-10-20) · Oct 2026
· source
· release history
docs
Oct 7, 2026 This page describes how to ingest data into Databricks using SQL and Spark APIs, which offer higher levels of ingestion pipeline customization compared to the managed connectors. Use it to choose an ingestion approach by data source and level of pipeline customization.
seen Oct 2026
· source
Oct 7, 2026 has connectors to ingest data from databases, enterprise applications, files, and streaming sources. Choose fully managed connectors for minimal operational overhead, or SQL and Spark APIs for access to a wider range of sources from within your pipelines and queries.
seen Oct 2026
· source
example
Enable the Oracle Eloqua connector Beta for your workspace before building an ingestion pipeline.$ In the Databricks console, go to Settings > Previews, find 'Oracle Eloqua connector', and toggle it on.
Oracle Eloqua connector is available in Beta (2026-10-20) · Oct 2026
· source
＋1Password Event Logs connectorshippedIngests 1Password audit events into Databricks via Lakeflow Connect, with workspace admins able to enable or disable the connector from the Previews page.2 releases · 1 other source · first seen Sep 2026▸
Shared capability: Log collection
release
Adds a 1Password Event Logs connector to Lakeflow Connect for ingesting item usages and sign-in attempts via the 1Password Events API
1Password Event Logs connector (Beta) â · Sep 2026
· source
· release history
Workspace admins can enable or disable the 1Password Event Logs connector from the Previews page.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
1Password Event Logs connector (Beta) (2026-09-28) · Sep 2026
· source
· release history
example
Enable the 1Password Event Logs connector for your workspace to start pulling 1Password audit events into Databricks.$ In the Databricks workspace, go to Settings > Previews, locate '1Password Event Logs connector', and toggle it on.
1Password Event Logs connector (Beta) (2026-09-28) · Sep 2026
· source
＋CrowdStrike Falcon Event Stream connectorshippedIngests CrowdStrike Falcon event stream data into Databricks via Lakeflow Connect.1 other source · first seen Sep 2026▸
Shared capability: Log collection
example
Enable the CrowdStrike Falcon Event Stream connector Beta for your workspace before configuring ingestion pipelines.$ In the Databricks workspace, go to Settings > Previews, locate 'CrowdStrike Falcon Event Stream connector', and toggle it on.
CrowdStrike Falcon Event Stream connector (Beta) (2026-09-28) · Sep 2026
· source
＋Log retention management1 featureLogs and telemetrysince 2023▸
＋Account-level system table retentionshippedEnables account-wide configurable data retention periods for supported system tables.4 releases · first seen Sep 2023▸
Shared capability: Log retention management
release
Adds account-wide configurable data retention period (30–3,650 days) for supported system tables, settable by account admins.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Configurable retention for system tables is in Beta (2026-09-09) · Sep 2026
· source
· release history
Makes jobs, job_tasks, job_run_timeline, and job_task_run_timeline system tables generally available for querying account-wide job insights
Lakeflow jobs system tables are now generally available (GA) · Jan 2026
· source
· release history
Adds system.access.workspaces_latest system table to monitor the latest state of all active workspaces in your account
Workspaces system table now available (Public Preview) · May 2025
· source
· release history
System tables now include a marketplace schema that stores Marketplace provider data.
System tables now include Marketplace schema (Public Preview) · Sep 2023
· source
· release history
＋Log search1 featureLogs and telemetrysince 2020▸
＋AI Search indexesshippedEnables vector and keyword search over indexed data, with support for indexing and filtering struct and map columns, and filter-only queries that return matching rows without requiring vector or keyword retrieval.23 releases · 1 other source · first seen Feb 2020▸
Shared capability: Log search
release
23 total
Adds the tokenizer_morph template to lakebase_tokenizer 0.2.0, which uses morphological analysis with bundled language dictionaries to segment CJK text — supporting compound-word modes (whole, split, or both), Japanese particle/function-word filtering and base-form conversion, and Korean particle/ending…
Lakebase Search supports Chinese, Japanese, and Korean full-text search (2026-10-15) · Oct 2026
· source
· release history
CJK tokenizer output is compatible with GIN indexes, the lakebase_text index, and the lakebase_bm25 index for BM25 ranking, so existing index infrastructure works unchanged.
Lakebase Search supports Chinese, Japanese, and Korean full-text search (2026-10-15) · Oct 2026
· source
· release history
Extends ai_parse_document to extract chart values, series, legends, and axes as structured JSON, enabling search and agents to use chart data in answers.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
ai_parse_document now extracts chart data as JSON (2026-10-05) · Oct 2026
· source
· release history
Adds lakebase_search as a knowledge source type in ai_search, enabling retrieval from Lakebase synced tables with Lakebase Search enabled — combinable with vector_search sources in the same call.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
ai_search can search Lakebase synced tables (Beta) (2026-09-24) · Sep 2026
· source
· release history
Supports hybrid search by combining lakebase_vector and lakebase_text to return semantic and exact-term matches in a single ranked list within one Lakebase database.
Lakebase Search is generally available (2026-09-18) · Sep 2026
· source
· release history
Adds the lakebase_text Postgres extension with the lakebase_bm25 index type for BM25 full-text search using standard tsvector types and operators, adding BM25 ranking and top-K pushdown not available in PostgreSQL's native GIN index.
Lakebase Search is generally available (2026-09-18) · Sep 2026
· source
· release history
example
Upgrade an existing lakebase_tokenizer installation to 0.2.0 to gain CJK support without rebuilding existing configurations or indexes.$ ALTER EXTENSION lakebase_tokenizer UPDATE;
Lakebase Search supports Chinese, Japanese, and Korean full-text search (2026-10-15) · Oct 2026
· source
＋Log parsing and normalization1 featureLogs and telemetrysince 2025▸
＋Audit log event field updatesshippedRenames the share field in deltaSharingProxy audit log events to share_name.1 release · first seen Dec 2025▸
Shared capability: Log parsing and normalization
release
The share field in deltaSharingProxy* audit log events is renamed to share_name.
Update request parameters for Delta Sharing recipient audit log events · Dec 2025
· source
· release history
＋Log routing1 featureLogs and telemetrysince 2021▸
＋Audit Log Delivery CapabilitiesshippedProvides configurable audit log delivery, including standard delivery to S3 and low-latency delivery for premium accounts.3 releases · first seen Mar 2021▸
Shared capability: Log routing
Also counts toward: S3 export
release
Enables history_tracking in Lakeflow Connect managed connector configuration to maintain change history (SCD Type 2) instead of overwriting records (SCD Type 1)
Salesforce ingestion connector supports history tracking (SCD type 2) · Oct 2025
· source
· release history
Databricks releases AWS PrivateLink in public preview for E2 workspaces, enabling private VPC endpoints for frontend and backend connectivity.
AWS PrivateLink for Databricks workspaces (Public Preview) · Apr 2021
· source
· release history
Adds the modification_time field to the FileInfo response structure for DBFS REST API get-status and list endpoints
Added modification_time to the DBFS REST API get-status and list responses · Mar 2021
· source
· release history
＋Distributed tracing1 featureLogs and telemetrysince 2026▸
＋Coding agent governanceshippedProvides visibility into coding agent activity, including tool and skill usage, via unified tracing in the Govern traces UI.1 release · 1 other source · first seen Sep 2026▸
Shared capability: Distributed tracing
release
Adds coding-agent activity (tools and skills used) to Unity Gateway unified tracing, viewable in Govern > Traces or via Genie.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Unified tracing now includes coding agent activity (2026-09-22) · Sep 2026
· source
· release history
example
Workspace admins enabling managed warehouse so analysts can view MLflow traces without configuring a SQL warehouse$ In the Databricks console, go to Settings > Previews and enable 'Managed Warehouse for MLflow'.
Managed warehouse for MLflow (Beta) (2026-11-02) · Nov 2026
· source
＋Other / not yet classified192 featuresFeatures we have not matched to a capability yet. A suggested match is marked.▸
＋Enhanced security and compliance controlsshippedImplements hardened security measures, compliance certifications, and restricted access settings for enterprise-grade data protection.94 releases · first seen Aug 2022▸
release
94 total
Account-level security features covering network connectivity (private connectivity), network security (ingress/egress controls), encryption, and enhanced security and compliance are now automatically available to all accounts upon General Availability, removing the requirement for account admins to manually enable…
Account-level security features are now available by default at GA (2026-10-26) · Oct 2026
· source
· release history
Adds Jailbreak guardrail support in Unity Gateway to screen MCP tool calls and their results for jailbreak and prompt injection attempts, applicable on input, output, or both.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Screen MCP tool calls and results for jailbreaks (Beta) (2026-10-21) · Oct 2026
· source
· release history
Enables the READ METADATA privilege by default for workspaces with the compliance security profile enabled, covering all supported compliance standards.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
READ METADATA privilege support for compliance security profile standards (2026-10-16) · Oct 2026
· source
· release history
Enables the Context-Based Ingress: Workspace Private Access Policies feature via the account console Previews page for accounts where it is not yet active.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Context-based ingress policies for inbound private connectivity are now generally available (2026-10-12) · Oct 2026
· source
· release history
Cross-engine attribute-based access controls (ABAC) is now generally available, allowing supported external engines to read Unity Catalog managed tables with ABAC policies, row filters, and column masks enforced by Databricks serverless compute.
Cross-engine attribute-based access controls (ABAC) is now generally available · Oct 2026
· source
· release history
Adds the ability to restrict a service principal's OAuth secret to specific API scopes such as sql or jobs, rather than granting access to all APIs.
Restrict service principal OAuth secrets to specific API scopes тАЛ · Aug 2026
· source
· release history
＋Centralized data governance and security via Unity CatalogshippedProvides account-wide governance, security policies, and data sharing capabilities through a unified catalog system.76 releases · first seen Mar 2022▸
Also counts toward: Terraform provider
release
76 total
Control history sharing on views with WITH HISTORY and WITHOUT HISTORY clauses on ALTER SHARE ADD VIEW and ALTER SHARE ALTER VIEW; existing history defaults are unchanged.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Databricks Runtime 19: November 2, 2026 (2026-11-02) · Nov 2026
· source
· release history
Discover Unity Catalog secrets and their metadata without read access to values or code references by granting BROWSE on a catalog, now extended to cover Unity Catalog secrets.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Higher limits and BROWSE support for Unity Catalog secrets (2026-11-02) · Nov 2026
· source
· release history
Enables metastore admins to apply Unity Catalog permissions on the system.ai schema to control which task-specific AI Functions users can run.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
AI Functions Unity Catalog permissions is now generally available (2026-10-27) · Oct 2026
· source
· release history
Enables tag propagation in Unity Catalog (Beta): when activated for a governed tag, Unity Catalog uses lineage to automatically apply that tag to derived tables and views whenever CREATE TABLE AS SELECT, CREATE VIEW, INSERT INTO ...︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄ SELECT, or MERGE runs, keeping classification and…
Governed tag propagation is in Beta (2026-10-12) · Oct 2026
· source
· release history
Adds ABAC GRANT policies to dynamically grant Unity Catalog privileges on models, model services, and MCP services based on governing tags
ABAC GRANT policies are generally available for models and services тАЛ · Aug 2026
· source
· release history
Adds support for the has_identity_attribute_tag_match function in the WHEN clause of Unity Catalog ABAC column mask policies to target users by synced identity attribute tags
Identity attributes in ABAC column mask policies (Beta) тАЛ · Aug 2026
· source
· release history
＋Genie AI assistantshippedProvides conversational AI assistance across data and code workflows, with Genie One and Genie Agents able to use models served through OpenAI on Databricks when partner-powered AI features are enabled.56 releases · 8 other sources · first seen Jan 2019▸
Also counts toward: Built-in AI assistant
release
56 total
Links to volume files in an embedded Genie Agent now open the file directly instead of redirecting users to the workspace.
Genie Agents enhancements and bug fixes (2026-10-29) · Oct 2026
· source
· release history
Databricks Genie Agents now retrieves files faster when answering questions (Beta).
Genie Agents enhancements and bug fixes (2026-10-29) · Oct 2026
· source
· release history
Databricks Genie Agents adds a guided creation experience that walks through building an effective Genie Agent.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Genie Agents enhancements and bug fixes (2026-10-29) · Oct 2026
· source
· release history
Adds conversation outline along the left edge of Genie One conversations to jump between messages and hover-preview responses.
Genie One enhancements (2026-10-22) · Oct 2026
· source
· release history
Genie Ontology now extracts snippets from queries run by external tools such as dbt on Databricks, surfacing those runs in query history alongside native queries (Public Preview).
Genie One enhancements (2026-10-22) · Oct 2026
· source
· release history
Adds Genie Code task type to Lakeflow Jobs, which runs a prompt autonomously, reads upstream task outputs, calls tools as needed, and returns a link to the resulting Genie Code chat.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Genie Code tasks in Lakeflow Jobs are now generally available (2026-10-21) · Oct 2026
· source
· release history
docs
Sep 14, 2026 Transcribe audio: ai_transcribe Transcribe an audio file to text, with per-segment timestamps and automatic speaker labeling when enabled.
docs update · Sep 2026
· source
example
7 total
Enable Genie Agent file analysis for Unity Catalog volumes so your workspace can query PDFs and slide decks with cited answers.$ In the Databricks workspace, go to Settings > Previews and enable 'Analyze files in volumes with a Genie Agent'.
Genie Agents enhancements (2026-11-02) · Nov 2026
· source
Download a Genie One chat session to share or archive a conversation with your team.$ In Genie One, open the sidebar and select 'Manage chats', then choose the chat you want and select 'Download'.
Genie One enhancements (2026-10-01) · Oct 2026
· source
Upload a text file for analysis in a Genie One session$ Upload .txt file to Genie One conversation
Genie One enhancements (2026-10-01) · Oct 2026
· source
Export a completed chat for record-keeping$ Download Genie One chat via sidebar management
Genie One enhancements (2026-10-01) · Oct 2026
· source
Submit a one-time Databricks run with standard performance mode to control cost vs. speed trade-offs at submission time.$ curl -X POST https://<databricks-instance>/api/2.1/jobs/runs/submit \ -H 'Authorization: Bearer <token>' \ -H 'Content-Type: application/json' \ -d '{"performance_target": "STANDARD", "run_name":…
Standard performance mode is now available for one-time runs in the Jobs API (2026-09-11) · Sep 2026
· source
Steer a long-running Genie One response mid-flight to refocus the answer without cancelling and restarting.$ While Genie One is generating a response, type a steering message (e.g.
Genie One enhancements (2026-09-10) · Sep 2026
· source
＋Foundation Model APIsshippedProvides access to hosted third-party large language models — including Anthropic, Google Gemini, and OpenAI models — through a unified API gateway (Unity Gateway / Foundation Model APIs) with pay-per-token pricing.61 releases · 1 other source · first seen Aug 2023▸
Also counts toward: REST API
release
61 total
Adds OpenAI GPT-6.1 Terra model access on Unity Gateway via Foundation Model APIs.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
OpenAI GPT-6.1 Terra is now available on Unity Gateway (2026-10-27) · Oct 2026
· source
· release history
Adds DeepSeek V4.1 Flash (1017) model to Unity Gateway, accessible via Foundation Model APIs, supporting text and image inputs.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
DeepSeek V4.1 Flash (1017) is now available on Unity Gateway (2026-10-19) · Oct 2026
· source
· release history
Adds TypeSafe AI Jev 1.14.0 as an externally-hosted model on Unity Gateway, requiring an account admin to enable the Externally-hosted TypeSafe AI Models preview.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
TypeSafe AI Jev 1.14.0 is now available on Unity Gateway (2026-10-16) · Oct 2026
· source
· release history
Account admins can set budgets and rate limits, or disable direct model access, for consumer access users to control increased model traffic to external providers.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Consumer access to query Unity Gateway services is generally available (2026-10-15) · Oct 2026
· source
· release history
Adds Google Gemini 4 Argon model support on Unity Gateway, accessible through Foundation Model APIs.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Google Gemini 4 Argon is now available on Unity Gateway (2026-10-13) · Oct 2026
· source
· release history
Adds the Unity Gateway Skills REST API in Beta, supporting create, read, update, list, delete, and finalize operations.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Unity Gateway Skills API and developer tools are available in Beta (2026-10-12) · Oct 2026
· source
· release history
docs
Oct 16, 2026 AI Function inference costs are recorded in the system.billing.usage table under one of two products: are recorded under the product with the offering type.
seen Oct 2026
· source
＋Unified job orchestration and managementshippedEnables creating, scheduling, and monitoring complex multi-task data pipelines with shared clusters, inter-task communication, and real-time UI visibility.48 releases · 1 other source · first seen Jan 2022▸
Also counts toward: Scheduled jobs, Web management console
release
48 total
Configure a Lakeflow Job to run automatically when one or more upstream jobs complete, including jobs in other workspaces sharing the same Unity Catalog metastore, by setting dependencies on the downstream job.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Trigger Lakeflow Jobs when upstream jobs complete (Beta) (2026-11-03) · Nov 2026
· source
· release history
Adds the ability to define automation rules using natural language via Genie or manually by specifying scope, conditions, and action
Tag automations (Beta) тАЛ · Aug 2026
· source
· release history
Adds a new SQL alert task in Lakeflow Jobs that evaluates a Databricks SQL alert and returns its state as a task output value for branching.
SQL alert task in Lakeflow Jobs is now generally available · Jun 2026
· source
· release history
Adds the ability to show the latest scheduled notebook run directly within your notebook and notebook dashboards
View latest scheduled notebook job results · Dec 2025
· source
· release history
Adds trigger, trigger_type, run_as_user_name, creator_user_name, paused, timeout_seconds, health_rules, deployment, and create_time columns to the jobs table.
New columns in Lakeflow system tables (Public Preview) · Dec 2025
· source
· release history
Enables triggering job runs to backfill data from the past for loading older data or repairing processing failures
Create backfill job runs · Oct 2025
· source
· release history
example
Trigger a downstream Lakeflow Job in another workspace as soon as an upstream job finishes, without manual scheduling.$ In the Databricks UI, open the downstream job, go to Triggers, select 'Add trigger', choose 'Job completion', and specify the upstream job (including cross-workspace jobs attached to the same Unity…
Trigger Lakeflow Jobs when upstream jobs complete (Beta) (2026-11-03) · Nov 2026
· source
＋Unified Experiment Tracking and Model ManagementshippedIntegrates MLflow as a hosted service for tracking experiments and registering models, with automatic run logging for MLlib pipelines and native integration into the Databricks Workspace UI.35 releases · first seen Mar 2019▸
Also counts toward: Web management console
release
35 total
MLflow trace storage in Unity Catalog tables moves from Beta to Public Preview, allowing traces to be stored in OpenTelemetry (OTel) format and queried via Databricks SQL or the MLflow Python SDK
MLflow trace storage in Unity Catalog is now in Public Preview · Apr 2026
· source
· release history
Makes MLflow tracking metadata accessible via Databricks system tables, enabling central visibility and lakehouse-based analysis across the workspace
MLflow metadata is now available in system tables (Public Preview) · Sep 2025
· source
· release history
AutoML now supports sample weights for classification, letting you adjust the importance of each class during classification model training
Databricks Runtime 15.4 LTS for Machine Learning · Aug 2024
· source
· release history
Integrates MLflow Tracing for analyzing and comparing traces across code execution
Mosaic AI Agent Framework (Public Preview) · Jun 2024
· source
· release history
Introduces a revamped parallel coordinates experience for hyperparameter tuning within the experiment UI.
Improvements to the MLflow experiment UI · Feb 2023
· source
· release history
Enhances the streamlined table view with improvements for search and filtering of training runs.
Improvements to the MLflow experiment UI · Feb 2023
· source
· release history
＋Shopify connector ingestionshippedIngests Shopify data such as products, orders, and inventory into Databricks via Lakeflow Connect.33 releases · first seen Jan 2022▸
release
33 total
Adds a Shopify connector in Lakeflow Connect (Beta) that ingests products, orders, customers, inventory, fulfillments, and discounts from Shopify into Databricks using the Shopify OAuth client credentials grant; workspace admins enable it via the Previews page.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Shopify connector (Beta) (2026-09-22) · Sep 2026
· source
· release history
Adds Shopify connector (Beta) to Lakeflow Connect for ingesting products, orders, customers, inventory, fulfillments, and discounts from Shopify into Databricks.
Shopify connector (Beta) â · Sep 2026
· source
· release history
Enables ingestion of standard objects, custom objects, system tables, and audit trail tables from Veeva Vault using OAuth 2.0 M2M authentication via Microsoft Entra ID
Veeva Vault connector (Beta) · Jul 2026
· source
· release history
Introduces IP access lists and region restrictions to restrict recipient access to downloading credential files or querying data
Delta Sharing is GA · Aug 2022
· source
· release history
Supports sharing incremental versions or querying changes via Change Data Feeds
Delta Sharing is GA · Aug 2022
· source
· release history
Adds a new UI to create and manage providers, recipients, and shares
Delta Sharing is GA · Aug 2022
· source
· release history
＋Model Serving availabilityshippedOffers a generally available, highly available service for deploying machine learning models with low latency.24 releases · first seen Mar 2023▸
release
24 total
Allows sending Content-Type: application/x-protobuf requests with a serialized KServe v2 ModelInferRequest to custom model serving endpoints.
Protobuf tensor input for custom model serving endpoints (Public Preview) · Jul 2026
· source
· release history
Databricks extends Mosaic AI Model Serving with a new generative model option for Beta users in two specific regions.
Alibaba Cloud Qwen3-Next Instruct now available in Beta · Oct 2025
· source
· release history
Adds GPT-5, GPT-5 mini, and GPT-5 nano to Mosaic AI Model Serving's supported model list (Public Preview)
Mosaic AI Model Serving now supports OpenAI GPT 5 models (preview) · Oct 2025
· source
· release history
Adds OpenAI GPT OSS 20B to the list of Databricks-hosted foundation models available via Mosaic AI Model Serving
OpenAI GPT OSS models now available on Mosaic AI Model Serving · Aug 2025
· source
· release history
Adds Claude Opus 4 model availability in Mosaic AI Model Serving for Databricks-hosted foundation models.
Claude Sonnet 4 and Claude Opus models now available on Mosaic AI Model Serving · May 2025
· source
· release history
Adds Claude Sonnet 4 model availability in Mosaic AI Model Serving for Databricks-hosted foundation models.
Claude Sonnet 4 and Claude Opus models now available on Mosaic AI Model Serving · May 2025
· source
· release history
＋Workspace and Account Management APIsshippedProvides programmatic access to manage account administrators, subscriptions, billing, and workspace configurations via REST APIs.24 releases · first seen Feb 2021▸
Also counts toward: REST API, SCIM provisioning API, Web management console
release
24 total
Adds New definition dropdown menus to the compute policy form, allowing configuration of rules without referencing raw policy syntax
New compute policy form (Public Preview) · Jul 2025
· source
· release history
Adds the ability to add and update payment methods (credit cards and AWS Marketplace accounts) in the Subscription and billing tab.
Improved admin billing settings · May 2025
· source
· release history
Adds API endpoints to manage the automatic_cluster_update settings for workspaces
New compliance and security settings APIs (Public Preview) · May 2024
· source
· release history
Adds a View YAML/JSON option on the job details page in the Databricks UI to view and copy the YAML source of a job.
View the YAML source for a Databricks job · Oct 2023
· source
· release history
Workspace admins can add libraries to compute policies, enabling automatic installation on associated compute resources.
Libraries now supported in compute policies (Public Preview) · Oct 2023
· source
· release history
The /api/2.1/unity-catalog/workspace-bindings/ API endpoint is deprecated and replaced by /api/2.1/unity-catalog/bindings/
Use workspace-catalog binding to give read-only access to a catalog · Oct 2023
· source
· release history
＋Structured Streaming ETL PipelinesshippedEnables the creation, management, and monitoring of cloud-based ETL pipelines with declarative interfaces, test-driven development support, and incremental reprocessing capabilities.22 releases · first seen May 2021▸
release
22 total
Source stage adaptive repartitioning now automatically adjusts the number of tasks reading from Kafka or Kinesis sources to match traffic, removing the need to manually set maxPartitions or shardsPerTask.
Multiple real-time flows per serverless pipeline and source stage adaptive repartitioning are in Beta (2026-10-28) · Oct 2026
· source
· release history
Adds import_checkpoint capability on an append_flow to migrate existing Structured Streaming workloads without reprocessing the source.
Managed tables in Lakeflow pipelines (Beta) â · Sep 2026
· source
· release history
Adds WHERE clause support to the REFRESH STREAMING TABLE command to override a standalone streaming table's REPLACE WHERE predicate for a single refresh
Override the REPLACE WHERE predicate for a single refresh · Jul 2026
· source
· release history
Generally available: the @dp.update_flow decorator in Spark Declarative Pipelines on Lakeflow supports writing to a sink in update output mode, emitting only changed rows per batch without requiring a watermark for stateful aggregations
The update_flow API for Spark Declarative Pipelines on Lakeflow is generally available · Jun 2026
· source
· release history
Adds the update_flow decorator for Spark Declarative Pipelines on Lakeflow to enable real-time mode with end-to-end latency as low as five milliseconds
Real-time mode in Spark Declarative Pipelines on Lakeflow , and the update_flow API are now available (Public Preview) · May 2026
· source
· release history
Standalone pipelines (renamed from pipelines on Databricks SQL), including materialized views and streaming tables, can now be created from a notebook running on serverless general compute
Standalone pipelines on serverless general compute (Beta) · May 2026
· source
· release history
＋Auto CDF performance improvementsshippedMakes MERGE and UPDATE operations approximately 15% faster on tables queried for changes by eliminating write-time overhead.21 releases · first seen Jan 2019▸
release
21 total
Limits secret-accessing Unity Catalog Scala UDFs to serverless SQL warehouses only among SQL warehouse types; dedicated access mode compute does not support direct invocation.
Scala UDFs can access Unity Catalog secrets (2026-09-23) · Sep 2026
· source
· release history
Introduces Automatic Change Data Feed (Auto CDF), which computes row-level changes at query time using row tracking — eliminating the need to enable change data feed on each individual Delta Lake or Apache Iceberg v3 table.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Automatic change data feed will soon be available in all supported regions (2026-09-15) · Sep 2026
· source
· release history
Auto CDF makes MERGE and UPDATE operations approximately 15% faster on tables queried for changes by eliminating write-time overhead.
Automatic change data feed is now generally available (2026-09-01) · Sep 2026
· source
· release history
Newly deployed agents after November 1, 2025 will not include the experimental feedback model
Feedback model deprecated for AI agents · Oct 2025
· source
· release history
Compare runs UI gains a parallel coordinates plot for n-dimensional parameter/metric analysis
MLflow 1.1 brings several UI and API improvements · Aug 2019
· source
· release history
Adds DeleteTag API endpoint for removing tags from MLflow runs
MLflow 1.1 brings several UI and API improvements · Aug 2019
· source
· release history
＋Change Data Feeds and data sharingshippedEnables the detection of data changes over time and the secure sharing of incremental datasets with external providers.19 releases · 1 other source · first seen Aug 2022▸
release
19 total
Introduces SEQUENCE BY column support in REPLACE USING flows to order updates and resolve out-of-order arrivals by highest sequence win.
REPLACE USING flows for standalone streaming tables (Beta) тАЛ · Aug 2026
· source
· release history
Adds REPLACE USING flow capability for standalone streaming tables (Beta) to replace rows matching key columns while preserving others.
REPLACE USING flows for standalone streaming tables (Beta) тАЛ · Aug 2026
· source
· release history
Adds the ability to read a change data feed from a materialized view in Databricks SQL or Lakeflow pipelines using Databricks Runtime 18 LTS or above
Change data feed on materialized views (Beta) тАЛ · Aug 2026
· source
· release history
Adds OIDC federation support for Databricks-to-open Delta Sharing, allowing recipients to use JSON web tokens (JWT) from their own IdP as short-lived OAuth tokens.
OIDC federation for Databricks-to-open Delta Sharing is generally available · Jun 2025
· source
· release history
Databricks now supports sharing managed Iceberg tables via Delta Sharing in both Databricks-to-Databricks and open sharing modes during Public Preview.
Sharing managed Iceberg tables in Delta Sharing is in Public Preview · Jun 2025
· source
· release history
Adds AUTO CDC INTO SQL API to create flows supporting change data feeds in Spark Declarative Pipelines on Lakeflow
AUTO CDC APIs replace APPLY CHANGES · Jun 2025
· source
· release history
example
Add a view to a Delta Sharing share while exposing its full history to recipients.$ ALTER SHARE my_share ADD VIEW my_catalog.my_schema.my_view WITH HISTORY;
Databricks Runtime 19: November 2, 2026 (2026-11-02) · Nov 2026
· source
＋Delta Lake Optimization and Catalog IntegrationshippedMakes Delta time travel generally available, introduces automatic table optimization, and adds support for Glue Catalog integration.20 releases · first seen Apr 2019▸
release
20 total
Support grouping multiple SQL statements across one or more tables into a single atomic transaction using BEGIN TRANSACTION; ... COMMIT; syntax.
Transactions are now generally available · Jul 2026
· source
· release history
Auto-TTL for automatic row deletion is now generally available for Unity Catalog managed Delta Lake, Apache Iceberg, and streaming tables.
Auto time-to-live for automatic row deletion is generally available · Jun 2026
· source
· release history
Enables new features such as multi-statement, multi-table transactions when catalog commits are enabled on a Unity Catalog managed Delta table.
Catalog commits are now generally available · May 2026
· source
· release history
ALTER TABLE ... SET MANAGED command is available in Public Preview to convert Unity Catalog external tables to managed tables
Convert to Unity Catalog managed table from external table is in Public Preview · Jun 2025
· source
· release history
Allows recomputing data skipping statistics for Delta tables after changing columns used for data skipping.
Databricks Runtime 14.3 LTS · Feb 2024
· source
· release history
Predictive optimization removes the need for manual maintenance operations.
Predictive optimization (Public Preview) · Oct 2023
· source
· release history
＋Asset governance via tagsshippedSupports governed and ungoverned key-value tags on dashboards, notebooks, Databricks apps, and Genie Agents for organization.18 releases · 1 other source · first seen Jul 2023▸
release
18 total
Adds NOCOPY * modifier to CREATE OR REPLACE VIEW <catalog>.<schema>.<view> NOCOPY * to explicitly drop grants, tags, and comments when replacing a view (governed tags are still retained).︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
CREATE OR REPLACE VIEW will soon preserve grants, comments and tags by default (2026-10-06) · Oct 2026
· source
· release history
Raises a CANNOT_DROP_TAGGED_COLUMN error when a governed tag on a view column is not removed before dropping that column via CREATE OR REPLACE VIEW, protecting dependent ABAC policies.
CREATE OR REPLACE VIEW will soon preserve grants, comments and tags by default (2026-10-06) · Oct 2026
· source
· release history
Starting December 2, 2026, CREATE OR REPLACE VIEW no longer drops and re-creates the view — it updates in-place, preserving grants, tags, and comments.
CREATE OR REPLACE VIEW will soon preserve grants, comments and tags by default (2026-10-06) · Oct 2026
· source
· release history
Supports governed and ungoverned key-value tags on dashboards, notebooks, Databricks apps, and Genie Agents to organize and categorize workspace assets (now generally available).︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Tags for dashboards, notebooks, Databricks apps, and Genie Agents are now generally available (2026-09-25) · Sep 2026
· source
· release history
Adds the Tags page in Governance Hub (Beta) to summarize governed tag usage, recent assignments, sources, and recommendations for invalid or missing tags.
Tags page in Governance Hub (Beta) тАЛ · Aug 2026
· source
· release history
Adds the system.tags.governed_tags system table (Beta) to list all governed tag keys, including customer-created and system-generated ones.
Governed tags system table is in Beta · Jul 2026
· source
· release history
example
Explicitly drop grants, tags, and comments when replacing a view — necessary after December 2, 2026 when the default changes to in-place preservation.$ CREATE OR REPLACE VIEW main.analytics.my_view NOCOPY * AS SELECT id, name FROM main.raw.source_table;
CREATE OR REPLACE VIEW will soon preserve grants, comments and tags by default (2026-10-06) · Oct 2026
· source
＋Genie web searchshippedEnables Genie One and Genie Agents to search the public web for current information such as release notes, third-party documentation, and news, citing each source as an openable link in responses.19 releases · first seen Feb 2020▸
release
19 total
Adds support for creating managed tables in Lakeflow pipelines and writing to them via one or more append flows using append_flow (Beta).︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Managed tables in Lakeflow pipelines (Beta) (2026-09-10) · Sep 2026
· source
· release history
Adds maintenance window scheduling for continuous Lakeflow pipelines, letting you specify a day of the week, start hour, and time zone so Databricks applies runtime upgrades and serverless infrastructure restarts only within that one-hour window — configurable via the Jobs UI, the Pipelines UI, or the Jobs REST…
Maintenance windows for continuous pipelines (2026-09-10) · Sep 2026
· source
· release history
Adds import_checkpoint on append_flow to migrate existing Structured Streaming workloads into a Lakeflow pipeline without reprocessing the source.
Managed tables in Lakeflow pipelines (Beta) (2026-09-10) · Sep 2026
· source
· release history
Adds create_table and CREATE TABLE ... FLOW (pipelines) syntax for defining managed tables and flows within Lakeflow pipelines.
Managed tables in Lakeflow pipelines (Beta) (2026-09-10) · Sep 2026
· source
· release history
Lakeflow Connect will default to incremental ingestion for Salesforce formula fields instead of taking a full snapshot on every pipeline run, improving performance and reducing cost.
Incremental ingestion for Salesforce formula fields in Lakeflow Connect will soon be generally available (2026-09-08) · Sep 2026
· source
· release history
When incremental Salesforce formula field ingestion reaches GA, full snapshots will no longer be the default for Lakeflow Connect pipeline runs — existing pipelines that relied on the full-snapshot default will change behavior on upgrade.
Incremental ingestion for Salesforce formula fields in Lakeflow Connect will soon be generally available (2026-09-08) · Sep 2026
· source
· release history
＋SQLware and Databricks SQL previewshippedIntroduces SQL warehouses for analytics workloads and a public preview environment for ad-hoc querying and dashboard creation.19 releases · first seen Nov 2020▸
release
19 total
Workspace administrators can now set a default SQL warehouse automatically selected in SQL editor, AI/BI dashboards, Genie Agents, Alerts, and Catalog Explorer
Default SQL warehouse settings (General Availability) · Feb 2026
· source
· release history
Adds st_dump, st_numinteriorrings, and st_interiorringn functions for polygon interior ring operations
Databricks Runtime 17.3 LTS · Oct 2025
· source
· release history
Adds support for LIMIT ALL in recursive common table expressions (CTEs) to remove row count restrictions
Databricks Runtime 17.3 LTS · Oct 2025
· source
· release history
Enables column recommendations from underlying table structure when autocompleting CTEs defined with SELECT *
Enhanced autocomplete for complex data types in notebooks · Aug 2025
· source
· release history
Adds INSERT REPLACE ON SQL command to Databricks Runtime 17.1 for replacing table rows based on a condition
Selectively replace data with INSERT REPLACE ON (Public Preview) · Jul 2025
· source
· release history
Adds the system.compute.warehouses system table to record SQL warehouse configurations as property change snapshots
Warehouses system table is now available (Public Preview) · Nov 2024
· source
· release history
＋External BI connector integrationsshippedEnables direct data integration and querying with external business intelligence tools such as Tableau and Microsoft Power BI.18 releases · first seen Sep 2020▸
release
18 total
Promotes the Arrow Database Connectivity (ADBC) driver for the Databricks connector for Power BI to general availability, replacing ODBC as the default driver for new connections in Power BI Desktop and the Power BI service.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
ADBC driver for Power BI is now generally available (2026-10-15) · Oct 2026
· source
· release history
Enables BI compatibility mode when creating a connection in Power BI to query Databricks metric views using standard SQL aggregation functions that automatically rewrite to correct measure definitions.
BI compatibility mode for metric views in Power BI (Beta) · Mar 2026
· source
· release history
Adds the ability to select tables from Catalog Explorer and import them as pivot tables in Google Sheets through the Databricks Connector.
Select tables and create pivot tables in Google Sheets · Feb 2026
· source
· release history
The Power BI Databricks connector adds support for Machine-to-Machine (M2M) OAuth authentication using the Client credentials flow.
Power BI Databricks connector supports M2M OAuth · Aug 2025
· source
· release history
Adds support for configuring the Databricks connector for Power BI to use the Arrow Database Connectivity (ADBC) driver instead of the ODBC driver
Databricks connector for Power BI now supports the ADBC driver (Public Preview) · Jul 2025
· source
· release history
Introduces Databricks Connector for Google Sheets to allow connecting from Google Sheets to a Databricks workspace
Databricks Connector for Google Sheets (Public Preview) · Mar 2025
· source
· release history
＋Private and secure network connectivityshippedAllows users to configure private access settings and restrict data access via IP allowlists and region restrictions.17 releases · first seen Aug 2022▸
Also counts toward: Web management console
release
17 total
Adds Partner Platforms as a selectable option under Network sources for context-based ingress control to allowlist IPs for third-party apps.
Allowlist partner platform IPs in context-based ingress control (Beta) · Jul 2026
· source
· release history
Enables connection of Databricks classic and serverless compute to on-premises resources via an SSH reverse tunnel with proxy VMs in AWS, eliminating the need for inbound firewall access.
Connect Databricks to on-premises resources using an SSH reverse tunnel · Apr 2026
· source
· release history
Enables AWS PrivateLink connectivity from serverless compute to VPC resources through a network load balancer (NLB).
PrivateLink connections from serverless compute to resources in your VPC through an NLB is in Public Preview · Jun 2025
· source
· release history
Unified login allows you to manage one SSO configuration for your Databricks account and workspaces.
Unified login is now generally available · Jun 2024
· source
· release history
Route optimized serving endpoints now enforce network restrictions such as IP access control lists or PrivateLink.
Route optimized serving endpoints enforce network restrictions · Jun 2024
· source
· release history
Enables the driver to accept a private signed CA if added to the Windows Trusted Root CA certificate store
Databricks ODBC driver 2.8.2 · Jun 2024
· source
· release history
＋Lakehouse FederationshippedProvides a query federation platform for ad hoc reporting and exploratory analysis against multiple external data sources without migrating data.17 releases · first seen Jul 2023▸
release
17 total
Adds ability to sync table and column comments from supported external data sources to foreign tables in Unity Catalog via Lakehouse Federation (Beta)
Comments on foreign tables (Beta) · Jun 2026
· source
· release history
Enables reading Iceberg tables managed by external catalogs (AWS Glue, Hive metastore, Snowflake Horizon Catalog) through Lakehouse Federation
Unity Catalog managed Apache Iceberg tables, foreign Apache Iceberg tables, and Apache Iceberg v3 features are generally available · May 2026
· source
· release history
Supports Oracle, Teradata, SQL Server, MySQL, MariaDB, PostgreSQL, and all Lakehouse Federation data sources using foreign catalog ingestion
Query-based connectors for Lakeflow Connect (Public Preview) · Apr 2026
· source
· release history
Enables external Delta Lake and Iceberg clients like Amazon Athena, Snowflake, and Microsoft Fabric to read Databricks data.
Compatibility Mode (Public Preview) · Oct 2025
· source
· release history
Adds beta support for Delta Sharing on Lakehouse Federation to share foreign schemas and tables created with query federation in Databricks-to-Databricks and open sharing scenarios
Delta Sharing on Lakehouse Federation is in Beta · Sep 2025
· source
· release history
Reads Iceberg tables managed by foreign catalogs (HMS, Glue, Snowflake Horizon Catalog) using Lakehouse Federation
Foreign Apache Iceberg tables are in Public Preview · Jun 2025
· source
· release history
＋Genie AgentsshippedProvides an agentic chat mode powered by upgraded large language models, with attached SQL functions displaying their descriptions for immediate user context.12 releases · 4 other sources · first seen Apr 2025▸
release
12 total
Content search details — such as the number of files indexed — are now hidden from users with CAN VIEW or CAN RUN permission on a Genie Agent (Beta).
Genie Agents enhancements and bug fixes (2026-10-29) · Oct 2026
· source
· release history
Enables file upload in Genie One and Genie Agents by default for workspaces with the compliance security profile enabled and a supporting compliance standard, allowing natural-language analysis of uploaded files alongside other data.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
File upload in Genie One and Genie Agents will soon be available by default for compliance security profile workspaces with supported compliance standards (2026-10-16) · Oct 2026
· source
· release history
Adds Flash (Beta) option to Agent mode, prioritizing response speed over depth for simpler, everyday tasks.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Genie Agents enhancements (2026-10-15) · Oct 2026
· source
· release history
Enables collaborative document editing in Genie One — users with CAN EDIT permission can now edit shared documents.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Genie One enhancements (2026-10-15) · Oct 2026
· source
· release history
Upgrades Agent mode underlying models for better long-context handling and faster responses.
Genie Agents enhancements (2026-10-15) · Oct 2026
· source
· release history
Adds databricks-agentbricks CLI for scaffolding agent projects from bundled framework templates, running them locally, and deploying to the Databricks agent runtime with managed memory, sessions, tools, and MLflow tracing.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Agent Bricks CLI is in Beta (2026-09-29) · Sep 2026
· source
· release history
docs
Oct 12, 2026 Custom-built for data science workflows, can orchestrate multi-step workflows from a single prompt. Chat with the Data Science Agent to build an entire notebook for tasks like EDA, forecasting, and machine learning from scratch.
docs update · Oct 2026
· source
Oct 6, 2026 An application with complex reasoning capabilities that allows it to create its own plan and carry out the task according to the tools at its disposal. See Components of an agent Ingest with SQL and Spark APIs Develop agents on MCPs
seen Oct 2026
· source
Oct 6, 2026 An application with complex reasoning capabilities that allows it to create its own plan and carry out the task according to the tools at its disposal. See Components of an agent Develop agents on MCPs
seen Oct 2026
· source
Oct 6, 2026 An application with complex reasoning capabilities that allows it to create its own plan and carry out the task according to the tools at its disposal. See Components of an agent Develop agents on
seen Oct 2026
· source
＋Genie Code dashboard authoringshippedEnables AI-assisted creation and editing of dashboards, automatically placing new widgets in available layout space and supporting import of ranked table calculations from Power BI and Tableau.14 releases · 1 other source · first seen Sep 2025▸
Also counts toward: Import from a competing product
release
14 total
Adds an Optimize button in the Lakeflow Jobs UI that opens Genie Code to surface query performance insights and improvement suggestions.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Improved Lakeflow Performance Observability is now generally available (2026-10-26) · Oct 2026
· source
· release history
Adds bulk import via Genie Code to bring up to 100 Power BI or Tableau files at a time into AI/BI dashboards and metric views.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Dashboard enhancements (2026-10-22) · Oct 2026
· source
· release history
The dashboard canvas now stays visible while Genie Code builds datasets step by step
Dashboard enhancements and bug fixes (2026-10-01) · Oct 2026
· source
· release history
Genie Code can create dashboard materializations on request (Beta).
Dashboard enhancements and bug fixes (2026-10-01) · Oct 2026
· source
· release history
Allows selecting multiple tables simultaneously in the Add data source picker when building a dashboard data model.
Dashboard enhancements and bug fixes (2026-10-01) · Oct 2026
· source
· release history
Genie Code can use images stored in your workspace as image widgets, not only uploaded files.
Dashboard enhancements and bug fixes (2026-10-01) · Oct 2026
· source
· release history
example
Review query performance bottlenecks and open Genie Code for AI-assisted query tuning after a serverless job run.$ In the Lakeflow Jobs UI, open a completed job run, select a supported task, view the query performance metrics and data volume metrics panel, then click 'Optimize' to open Genie Code with the…
Improved Lakeflow Performance Observability is now generally available (2026-10-26) · Oct 2026
· source
＋Serverless and classic compute environmentsshippedProvides selectable base compute environments for serverless and standard classic compute, with environment version 6 now available.15 releases · first seen Aug 2021▸
release
15 total
Sets environment_version to 6 or above in the UDF definition to unlock scalar UDF capabilities on serverless compute and other newly GA features.
Scalar and Batch Unity Catalog Python UDFs are now generally available (2026-09-23) · Sep 2026
· source
· release history
Adds environment version 6 as a selectable base environment for serverless and standard classic compute.
Environment version 6 is now available (2026-09-03) · Sep 2026
· source
· release history
Workspace admins can configure default Python package repositories for Lakeflow pipelines and classic compute workloads via the UI and API
Default Python package repositories are GA for Lakeflow pipelines and classic compute тАЛ · Aug 2026
· source
· release history
Enables choosing the serverless environment used for both interactive runs and scheduled jobs when working with visual data prep files
Lakeflow Designer Summer Release · Jul 2026
· source
· release history
Changes default behavior: serverless notebook tasks no longer automatically inherit the notebook's environment
Serverless notebook tasks can now use jobs environment · Nov 2025
· source
· release history
New compute policy form is generally available for configuring policy definitions using dropdown menus and other UI elements.
New compute policy form is now generally available · Oct 2025
· source
· release history
＋Auto Loader for cloud datashippedProvides incremental processing of new data files arriving on cloud blob stores during ETL, replacing inefficient file-based structured streaming.15 releases · first seen Feb 2020▸
release
15 total
Adds the addNewColumnsWithTypeWidening schema evolution mode to Auto Loader, enabling automatic widening of data types (e.g., int to long, float to double) without requiring a data rewrite.
Auto Loader supports automatic type widening (Public Preview) · Mar 2026
· source
· release history
Enables automatic type widening for text formats (JSON, CSV, XML) and binary formats (Avro, Parquet) in Auto Loader schema evolution.
Databricks Runtime 16.4 LTS — Auto Loader supports automatic type widening (Public Preview) · Mar 2026
· source
· release history
Extends automatic type widening support in Auto Loader to all file formats with schema evolution capabilities, including text formats (JSON, CSV, XML) and binary formats (Avro, Parquet).
Auto Loader supports automatic type widening (Public Preview) · Mar 2026
· source
· release history
Adds addNewColumnsWithTypeWidening schema evolution mode to Auto Loader, automatically widening data types like int to long or float to double without rewriting data.
Databricks Runtime 16.4 LTS — Auto Loader supports automatic type widening (Public Preview) · Mar 2026
· source
· release history
file_events flag enables Auto Loader to discover files with notification efficiency while retaining directory listing setup simplicity
Discover files in Auto Loader efficiently using file events · Dec 2025
· source
· release history
Allows defining pipeline settings directly in the Create Pipeline dialog in the DLT user-interface
Quickly define pipeline settings when you create a new DLT pipeline · Aug 2021
· source
· release history
＋Databricks AssistantshippedProvides code generation, debugging, optimization, and explanation capabilities directly in the notebook interface.14 releases · 1 other source · first seen Jun 2023▸
Also counts toward: Built-in AI assistant
release
14 total
Adds User skills to Databricks Assistant in Agent mode that follow the open Agent Skills standard and are automatically loaded when relevant.
Create skills for Databricks Assistant · Jan 2026
· source
· release history
Enables Databricks Assistant Agent mode by default for most customers to automate multi-step workflows from a single prompt
Databricks Assistant Agent mode is now in Public Preview · Dec 2025
· source
· release history
Adds Managed MCP Servers preview support to enable Databricks Genie Agents as tools in Microsoft Copilot Studio agents
Connect Genie Agents to Microsoft Copilot Studio (Public Preview) · Nov 2025
· source
· release history
Databricks Assistant is generally available with Databricks-hosted models on all cloud platforms at no additional cost.
Databricks-hosted models for Assistant are now GA · Aug 2025
· source
· release history
Adds the ability for Databricks Assistant to execute any code it generates directly on serverless compute.
Run code in Databricks Assistant on serverless compute · Apr 2025
· source
· release history
Adds table lineage and insights capabilities to Databricks Assistant prompts within Unity Catalog-enabled workspaces
Databricks Assistant provides table insights and lineage · Feb 2025
· source
· release history
example
Standardize code formatting within a notebook cell directly through the Assistant command line.$ /prettify
New slash commands for Databricks Assistant · Aug 2024
· source
＋Genomics pipeline capabilitiesshippedEnables genomic data processing workflows with variant calling, alignment, annotation parsing, and support for custom reference genomes and file formats like BAM, VCF, and GFF3.15 releases · first seen Jan 2020▸
release
15 total
Adds PrimaryKeys and ForeignKeys support in the JDBC driver when connecting to a server that has Unity Catalog enabled.
Databricks JDBC driver 2.6.33 · May 2023
· source
· release history
Supports handling of manifest blobs for metadata or large file indexing
Databricks Runtime 6.6 for Genomics GA · May 2020
· source
· release history
Enables configuration of a custom reference genome for alignment workflows
Databricks Runtime 6.6 for Genomics GA · May 2020
· source
· release history
Introduces per-sample pipeline timeouts to control execution duration per sample
Databricks Runtime 6.6 for Genomics GA · May 2020
· source
· release history
Provides a new BAM export option to write output in BAM format
Databricks Runtime 6.6 for Genomics GA · May 2020
· source
· release history
Adds support for reading GFF3 format files directly in the runtime
Databricks Runtime 6.6 for Genomics GA · May 2020
· source
· release history
＋AI Runtime serverless GPU computeshippedProvides a serverless compute offering with GPU support for deep learning workloads.12 releases · 2 other sources · first seen May 2018▸
release
12 total
Enable serverless GPU in clean rooms before the November 26, 2026 default rollout by turning on Clean Rooms AI Runtime from the Previews page in the account console.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Serverless GPU in clean rooms will soon be on by default for accounts where it's turned off (2026-10-28) · Oct 2026
· source
· release history
Run clean room notebooks on serverless GPU compute for model inference and training over shared data, using AI Runtime with the same approval flow, data access, and output tables as other clean room notebooks.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Serverless GPU for clean room notebooks is now generally available (2026-10-28) · Oct 2026
· source
· release history
Renames gpus and gpu_type arguments to num_accelerators and accelerator_type; the old names still work in databricks.air but emit a FutureWarning and will be removed in version 7.
Databricks AI Runtime SDK replaces serverless_gpu (2026-10-13) · Oct 2026
· source
· release history
Version 6 is the last GPU environment version that includes the serverless_gpu package; workloads on version 7 or later must migrate to databricks-sdk-air.
Databricks AI Runtime SDK replaces serverless_gpu (2026-10-13) · Oct 2026
· source
· release history
GPU environment version 7 will drop support for the gpus and gpu_type argument names entirely; callers must migrate to num_accelerators and accelerator_type before upgrading past version 6.
Databricks AI Runtime SDK replaces serverless_gpu (2026-10-13) · Oct 2026
· source
· release history
Extends AI Runtime availability to workspaces with the compliance security profile enabled (mid-November 2026), supporting serverless GPU model training and fine-tuning without provisioning infrastructure.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
AI Runtime will soon be available by default for workspaces with the compliance security profile enabled (2026-10-13) · Oct 2026
· source
· release history
docs
Oct 8, 2026 An application with complex reasoning capabilities that allows it to create its own plan and carry out the task according to the tools at its disposal. See Components of an agent AI Runtime A serverless compute offering for deep learning workloads that brings GPU support to serverless compute.
seen Oct 2026
· source
example
Turn on serverless GPU for clean rooms early, before the automatic November 2026 rollout, so your team can run notebooks on GPU compute within a clean room now.$ In the account console, go to Previews and enable 'Clean Rooms AI Runtime'.
Serverless GPU in clean rooms will soon be on by default for accounts where it's turned off (2026-10-28) · Oct 2026
· source
＋Unity Catalog VolumesshippedIntroduces a new resource type for accessing, storing, governing, and organizing files in cloud object storage.13 releases · 1 other source · first seen Jul 2023▸
release
13 total
Enables in-place editing of files stored in Unity Catalog volumes via the workspace file editor, accessible from Catalog Explorer or the schema browser in a notebook or SQL editor.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Editing files in Unity Catalog volumes is now generally available (2026-10-27) · Oct 2026
· source
· release history
Adds multipart upload support in Files API 3.0, enabling uploads of files larger than 5 GB to Unity Catalog volumes.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Files API 3.0 for Unity Catalog volumes is now in Beta (2026-10-23) · Oct 2026
· source
· release history
Adds conditional operations in Files API 3.0, allowing upload, download, and delete of files in Unity Catalog volumes based on their current version to prevent unintended changes.
Files API 3.0 for Unity Catalog volumes is now in Beta (2026-10-23) · Oct 2026
· source
· release history
Adds support for delivering driver, worker, and event logs from compute resources to a Unity Catalog volume.
Compute logs can now be delivered to volumes (Public Preview) · Mar 2025
· source
· release history
Adds UseNativeQuery=1 property to enable data ingestion via Unity Catalog volumes
Databricks JDBC driver 2.6.38 · May 2024
· source
· release history
Enables Unity Catalog volumes for managing read and write access to non-tabular data in cloud object storage (requires Databricks Runtime 14.3 LTS or above)
Unity Catalog volumes are GA · Feb 2024
· source
· release history
example
Edit a config or data file in a Unity Catalog volume directly without leaving the workspace.$ In the workspace, open Catalog Explorer, navigate to your Unity Catalog volume, select a file, and choose 'Edit' to modify it in the workspace file editor — no download or re-upload needed.
Editing files in Unity Catalog volumes is now generally available (2026-10-27) · Oct 2026
· source
＋Feature Store for machine learningshippedEnables the creation, sharing, discovery, and serving of machine learning features with support for various data types and external stores.14 releases · first seen Mar 2022▸
release
14 total
Feature Views are now generally available, enabling declarative feature definition and computation from batch or streaming data for model training and online serving.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Feature Views will soon be available by default for workspaces with the compliance security profile enabled (2026-10-12) · Oct 2026
· source
· release history
Feature Views are now generally available for batch, streaming, and request-time data workloads; compliance security profile workspaces will gain access in mid-November 2026.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Feature Views are now generally available (2026-10-12) · Oct 2026
· source
· release history
Adds Databricks Online Feature Stores (powered by Lakebase) for highly-scalable, low-latency feature data access consistent with offline feature tables.
Databricks Online Feature Stores (Public Preview) · Sep 2025
· source
· release history
Feature & Function Serving endpoints are now available in public preview to expose Databricks data to external models and applications.
Feature & Function Serving is Public Preview · Dec 2023
· source
· release history
Enables computation of ML features at inference time using inputs only available then (e.g., user location)
On-demand feature computation is GA · Oct 2023
· source
· release history
Unity Catalog becomes your feature store. You can use any Delta table with a primary key as a feature table for model training or inference.
Feature Engineering in Unity Catalog is GA · Oct 2023
· source
· release history
＋Expanded audit logging capabilitiesshippedProvides detailed visibility into user and system actions by recording notebook events, query submissions, and completions in audit logs.14 releases · first seen Jul 2022▸
Also counts toward: Administrative audit log
release
14 total
Adds catalog_name request parameter to deltaSharingProxy* audit log events for Delta Sharing recipients.
Update request parameters for Delta Sharing recipient audit log events · Dec 2025
· source
· release history
Allows viewing and analyzing denial logs in Unity Catalog for auditing and troubleshooting outbound egress.
Manage network policies for serverless egress control (Generally Available) · Jun 2025
· source
· release history
Adds createApp, installTemplateApp, updateApp, startApp, stopApp, deployApp, and deleteApp event records to Databricks Apps audit logs
Additional audit logging for Databricks Apps events (Public Preview) · Mar 2025
· source
· release history
Adds a new query system schema containing detailed logs of each query run on a SQL warehouse
Query history system table is now available (Public Preview) · Jul 2024
· source
· release history
system.compute.clusters table provides full history of all-purpose and jobs cluster configurations over time.
Compute system tables are now available (Public Preview) · Oct 2023
· source
· release history
Adds queryable system tables providing account-wide observability for access audit logs, billable usage, and lineage
Access audit log, billable usage, and lineage system tables (Public Preview) · Jun 2023
· source
· release history
＋External secrets in Unity CatalogshippedLinks a Unity Catalog schema to AWS Secrets Manager so secrets appear as read-only securable objects governed by Unity Catalog privileges.12 releases · first seen Jun 2019▸
release
12 total
Store up to 1,000 secrets per schema and 10,000 per metastore in Unity Catalog, up from 100 and 1,000, for both Databricks-managed secrets and secrets backed by AWS Secrets Manager.
Higher limits and BROWSE support for Unity Catalog secrets (2026-11-02) · Nov 2026
· source
· release history
Adds External Secrets in Unity Catalog (Beta), linking a Unity Catalog schema to AWS Secrets Manager so secrets appear as read-only securable objects governed by Unity Catalog privileges, with values read from AWS Secrets Manager on demand.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
External secrets in Unity Catalog (Beta) (2026-09-09) · Sep 2026
· source
· release history
Existing column mask functions might fail if their return types are incompatible with the target column's type due to new automatic type casting behavior
Attribute-based access control (ABAC) now in Public Preview · Nov 2025
· source
· release history
service_credentials for Unity Catalog-governed access to external cloud services is now generally available (GA)
Unity Catalog -governed access to external cloud services using service credentials is now GA · Feb 2025
· source
· release history
Adds oauthInteractiveFlow for native browser-based user-to-machine authentication
Databricks JDBC driver 2.6.36 · Dec 2023
· source
· release history
Adds General Availability for OAuth machine-to-machine (M2M) and user-to-machine (U2M) authentication.
Authentication using OAuth is GA · Nov 2023
· source
· release history
＋Databricks Excel Add-inshippedConnects Microsoft Excel to a Databricks workspace for browsing and importing Unity Catalog tables, running SQL queries, building pivot tables with live query mode, using custom functions, and writing data back.10 releases · 2 other sources · first seen Aug 2024▸
release
10 total
Adds the ability to schedule automatic data refreshes in the Databricks Excel Add-in (Public Preview), allowing users to choose an interval or calendar schedule and select the SQL warehouse for each run.
Schedule automatic data refresh in the Databricks Excel Add-in (Public Preview) (2026-10-01) · Oct 2026
· source
· release history
Adds scheduled automatic data refresh in the Databricks Excel Add-in, letting users choose an interval or calendar schedule and select the SQL warehouse that runs each refresh, with recent run history reviewable from the add-in.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Schedule automatic data refresh in the Databricks Excel Add-in (Public Preview) (2026-10-01) · Oct 2026
· source
· release history
Excel and Google Sheets writeback now requires a workspace admin to explicitly enable the Allow spreadsheet writeback security setting — existing writeback workflows will stop working until the setting is enabled.
Control spreadsheet writeback with a workspace admin setting (2026-09-30) · Sep 2026
· source
· release history
Users cannot perform spreadsheet writebacks until a workspace administrator enables the Allow spreadsheet writeback setting.
Control spreadsheet writeback with a workspace admin setting (2026-09-30) · Sep 2026
· source
· release history
Adds the Allow spreadsheet writeback workspace admin security setting to control whether Excel and Google Sheets can write data back to Databricks.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Control spreadsheet writeback with a workspace admin setting (2026-09-30) · Sep 2026
· source
· release history
Requires workspace admins to manually enable the Allow spreadsheet writeback security setting before users can use the Databricks Excel Add-in or Google Sheets connector for data backfill.
Control spreadsheet writeback with a workspace admin setting (2026-09-30) · Sep 2026
· source
· release history
example
Use this feature to keep Excel reports updated without manual intervention by configuring a recurring refresh via the Add-in UI.$ In the Databricks Excel Add-in interface, open the data import settings and select 'Schedule automatic data refresh'.
Schedule automatic data refresh in the Databricks Excel Add-in (Public Preview) (2026-10-01) · Oct 2026
· source
Enable spreadsheet writeback for the workspace to allow Excel/Sheets integration.$ In the Databricks workspace, go to Admin Console > Security and enable 'Allow spreadsheet writeback'.
Control spreadsheet writeback with a workspace admin setting (2026-09-30) · Sep 2026
· source
＋Notebook interface and editing enhancementsshippedModernizes the notebook editor with streamlined coding workflows, auto-complete for Spark Connect DataFrames, and a built-in toolbar for common Markdown formatting.12 releases · first seen May 2024▸
release
12 total
Adds real-time simultaneous editing support to notebook cells, allowing multiple users to edit the same cell at once
Real-time collaboration in notebook cells, files, and SQL editor · Nov 2025
· source
· release history
Enables breakpoints and stepping into functions across multiple workspace files in the Python notebook interactive debugger
Improved notebook debugger experience · Oct 2025
· source
· release history
Supports importing and exporting IPYNB notebooks up to 100 MB with revision snapshot autosaving, manual saving, and cloning
Notebook improvements · Oct 2025
· source
· release history
Adds new icons on the top left of the editor to quickly switch between tab groups based on authoring contexts
Improvements to the notebook editing experience · Jul 2025
· source
· release history
Pressing Cmd + F (Mac) or Ctrl + F (Windows) opens the native Databricks find-and-replace tool in notebooks
Improvements to the notebook editing experience · Jul 2025
· source
· release history
Adds personalized suggestion rankings for notebook autocomplete using Unity Catalog metadata.
Personalized notebook autocomplete · Aug 2024
· source
· release history
＋UDF performance and type improvementsshippedRemoves UDF call limits, supports custom dependencies, named handlers, and aligns TIMESTAMP inputs with PySpark behavior.11 releases · first seen Jun 2020▸
release
11 total
Removes the five-UDF-call-per-query limit for Unity Catalog Python UDFs.
Scalar and Batch Unity Catalog Python UDFs are now generally available (2026-09-23) · Sep 2026
· source
· release history
Supports named handlers for row-at-a-time scalar UDFs in Unity Catalog Python UDFs.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Scalar and Batch Unity Catalog Python UDFs are now generally available (2026-09-23) · Sep 2026
· source
· release history
Aligns scalar TIMESTAMP inputs with PySpark behavior for Unity Catalog Python UDFs.
Scalar and Batch Unity Catalog Python UDFs are now generally available (2026-09-23) · Sep 2026
· source
· release history
Enables installing custom dependencies in Unity Catalog Python UDFs.
Scalar and Batch Unity Catalog Python UDFs are now generally available (2026-09-23) · Sep 2026
· source
· release history
Execution support for Unity Catalog Python UDTFs on serverless compute, classic compute with standard access mode, and SQL warehouses
Python UDTFs in Unity Catalog are now generally available · Jul 2026
· source
· release history
Exposes TaskContext in Unity Catalog Python UDFs to retrieve user identity and cluster tags during execution
Access UDF context information using TaskContext · Apr 2025
· source
· release history
＋Databricks for VS Code extensionshippedProvides a Visual Studio Code extension to connect to Databricks clusters, run code remotely from the IDE, and support source control, refactoring, and unit testing workflows.11 releases · first seen Feb 2023▸
release
11 total
Databricks IDE extension is generally available for Visual Studio Code, enabling connection to remote Databricks workspaces.
Databricks extension for Visual Studio Code is GA · Sep 2024
· source
· release history
Supports defining and deploying Declarative Automation Bundles directly from the VSCode IDE.
Databricks extension for Visual Studio Code is GA · Sep 2024
· source
· release history
Adds support for configuring custom Databricks workspace URLs in the Databricks extension for Visual Studio Code
Databricks extension for Visual Studio Code updated to version 1.1.4 · Oct 2023
· source
· release history
repos create command gains automatic cloud provider detection during workspace registration
Databricks CLI updated to version 0.200.1 (Public Preview) · Jun 2023
· source
· release history
The Databricks IDE extension is now generally available for Visual Studio Code
Databricks extension for Visual Studio Code (General Availability) · Jun 2023
· source
· release history
Adds a contextual browser for navigating Repos directly from within a notebook view.
Full-page workspace browser includes Repos · Jun 2023
· source
· release history
＋Genie AI assistant capabilitiesshippedAdds deepseek model support, raises agent conversation storage and data source limits, and adds memory confirmation prompts.10 releases · first seen Mar 2019▸
release
10 total
Adds Agent memory pipelines (Beta), which connect a session store to a memory store and use an LLM to distill durable facts, preferences, and decisions from stored conversations into memory entries recalled in later sessions.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Agent memory pipelines are in Beta (2026-10-12) · Oct 2026
· source
· release history
Adds Managed agent sessions as a fully managed, Lakebase-backed store to persist conversation history across turns for agents built on any framework
Managed agent memory and sessions are in Beta â · Sep 2026
· source
· release history
Adds DeepSeek V4.1 Flash model to Unity Gateway, accessible via Foundation Model APIs, with support for text and image inputs.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
DeepSeek V4.1 Flash is now available on Unity Gateway (2026-09-11) · Sep 2026
· source
· release history
Adds memory confirmation prompts (Beta) to Genie One, where the assistant detects facts worth remembering, surfaces a suggestion, and requires explicit approval, modification, or rejection before saving.
Genie One enhancements (2026-09-10) · Sep 2026
· source
· release history
Raises the per-agent data source limit to 50 tables, views, or metric views, up from 30.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Genie Agents enhancements (2026-09-10) · Sep 2026
· source
· release history
Raises the per-agent conversation storage limit to 200,000 conversations, up from 10,000.
Genie Agents enhancements (2026-09-10) · Sep 2026
· source
· release history
＋JDBC Unity Catalog connectionsshippedProvides generally available JDBC connectivity to Unity Catalog on serverless compute, Databricks Runtime 19+, and SQL warehouses 2025.40+, with SSL certificate support.10 releases · first seen Nov 2023▸
release
10 total
Enables the remote_query table-valued function by default for workspaces with the compliance security profile enabled, allowing queries on external databases in their native SQL syntax using Unity Catalog connection credentials.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
The remote_query function will soon be available by default for workspaces with the compliance security profile enabled (2026-10-05) · Oct 2026
· source
· release history
Makes JDBC Unity Catalog connections generally available for serverless compute, Databricks Runtime 19+, and SQL warehouses 2025.40+.
JDBC Unity Catalog connections are now generally available (2026-10-02) · Oct 2026
· source
· release history
Promotes JDBC Unity Catalog connections to general availability on serverless compute, Databricks Runtime 19 and above, and SQL warehouses 2025.40 and above, with SSL certificate support included.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
JDBC Unity Catalog connections are now generally available (2026-10-02) · Oct 2026
· source
· release history
Makes JDBC connection reusable across any Unity Catalog compute type: serverless, standard clusters, dedicated clusters, and Databricks SQL
JDBC Unity Catalog connection in Beta · Nov 2025
· source
· release history
The driver now lists columns with unknown or unsupported types and maps them to SQL VARCHAR in the getColumns() metadata API
Databricks JDBC driver 2.7.3 · May 2025
· source
· release history
Added support for cloud.databricks.us and cloud.databricks.mil domains when connecting via OAuth (AuthMech=11)
Databricks JDBC driver 2.7.3 · May 2025
· source
· release history
＋Databricks Marketplace self-service onboardingshippedEnables private exchange providers to sign up for Databricks Marketplace via a self-service workflow.10 releases · first seen Jun 2023▸
release
10 total
Allows discovery, installation, and execution of third-party data and AI apps from the Databricks Marketplace within a Unity Catalog-governed workspace
Install third-party apps from Databricks Marketplace · Jun 2026
· source
· release history
Monitors listing views, requests, and installs via a new dashboard powered by Marketplace system tables.
New dashboard helps Databricks Marketplace providers monitor listing usage · May 2024
· source
· release history
Enables private exchange providers to sign up for Databricks Marketplace via a self-service workflow rather than the partner portal.
Self-service sign-up for private exchange providers in Marketplace · Mar 2024
· source
· release history
Enables sharing of AI models registered in Unity Catalog through the Marketplace interface
Share AI models using Databricks Marketplace (Public Preview) · Jan 2024
· source
· release history
Adds the system.marketplace.listing_funnel_events system table to monitor consumer actions on listings
Marketplace listing events system table now available (Public Preview) · Jan 2024
· source
· release history
Adds Tego Cyber as a Databricks Marketplace provider for cybersecurity and threat intelligence data.
New Databricks Marketplace providers · Jun 2023
· source
· release history
＋Customer-managed VPC supportshippedAllows creation of Databricks workspaces in customer-managed AWS VPCs with secure outbound connectivity and regional endpoint support.10 releases · first seen Jun 2020▸
Also counts toward: REST API
release
10 total
Adds the ability to share subnets for a customer-managed VPC between multiple Databricks workspaces
Reuse subnets across workspaces for customer-managed VPCs · Jan 2024
· source
· release history
Allows conversion of a workspace in the failed state from Databricks-managed VPC to a customer-managed VPC
Update a failed workspace with Databricks-managed VPC to use a customer-managed VPC · Oct 2022
· source
· release history
Databricks now allows workspaces in different accounts to reuse the same customer-managed AWS VPC endpoints, simplifying network architecture.
Share VPC endpoints among Databricks accounts · Aug 2022
· source
· release history
Adds the ability to enable private DNS for new AWS VPC endpoints during the workspace creation workflow.
Improvements to AWS PrivateLink connectivity · Aug 2022
· source
· release history
Enables creation of Databricks workspaces in customer-managed VPCs in the ap-northeast-2 (Tokyo) region.
Customer-managed VPCs are now available in ap-northeast-2 · Feb 2022
· source
· release history
Adds the private_access_level configuration field to limit AWS PrivateLink VPC endpoints for a workspace
Limit the set of VPC endpoints your workspace can use for AWS PrivateLink connections (Public Preview) · Oct 2021
· source
· release history
＋Git Folder Serverless computeshippedSupports a pyproject.toml-managed environment shared across notebooks and files within a Git folder on serverless compute.9 releases · first seen Aug 2023▸
Also counts toward: Python scripting support
release
9 total
Serverless notebook and Python script tasks support pyproject.toml for configuring job environments, configurable via the Jobs UI, Jobs API, or a bundle.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Serverless job environments from pyproject.toml (Beta) (2026-10-22) · Oct 2026
· source
· release history
Supports a pyproject.toml-managed environment shared across notebooks and files within a Git folder via Git Folder Serverless (Beta).
Git Folder Serverless is in Beta (2026-09-02) · Sep 2026
· source
· release history
Adds Git Folder Serverless feature to share serverless compute and a pyproject.toml-managed environment across notebooks and files in a Git folder
Git Folder Serverless is in Beta â · Sep 2026
· source
· release history
Enables searching and replacing text across files within a Databricks Git folder or Declarative Automation Bundles project from the Search pane.
Search and replace text across files тАЛ · Aug 2026
· source
· release history
Adds Git folder sharing to generate URL links for pre-filled Add Git folder dialogs among workspace users
Updates to Databricks Git folders authentication and sharing behaviors · Jul 2024
· source
· release history
Adds a banner alert when sharing a Git folder that copies a link to create a new Git folder
New changes to Git folder UI · May 2024
· source
· release history
＋Azure AD SCIM provisioningshippedEnables automated user and group provisioning from Microsoft Entra ID (Azure Active Directory) to Databricks using the Azure Databricks SCIM Provisioning Connector.9 releases · first seen Dec 2019▸
Also counts toward: SCIM provisioning API
release
9 total
Account admins can now provision nine IdP-sourced attributes (e.g., title, department, cost center) to account users via automatic identity management or account SCIM 2.1.
Identity attributes (Beta) тАЛ · Aug 2026
· source
· release history
The connector no longer supports Databricks Runtime version 10.4 LTS.
Databricks ODBC driver 2.9.2 · Aug 2025
· source
· release history
Adds the cloudFiles.cleanSource Auto Loader option to instruct the stream to move or delete processed files from the source directory
Databricks Runtime 16.4 LTS · May 2025
· source
· release history
Files with a .gzip extension are now read as gzip-compressed files; previously uncompressed data in .gzip files will fail with java.io.IOException: incorrect header check unless the extension is renamed or decompression is skipped using io.compression.codecs=org.apache.hadoop.io.compress.PassthroughCodec
Databricks Runtime 16.4 LTS · May 2025
· source
· release history
Enables users to authenticate via one-time passcodes or external accounts such as Google and Microsoft.
Sign-in with one-time passcodes and external accounts · Jul 2024
· source
· release history
Adds azure.managed_identity authentication method to enable Azure Managed Identity login
Databricks ODBC driver 2.7.7 · Jan 2024
· source
· release history
＋Photon engine and runtime performance improvementsshippedIntroduces the Photon vectorized query engine and updates library installation timing to improve SQL and DataFrame workloads.9 releases · first seen Jul 2022▸
release
9 total
DataFrame.applyInPandas now accepts a function with an Iterator[pandas.DataFrame] signature to reduce overhead when processing large groups
Databricks Runtime 18 LTS · Jun 2026
· source
· release history
max_by and min_by aggregate functions now accept an optional third argument limit (up to 100,000) to return top-K or bottom-K values
Databricks Runtime 18 LTS · Jun 2026
· source
· release history
The IDENTIFIER clause reach has been expanded to nearly everywhere an identifier is permitted, allowing strings to be cast to SQL object names
Databricks Runtime 18 LTS · Jun 2026
· source
· release history
Enables Cloud Fetch by default in AWS workspaces with bucket versioning enabled.
Databricks Runtime 14.3 LTS · Feb 2024
· source
· release history
Automatically enables Photon for new clusters where Databricks Runtime supports it, the node_type is supported, and runtime_engine is not explicitly set to STANDARD.
New Photon defaults · Oct 2023
· source
· release history
Sets Photon as the default runtime_engine for new all-purpose and job clusters created via the UI when using a compatible cluster policy.
New Photon defaults · Oct 2023
· source
· release history
＋Genomics Firth logistic regressionshippedAdds support for Firth logistic regression within Databricks Runtime specifically for Genomics workloads.9 releases · first seen Dec 2019▸
release
9 total
Enables configuration of a custom reference genome for alignment workflows
Databricks Runtime 6.6 for Genomics GA · May 2020
· source
· release history
Introduces per-sample pipeline timeouts to control execution duration per sample
Databricks Runtime 6.6 for Genomics GA · May 2020
· source
· release history
Provides a new BAM export option to write output in BAM format
Databricks Runtime 6.6 for Genomics GA · May 2020
· source
· release history
Enables loading of custom reference genome files for variant calling or alignment instead of relying on default references.
Databricks Runtime 6.6 for Genomics (Beta) · May 2020
· source
· release history
Introduces per-sample pipeline timeouts to control execution limits on a per-sample basis.
Databricks Runtime 6.6 for Genomics (Beta) · May 2020
· source
· release history
Adds a BAM export option to write processed genomic data back into BAM format.
Databricks Runtime 6.6 for Genomics (Beta) · May 2020
· source
· release history
＋Customer-Managed Key Encryption SupportshippedAllows users to configure customer-managed keys to encrypt workspace storage and optional cluster node EBS volumes.8 releases · first seen Apr 2021▸
release
8 total
Enables access to S3 buckets that require server-side encryption via new external location configuration
Configure an encryption algorithm on an external location · Oct 2024
· source
· release history
Serverless SQL warehouses now support adding customer-managed keys to your workspace for managed services and your workspace's root S3 bucket
Improved serverless SQL warehouse support for customer-managed keys · Dec 2022
· source
· release history
Customer-managed keys for encryption, which includes both managed services and workspace storage, is now generally available.
Protect and control access to some types of encrypted data with customer-managed keys (GA) · Sep 2022
· source
· release history
Adds the ability to rotate (update) the customer-managed key for managed services on a running workspace without recreating the workspace.
Add or rotate the customer-managed key for managed services on a running workspace · Jan 2022
· source
· release history
Adds the ability to add a customer-managed key (CMK) for notebook source, secrets, and Databricks SQL query history on a running workspace.
Add or rotate the customer-managed key for managed services on a running workspace · Jan 2022
· source
· release history
Renames the customer_managed_key_id field to managed_services_customer_managed_key_id in workspace configurations
Changes to the Account API for customer-managed keys · May 2021
· source
· release history
＋Unified workspace searchshippedEnables users to find tables, columns, queries, dashboards, and alerts across the workspace using a centralized search interface.8 releases · first seen Aug 2022▸
release
8 total
Adds /findQueries slash command to search for relevant queries via Unity Catalog metadata
New slash commands for Databricks Assistant · Aug 2024
· source
· release history
Adds support for viewing recently accessed Unity Catalog objects in the recents list
Unity Catalog objects are available in recents and favorites · May 2024
· source
· release history
Adds AI-generated comments to tables and columns in Catalog Explorer, powered by LLMs analyzing metadata like schema and column names.
AI-generated table comments (Public Preview) · Oct 2023
· source
· release history
Enables viewing, editing, and adding AI-generated comments for any managed object in Unity Catalog during Public Preview.
AI-generated table comments (Public Preview) · Oct 2023
· source
· release history
New GA feature enabling search for tables, comments, columns, and column comments within Unity Catalog via the Databricks workspace UI.
Search for tables in Unity Catalog is GA · Nov 2022
· source
· release history
Integrates global search into the SQL persona to find queries, dashboards, and alerts by name
SQL persona integrated with new search experience · Oct 2022
· source
· release history
＋Metric viewsshippedProvides reusable metric definitions with field display names on download, shareable with Databricks users in other metastores or accounts via OpenSharing.7 releases · first seen Jul 2024▸
release
7 total
Define how metric views join each other — including cardinality and join condition — using ALTER VIEW ...︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄ ADD CONSTRAINT ... RELATIONSHIP, so AI assistants and BI tools automatically select the correct join path; requires Databricks Runtime 19 or a SQL warehouse.
Relationships between metric views (Beta) (2026-10-30) · Oct 2026
· source
· release history
Promotes numeric window measures to general availability in the low-code metric view UI.
Dashboard enhancements and bug fixes (2026-10-01) · Oct 2026
· source
· release history
Adds support for including metric views in a share via OpenSharing, queryable with MEASURE(...) on serverless compute.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Sharing metric views with OpenSharing is now generally available (2026-09-24) · Sep 2026
· source
· release history
Enables sharing metric views with Databricks users in other metastores or accounts using OpenSharing (Beta).
Share metric views with OpenSharing (Beta) (2026-09-03) · Sep 2026
· source
· release history
Downloads from a metric view now use the display names defined for its fields.
Dashboard enhancements and bug fixes (2026-09-03) · Sep 2026
· source
· release history
Adds metadata column in DESCRIBE QUERY and DESCRIBE TABLE output for semantic metadata propagation on metric views
Databricks Runtime 17.3 LTS · Oct 2025
· source
· release history
＋OAuth custom identity claim for per-user data isolationshippedAllows applications to attach a custom identity claim to service principal OAuth tokens, which SQL functions, dynamic views, and supported APIs can read to enforce per-user row-level filtering through a single service principal.5 releases · 2 other sources · first seen Aug 2024▸
release
Adds custom identity claims to a service principal's OAuth token, usable in dynamic views or ABAC policies to filter rows per end user — enabling one service principal to serve many users while each sees only their own data.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Filter data per end user with OAuth custom identity claims (2026-10-19) · Oct 2026
· source
· release history
Adds current_oauth_custom_identity_claim() SQL function to read the custom identity claim value at query time, returning NULL when no claim is present.
OAuth custom identity claims for service principal tokens will soon be available (2026-10-05) · Oct 2026
· source
· release history
Adds custom_claim parameter to OAuth token requests using client_credentials or urn:ietf:params:oauth:grant-type:token-exchange grant types, letting applications attach a custom identity claim to service principal tokens.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
OAuth custom identity claims for service principal tokens will soon be available (2026-10-05) · Oct 2026
· source
· release history
The Genie Conversation API, the SQL Statement Execution API, and the Databricks JDBC Driver honor the custom_claim, enabling per-user data isolation through a single service principal via dynamic view row filters.
OAuth custom identity claims for service principal tokens will soon be available (2026-10-05) · Oct 2026
· source
· release history
Adds OAuth2RedirectUrlPort property to configure the OAuth redirect port for unified default OAuth options
Databricks JDBC driver 2.6.40 · Aug 2024
· source
· release history
example
Create a dynamic view that isolates each end user's rows by comparing a column to the custom identity claim on the token — write the filter to match no rows when the claim is NULL.$ CREATE OR REPLACE VIEW user_orders_view AS SELECT * FROM orders WHERE user_email = current_oauth_custom_identity_claim() AND current_oauth_custom_identity_claim() IS NOT NULL;
OAuth custom identity claims for service principal tokens will soon be available (2026-10-05) · Oct 2026
· source
Request a service principal token with a custom identity claim so downstream SQL queries can filter rows to only that end user's data.$ curl -X POST https://<workspace-host>/oidc/v1/token \ -H 'Content-Type: application/x-www-form-urlencoded' \ -d 'grant_type=client_credentials' \ -d 'client_id=<sp-client-id>' \ -d…
OAuth custom identity claims for service principal tokens will soon be available (2026-10-05) · Oct 2026
· source
＋MCP connectors for external toolsshippedProvides Databricks-provided MCP connectors for Google Drive, Gmail, Google Calendar, Microsoft 365, Atlassian, Slack, and GitHub, enabling Genie to search and act on external company tools.6 releases · 1 other source · first seen Jan 2025▸
Also counts toward: Administrative audit log
release
Adds MCP write actions support in the Genie One mobile app (Beta), enabling write operations from connected external tools.
Genie One enhancements (2026-09-24) · Sep 2026
· source
· release history
Adds Databricks-provided MCP connectors for Google Drive, Gmail, Google Calendar, Microsoft 365, Atlassian, Slack, and GitHub, enabling Genie One and Genie Code to search and act on external company tools while answering questions.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Databricks-provided MCP connectors for Genie One and Genie Code are generally available (2026-09-10) · Sep 2026
· source
· release history
Governs all MCP connector tool calls through Unity Catalog and Unity Gateway, enforcing built-in policies, approval requirements, and logging usage and audit activity.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Databricks-managed MCP connectors for Genie One are generally available (2026-09-10) · Sep 2026
· source
· release history
Adds support for entering a workspace URL (instead of only a server hostname) when connecting to the Databricks Genie app in Microsoft Teams
Connect to the Databricks Genie app in Microsoft Teams with your workspace URL (Public Preview) тАЛ · Aug 2026
· source
· release history
Users can now connect Databricks to external Model Context Protocol (MCP) servers, enabling agents to access tools outside of Databricks.
External MCP servers are in Beta · Aug 2025
· source
· release history
AI agent tools can now connect to external applications like Slack, Google Calendar, or any service with an API using HTTP requests
Connect AI agent tools to external services (Public Preview) · Jan 2025
· source
· release history
docs
Oct 7, 2026 Connect a to external tools and sources Attach MCP connectors so the agent can use external tools and sources such as Google Drive and Slack. (Beta)
docs update · Oct 2026
· source
＋Lakebase vector search capabilitiesshippedsuggestedAdds support for approximate nearest-neighbor vector search via the `lakebase_vector` Postgres extension, scaling to over 1 billion vectors.6 releases · 1 other source · first seen Sep 2024▸
Suggested capability: Log search. This is our guess, not confirmed.
release
Enables LTAP Direct Writes per synced table via LTAP Direct Writes under Synchronization settings at synced table creation, bypassing the compute endpoint for faster initial loads and full refreshes on Lakebase projects running Postgres 16, 17, or 18.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
LTAP Direct Writes is generally available (2026-10-01) · Oct 2026
· source
· release history
Produces standard tsvector output, making lakebase_tokenizer compatible with to_tsvector, GIN indexes, and the lakebase_bm25 index for BM25 ranking.
Lakebase Search adds a configurable text tokenizer for keyword search (2026-09-28) · Sep 2026
· source
· release history
Adds the lakebase_tokenizer PostgreSQL extension to control how Lakebase Search tokenizes text, with configurable normalization (lowercase, Unicode, accent-stripping), stopword and synonym lists managed in SQL, and a native English stemmer with possessive-stripping.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Lakebase Search adds a configurable text tokenizer for keyword search (2026-09-28) · Sep 2026
· source
· release history
Adds the lakebase_vector Postgres extension with the lakebase_ann index type for approximate nearest-neighbor vector search, drop-in compatible with pgvector, scaling to over 1 billion vectors on a single index with index builds up to 50-100x faster than HNSW.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Lakebase Search is generally available (2026-09-18) · Sep 2026
· source
· release history
New vector math aggregate functions are available: vector_avg, vector_sum, vector_norm, and vector_normalize for dense vector columns
Databricks Runtime 18 LTS · Jun 2026
· source
· release history
vector_search() is now available to all customers in supported regions without requiring an access request
vector_search() now available to all customers (Public Preview) · Sep 2024
· source
· release history
example
Opt in a new synced table to LTAP Direct Writes to avoid large initial loads competing with live queries on your compute endpoint.$ When creating a synced table in the Lakebase UI: go to Synchronization settings and select 'LTAP Direct Writes'. This option is available for Lakebase projects running Postgres 16, 17, or 18.
LTAP Direct Writes is generally available (2026-10-01) · Oct 2026
· source
＋SQL workload query tagsshippedsuggestedAdds custom key-value query tags to SQL workloads on Databricks SQL warehouses and Lakehouse compute, surfaced in system tables and Query History for grouping, filtering, and cost attribution.7 releases · first seen Jan 2019▸
Suggested capability: Log enrichment. This is our guess, not confirmed.
release
7 total
Adds custom key-value query tags to SQL workloads on Databricks SQL warehouses and Lakehouse//RT compute, surfaced in system.query.history and the Query History page for grouping, filtering, and cost attribution.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Query tags for SQL warehouses are now generally available (2026-09-30) · Sep 2026
· source
· release history
Adds query_tags configuration to SQL warehouse compute to enable custom key-value tagging of workloads
Query tags for SQL warehouses are now generally available (2026-09-30) · Sep 2026
· source
· release history
Materialized view and streaming table refreshes now inherit custom tags from the enclosing SQL warehouse environment and propagate them to system.billing.usage for cost attribution.
Automatic cost attribution for materialized views and streaming tables in Databricks SQL тАЛ · Aug 2026
· source
· release history
Adds runs/log-batch REST API endpoint (and Python, R, Java methods) to log multiple metrics, params, and tags in a single request
MLflow 1.0 · Jun 2019
· source
· release history
Enables searching for a cluster by typing in the cluster selector when attaching a notebook
Searchable cluster selector · Apr 2019
· source
· release history
Integrates Structured Streaming feature improvements
Databricks Runtime 5.2 release · Jan 2019
· source
· release history
＋OpenSharing access for foreign tablesshippedEnables recipients to read data in shared foreign tables and foreign schemas via OpenSharing.7 releases · first seen Aug 2021▸
release
7 total
Adds general availability for OpenSharing, enabling providers to share foreign Delta-format tables federated from OneLake, Hive metastore, or AWS Glue without copying data into Databricks.
Sharing foreign Delta tables with OpenSharing is now generally available â · Sep 2026
· source
· release history
Enables recipients to read data in shared foreign tables and foreign schemas via OpenSharing.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Sharing foreign schemas and tables with OpenSharing is now generally available (2026-09-11) · Sep 2026
· source
· release history
Adds SecureConnect capability to OpenSharing, enabling data sharing from cloud storage behind a firewall or private endpoint without adding recipient networks to an allowlist.
Share data behind a firewall with SecureConnect (Public Preview) · Jun 2026
· source
· release history
GA of cloud token access for open Delta Sharing allows direct cloud storage reads via directory-based access mode for eligible tables.
Cloud token access for open Delta Sharing sharing (GA) · Apr 2026
· source
· release history
Introduces OpenSharing cost tracking and configuration for data access and billing methods when sharing views.
Cross-platform view sharing is now GA · Jun 2025
· source
· release history
Enables SQL-based schema sharing requiring a SQL warehouse or Databricks Runtime 13.2+ cluster
Share schemas using Delta Sharing (Public Preview) · Aug 2023
· source
· release history
＋Partner Integrations galleryshippedProvides a centralized interface in the workspace to access and manage partner data ingestion integrations.7 releases · first seen Feb 2020▸
release
7 total
Supports daily and hourly analytics dimensions (date, country, device, page, query), verified sites, and sitemaps via the new connector.
Google Search Console connector is available in Beta тАЛ · Aug 2026
· source
· release history
Adds Monte Carlo as a supported destination in Partner Connect for workspace integration
Partner Connect supports Monte Carlo · Oct 2023
· source
· release history
Adds support for all workspace users to connect to Fivetran using Partner Connect (Public Preview)
All users can connect to Fivetran using Partner Connect (Public Preview) · May 2023
· source
· release history
Enables connecting to Fivetran directly from the add data UI using the same steps as the Partner Connect portal.
Connect to Fivetran from the add data UI · Nov 2022
· source
· release history
Adds Hevo Data as a supported integration target in Partner Connect
Partner Connect supports connecting to Hevo Data · Oct 2022
· source
· release history
Partner Connect supports connecting to Stardog
Partner Connect supports connecting to Stardog · Aug 2022
· source
· release history
＋Databricks SQL ServerlessshippedProvides serverless SQL warehouses in supported regions for instant compute and cost optimization.7 releases · first seen Mar 2023▸
release
7 total
Adds new SQL aggregate functions listagg and string_agg to aggregate STRING and BINARY values within a group
Databricks Runtime 16.4 LTS · May 2025
· source
· release history
Custom tags assigned to a dedicated compute instance are now automatically propagated to any query that is forwarded to serverless compute for data filtering, enabling accurate cost attribution.
Enable cost attribution of fine-grained access control on dedicated compute (formerly single user compute) · Oct 2024
· source
· release history
Enables serverless compute for notebooks, jobs, and DLT by default on eligible Premium plan or above accounts
Serverless compute automatically enabled on eligible accounts · Oct 2024
· source
· release history
serverless SQL warehouses are generally available for workspaces enabled for the compliance security profile.
Serverless SQL warehouses with the compliance security profile is now GA · Aug 2024
· source
· release history
Adds the ability to run Databricks notebooks directly on SQL warehouses in Public Preview.
Run Databricks notebooks on SQL warehouses (Public Preview) · May 2023
· source
· release history
General availability of Databricks SQL Serverless in supported regions for instant compute and cost optimization.
Databricks SQL Serverless is GA · Mar 2023
· source
· release history
＋Serverless online tables for low-latency servingshippedEnables administrators to manage user groups, including creating groups, defining parent-child hierarchies, adding members/subgroups, and assigning instance profiles.7 releases · first seen Mar 2019▸
previously: Admin Console Group Management
Also counts toward: Web management console
release
7 total
Public Preview of Databricks Online Tables: fully serverless tables that auto-scale with request load for low latency and high throughput.
Databricks Online Tables is Public Preview · Dec 2023
· source
· release history
Adds the group manager permission in Public Preview, enabling designated users, service principals, and groups to manage group membership and assign the permission to others.
Group manager permission is in Public Preview · Jul 2023
· source
· release history
New public preview capability allowing admins to restrict workspace access via IP allow/block lists through a new API.
Restrict access to Databricks using IP access lists (Public Preview) · Jun 2020
· source
· release history
Adds the Groups tab to the Admin Console, allowing admins to create new groups.
Manage groups from the Admin Console · Mar 2019
· source
· release history
Provides functionality to manage parent-child relationships between groups in the Admin Console.
Manage groups from the Admin Console · Mar 2019
· source
· release history
Enables adding users and subgroups to a group directly from the Admin Console UI.
Manage groups from the Admin Console · Mar 2019
· source
· release history
＋Genie mobile appshippedProvides mobile access to Genie, including push notifications for scheduled tasks on iOS devices.6 releases · first seen Sep 2021▸
release
The Genie mobile app now remembers and prefills the last signed-in email address at next sign-in (Public Preview).
Genie One enhancements (2026-10-22) · Oct 2026
· source
· release history
Genie chart visualizations now appear as inline images in Slack replies when using the Databricks Genie app for Slack.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Genie visualizations in Slack replies (Public Preview) (2026-09-14) · Sep 2026
· source
· release history
Enables push notifications for scheduled tasks to iOS devices in the Genie mobile app (Public Preview).
Genie One enhancements (2026-09-03) · Sep 2026
· source
· release history
Adds support for navigating a three-level namespace in the Unity Catalog.
Databricks Connector for Tableau 2021.4 · Dec 2021
· source
· release history
Adds support for navigation through three-level namespaces in the Unity Catalog
Databricks Connector for Power BI · Oct 2021
· source
· release history
Adds three-level namespace support (catalog.schema.table) for Unity Catalog integration
Databricks ODBC driver 2.6.18 · Sep 2021
· source
· release history
＋Lakebase InsightsshippedProvides integrated observability for Lakebase projects by reading telemetry from system.lakebase system tables to diagnose issues and recommend next steps, configured directly in each project's Settings with support for on-demand and scheduled analysis runs.4 releases · 2 other sources · first seen Oct 2026▸
Also counts toward: Scheduled jobs
release
Enables Lakebase Insights configuration directly in each project's Settings for users with CAN MANAGE, removing the need to create a separate observability configuration.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Lakebase Insights moves to per-project settings, with on-demand runs (Beta) (2026-10-19) · Oct 2026
· source
· release history
Reads telemetry from system.lakebase system tables to diagnose issues and recommend next steps.
Lakebase Insights moves to per-project settings, with on-demand runs (Beta) (2026-10-19) · Oct 2026
· source
· release history
Supports on-demand Insights runs at any time, with or without a scheduled analysis frequency set in Settings.
Lakebase Insights moves to per-project settings, with on-demand runs (Beta) (2026-10-19) · Oct 2026
· source
· release history
Enabling the Lakebase Insights preview also auto-enables Lakebase Observability in System Tables if not already active; workspace admins can enable the observability preview independently to capture telemetry without Insights.
Lakebase Insights moves to per-project settings, with on-demand runs (Beta) (2026-10-19) · Oct 2026
· source
· release history
example
Trigger an immediate, unscheduled Insights analysis on a specific project without waiting for a scheduled run.$ In the Databricks UI, open the project, go to Settings > Insights, and click 'Run now'.
Lakebase Insights moves to per-project settings, with on-demand runs (Beta) (2026-10-19) · Oct 2026
· source
Enable Insights for a workspace so telemetry begins flowing into system.lakebase for all subsequent project analyses.$ In the Databricks UI, go to the workspace admin panel, open Previews, and enable 'Lakebase Insights'.
Lakebase Insights moves to per-project settings, with on-demand runs (Beta) (2026-10-19) · Oct 2026
· source
＋Mosaic AI agent framework and evaluationshippedEnables building production-quality RAG applications, parameterizing agents and chains for rapid iteration, and assessing application quality, latency, and cost using built-in evaluation metrics.6 releases · first seen Jun 2024▸
release
Adds OpenJev (Qwen3.5 4B) as a selectable evaluator model service in custom LLM-as-a-judge service policies, classifying content without generating output tokens for faster responses than a chat evaluator.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Use OpenJev as the evaluator for LLM-as-a-judge service policies (Beta) (2026-10-09) · Oct 2026
· source
· release history
Adds support for the ChatAgent and ChatModel classes from the mlflow.evaluate model_type='databricks-agent' harness
databricks-agents SDK 0.14.0 release: Custom evaluation metrics · Jan 2025
· source
· release history
Adds built-in metrics for comparing runs across document retrieval, response accuracy, cost, and latency
Mosaic AI Agent Framework (Public Preview) · Jun 2024
· source
· release history
Introduces Mosaic AI Agent Framework for building production-quality RAG applications
Mosaic AI Agent Framework (Public Preview) · Jun 2024
· source
· release history
Offers Agent Evaluation capabilities to assess application quality, latency, and cost
Mosaic AI Agent Framework (Public Preview) · Jun 2024
· source
· release history
Provides parameterization capabilities for agents and chains to facilitate rapid experimentation and iteration
Mosaic AI Agent Framework (Public Preview) · Jun 2024
· source
· release history
＋ABAC enforcement on time travelshippedEnforces ABAC row filter and column mask policies on Unity Catalog managed tables when using time travel queries.5 releases · 1 other source · first seen Feb 2020▸
release
Enables the ABAC on Views preview via the account console's Previews page (requires Databricks Runtime 19 or above).
ABAC on views is in Beta (2026-09-29) · Sep 2026
· source
· release history
Extends Attribute-based access control (ABAC) row filters and column masks to work with views in addition to tables.
ABAC on views is in Beta (2026-09-29) · Sep 2026
· source
· release history
Enforces ABAC row filter and column mask policies on Unity Catalog managed tables when using time travel queries, starting with Databricks Runtime 19 (Beta).︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Time travel queries now enforce ABAC policies (Beta) (2026-09-23) · Sep 2026
· source
· release history
Supports MERGE INTO on tables with fine-grained access control on dedicated compute, now generally available (GA)
Databricks Runtime 16.4 LTS · May 2025
· source
· release history
Glow includes Python and Scala APIs for DataFrame operations, previously available only via SQL expressions.
Databricks Runtime 6.4 for Genomics GA · Feb 2020
· source
· release history
example
Enable the ABAC on Views beta so your team can apply existing row filters and column masks to views in Unity Catalog.$ In the account console, go to Previews and enable 'ABAC on Views'.
ABAC on views is in Beta (2026-09-29) · Sep 2026
· source
＋Genie Code scheduled tasksshippedAllows Genie Code prompts to run on a recurring schedule as unattended background tasks, producing a continuable Genie chat with results for each run, including support for compliance security profile workspaces.5 releases · 1 other source · first seen Sep 2021▸
Also counts toward: Scheduled jobs
release
Genie Code scheduled tasks are now generally available, allowing users to schedule prompts to run on a recurring basis and produce continuable Genie chats as results.
Genie Code scheduled tasks are now generally available â · Sep 2026
· source
· release history
Enables scheduling Genie Code to run a prompt on a recurring schedule, producing a continuable Genie chat with results for each run — accessible via chat prompt or the Schedules menu.
Genie Code scheduled tasks are now generally available (2026-09-01) · Sep 2026
· source
· release history
Enables Genie Code scheduled tasks for workspaces with the compliance security profile, allowing prompts to run on a recurring schedule as unattended background tasks that produce a continuable Genie chat with results.
Genie Code scheduled tasks will soon be available by default for workspaces with the compliance security profile enabled (2026-09-01) · Sep 2026
· source
· release history
Jobs API version 2.1 is released, adding full support for orchestrating multiple tasks within Databricks jobs.
Jobs orchestration is now GA · Oct 2021
· source
· release history
Adds a new Job details side panel in the jobs UI to manage job schedule, cluster settings, maximum concurrent runs, and job alerts.
Streamlined management of settings for Databricks jobs · Sep 2021
· source
· release history
example
Set up a recurring analysis task when you want Genie Code to automatically run a prompt (e.g. a weekly data quality report) without manual intervention.$ In the Genie Code chat, type your prompt (e.g. 'Summarize data quality issues in the sales table') and then go to Schedules > Create schedule to set the recurrence.
Genie Code scheduled tasks are now generally available (2026-09-01) · Sep 2026
· source
＋Regional Availability ExpansionshippedExpands the availability of Databricks workspaces to include additional AWS regions, including multiple Asia Pacific locations.6 releases · first seen Jan 2021▸
release
Adds eu-west-2 region support for serverless compute on notebooks, workflows, and DLT.
Serverless compute is now available in the eu-west-2 region · Oct 2024
· source
· release history
Enables access to Databricks on AWS in the ap-southeast-1 (Singapore) region.
Databricks now available in region ap-southeast-1 · Sep 2021
· source
· release history
Enables creation of multiple workspaces per account in the AWS Asia Pacific region
E2 platform comes to the Asia Pacific region · Jan 2021
· source
· release history
Adds support for the ap-northeast-1 (Tokyo) region
E2 platform comes to the Asia Pacific region · Jan 2021
· source
· release history
Adds support for the ap-south-1 (Mumbai) region
E2 platform comes to the Asia Pacific region · Jan 2021
· source
· release history
Adds support for the ap-southeast-2 (Sydney) region
E2 platform comes to the Asia Pacific region · Jan 2021
· source
· release history
＋Serverless real-time machine learning inferenceshippedEnables deploying MLflow models as scalable REST API endpoints on managed serverless compute.6 releases · first seen Aug 2022▸
Also counts toward: REST API
release
Adds support for using AWS instance profiles when configuring external models to access Amazon Bedrock
External models now supports instance profiles for Amazon Bedrock · Sep 2024
· source
· release history
Adds usage tracking via system tables to monitor endpoint operational usage and costs
AI Gateway is now Public Preview · Sep 2024
· source
· release history
Adds traffic routing capabilities to minimize production outages during and after deployment
AI Gateway is now Public Preview · Sep 2024
· source
· release history
Serverless Real-Time Inference is now available in public preview to all customers
Serverless Real-Time Inference Public Preview now available to all customers · Feb 2023
· source
· release history
Adds Serverless Real-Time Inference to process MLflow models as REST API endpoints using managed compute.
Serverless Real-Time Inference in Public Preview · Aug 2022
· source
· release history
Workspace admins can enable the Serverless Real-Time Inference feature for their workspace.
Serverless Real-Time Inference in Public Preview · Aug 2022
· source
· release history
＋Databricks Connect runtime supportshippedAllows connecting external Spark sessions to Databricks clusters using Databricks Connect with specific supported runtime versions.6 releases · first seen Dec 2019▸
Also counts toward: Python scripting support, Scripting language support
release
Adds serverless compute support to Databricks Connect for Python, enabling connections via the new configuration options.
Databricks Connect for Python now supports serverless compute · Jul 2024
· source
· release history
Adds SPARK_CLI_SERVICE_PROTOCOL_V8 support for native parameterized queries (limit 256 parameters)
Databricks JDBC driver 2.6.38 · May 2024
· source
· release history
Databricks Connect for Databricks Runtime 13.3 LTS now supports Scala in Public Preview, including DataFrames, Delta, Structured Streaming, and more.
Databricks Connect V2 is Public Preview for Scala · Sep 2023
· source
· release history
Enables Structured Streaming capabilities in Python via Databricks Connect
Databricks Connect V2 is GA for Python · Jun 2023
· source
· release history
Adds general availability of Databricks Connect V2 for Python starting with Databricks Runtime 13.1
Databricks Connect V2 is GA for Python · Jun 2023
· source
· release history
Adds support for Databricks Runtime 6.1 in Databricks Connect
Databricks Connect now supports Databricks Runtime 6.1 · Dec 2019
· source
· release history
＋Unified platform integrationshippedProvides native integration with Unity Catalog, MLflow, and Mosaic AI Model Serving to allow productionized endpoints, agents, and rule engines to automatically access features.5 releases · first seen Sep 2025▸
release
Enable managed warehouse for MLflow traces via the Previews page, letting users query Unity Catalog traces in the MLflow UI without manually selecting a SQL warehouse — MLflow provisions its own warehouse or falls back to serverless compute automatically.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Managed warehouse for MLflow (Beta) (2026-11-02) · Nov 2026
· source
· release history
Enables inference tables for custom model serving endpoints to ingest request/response payloads through endpoint telemetry into a Unity Catalog inference table view with configurable sampling.
Faster inference tables for custom model serving endpoints · Jun 2026
· source
· release history
Adds the ability to configure endpoint telemetry for custom model serving endpoints to persist OpenTelemetry logs, traces, and metrics to Unity Catalog tables.
Endpoint telemetry for custom model serving endpoints is generally available · Jun 2026
· source
· release history
Adds unity_catalog_connection resource type for managing Unity Catalog connections within a Databricks App
New resource types for Databricks Apps · Dec 2025
· source
· release history
Provides native integration with Unity Catalog, MLflow, and Mosaic AI Model Serving to allow productionized endpoints, agents, and rule engines to automatically access features.
Databricks Online Feature Stores (Public Preview) · Sep 2025
· source
· release history
＋Dashboard interactive controls enhancementsshippedEnhances dashboard interactivity by scoping Ask Genie suggested starter questions to the current widget, showing the selected chart as context in the input bar, and adding relationship-scoped filters.4 releases · 1 other source · first seen Sep 2026▸
release
Adds private bookmarks so dashboard viewers can save and return to filter combinations visible only to themselves.
Dashboard enhancements (2026-10-22) · Oct 2026
· source
· release history
Shows the selected chart as context in the Ask Genie input bar on published dashboards, enabling questions about a specific chart.
Dashboard enhancements (2026-09-10) · Sep 2026
· source
· release history
Scopes Ask Genie suggested starter questions to the current dashboard page and widget on published dashboards.
Dashboard enhancements (2026-09-10) · Sep 2026
· source
· release history
Adds relationship-scoped filters (Public Preview): on dashboards with relationships, each widget now responds only to filters whose dataset is related to it.
Dashboard enhancements (2026-09-10) · Sep 2026
· source
· release history
example
Let analysts return quickly to a frequently used filter state without affecting other users' dashboard views.$ While viewing a dashboard, apply the desired filters, open the bookmarks menu, and select 'Save a private bookmark' — the saved filter combination is visible only to your account.
Dashboard enhancements (2026-10-22) · Oct 2026
· source
＋Dashboard subscriptions and snapshotsshippedDelivers scheduled dashboard snapshots and data attachments (CSV, TSV, or Excel) to Slack, Microsoft Teams channels, and other recipients.4 releases · 1 other source · first seen Jul 2023▸
Also counts toward: CSV data export, Scheduled jobs
release
Scheduled emails now preserve attachments that fit within the size limit instead of dropping all attachments when the combined image and PDF exceed it.
Dashboard enhancements and bug fixes (2026-10-01) · Oct 2026
· source
· release history
Adds Data attachments to dashboard subscriptions delivered to Slack and Microsoft Teams, supporting CSV, TSV, or Excel format.
Dashboard enhancements and bug fixes (2026-09-03) · Sep 2026
· source
· release history
Enables automatic summary dashboard generation for visualizing data quality over time
Lakehouse Monitoring is Public Preview · Aug 2023
· source
· release history
Adds subscriptions attribute to databricks_dashboard resource for dashboard subscription management
Databricks Terraform provider updated to version 1.21.0 · Jul 2023
· source
· release history
example
Deliver a scheduled dashboard snapshot to a Teams channel with a CSV data attachment so recipients can slice the raw numbers without opening Databricks.$ In the dashboard, open Subscriptions > Add subscription, set the destination to your Microsoft Teams channel, and under 'Data attachments' select CSV. Save and schedule the subscription.
Dashboard enhancements and bug fixes (2026-09-03) · Sep 2026
· source
＋Dashboard text and widget formattingshippedSupports rich text formatting for dynamic data references in text widgets, widget titles, and descriptions.5 releases · first seen Jun 2020▸
release
Enables configuring a dashboard widget to ignore selected dashboard filters while those filters continue to apply to the rest of the page.
Dashboard enhancements and bug fixes (2026-09-24) · Sep 2026
· source
· release history
Adds rich text formatting support for dynamic data references in text widgets, widget titles, and descriptions.
Dashboard enhancements and bug fixes (2026-09-03) · Sep 2026
· source
· release history
Adds rich text formatting capabilities to AI/BI dashboard widget titles and descriptions, allowing text styling, links, tables, or markdown input.
Format AI/BI dashboard widget titles and descriptions with rich text тАЛ · Aug 2026
· source
· release history
Integrates RStudio Server Open Source v1.2 into the runtime.
Databricks Runtime 7.0 ML GA · Jun 2020
· source
· release history
Supports Scala 2.12 as the language version
Databricks Runtime 7.0 GA, powered by Apache Spark 3.0 · Jun 2020
· source
· release history
＋Dataset results table enhancementsshippedAdds column pinning, formatting, search, a column explorer, and natural-language filtering to dataset results tables.5 releases · first seen Dec 2023▸
release
Adds column pinning and formatting, search, a column explorer, natural-language filtering, and a selection details panel to the dataset results table and metric view preview grid.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Dashboard enhancements and bug fixes (2026-09-24) · Sep 2026
· source
· release history
Adds column explorer UI to tabular notebook outputs, enabling search, show/hide, pin, and rearrange columns
New column explorer · Mar 2025
· source
· release history
Supports Currency, Percentage, and URL formatting for columns in notebook and query result tables
Format columns in notebook and query results tables · Aug 2024
· source
· release history
Adds the ability to search columns and select filter values from a dropdown list in Notebook and SQL Editor results tables
Improved search and filtering in notebook and SQL editor results tables · May 2024
· source
· release history
Enables new tabular output rendering in notebooks that supports searching results and copying subsets to the clipboard
New notebook cell results rendering available (Public Preview) · Dec 2023
· source
· release history
＋Metric view enhancementsshippedAdds Include-style level of detail expressions in the metric view editor and lets users choose which SQL warehouse runs materialization for exported datasets.5 releases · first seen Oct 2022▸
release
Adds include-style level of detail (LOD) expressions to the metric view editor.
Dashboard enhancements and bug fixes (2026-09-24) · Sep 2026
· source
· release history
Lets you choose which SQL warehouse runs materialization when exporting a dashboard dataset as a materialized view in Unity Catalog.
Dashboard enhancements (2026-09-10) · Sep 2026
· source
· release history
Adds Include-style level of detail (LOD) expressions in YAML to the metric view editor.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Dashboard enhancements (2026-09-10) · Sep 2026
· source
· release history
Enables serverless compute support for notebooks, workflows, and Spark Declarative Pipelines on Lakeflow in the Asia Pacific (Jakarta) region (ap-southeast-3)
Serverless compute is now available in ap-southeast-3 · Aug 2025
· source
· release history
Adds capability to automatically generate a Databricks notebook configured for streaming inference via DLT when deploying a model.
Deploy models for streaming inference with DLT notebooks · Oct 2022
· source
· release history
＋UDF secret access configurationshippedAllows Unity Catalog UDFs to declare and access secrets without direct caller privileges using SECRETS clauses.4 releases · 1 other source · first seen Jun 2026▸
release
Extends Unity Catalog Scala UDF secret access support to only serverless SQL warehouses; dedicated access mode does not support direct invocation.
Scala UDFs can access Unity Catalog secrets â · Sep 2026
· source
· release history
Requires environment_version = 6 or above on serverless compute and Databricks Runtime 19+ with standard access mode on classic compute for secret access in Scala UDFs.
Scala UDFs can access Unity Catalog secrets â · Sep 2026
· source
· release history
Unity Catalog Scala UDFs declare required secrets in a SECRETS clause and run under the function owner's permissions, so callers need no direct secret access.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Scala UDFs can access Unity Catalog secrets (2026-09-23) · Sep 2026
· source
· release history
ai_classify function general availability allows classifying text according to custom labels, supporting label descriptions, global instructions, and multi-label classification.
ai_classify is now generally available · Jun 2026
· source
· release history
example
Define a Unity Catalog Scala UDF that reads a secret without exposing it to callers — the SECRETS clause grants owner-permission access so callers need no direct secret privilege.$ CREATE OR REPLACE FUNCTION my_catalog.my_schema.fetch_api_key() RETURNS STRING LANGUAGE SCALA SECRETS ('my_scope' = 'my_key') ENVIRONMENT_VERSION 6 AS $$ dbutils.secrets.get(scope = "my_scope", key =…
Scala UDFs can access Unity Catalog secrets (2026-09-23) · Sep 2026
· source
＋Information Extraction capabilitiesshippedsuggestedSupports the transformation of large volumes of unlabeled text documents into structured tables with extracted information using AI models.5 releases · first seen Mar 2025▸
Suggested capability: Log parsing and normalization. This is our guess, not confirmed.
Also counts toward: REST API
release
Adds general availability for the AI Functions REST API, enabling programmatic access to ai_parse_document, ai_extract, and ai_classify functions.
AI Functions REST API is now generally available тАЛ · Aug 2026
· source
· release history
The ai_extract function's precision mode is generally available for multi-page documents, schemas with 50+ fields, and complex conditional logic.
ai_extract precision mode is now generally available тАЛ · Aug 2026
· source
· release history
The ai_parse_document function is now generally available to parse structured content from PDFs, images, Word, and PowerPoint files.
ai_parse_document is now generally available · Apr 2026
· source
· release history
Adds the ai_parse_document AI Function (Beta) to invoke a state-of-the-art AI model for extracting structured content.
Parse documents using ai_parse_document (Beta) · Jun 2025
· source
· release history
Information Extraction is in Beta, supporting transformation of large volumes of unlabeled text documents into structured tables with extracted information.
Information Extraction is in Beta · Mar 2025
· source
· release history
＋Lakeflow visual designershippedProvides a drag-and-drop, no-code canvas for preparing and transforming data using built-in operators or natural language.5 releases · first seen May 2026▸
Also counts toward: Natural-language query
release
Expands Join operator with three default outputs (unmatched left rows, matched rows, unmatched right rows) for easier workflow branching
Lakeflow Designer Summer Release · Jul 2026
· source
· release history
Adds Prepare operator for common data-cleansing tasks including text case changes, data type conversions, value replacement, and formulas
Lakeflow Designer Summer Release · Jul 2026
· source
· release history
Introduces Lakeflow Designer, a visual, no-code experience on a drag-and-drop canvas to prepare and transform data with built-in operators or natural language.
Lakeflow Designer is now generally available · Jun 2026
· source
· release history
Adds AI operator search to the operator panel, suggesting operators based on intent (e.g., typing average by month surfaces Aggregate operator)
Lakeflow Designer updates · May 2026
· source
· release history
Adds Configurable sample size allowing users to set the number of sample rows for each operator, with limits remembered per operator
Lakeflow Designer updates · May 2026
· source
· release history
＋Databricks Light RuntimeshippedProvides a lightweight runtime option optimized for running JAR, Python, or spark-submit jobs without the full data engineering stack.5 releases · first seen Apr 2019▸
Also counts toward: Python scripting support
release
MLflow Tracing is generally available for tracking inputs, outputs, and metadata associated with each step of a model or agent request.
MLflow Tracing is GA · Feb 2025
· source
· release history
Adds runtime_engine attribute to the databricks_cluster resource
Databricks Terraform provider updated to version 1.6.2 · Nov 2022
· source
· release history
Makes the Personal Compute cluster policy available by default on all workspaces, allowing users to create single-machine compute resources with minimal management overhead.
Personal Compute cluster policy is available by default to all users · Oct 2022
· source
· release history
Databricks Light is now selectable as the runtime version when configuring pool-backed clusters for automated jobs.
Launch pool-backed automated clusters that use Databricks Light (Public Preview) · Oct 2019
· source
· release history
Adds Databricks Light (Data Engineering Light) as a selectable runtime option when creating clusters to run JAR, Python, or spark-submit jobs.
Databricks Light generally available · Apr 2019
· source
· release history
＋Catalog Explorer interaction featuresshippedAdds a Quick access section, table name linking to metadata inspection, and stepwise catalog creation UI in Catalog Explorer.5 releases · first seen Aug 2023▸
release
Hovering over the name of a Unity Catalog table in a notebook cell displays tooltip metadata including Owner, Last updated, Size, Description, and a link to view the table in the Catalog Explorer side panel
Additional metadata for the table tooltip in notebooks · Nov 2024
· source
· release history
Adds a Quick access section in Catalog Explorer to display recent Unity Catalog objects, favorite Unity Catalog objects, and catalogs and schemas for browsing.
Catalog Explorer improvements · Jun 2024
· source
· release history
Adds EnableAsyncModeForMetadataOperation=1 property for async metadata Thrift calls on SPARK_CLI_SERVICE_PROTOCOL_V9 servers
Databricks JDBC driver 2.6.38 · May 2024
· source
· release history
Displays Unity Catalog object counts at the schema level when filtering
Unified schema browser is now GA · Aug 2023
· source
· release history
Adds a unified schema browser across notebooks, SQL Editor, and Catalog Explorer
Unified schema browser is now GA · Aug 2023
· source
· release history
＋Interactive Charting EnhancementsshippedAdds interactive controls and visualization options to line charts, including Y-axis range/log scale settings, marker visibility toggles, and a built-in toolbar for client-side interactions.5 releases · first seen Mar 2019▸
release
Adds Y-axis range setting to the line chart
New interactive charts offer rich client-side interactions · Mar 2019
· source
· release history
Adds log scale application to the Y-axis for the line chart
New interactive charts offer rich client-side interactions · Mar 2019
· source
· release history
Replaces bar chart and line chart implementations with two new interactive chart types
New interactive charts offer rich client-side interactions · Mar 2019
· source
· release history
Introduces a built-in toolbar supporting rich client-side interactions for both new chart types
New interactive charts offer rich client-side interactions · Mar 2019
· source
· release history
Adds show/hide markers option to the line chart
New interactive charts offer rich client-side interactions · Mar 2019
· source
· release history
＋Genie budget access controlsshippedAllows account and workspace admins to assign Budget Manager or Budget Viewer roles to specific users, groups, or service principals via access control lists on Genie budgets.2 releases · 2 other sources · first seen Oct 2026▸
Also counts toward: Role-based access control
release
View up to five personal and shared spend limits sorted by highest percentage used with ug usage, or see all applicable limits with ug usage --all.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
View personal and shared spend limits with the ug CLI (2026-10-28) · Oct 2026
· source
· release history
Adds access control lists (ACLs) to Genie budgets, enabling account and workspace admins to grant Budget Manager or Budget Viewer roles to specific users, groups, or Databricks service principals.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Delegate access to Genie budgets (2026-10-16) · Oct 2026
· source
· release history
example
See every personal and shared spend limit in your account to audit which budgets are close to exhaustion.$ ug usage --all
View personal and shared spend limits with the ug CLI (2026-10-28) · Oct 2026
· source
Delegate read-only budget visibility to a service principal so automated reporting jobs can access cost data without admin rights.$ In the Databricks console, go to your Account > Budgets, select a budget, open Permissions, and assign the `Budget Viewer` role to the desired user, group, or service principal.
Delegate budget access with access control lists (ACLs) (2026-10-16) · Oct 2026
· source
＋Google Analytics Aggregated connector ingestionshippedsuggestedIngests Google Analytics aggregated data into Databricks via Lakeflow Connect, supporting custom report definitions with user-defined dimensions and metrics, and both service account and OAuth U2M authentication, with workspace admins able to enable or disable the connector from the Previews page.3 releases · 1 other source · first seen Oct 2026▸
Suggested capability: Metrics collection. This is our guess, not confirmed.
release
Workspace admins can enable or disable the Google Analytics Aggregated connector from the Previews page.
Google Analytics Aggregated connector is available in Beta (2026-10-23) · Oct 2026
· source
· release history
Supports custom report definitions with user-defined dimensions, metrics, and aggregation level.
Google Analytics Aggregated connector is available in Beta (2026-10-23) · Oct 2026
· source
· release history
Supports both service account and OAuth user-to-machine (U2M) authentication for the Google Analytics Aggregated connector.
Google Analytics Aggregated connector is available in Beta (2026-10-23) · Oct 2026
· source
· release history
example
Enable the Google Analytics Aggregated connector Beta for your workspace before configuring ingestion pipelines.$ In the Databricks workspace, go to Settings > Previews, find the Google Analytics Aggregated connector, and toggle it on.
Google Analytics Aggregated connector is available in Beta (2026-10-23) · Oct 2026
· source
＋Dashboard visualization controlsshippedAdds a line shape control for connecting data points with linear, smooth, or stepped lines, and path map support for connecting ordered point sequences into trajectories.4 releases · first seen Sep 2026▸
release
Adds layered combo charts, letting authors build combo charts from separate chart layers.
Dashboard enhancements (2026-10-22) · Oct 2026
· source
· release history
Adds customizable totals on waterfall charts.
Dashboard enhancements (2026-10-22) · Oct 2026
· source
· release history
Adds Line shape control to line and area charts, connecting data points with linear, smooth, or stepped lines.
Dashboard enhancements (2026-09-10) · Sep 2026
· source
· release history
Adds path map support for connecting ordered point sequences into a line from separate longitude/latitude columns or a single point geometry column, enabling GPS-track-style trajectories.
Dashboard enhancements (2026-09-10) · Sep 2026
· source
· release history
＋Genie Code skill managementshippedEnables Genie Code skills in Genie One by default with per-skill toggle controls for customization.3 releases · 1 other source · first seen Sep 2026▸
release
Adds Upload skills button to upload existing skill files and folders directly to your skills folder in the workspace (Public Preview).︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Genie One enhancements (2026-10-22) · Oct 2026
· source
· release history
Enables central configuration of coding agents — including models, MCP servers, skills, a default harness, and Smart Routing — with settings applied at agent launch or rolled out via mobile device management (MDM).︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Centrally configure coding agents (2026-09-22) · Sep 2026
· source
· release history
Enables Genie Code skills in Genie One by default, with per-skill toggle controls on the customization page.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Genie One enhancements (2026-09-10) · Sep 2026
· source
· release history
example
Upload a folder of existing skill files to the workspace without manually navigating the file tree.$ In Genie One, click 'Upload skills', then select your local skill files or folders to add them to your skills folder in the workspace.
Genie One enhancements (2026-10-22) · Oct 2026
· source
＋PCI-DSS and HITRUST compliance expansionshippedExtends PCI-DSS and HITRUST compliance for Lakebase to all available AWS regions.4 releases · first seen Sep 2026▸
release
Jobs scheduled through an observability configuration have stopped and their schedules do not carry over; those configurations no longer write telemetry to their Unity Catalog destinations, so dashboards retain historical data but receive no new data.
Lakebase Insights moves to per-project settings, with on-demand runs (Beta) (2026-10-19) · Oct 2026
· source
· release history
The Salesforce Data 360 file sharing connector is now enabled by default for workspaces with the compliance security profile
Salesforce Data 360 file sharing will soon be available by default for workspaces with the compliance security profile enabled (2026-09-30) · Sep 2026
· source
· release history
Adds trim_array function to SQL, Scala DataFrame, and Python DataFrame APIs to remove elements from the end of an array (positive count) or the beginning (negative count).
Databricks Runtime 19: September 21, 2026 (2026-09-21) · Sep 2026
· source
· release history
Extends PCI-DSS and HITRUST compliance for Lakebase to all AWS regions where it is available, for workspaces with the compliance security profile enabled (previously limited to us-east-1).
Lakebase now supports PCI-DSS and HITRUST in all AWS regions (2026-09-08) · Sep 2026
· source
· release history
＋Databricks Apps horizontal scalingshippedEnables horizontal scaling for Databricks Apps in compliance security profile workspaces, running an app across multiple instances behind a single URL.4 releases · first seen May 2026▸
Also counts toward: High-availability clustering
release
Workspace admins can configure default Python and npm package repositories for Databricks Apps, with app-level overrides still supported.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Workspace-level package repositories for Databricks Apps are generally available (2026-10-14) · Oct 2026
· source
· release history
Enables running a Databricks app across multiple instances behind a single app URL for higher availability and concurrency, with zero-downtime deployments and best-effort session affinity.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Horizontal scaling for Databricks Apps is now generally available (2026-09-29) · Sep 2026
· source
· release history
Enables horizontal scaling for Databricks Apps in workspaces with the compliance security profile, running an app across multiple instances behind a single app URL for higher availability and concurrency.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Horizontal scaling for Databricks Apps will soon be available for workspaces with the compliance security profile enabled (2026-09-09) · Sep 2026
· source
· release history
Enables running a Databricks app across multiple instances behind a single URL for higher availability and zero-downtime deployments
Databricks Apps horizontal scaling (Beta) · May 2026
· source
· release history
＋Lakeflow pipeline versioning and editorshippedAllows users to manage Spark Declarative Pipelines using Git folders, including setting custom Git identities and viewing pipelines as code files.4 releases · first seen Feb 2025▸
Also counts toward: Python scripting support, Scripting language support
release
Adds pipeline parameters (GA) to Lakeflow: define key-value pair defaults in pipeline settings, override them at update start, and reference them in SQL with named parameter syntax — so one pipeline can run against different catalogs, schemas, or tables without editing source code.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Parameters for Lakeflow pipelines are now generally available (2026-10-12) · Oct 2026
· source
· release history
The default source code format for pipelines is changed from notebooks to Python and SQL code files.
Lakeflow Pipelines Editor is now in public preview · Sep 2025
· source
· release history
The Lakeflow Pipelines Editor is now in public preview, allowing users to view pipelines as a set of files in the pipeline asset browser.
Lakeflow Pipelines Editor is now in public preview · Sep 2025
· source
· release history
New pipelines now support creating and updating materialized views and streaming tables in multiple catalogs and schemas by default.
DLT now supports publishing to tables in multiple schemas and catalogs · Feb 2025
· source
· release history
＋Databricks REST API Reference documentationshippedProvides a beta documentation experience for browsing the latest Databricks REST API documentation.3 releases · 1 other source · first seen Jan 2023▸
Also counts toward: REST API
release
The /api/2.1/unity-catalog/workspace-bindings/ API endpoint is deprecated and replaced by /api/2.1/unity-catalog/bindings/
Use workspace-catalog binding to give read-only access to a catalog · Oct 2023
· source
· release history
Adds the owner attribute to the databricks_metastore_data_access resource to specify the metastore owner.
Databricks Terraform provider updated to version 1.27.0 · Sep 2023
· source
· release history
Adds the new Databricks REST API Reference documentation experience (beta) for browsing the latest Databricks REST API docs
REST API Reference is now available for browsing API documentation · Jan 2023
· source
· release history
docs
Oct 9, 2026 The following functions are grouped by task. Use the SQL and REST API columns to open the reference for each interface. A dash in the REST API column means no dedicated REST API reference is listed.
docs update · Oct 2026
· source
＋ABAC DENY policiesshippedAllows explicitly denying the MANAGE ACCESS CONTROL privilege to specified principals, taking precedence over any grant.4 releases · first seen Nov 2025▸
release
Promotes cross-engine attribute-based access controls (ABAC) to general availability, allowing supported external engines to read Unity Catalog managed tables with ABAC policies, row filters, and column masks enforced by Databricks serverless compute.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Cross-engine attribute-based access controls (ABAC) is now generally available (2026-10-01) · Oct 2026
· source
· release history
Adds ABAC DENY policy support in Unity Catalog to explicitly deny the MANAGE ACCESS CONTROL privilege for specified principals, including object owners, taking precedence over grants.
ABAC DENY policies are in Beta â · Sep 2026
· source
· release history
Adds ABAC DENY policies (Beta) in Unity Catalog to explicitly deny the MANAGE ACCESS CONTROL privilege to specified principals, including object owners, always taking precedence over any grant.
ABAC DENY policies are in Beta (2026-09-08) · Sep 2026
· source
· release history
Enables automatic type casting for column mask functions defined in ABAC policies to match target column data types
Attribute-based access control (ABAC) now in Public Preview · Nov 2025
· source
· release history
＋Dashboard materializationshippedExtends dashboard materialization in Beta to cover SQL datasets in addition to local metric views, and allows Genie Code to create dashboard materializations on request.4 releases · first seen May 2024▸
release
Genie Code can create dashboard materializations on request (Beta).
Dashboard enhancements and bug fixes (2026-10-01) · Oct 2026
· source
· release history
Extends dashboard materialization (Beta) to cover SQL datasets in addition to local metric views.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Dashboard enhancements and bug fixes (2026-10-01) · Oct 2026
· source
· release history
Genie Code can now create dashboard materializations (Beta)
Dashboard enhancements and bug fixes (2026-10-01) · Oct 2026
· source
· release history
Adds the ability to schedule automatic refreshes for materialized views and streaming tables.
New dbt-databricks connector 1.8.0 adopts decoupled dbt architecture · May 2024
· source
· release history
＋Embedded dashboardsshippedSupports embedding dashboards in external applications, with APIs to set and retrieve filter values programmatically and contextual hiding of unsupported features.4 releases · first seen Oct 2022▸
release
Embedded dashboards can now show, collapse, or hide global filters by default.
Dashboard enhancements and bug fixes (2026-10-01) · Oct 2026
· source
· release history
Adds embedded dashboard filter APIs to set and retrieve filter values programmatically in embedded dashboards.
Dashboard enhancements and bug fixes (2026-09-03) · Sep 2026
· source
· release history
Hides the Ask Genie button in embedded dashboards when the feature is not supported.
Genie One enhancements (2026-09-03) · Sep 2026
· source
· release history
Makes the Personal Compute cluster policy available by default on all workspaces, allowing users to create single-machine compute resources with minimal management overhead.
Personal Compute cluster policy is available by default to all users · Oct 2022
· source
· release history
＋Foreign Iceberg table sharingshippedSupports sharing foreign Iceberg tables federated from external catalogs via Lakehouse Federation to Delta Sharing recipients.4 releases · first seen Aug 2024▸
Also counts toward: REST API
release
Supports sharing foreign Iceberg tables federated from external Iceberg catalogs via Lakehouse Federation to Delta Sharing recipients, including those using non-Databricks Iceberg clients.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Sharing foreign Iceberg tables with OpenSharing is now generally available (2026-09-11) · Sep 2026
· source
· release history
Allows providers to add foreign Iceberg tables federated from external catalogs into a Delta Sharing share for read-only recipient access
Share foreign Iceberg tables with Delta Sharing (Public Preview) · Apr 2026
· source
· release history
Enables reading and writing to managed Apache Iceberg tables from Databricks or external engines via the Iceberg REST Catalog API
Managed Apache Iceberg tables are in Public Preview · Jun 2025
· source
· release history
Support for enabling UniForm Iceberg on existing tables via ALTER TABLE without rewriting data files
Databricks Runtime 15.4 LTS · Aug 2024
· source
· release history
＋One-time job performance targetsshippedAdds support for standard performance mode in one-time Databricks runs via the Jobs API, Airflow operator, and command submission.3 releases · 1 other source · first seen Jun 2025▸
Also counts toward: REST API
release
Supports performance_target: STANDARD in Apache Airflow's DatabricksSubmitRunOperator for one-time Databricks job submissions.
Standard performance mode is now available for one-time runs in the Jobs API (2026-09-11) · Sep 2026
· source
· release history
Adds performance_target field set to STANDARD in the Jobs API for one-time runs, enabling standard performance mode alongside the existing options.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Standard performance mode is now available for one-time runs in the Jobs API (2026-09-11) · Sep 2026
· source
· release history
Performance optimized setting is now generally available for selecting the serverless performance mode for jobs and pipelines.
Serverless performance targets is now GA · Jun 2025
· source
· release history
example
Submit a one-time Databricks run with standard performance mode to control cost vs. speed trade-offs at submission time.$ curl -X POST https://<databricks-instance>/api/2.1/jobs/runs/submit \ -H 'Authorization: Bearer <token>' \ -H 'Content-Type: application/json' \ -d '{"performance_target": "STANDARD", "run_name":…
Standard performance mode is now available for one-time runs in the Jobs API (2026-09-11) · Sep 2026
· source
＋Lakeflow connector file ingestionshippedAdds built-in Excel file format support for querying via Spark DataFrames and enables a customizable SharePoint connector for structured, semi-structured, and unstructured file ingestion.4 releases · first seen Dec 2025▸
release
Adds Genie Code in Public Preview to generate distributed training code, resolve environment issues, and debug GPU/distributed workload failures when used with AI Runtime.
Genie Code for AI Runtime (Public Preview) тАЛ · Aug 2026
· source
· release history
Adds structured file ingestion for CSV, JSON, XML, Excel, Parquet, Avro, and ORC formats via the unified managed file source API in the Managed SharePoint connector (Lakeflow Connect).
Managed SharePoint connector adds structured file ingestion and file metadata support (Beta) · Jun 2026
· source
· release history
Adds the customizable SharePoint connector to enable structured, semi-structured, and unstructured file ingestion into Delta tables.
Customizable SharePoint connector (Beta) · Dec 2025
· source
· release history
Adds built-in Excel file format support (Beta) allowing users to query Excel files directly using Spark DataFrames without external libraries
Built-in Excel file format support (Beta) · Dec 2025
· source
· release history
＋Databricks Connector for Microsoft Power PlatformshippedAdds the Databricks connector to Microsoft Power Platform, enabling data access for canvas apps, flows, and agents.4 releases · first seen Dec 2023▸
release
Enables OAuth authentication for Databricks connections in Microsoft Power Platform as an alternative to personal access tokens (PAT).
Use OAuth to authenticate Databricks connections in Power Platform · Jun 2026
· source
· release history
Adds the Databricks connector to Microsoft Power Platform (Public Preview), enabling data access for canvas apps, flows, and agents
Databricks connector in Microsoft Power Platform is in Public Preview · Sep 2025
· source
· release history
Adds easy navigation between workspace settings and user settings in the admin interface
New unified admin settings UI · Dec 2023
· source
· release history
Updates the workspace admin settings UI to incorporate previously separate SQL settings
New unified admin settings UI · Dec 2023
· source
· release history
＋Knowledge AssistantshippedEnables the creation of question-and-answer chatbots over documents with quality improvement via natural language feedback.4 releases · first seen May 2025▸
Also counts toward: Built-in AI assistant, Natural-language query
release
Enables Knowledge Assistant capability by default for workspaces with the compliance security profile enabled and HIPAA controls selected
Knowledge Assistant is now available by default for Enhanced Security and Compliance customers · Mar 2026
· source
· release history
Adds Knowledge Assistant availability in AWS regions us-east-2, ca-central-1, eu-central-1, eu-west-1, ap-southeast-1 (requires cross-geo processing), and ap-southeast-2 (requires cross-geo processing).
Knowledge Assistant is now available in more regions · Jan 2026
· source
· release history
Knowledge Assistant is now generally available in select US regions for workspaces without Enhanced Security and Compliance features.
Knowledge Assistant is now generally available · Jan 2026
· source
· release history
Knowledge Assistant (Beta) enables creation of question-and-answer chatbots over documents with quality improvement via natural language feedback.
Knowledge Assistant for domain-specialized chatbots is in Beta · May 2025
· source
· release history
＋Usage tracking enhancementsshippedsuggestedAdds detailed columns for compute duration and task run timing to billable usage and job timeline tables.4 releases · first seen Jan 2025▸
Suggested capability: Metrics collection. This is our guess, not confirmed.
release
Adds compute, termination_type, task_parameters, setup_duration_seconds, cleanup_duration_seconds, and execution_duration_seconds columns to the job_task_run_timeline table.
New columns in Lakeflow system tables (Public Preview) · Dec 2025
· source
· release history
Adds source_task_run_id, root_task_run_id, compute, termination_type, setup_duration_seconds, queue_duration_seconds, run_duration_seconds, cleanup_duration_seconds, and execution_duration_seconds columns to the job_run_timeline table.
New columns in Lakeflow system tables (Public Preview) · Dec 2025
· source
· release history
Adds product_features.performance_target column to billable usage table logging performance mode (PERFORMANCE_OPTIMIZED, STANDARD, or null) for serverless jobs and pipelines.
The billable usage table now records the performance mode of serverless jobs and pipelines · Oct 2025
· source
· release history
Enables usage tracking via system tables for operational monitoring on endpoints using provisioned throughput.
AI Gateway now supports provisioned throughput (Public Preview) · Jan 2025
· source
· release history
＋MLeap ML model exportshippedEnables export of ML models and pipelines for deployment as low-latency, lightweight applications.4 releases · first seen Mar 2018▸
release
Identity federation is now generally available, enabling assignment of account-level users, service principals, and groups to identity-federated workspaces.
Identity federation is GA · Aug 2022
· source
· release history
Adds MLeap integration for model serialization
Databricks Runtime 5.0 for Machine Learning (Beta) release · Nov 2018
· source
· release history
Releases MLeap ML model export capability targeting low-latency, lightweight ML-powered applications
Databricks ML Model Export · Mar 2018
· source
· release history
Introduces ML Model Export functionality allowing export of models and full ML pipelines from Apache Spark for scoring on other platforms
Databricks ML Model Export · Mar 2018
· source
· release history
＋Usage log deliveryshippedsuggestedAllows programmatic access to cluster DBU usage data via S3 delivery for billing analysis.4 releases · first seen Jun 2020▸
Suggested capability: Log routing. This is our guess, not confirmed.
Also counts toward: S3 export
release
Databricks 3.48 enables direct API-based retrieval of billable usage logs in CSV, eliminating the previous requirement for S3 bucket delivery setup.
Use an API to download usage data directly · Jun 2021
· source
· release history
Adds automatic usage and audit log delivery to an S3 bucket in a different AWS account than the IAM role's account
Billable usage and audit log S3 bucket policy and object ACL changes · Jan 2021
· source
· release history
Supports BucketOwnerFullControl Canned ACL for usage/audit logs delivered to S3
Billable usage and audit log S3 bucket policy and object ACL changes · Jan 2021
· source
· release history
Public preview of S3 delivery for billable usage logs provides programmatic access to cluster DBU data for account owners.
Billable usage logs delivered to your own S3 bucket (Public Preview) · Jun 2020
· source
· release history
＋Lakebase low-latency table servingshippedGenerates read-only versions of Unity Catalog managed tables, streaming tables, or materialized views automatically synced with the original for low-latency querying.3 releases · first seen Aug 2025▸
release
Databricks now supports merge strategies when writing to Lakebase from Structured Streaming, letting you keep the first or last value, ignore nulls, or select values by an ordering column during upserts — requires Databricks Runtime 19 or above.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Control Lakebase sink upserts with merge strategies (2026-11-03) · Nov 2026
· source
· release history
Generates a read-only version of Unity Catalog managed tables, streaming tables, or materialized views automatically synced with the original.
Compatibility Mode (Public Preview) · Oct 2025
· source
· release history
Newly created Lakebase synced tables map TIMESTAMP types in source tables to TIMESTAMP WITH TIMEZONE in the synced table.
Data type mapping update for Lakebase synced tables · Aug 2025
· source
· release history
＋AI Functions in SQLshippedEnables the invocation of state-of-the-art AI models directly from SQL queries for tasks such as sentiment analysis and classification.3 releases · first seen Feb 2024▸
release
Unity Gateway budgets now track spend from task-specific AI Functions — ai_parse_document, ai_extract, and ai_classify — across both batch and real-time execution paths.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
AI Functions usage is now included in Unity Gateway budgets (2026-11-01) · Nov 2026
· source
· release history
Adds ai_forecast() SQL function to Databricks AI Functions for extrapolating time series data
Forecast time series data using ai_forecast() · Jul 2024
· source
· release history
Adds AI Functions capability to invoke state-of-the-art AI models from Foundation Model APIs for tasks such as sentiment analysis and classification.
Use AI Functions to invoke an AI model from Foundation Model APIs · Feb 2024
· source
· release history
＋Coding agent central configurationshippedAllows workspace admins to centrally configure coding agent settings such as models, MCP servers, and skills, with rollout support via mobile device management.3 releases · first seen Sep 2026▸
Also counts toward: MCP server
release
Claude Code auto mode now works with both Anthropic and non-Anthropic models hosted by Databricks, reviewing tool calls to reduce routine permission prompts.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Claude Code auto mode for Anthropic and non-Anthropic models (2026-10-30) · Oct 2026
· source
· release history
Adds GA support for the agentic code converter for the SQL target framework, converting dialects including T-SQL, Snowflake, Redshift, Oracle, BigQuery, and Teradata into Databricks SQL queries, organized within a migration project that validates output and writes results to a workspace…
The agentic code converter is generally available for SQL conversion (2026-10-15) · Oct 2026
· source
· release history
Enables central configuration of coding agents — including models, MCP servers, skills, a default harness, and Smart Routing — with settings applied at agent launch or rolled out via mobile device management (MDM).︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Centrally configure coding agents (2026-09-22) · Sep 2026
· source
· release history
＋Lakeflow Connect CDC data freshness monitoringshippedsuggestedDisplays how current each destination table is in Lakeflow Connect database connector pipelines, with a data freshness column in the tables list showing time since the latest ingested source commit, and the ability to query end-to-end lag from the event log and create alerts for SQL Server, PostgreSQL, MySQL, and Oracle sources.2 releases · 1 other source · first seen Oct 2026▸
Suggested capability: Metrics collection. This is our guess, not confirmed.
release
Query data freshness and end-to-end lag from the ingestion pipeline's event log and create alerts on them — available for SQL Server, PostgreSQL, MySQL, and Oracle sources.
Monitor data freshness in Lakeflow Connect database connector pipelines (Public Preview) (2026-10-30) · Oct 2026
· source
· release history
Databricks now shows how current each destination table is in Lakeflow Connect database connector pipelines via a new Data freshness column in the pipeline's tables list, displaying time since the latest ingested source commit for each CDC table.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Monitor data freshness in Lakeflow Connect database connector pipelines (Public Preview) (2026-10-30) · Oct 2026
· source
· release history
example
Check data freshness of CDC tables in a Lakeflow Connect pipeline's tables list directly in the Databricks UI.$ In the Databricks console, go to Pipelines > <your Lakeflow Connect pipeline> > Tables, and check the 'Data freshness' column for each CDC destination table.
Monitor data freshness in Lakeflow Connect database connector pipelines (Public Preview) (2026-10-30) · Oct 2026
· source
＋Dashboard cross-dataset filteringshippedPropagates filters, selections, and parameters applied to one dataset automatically across widgets built on related datasets.2 releases · 1 other source · first seen Sep 2026▸
release
Dashboard relationships now generally available, letting you build complex multi-fact data models scoped to an AI/BI dashboard.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Dashboard relationships are now generally available (2026-10-29) · Oct 2026
· source
· release history
Adds cross-dataset filtering through relationships (Public Preview): filters, selections, and parameters applied to one dataset automatically carry across to widgets built on related datasets.
Dashboard enhancements and bug fixes (2026-09-03) · Sep 2026
· source
· release history
example
Enable cross-dataset filtering so that a region filter on a sales dataset automatically narrows widgets built on the related returns dataset.$ In the dashboard editor, open Data > Relationships, click 'Add relationship', select the two datasets and the shared key field, then save.
Dashboard enhancements and bug fixes (2026-09-03) · Sep 2026
· source
＋Dashboard variablesshippedLets viewers interactively control visualizations via variables, now supporting multiple fields per variable so viewers can add, remove, and swap multiple fields at once.3 releases · first seen Sep 2026▸
release
Adds full-name tooltips when hovering over a field or measure name in the field picker.
Dashboard enhancements (2026-10-22) · Oct 2026
· source
· release history
Adds multiple-field support to dashboard variables, letting viewers add, remove, and swap multiple fields on a visualization at once instead of one at a time.
Dashboard enhancements and bug fixes (2026-09-03) · Sep 2026
· source
· release history
Dashboard variable options now show their source dataset as a subtitle.
Dashboard enhancements and bug fixes (2026-09-03) · Sep 2026
· source
· release history
＋Project-Scoped Shared ComputeshippedAllows workspace admins to enable a shared serverless compute scope for asset bundles and job tasks, so that serverless notebook and Python script tasks can pick up dependencies defined in a pyproject.toml file.1 release · 2 other sources · first seen Oct 2026▸
Also counts toward: Python scripting support, Scripting language support
release
Workspace admins can enable Project-Scoped Shared Compute on the Previews page to use this feature.
Serverless job environments from pyproject.toml (Beta) (2026-10-22) · Oct 2026
· source
· release history
example
Activate Project-Scoped Shared Compute so your workspace can use Shared Serverless for Asset Bundles.$ 1. In your Databricks workspace, go to Settings > Previews. 2. Locate 'Project-Scoped Shared Compute' and toggle it on.
Shared Serverless for Asset Bundles (Beta) (2026-10-22) · Oct 2026
· source
Enable Project-Scoped Shared Compute so serverless job tasks can pick up dependencies from a pyproject.toml file.$ In the Databricks workspace, go to Settings > Previews and enable 'Project-Scoped Shared Compute'.
Serverless job environments from pyproject.toml (Beta) (2026-10-22) · Oct 2026
· source
＋JDBC Unity Catalog external connectivityshippedEnables JDBC Unity Catalog connections to read/write to external databases via Spark Data Source API or Databricks Remote Query SQL API.3 releases · first seen Oct 2025▸
release
Enables JDBC Unity Catalog connections — including SSL certificate support — by default for workspaces with the compliance security profile enabled, allowing external database access via custom JDBC drivers governed by Unity Catalog.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
JDBC Unity Catalog connections will soon be available by default for workspaces with the compliance security profile enabled (2026-10-09) · Oct 2026
· source
· release history
Enables JDBC Unity Catalog connection to read/write to external databases via Spark Data Source API or Databricks Remote Query SQL API
JDBC Unity Catalog connection in Beta · Nov 2025
· source
· release history
Adds the remote_query table-valued function to fetch data from remote SQL and NoSQL databases using Unity Catalog connections
Databricks Runtime 17.3 LTS · Oct 2025
· source
· release history
＋Data classification scanning for viewsshippedExtends data classification scanning to Unity Catalog views in addition to tables, classifying view columns using the same detection engine.3 releases · first seen Sep 2026▸
release
Automatically classify and tag sensitive data in Unity Catalog with the new Data Classification capability.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
changelog · Sep 2026
· source
· release history
Automatically classify and tag sensitive data in Unity Catalog via the new Data Classification feature.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
changelog · Sep 2026
· source
· release history
Extends Data Classification scanning to Unity Catalog views in addition to tables, classifying view columns for sensitive data using the same detection engine.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Data Classification will soon scan Unity Catalog views (2026-09-03) · Sep 2026
· source
· release history
＋Monitoring table customizationshippedAdds a column picker and filtering capabilities to the agent monitoring table for streamlined triage workflows.2 releases · 1 other source · first seen Jul 2026▸
release
Adds a column picker to the agent monitoring table on the Monitor tab, letting you choose which columns are displayed.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Genie Agents enhancements (2026-09-24) · Sep 2026
· source
· release history
Activity details toggle in SQL warehouse monitoring UI now generally available for color-coded annotations on Running clusters chart
View warehouse activity details (General Availability) · Jul 2026
· source
· release history
docs
Sep 22, 2026 Predict outcomes: ai_predict_class Train a classification model and predict class labels for rows where the target column is NULL ai_predict_value Train a regression model and predict numeric values for rows where the target column is NULL ai_predict_class ai_predict_value
docs update · Sep 2026
· source
＋Lakebase snapshot scheduling APIshippedOffers a Beta API to configure automated snapshot cadences and retention periods for Lakebase root branches.3 releases · first seen Aug 2025▸
Also counts toward: REST API
release
Adds a Beta snapshot schedule API for Lakebase that lets you read and set a root branch's automated snapshot cadences (daily, weekly, or monthly) and per-cadence retention periods.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Lakebase backup schedule API (Beta) (2026-09-22) · Sep 2026
· source
· release history
Tag keys consisting only of '.', '..', or _index are now invalid
Updated AWS tag character restrictions · Apr 2026
· source
· release history
Lakebase public preview is now enabled by default, allowing users to start creating Lakebase database instances without requiring workspace admins to enable the preview first.
Lakebase Public Preview enabled by default · Aug 2025
· source
· release history
＋Pivot table enhancementsshippedAdds an Apply to setting on pivot table color scales to paint gradients on cell text, and supports generating Key Insights per dashboard page.3 releases · first seen Sep 2026▸
release
Adds a configurable default expand level for pivot table row and column hierarchy when the table first loads.
Dashboard enhancements and bug fixes (2026-09-17) · Sep 2026
· source
· release history
Adds Apply to setting on the pivot table color scale, letting you paint the color gradient on cell text as well as the background.
Dashboard enhancements (2026-09-10) · Sep 2026
· source
· release history
Generates Key Insights per dashboard page, with a New insights badge and live-generating indicator when new insights are available.
Dashboard enhancements (2026-09-10) · Sep 2026
· source
· release history
＋Unified trace tableshippedsuggestedCaptures every request and response across Unity Gateway services into a single Unity Catalog table in OpenTelemetry format.3 releases · first seen Jan 2025▸
Suggested capability: Distributed tracing. This is our guess, not confirmed.
release
Adds the unified trace table (Beta) to capture every request and response across Unity Gateway services into a single Unity Catalog table in OpenTelemetry format.
Monitor all AI activity with the unified trace table (Beta) тАЛ · Aug 2026
· source
· release history
Adds capability to persist logs, traces, and metrics from custom model serving endpoints into Unity Catalog Delta tables using OpenTelemetry.
Endpoint telemetry for custom model serving endpoints (Beta) · Mar 2026
· source
· release history
Enables AI Gateway inference tables automatically for custom Python agents to provide enhanced logging metadata
Custom Python AI agents now support AI Gateway and streaming output · Jan 2025
· source
· release history
＋SQL task type in WorkflowsshippedAllows running SQL queries, refreshing SQL dashboards, and refreshing SQL alerts as a specific task type within multi-task data pipelines.3 releases · first seen Sep 2022▸
release
Enables sql_alert task in Lakeflow Jobs for evaluating Databricks SQL alerts within job pipelines, returning evaluation state as a task output.
SQL alert task in Lakeflow Jobs is now available by default for workspaces with the compliance security profile enabled тАЛ · Aug 2026
· source
· release history
Adds subscriptions support in alert SQL tasks within the databricks_job resource
Databricks Terraform provider updated to version 1.21.0 · Jul 2023
· source
· release history
sql task type in Databricks Workflows allows running SQL queries, refreshing SQL dashboards, and refreshing SQL alerts.
Orchestrate Databricks SQL tasks in your Databricks workflows (Public Preview) · Sep 2022
· source
· release history
＋Identity and access automationshippedSends automatic email notifications to workspace users approximately 7 days before their personal access tokens expire.3 releases · first seen Sep 2024▸
release
Databricks automatically sends email notifications to workspace admins when a service principal token is set to expire within seven days
Email notifications for expiring service principal tokens are now generally available · Jul 2026
· source
· release history
Databricks now sends automatic email notifications to workspace users approximately 7 days before their personal access tokens expire.
Automatic email notifications for expiring personal access tokens (Public Preview) · Nov 2025
· source
· release history
Emergency access for account admins no longer requires Single Sign-On (SSO) configuration.
Emergency access no longer requires single sign-on · Sep 2024
· source
· release history
＋Workspace migration and account managementshippedFacilitates the transition from legacy metastores to Unity Catalog and provides tools for managing multi-account environments.3 releases · first seen May 2022▸
release
Two new admin settings are generally available to help migrate accounts and workspaces to Unity Catalog by disabling legacy features.
Disable legacy features settings are now GA · Dec 2025
· source
· release history
Reduces ALTER TABLE privilege requirement from OWNERSHIP to MODIFY for metadata operations (comments, properties, columns) in Unity Catalog
ALTER TABLE permission changes for Unity Catalog · Jun 2022
· source
· release history
Adds an upgrade wizard to copy complete schemas (databases) and multiple tables from the default Hive metastore to the Unity Catalog metastore.
Upgrade wizard makes it easier to copy databases and multiple tables to Unity Catalog (Public Preview) · May 2022
· source
· release history
＋Delta compression and data functionsshippedSwitches default managed table compression from Snappy to Zstandard for improved efficiency, and updates supported file name functions.3 releases · first seen Aug 2025▸
release
The input_file_name function is no longer supported; use _metadata.file_name instead
Databricks Runtime 17.3 LTS · Oct 2025
· source
· release history
New managed tables in Databricks Runtime 16.0 and above now use Zstandard (Zstd) compression by default, replacing the previous Snappy default to improve storage efficiency and I/O performance.
Zstd is now the default compression for new managed tables · Oct 2025
· source
· release history
Ensures all future writes to the table use the chosen compression codec when the delta.parquet.compression.codec property is set.
New table property to control Delta table compression · Aug 2025
· source
· release history
＋Notebook-scoped librariesshippedEnables management of custom Python environments and libraries in notebooks using conda and pip commands.3 releases · first seen May 2020▸
release
Adds pyproject.toml support in notebook ancestor paths or home folder to configure Python syntax highlighting
Configure Python syntax highlighting in Databricks notebooks · May 2025
· source
· release history
Adds notebook-scoped Python libraries and custom environments managed by conda and pip commands.
Databricks Runtime 7.0 ML GA · Jun 2020
· source
· release history
Adds notebook-scoped Python libraries and custom environments managed by conda and pip commands
Databricks Runtime 7.0 ML (Beta) · May 2020
· source
· release history
＋Foundation Model Fine-tuningshippedEnables Foundation Model Fine-tuning as part of Mosaic AI Model Training for all us-west-2 customers.3 releases · first seen May 2024▸
release
Adds Meta Llama 3.2 3B and 1B models to the supported list for Foundation Model Fine-tuning.
Meta Llama 3.2 3B and 1B models are supported in Foundation Model Fine-tuning · Sep 2024
· source
· release history
Enables Foundation Model Fine-tuning as part of Mosaic AI Model Training for all us-west-2 customers without access requests.
Foundation Model Fine-tuning available to all us-west-2 customers (Public Preview) · Jul 2024
· source
· release history
Adds access to a selection of high-quality, pre-trained AI models within Unity Catalog.
Pre-trained models in Unity Catalog (Public Preview) · May 2024
· source
· release history
＋Cloudflare R2 storage supportshippedAdds Cloudflare R2 as a supported cloud storage option for Unity Catalog and Delta Sharing.3 releases · first seen Feb 2024▸
release
Cloudflare R2 is now generally available for use as cloud storage for data registered in Unity Catalog
Support for Cloudflare R2 storage is GA · Jul 2024
· source
· release history
Support for Cloudflare R2 extends to all Databricks data and AI assets previously supported in AWS S3, Azure Data Lake Storage, and Google Cloud Storage
Support for Cloudflare R2 storage is GA · Jul 2024
· source
· release history
Adds Cloudflare R2 storage support (Public Preview) as a cloud storage option for Unity Catalog and Delta Sharing.
Databricks Runtime 14.3 LTS · Feb 2024
· source
· release history
＋Global init script managementshippedAllows administrators to programmatically create, manage execution order, and monitor launch failures of global init scripts for cluster configuration.3 releases · first seen Aug 2020▸
Also counts toward: REST API
release
Adds Global Init Scripts REST API endpoints for creating and managing init scripts programmatically.
New, more secure global init script framework (Public Preview) · Aug 2020
· source
· release history
Adds the ability to set execution order for multiple global init scripts in the cluster configuration.
New, more secure global init script framework (Public Preview) · Aug 2020
· source
· release history
Adds visibility into launch failures for global init scripts via new logging mechanisms.
New, more secure global init script framework (Public Preview) · Aug 2020
· source
· release history
＋Genie page citationsshippedProvides Beta page-level citations when Genie Agents reference content from attached volume files.2 releases · first seen Sep 2026▸
release
Databricks Genie Agent now analyzes unstructured files stored in Unity Catalog volumes — including PDFs, slide decks, and images — and answers queries with citations pointing to the source page; workspace admins can control access from the Previews page.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Genie Agents enhancements (2026-11-02) · Nov 2026
· source
· release history
Adds page-level citations (Beta) so that when a Genie Agent answers using content from an attached volume file, citations point to the specific page of the source file.
Genie Agents enhancements (2026-09-24) · Sep 2026
· source
· release history
＋Model retirement and migrationshippedRetires end-of-life hosted models — including Thinking Machine Labs Inkling and Moonshot AI Kimi K2.7 — and directs workloads to migrate to supported replacements.2 releases · first seen Oct 2026▸
release
Thinking Machine Labs Inkling is retired as of October 30, 2026; workloads using it must migrate to GLM 5.3 or Kimi K3.
Thinking Machine Labs Inkling is retired (2026-10-30) · Oct 2026
· source
· release history
Moonshot AI Kimi K2.7 is retired as of October 30, 2026; workloads using it must migrate to Kimi K3 or another supported model.
Moonshot AI Kimi K2.7 is retired (2026-10-30) · Oct 2026
· source
· release history
＋Concurrent real-time pipeline flowsshippedAllows multiple real-time mode flows to run in a single serverless pipeline without competing for task slots.2 releases · first seen Oct 2026▸
release
Lakeflow pipelines now support real-time mode on both classic compute and serverless compute, enabling operational workloads such as fraud detection with end-to-end latency as low as five milliseconds.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Real-time mode in Lakeflow pipelines is now generally available (2026-10-29) · Oct 2026
· source
· release history
Run multiple real-time mode flows in one serverless pipeline without flows competing for task slots, available on the preview channel in Beta.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Multiple real-time flows per serverless pipeline and source stage adaptive repartitioning are in Beta (2026-10-28) · Oct 2026
· source
· release history
＋COPY INTO commandshippedLoads data into Delta Lake using a SQL command with idempotent retries, eliminating the need for Apache Spark DataFrame APIs for ingestion.2 releases · first seen Feb 2020▸
release
Ingest, query, and parse XML files in batch or streaming workloads using Auto Loader, read_files, and COPY INTO.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Native XML file format support is now generally available (2026-10-29) · Oct 2026
· source
· release history
Adds COPY INTO SQL command (Public Preview) to load data into Delta Lake with idempotent retries without requiring Apache Spark DataFrame APIs.
Databricks Runtime 6.4 GA · Feb 2020
· source
· release history
＋XML parsing in SQLshippedProvides SQL functions — `from_xml` and `schema_of_xml` — to parse XML data and extract structured fields from XML columns stored in Delta tables.1 release · 1 other source · first seen Oct 2026▸
release
Parse XML data in SQL using the from_xml and schema_of_xml functions.
Native XML file format support is now generally available (2026-10-29) · Oct 2026
· source
· release history
example
Extract structured fields from an XML column already stored in a Delta table using SQL.$ SELECT from_xml(xml_col, schema_of_xml('<record><id>1</id><name>foo</name></record>')) AS parsed FROM my_table;
Native XML file format support is now generally available (2026-10-29) · Oct 2026
· source
＋Genie MCP Service GAshippedPromotes the `system.ai.genie_one_mcp` MCP Service to general availability, exposing Genie as a conversational tool over the Model Context Protocol.2 releases · first seen Sep 2026▸
Also counts toward: MCP server, Natural-language query
release
Enables ChatGPT, Codex, Claude, Claude Code, and Cursor to connect to Databricks MCP servers (including the Genie One MCP server) using default OAuth client IDs, with no OAuth app creation required from an account admin.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Default OAuth apps for external AI agents are now generally available (2026-10-27) · Oct 2026
· source
· release history
Promotes system.ai.genie_one_mcp MCP Service in Unity Gateway to general availability, exposing Genie as a conversational tool over the Model Context Protocol so any MCP client or agent (Claude, ChatGPT, Cursor) can query Databricks data with Unity Catalog permissions enforced on every…
The Genie One MCP server is now generally available (2026-09-25) · Sep 2026
· source
· release history
＋DataFrame caching on serverless computeshippedSupports df.cache() and df.persist() on serverless compute (environment version 5+) to reuse expensive DataFrame results within a session, with compatibility via Databricks Connect for Python and Scala.1 release · 1 other source · first seen Oct 2026▸
Also counts toward: Python scripting support, Scripting language support
release
Enables df.cache() and df.persist() on serverless compute (environment version 5+) to reuse expensive DataFrame results within a session, supported by Databricks Connect for Python 18.1.8+ or Scala 18.1.5+.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
DataFrame caching on serverless compute is now in Public Preview (2026-10-23) · Oct 2026
· source
· release history
example
Cache a costly aggregation result on serverless compute to reuse it multiple times in the same session without recomputing.$ df_summary = spark.table('events').groupBy('region').agg({'revenue': 'sum'}) df_summary.cache() df_summary.show() # subsequent actions on df_summary reuse the cached result
DataFrame caching on serverless compute is now in Public Preview (2026-10-23) · Oct 2026
· source
＋Lakeflow pipeline monitoringshippedProvides a system table to track all pipelines created in the account as a slowly changing dimension table for operational visibility.2 releases · first seen May 2025▸
release
Promotes the lakeflow system tables pipelines and pipeline_update_timeline to generally available, recording pipeline definitions and update history across your account.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Lakeflow pipelines system tables are now generally available (GA) (2026-10-21) · Oct 2026
· source
· release history
Adds the system.lakeflow.pipelines system table, available in Public Preview, to track all pipelines created in your Databricks account as a slowly changing dimension table (SCD2).
Pipelines system table is now available (Public Preview) · May 2025
· source
· release history
＋External client table managementshippedAllows external clients and systems, such as Apache Spark, to create Unity Catalog external tables backed by Delta Lake.2 releases · first seen Aug 2025▸
release
Enables external Apache Spark clients to create and write to Unity Catalog managed Delta tables (GA), requiring catalog commits to be enabled on the target tables.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
External writes to managed Delta tables are now generally available (2026-10-13) · Oct 2026
· source
· release history
Adds the ability to create Unity Catalog external tables backed by Delta Lake from external clients and systems, such as Apache Spark
Create external Delta tables from third-party clients (Public Preview) · Aug 2025
· source
· release history
＋Ray on Spark APIshippedEnables the creation of Ray clusters and execution of Ray applications using the Databricks Runtime.2 releases · first seen Feb 2023▸
release
Introduces the databricks-sdk-air package with @distributed and ray_init APIs and databricks.air.data utilities under the databricks.air namespace, replacing the deprecated serverless_gpu package starting in GPU environment version 6.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Databricks AI Runtime SDK replaces serverless_gpu (2026-10-13) · Oct 2026
· source
· release history
Adds Ray on Spark API to create Ray clusters and run Ray applications starting with Databricks Runtime 12.0
Ray on Databricks (Public Preview) · Feb 2023
· source
· release history
＋LTAP Direct Writes for Lakebase synced tablesshippedEnables direct writes to the storage layer for initial loads and full refreshes on Lakebase synced tables, configurable via UI settings.1 release · 1 other source · first seen Oct 2026▸
release
LTAP Direct Writes is now generally available, enabling direct writes to the storage layer for initial loads and full refreshes on Lakebase synced tables
LTAP Direct Writes is generally available (2026-10-01) · Oct 2026
· source
· release history
example
Enable LTAP Direct Writes for a new Lakebase synced table via UI settings.$ In the Synced tables settings for your table, select 'LTAP Direct Writes' under Synchronization options.
LTAP Direct Writes is generally available (2026-10-01) · Oct 2026
· source
＋Agent Bricks CLIshippedProvides a command-line interface for building and deploying custom code agents from the terminal.1 release · 1 other source · first seen Sep 2026▸
Also counts toward: Command-line interface
release
Introduces the databricks-agentbricks CLI tool as a new command-line interface for building and deploying custom code agents.
Agent Bricks CLI is in Beta (2026-09-29) · Sep 2026
· source
· release history
example
Access the new Agent Bricks CLI capabilities by invoking the tool from the terminal.$ databricks-agentbricks --help
Agent Bricks CLI is in Beta (2026-09-29) · Sep 2026
· source
＋Document processing pipelinesshippedEnables Genie Code to orchestrate end-to-end document processing pipelines for unstructured files with iterative quality improvement.2 releases · first seen Sep 2026▸
release
Genie Code now builds end-to-end document processing pipelines that orchestrate parsing, classification, extraction, and validation against unstructured PDFs, contracts, or invoices, with iterative quality improvement evaluated against labeled data.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Genie Code can now build intelligent document processing pipelines (2026-09-25) · Sep 2026
· source
· release history
Genie Code can now build end-to-end document processing pipelines by orchestrating parsing, classification, extraction, and validation.
Genie Code can now build intelligent document processing pipelines â · Sep 2026
· source
· release history
＋Genie app authoringshippedEnables the creation of governed data and AI applications using natural language through Genie App Builder.2 releases · first seen Sep 2026▸
release
Adds Genie App Builder to author governed data and AI apps in natural language without writing code (Beta).︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Build governed data and AI apps without code (Beta) (2026-09-23) · Sep 2026
· source
· release history
Introduces Genie App Builder in Beta, allowing users to build apps from natural-language prompts within a governance-enforced App Space.
Build governed data and AI apps without code (Beta) â · Sep 2026
· source
· release history
＋Dashboard themingshippedAllows customisation of dashboard appearance, including assigning specific colors to named values used consistently across all visualizations.2 releases · first seen Sep 2026▸
release
Adds coding-agent activity (tools and skills used) to Unity Gateway unified tracing, viewable in Govern > Traces or via Genie.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Unified tracing now includes coding agent activity (2026-09-22) · Sep 2026
· source
· release history
Adds color mappings in a dashboard's theme settings, letting you assign a specific color to a named value used consistently across all visualizations (color by field and color by series).
Dashboard enhancements and bug fixes (2026-09-03) · Sep 2026
· source
· release history
＋OpenSharing email invitationsshippedEnables sending secure activation links via email to OpenSharing recipients in Beta.2 releases · first seen Sep 2026▸
release
Adds email-based invitation for OpenSharing recipients, sending a secure activation link instead of requiring manual exchange of a sharing identifier or credential file (Beta).︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Invite OpenSharing recipients by email (Beta) (2026-09-22) · Sep 2026
· source
· release history
Adds OpenSharing by email to invite recipients via a secure activation link instead of exchanging identifiers or credential files.
Invite OpenSharing recipients by email (Beta) â · Sep 2026
· source
· release history
＋Genie file input scalingshippedIncreases the maximum number of files and folder depth Genie One skills can ingest, and raises PDF page limits for uploaded documents.2 releases · first seen Sep 2026▸
release
Genie One skills now support multiple files and sub-folders, up to three folders deep and 50 files or folders per skill (text files only).︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Skills in Genie One support multiple files and folders (2026-09-17) · Sep 2026
· source
· release history
Raises the PDF upload limit for Genie One and Genie Agents from 20 pages to 100 pages.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Genie Agents enhancements and bug fixes (2026-09-17) · Sep 2026
· source
· release history
＋Serverless job session restoreshippedAutomatically captures a snapshot of Python variables and Spark session state from eligible serverless compute job runs to restore in interactive notebooks.2 releases · first seen Aug 2026▸
release
Adds session restore for serverless jobs (Public Preview): automatically captures a snapshot of Python variables and Spark session state from eligible serverless compute job runs so you can restore them into a new interactive notebook to debug failures or explore results without rerunning the entire…
Session restore for serverless jobs is in Public Preview (2026-09-11) · Sep 2026
· source
· release history
Adds automatic state snapshot capture for serverless jobs on failure, runs >= 30 minutes, or cancellation, enabling session restoration to interactive notebooks.
Session restore for serverless jobs is now in Beta тАЛ · Aug 2026
· source
· release history
＋Unified External LineageshippedAllows registration of non-Databricks assets like Salesforce, MySQL, Tableau, or Power BI into a single lineage graph within Unity Catalog.2 releases · first seen Jun 2026▸
release
Adds External Lineage capability to Unity Catalog, allowing registration of non-Databricks assets like Salesforce, MySQL, Tableau, or Power BI into a single graph
External lineage is now generally available · Jun 2026
· source
· release history
Enables automatic source lineage recording from source tables to destination tables in Unity Catalog for Lakeflow Connect managed ingestion pipelines
External lineage is now generally available · Jun 2026
· source
· release history
＋Managed location for tablesshippedAllows specifying cloud storage paths for managed tables and schemas via SQL commands.2 releases · first seen Dec 2022▸
release
ALTER CATALOG ... SET MANAGED_STORAGE_LOCATION and ALTER SCHEMA ... SET MANAGED_STORAGE_LOCATION are now GA to modify the default cloud storage path for new Unity Catalog objects.
Altering a catalog or schema's managed storage location is now GA · Apr 2026
· source
· release history
MANAGED LOCATION can now be specified in CREATE CATALOG and CREATE SCHEMA SQL commands to define cloud storage paths for managed tables.
Use SQL to specify schema- and catalog-level storage locations for Unity Catalog managed tables · Dec 2022
· source
· release history
＋Consolidated SQL alert managementshippedUnifies query setup, condition definition, scheduling, and notification destinations for Databricks SQL alerts into a single interface.2 releases · first seen May 2025▸
Also counts toward: Web management console
release
Databricks SQL now supports failure notifications for materialized views and streaming tables defined and scheduled within the service.
Databricks SQL pipelines support notifications and performance mode (Beta) · Mar 2026
· source
· release history
Adds a new consolidated UI for Databricks SQL alerts in Beta, unifying query setup, condition definition, scheduling, and notification destinations into a single interface.
New alerts in Beta · May 2025
· source
· release history
＋Lakeflow connector automation and schedulingshippedEnables managed database connectors to schedule full refresh snapshots, recover from schema changes, and maintain change history.2 releases · first seen Oct 2025▸
Also counts toward: Scheduled jobs
release
Adds the ability to schedule full refresh snapshots and enable automatic recovery from unsupported schema changes for managed database connectors.
Configure full refresh behavior for managed database connectors · Nov 2025
· source
· release history
Enables history_tracking in Lakeflow Connect managed connector configuration to maintain change history (SCD Type 2) instead of overwriting records (SCD Type 1)
Salesforce ingestion connector supports history tracking (SCD type 2) · Oct 2025
· source
· release history
＋Lakeflow connector identity and migrationshippedAllows setting a specific user or service principal as the identity for Lakeflow pipelines and enables migration from legacy publishing mode to support multiple catalogs.2 releases · first seen Aug 2025▸
release
Enables migration of Spark Declarative Pipelines on Lakeflow from legacy publishing mode (single catalog/schema) to the default mode supporting multiple catalogs and schemas
Migrate Spark Declarative Pipelines on Lakeflow from legacy publishing mode is now GA · Aug 2025
· source
· release history
Allows setting a specific user or service principal as the identity used by Spark Declarative Pipelines on Lakeflow to run updates and own published tables.
Set the run-as user for Spark Declarative Pipelines on Lakeflow · Aug 2025
· source
· release history
＋Lakebase database instance managementshippedEnables users to create and manage Lakebase database instances, including configuring automated snapshot cadences and retention periods.2 releases · first seen Jun 2025▸
release
Lakebase public preview is now enabled by default, allowing users to start creating Lakebase database instances without requiring workspace admins to enable the preview first.
Lakebase Public Preview enabled by default · Aug 2025
· source
· release history
Adds Lakebase, a managed PostgreSQL-compatible OLTP engine integrated with the Databricks Data + AI Platform
Lakebase, a managed PostgreSQL OLTP database, is in Public Preview · Jun 2025
· source
· release history
＋SQL warehouse view-only access controlshippedEnables granting users the ability to view SQL warehouses, query history, and profiles for monitoring purposes without allowing them to execute queries.2 releases · first seen Mar 2025▸
release
The CAN VIEW permission on SQL warehouses is now generally available, allowing users to view warehouses including query history and profiles without running queries
The CAN VIEW permission on SQL warehouses is now generally available · Jul 2025
· source
· release history
Adds the CAN VIEW permission type for SQL warehouse access control lists, enabling users to monitor query history and profiles without executing queries.
New CAN VIEW permission available for SQL warehouses (Public Preview) · Mar 2025
· source
· release history
＋Workspace browser multi-object managementshippedAdds multi-select and drag-and-drop support for moving or deleting multiple workspace objects.2 releases · first seen May 2024▸
release
Adds drag-and-drop import support in the workspace file browser side panel available in notebook, query, and file editors
Import workspace files with drag-and-drop · Jan 2025
· source
· release history
Adds multi-select and drag-and-drop support for moving or deleting multiple workspace objects in the workspace browser.
Bulk move and delete workspace objects from the workspace browser · May 2024
· source
· release history
＋Cost management dashboard importshippedAllows the import of account-wide or single-workspace cost management dashboards into any Unity Catalog workspace.2 releases · first seen Jun 2024▸
release
Budgets support customized filters to track spending based on workspace and custom tags
Create budgets to monitor account spending (Public Preview) · Jun 2024
· source
· release history
Adds the ability to import account-wide or single-workspace cost management dashboards from the account console into any Unity Catalog workspace
Importable cost management dashboard added to account console (Public Preview) · Jun 2024
· source
· release history
＋Marketplace uninstallationshippedAllows consumers to uninstall installed data products directly from the Marketplace interface.2 releases · first seen Jun 2023▸
release
Enables private exchange providers to sign up for Databricks Marketplace via a self-service workflow rather than the partner portal.
Self-service sign-up for private exchange providers in Marketplace · Mar 2024
· source
· release history
Consumers can now uninstall any installed data product directly from the Databricks Marketplace My requests interface.
Databricks Marketplace: Consumers can uninstall data products using the UI · Jun 2023
· source
· release history
＋CONVERT TO DELTAshippedConverts Hive metastore Parquet tables to Delta Lake using SQL syntax.2 releases · first seen May 2020▸
release
Adds Cloud Fetch mechanism to fetch data in parallel through cloud storage, improving performance for BI tools by reducing unnecessary client-to-Databricks Runtime roundtrips.
Databricks ODBC driver 2.6.17 · Jun 2021
· source
· release history
Added CONVERT TO DELTA SQL syntax to convert Hive metastore Parquet tables to Delta Lake
Databricks Runtime 6.6 (Beta) · May 2020
· source
· release history
＋Notebook matplotlib plottingshippedSupports creating multiple matplotlib plots within a single notebook cell for data visualization.2 releases · first seen Oct 2019▸
release
Enables inline Matplotlib figures by default in Databricks notebooks (Public Preview).
Databricks Runtime 6.4 GA · Feb 2020
· source
· release history
Supports multiple matplotlib plots per notebook cell
Databricks Runtime 6.0 GA · Oct 2019
· source
· release history
＋Okta connector ingestionshippedsuggestedIngests identity and access data — including users, groups, group memberships, app integrations, devices, policies, and administrator roles — from Okta into Databricks via Lakeflow Connect using SSWS API token authentication with incremental ingestion.1 release · first seen Nov 2026▸
Suggested capability: Log collection. This is our guess, not confirmed.
release
Enable the Okta connector in Lakeflow Connect (Beta) through the Previews page to ingest identity and access data — users, groups, group memberships, app integrations, devices, policies, and administrator roles — from Okta into Databricks using SSWS API token authentication with incremental ingestion…
Okta connector is available in Beta (2026-11-03) · Nov 2026
· source
· release history
＋Xero connector ingestionshippedIngests accounting data — including invoices, payments, and contacts — from Xero into Databricks via Lakeflow Connect, using OAuth authorization, incremental ingestion, and automatic removal of deleted records for supported tables.1 release · first seen Oct 2026▸
release
Enable the managed Xero connector in Databricks Lakeflow Connect (Beta) to ingest accounting data — invoices, payments, and contacts — from Xero, with OAuth user authorization, incremental ingestion of transaction tables, and automatic removal of deleted records for supported tables.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Xero connector is available in Beta (2026-10-29) · Oct 2026
· source
· release history
＋QuickBooks connector ingestionshippedIngests accounting data from QuickBooks Online — including accounts, customers, vendors, invoices, bills, payments, and journal entries — into Databricks via Lakeflow Connect, using OAuth authorization and incremental ingestion with delete support.1 release · first seen Oct 2026▸
release
Adds a managed QuickBooks connector in Databricks Lakeflow Connect (Beta) to ingest accounting data — accounts, customers, vendors, items, invoices, bills, payments, and journal entries — from QuickBooks Online into Databricks, with OAuth user authorization and incremental ingestion with delete…
QuickBooks connector is available in Beta (2026-10-26) · Oct 2026
· source
· release history
＋Bulk dashboard migration from BI toolsshippedEnables migrating an entire Power BI or Tableau workspace to Databricks AI/BI dashboards in a single batch operation rather than one file at a time.1 other source · first seen Oct 2026▸
Also counts toward: Import from a competing product
example
Migrate a large Power BI or Tableau workspace to Databricks AI/BI dashboards all at once rather than one file at a time.$ In the Databricks UI, open Genie Code, select 'Import multiple files in bulk', and upload up to 100 Power BI (.pbix) or Tableau (.twbx/.twb) files to convert them to AI/BI dashboards and metric views.
Dashboard enhancements (2026-10-22) · Oct 2026
· source
＋SurveyMonkey connector ingestionshippedIngests SurveyMonkey survey data into Databricks via Lakeflow Connect, with workspace admins able to enable or disable the connector from the Previews page.1 other source · first seen Oct 2026▸
example
Enable the SurveyMonkey connector Beta so your workspace can start ingesting survey data into Databricks.$ In the Databricks workspace, go to Settings > Previews, find 'SurveyMonkey connector', and enable it.
SurveyMonkey connector is available in Beta (2026-10-20) · Oct 2026
· source
＋Customer-managed key decryption for system tablesshippedSupports customer-managed keys on the system catalog to decrypt sensitive fields such as statement text and error messages in the query history system table.1 release · first seen Oct 2026▸
release
Supports customer-managed keys on the system catalog to decrypt statement_text and error_message fields in the query history system table.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Customer-managed keys for query history are now generally available (2026-10-02) · Oct 2026
· source
· release history
＋Genie streaming responsesshippedDelivers real-time streaming of Genie responses so answers appear progressively as they are generated.1 release · first seen Oct 2026▸
release
Enables real-time streaming responses for progressive answer display
Genie One enhancements (2026-10-01) · Oct 2026
· source
· release history
＋Genie persistent style memoryshippedAllows users to save a preferred reporting style so Genie applies it automatically without requiring it to be repeated in each prompt.1 other source · first seen Sep 2026▸
example
Use when you want the AI to apply your specific reporting style without repeating it every time.$ In the chat, ask: 'Remember that I prefer tables with bold headers and no trailing zeros', then confirm by accepting the suggestion.
Genie One memory is now generally available (2026-09-29) · Sep 2026
· source
＋KPI widget filter isolationshippedPrevents specific KPI widgets from being affected by page-level filters to maintain baseline metric visibility.1 other source · first seen Sep 2026▸
example
Prevent a KPI widget from being affected by page-level date or region filters so it always shows the full baseline metric.$ In the dashboard editor, select the widget you want to isolate, open its settings panel, and enable 'Ignore filters' so the widget displays unfiltered data while all other widgets on the page…
Dashboard enhancements and bug fixes (2026-09-24) · Sep 2026
· source
＋App Spaces governanceshippedEnforces governance policies across applications built with Genie App Builder.1 release · first seen Sep 2026▸
release
Adds App Spaces to enforce governance policies across apps built with Genie App Builder (Beta).
Build governed data and AI apps without code (Beta) (2026-09-23) · Sep 2026
· source
· release history
＋Genie chat pinningshippedAllows users to pin conversations to keep them at the top of the Genie One sidebar.1 release · first seen Sep 2026▸
release
Aligns scalar TIMESTAMP inputs with PySpark behavior for Unity Catalog Python UDFs.
Scalar and Batch Unity Catalog Python UDFs are now generally available (2026-09-23) · Sep 2026
· source
· release history
＋Serverless micro apps scalingshippedProvides Beta support for serverless micro applications that scale to zero when idle.1 release · first seen Sep 2026▸
release
Adds Serverless Micro Apps that scale to zero when idle (Beta).
Build governed data and AI apps without code (Beta) (2026-09-23) · Sep 2026
· source
· release history
＋Auto-optimized shuffle v2shippedAutomatically enables optimized shuffle v2 for workloads that do not set a fixed partition count.1 release · first seen Sep 2026▸
release
Enables auto-optimized shuffle v2 by default for workloads that do not set a fixed shuffle partition count.
Databricks Runtime 19: September 21, 2026 (2026-09-21) · Sep 2026
· source
· release history
＋Continuous pipeline maintenance windowsshippedAllows setting a daily maintenance window to control restart timing for continuous pipelines during platform updates.1 release · first seen Sep 2026▸
release
Allows setting a one-hour maintenance window (day, hour, time zone) for continuous pipelines to control restart timing for platform updates like runtime versions.
Maintenance windows for continuous pipelines â · Sep 2026
· source
· release history
＋Dashboard theming portabilityshippedSupports exporting a dashboard theme to a JSON file and importing it into another dashboard for reuse.1 release · first seen Sep 2026▸
Also counts toward: JSON data export
release
Supports exporting a dashboard theme to a JSON file and importing a theme JSON file into another dashboard for reuse and sharing.
Dashboard enhancements (2026-09-10) · Sep 2026
· source
· release history
＋Anaplan connector managementshippedAllows workspace admins to enable or disable the Anaplan connector through the Previews page.1 release · first seen Sep 2026▸
release
Workspace admins can enable or disable the Anaplan connector through the Previews page.︀︄︇︀︅︉︀︅︀︀︃︀︀︅︅︀︅︊︀︄︆︀︃︄
Anaplan connector (Beta) (2026-09-09) · Sep 2026
· source
· release history
＋Serverless GPU coding agentshippedEnables Genie Code to generate distributed training code, resolve environment issues, and debug GPU/distributed workload failures with AI Runtime.1 release · first seen Aug 2026▸
release
Adds Genie Code in Public Preview to generate distributed training code, resolve environment issues, and debug GPU/distributed workload failures when used with AI Runtime.
Genie Code for AI Runtime (Public Preview) тАЛ · Aug 2026
· source
· release history
＋Granular write privilegesshippedEnables INSERT, UPDATE, and DELETE as least-privilege alternatives to MODIFY for controlled write access without schema changes.1 release · first seen Aug 2026▸
release
Adds INSERT, UPDATE, and DELETE privileges as least-privilege alternatives to MODIFY in Unity Catalog for controlled write access without schema changes.
The INSERT , UPDATE , and DELETE privileges are in Beta тАЛ · Aug 2026
· source
· release history
＋Sample dataset catalogshippedProvides pre-curated sample datasets that are exposed via OpenSharing for immediate exploration in Unity Catalog workspaces.1 release · first seen Jul 2026▸
release
Samples catalog samples.databricks.datasets exposes Databricks-provided sample datasets via OpenSharing in Unity Catalog workspaces.
Databricks-hosted sample datasets available in the samples catalog · Jul 2026
· source
· release history
＋Branded workspace entry pointshippedAllows claiming a custom URL as the single branded entry point for all users and workspaces.1 release · first seen Jul 2026▸
release
Adds public preview support for claiming and enabling a custom URL (e.g., acme.databricks.com) as the single branded entry point for all users and workspaces.
Custom URLs for your Databricks account (Public Preview) · Jul 2026
· source
· release history
＋Omnigent coding agent managementshippedOffers a web UI for managing coding agents with persistent sessions, team collaboration, mobile access, and unified deployment.1 release · first seen Jun 2026▸
Also counts toward: Web management console
release
Adds Omnigent beta: a web UI for managing coding agents (e.g. Claude Code, Codex) with persistent shareable sessions, team collaboration, mobile access, contextual policies, and unified deployment infrastructure.
Omnigent coding agent meta-harness is now in Beta · Jun 2026
· source
· release history
＋Open Sharing SecureConnectshippedEnables data sharing from cloud storage behind a firewall or private endpoint without requiring recipients to add network allowlists.1 release · first seen Jun 2026▸
release
Adds SecureConnect capability to OpenSharing, enabling data sharing from cloud storage behind a firewall or private endpoint without adding recipient networks to an allowlist.
Share data behind a firewall with SecureConnect (Public Preview) · Jun 2026
· source
· release history
＋Managed disaster recoveryshippedReplicates Unity Catalog metadata, managed table data, and workspace assets to a secondary region for failover with stable URLs.1 release · first seen Jun 2026▸
Also counts toward: Disaster recovery
release
Adds Managed disaster recovery capability replicating Unity Catalog metadata, managed table data, and workspace assets to a secondary region with stable URLs after failover.
Managed disaster recovery is now in Public Preview · Jun 2026
· source
· release history
＋Catalog Explorer column popularity metricsshippedsuggestedIdentifies which columns are read most frequently by queries by displaying a popularity metric on the table overview tab.1 release · first seen Jun 2026▸
Suggested capability: Metrics collection. This is our guess, not confirmed.
release
Adds a Popularity metric to the Catalog Explorer UI, visible on the table's Overview tab to identify which columns are read most frequently by queries.
Column popularity is now available in the Catalog Explorer · Jun 2026
· source
· release history
＋Data Quality Monitoring incident historyshippedsuggestedDisplays a section of previously unhealthy tables that have recovered, including their resolution time, within the Data Quality Monitoring dashboard.1 release · first seen Apr 2026▸
Suggested capability: Incident case management. This is our guess, not confirmed.
release
Adds a Recently Resolved Incidents section to the Data Quality Monitoring dashboard (Beta) that displays tables which were previously unhealthy but have recovered, including their resolution time.
Recently Resolved Incidents section in Data Quality Monitoring (Beta) · Apr 2026
· source
· release history
＋Catalog Explorer table health monitoringshippedDisplays anomaly detection-based summaries of table freshness and completeness status on schema and table overview pages.1 release · first seen Mar 2026▸
Also counts toward: ML-based detection
release
Adds health indicators to schema and table overview pages in Catalog Explorer (Public Preview) to summarize a table's freshness and completeness status based on anomaly detection.
Health indicators for tables in Catalog Explorer (Public Preview) · Mar 2026
· source
· release history
＋Asset curation and discoveryshippedEnables curators to customize and highlight specific assets within their organization or domain to improve data discoverability.1 release · first seen Feb 2026▸
release
Adds Custom curation capabilities allowing curators to customize and highlight specific assets within their organization or domain.
Discover page and domains (Beta) · Feb 2026
· source
· release history
＋Databricks Assistant documentation availabilityshippedMakes Databricks Assistant available on the Databricks documentation site to help users get answers and discover information.1 release · first seen Dec 2025▸
Also counts toward: Built-in AI assistant
release
Databricks Assistant (Genie) is now available on the Databricks documentation site to help you get answers and discover information about Databricks
Databricks Assistant on the documentation site · Dec 2025
· source
· release history
＋Lakeflow connector source platform supportshippedsuggestedAdds support for ingesting data from Amazon RDS for MySQL, Amazon Aurora MySQL, Azure Database for MySQL, Google Cloud SQL for MySQL, and MySQL on EC2.1 release · first seen Dec 2025▸
Suggested capability: Log collection. This is our guess, not confirmed.
release
Adds support for five source platforms: Amazon RDS for MySQL, Amazon Aurora MySQL, Azure Database for MySQL, Google Cloud SQL for MySQL, and MySQL on EC2
MySQL connector in Lakeflow Connect (Public Preview) · Dec 2025
· source
· release history
＋Open Sharing token managementshippedAutomates the expiration of existing Open Sharing recipient tokens issued before December 8, 2025.1 release · first seen Dec 2025▸
release
Existing open sharing recipient tokens issued before December 8, 2025, with expiration dates after December 8, 2026, or with no expiration date, automatically expire on December 8, 2026.
New token expiration policy for open Delta Sharing · Dec 2025
· source
· release history
＋Workspace automationshippedAdds the ability to automate classic workspace creation using AWS IAM temporary delegation.1 release · first seen Nov 2025▸
release
Adds the ability to automate classic workspace creation using AWS IAM temporary delegation instead of the previous AWS Quickstart template
Automate classic workspace creation with AWS IAM temporary delegation · Nov 2025
· source
· release history
＋Lakebase network policy supportshippedAllows Delta Sharing views to operate under serverless network policies without requiring manual alignment of storage locations.1 release · first seen Nov 2025▸
release
Allows Delta Sharing views to operate under serverless network policies without requiring manual alignment of storage locations for shared tables and view dependencies.
Delta Sharing views automatically permitted in serverless network policies · Nov 2025
· source
· release history
＋Lakebase full refresh optimizationshippedReduces downtime for managed database connector full refresh operations by delaying the table refresh until after the snapshot is completed.1 release · first seen Nov 2025▸
release
Full refresh operations for managed database connectors (like SQL Server) now reduce downtime by delaying the table refresh until after the snapshot is completed
Improved full refresh flow for managed database connectors · Nov 2025
· source
· release history
＋Auto Loader listing configurationshippedChanges the default source for Auto Loader incremental listing from auto to false, requiring explicit configuration to preserve previous behavior.1 release · first seen Oct 2025▸
release
Auto Loader's cloudFiles.useIncrementalListing default changed from auto to false; set explicitly to auto to preserve previous behavior
Databricks Runtime 17.3 LTS · Oct 2025
· source
· release history
＋Lakebase default source formatshippedChanges the default source code format for Lakeflow pipelines from notebooks to Python and SQL code files.1 release · first seen Sep 2025▸
Also counts toward: Python scripting support, Scripting language support
release
The default source code format for pipelines is changed from notebooks to Python and SQL code files.
Lakeflow Pipelines Editor is now in public preview · Sep 2025
· source
· release history
＋Unified Lakehouse platform availabilityshippedExpands serverless compute support for notebooks, workflows, and Spark Declarative Pipelines to the Asia Pacific (Jakarta) region.1 release · first seen Aug 2025▸
release
Enables serverless compute support for notebooks, workflows, and Spark Declarative Pipelines on Lakeflow in the Asia Pacific (Jakarta) region (ap-southeast-3)
Serverless compute is now available in ap-southeast-3 · Aug 2025
· source
· release history
＋Custom rate limiting for model servingshippedEnables specifying custom rate limits for AI Gateway endpoints at the endpoint, user, service principal, or user group scopes.1 release · first seen Jun 2025▸
release
Adds ability to specify custom rate limits for model serving endpoints through AI Gateway, supporting Endpoint-level, User (Default), Specific user, Service principal, and User group scopes.
Custom rate limits for model serving endpoints · Jun 2025
· source
· release history
＋Salesforce Data Cloud file federationshippedAllows Databricks to call Salesforce Data-as-a-Service APIs to read data in cloud object storage directly via file federation.1 release · first seen Jun 2025▸
release
Adds Salesforce Data Cloud File Sharing connector (Public Preview) allowing Databricks to call Salesforce Data-as-a-Service (DaaS) APIs to read data in cloud object storage directly via file federation.
Salesforce Data Cloud File Sharing connector (Public Preview) · Jun 2025
· source
· release history
＋Liquid clustering sharing for batch queriesshippedEnables sharing of tables enabled for liquid clustering via Delta Sharing and allows recipients to run batch queries against them.1 release · first seen Jul 2024▸
release
Delta Sharing now lets you share tables that are enabled for liquid clustering, and recipients can run batch queries against them.
Delta Sharing lets you share tables that use liquid clustering · Jul 2024
· source
· release history
＋Natural language filteringshippedAllows users to filter table data using natural language prompts via Databricks Assistant.1 release · first seen Jul 2024▸
Also counts toward: Built-in AI assistant, Natural-language query
release
Adds Filter data with natural language prompts capability to Databricks Assistant, allowing users to type prompts like 'Show me only males over 70.' to filter table data.
Filter data outputs using natural language prompts · Jul 2024
· source
· release history
＋Catalog Explorer quick accessshippedAdds a Quick access section in Catalog Explorer to display recent and favorite objects for faster browsing.1 release · first seen Jun 2024▸
release
Adds a Quick access section in Catalog Explorer to display recent Unity Catalog objects, favorite Unity Catalog objects, and catalogs and schemas for browsing.
Catalog Explorer improvements · Jun 2024
· source
· release history
＋Lakehouse Monitoring previewshippedIntegrates data and model quality monitoring capabilities into the platform as a public preview feature.1 release · first seen Aug 2023▸
release
Adds Lakehouse Monitoring feature in public preview to integrate data and model quality monitoring into the Databricks platform
Lakehouse Monitoring is Public Preview · Aug 2023
· source
· release history
＋Databricks-to-Databricks notebook sharingshippedEnables cross-metastore and cross-account notebook sharing between Databricks workspaces via Delta Sharing.1 release · first seen May 2023▸
release
Adds Databricks-to-Databricks notebook sharing via Delta Sharing for cross-metastore and cross-account collaboration
Share notebooks using Delta Sharing · May 2023
· source
· release history
＋Distributed PyTorch trainingshippedEnables distributed training on PyTorch models using the TorchDistributor module in PySpark.1 release · first seen Mar 2023▸
release
Enables distributed training on PyTorch models using the TorchDistributor module in PySpark on Databricks Runtime 13.0 ML and above.
Distributed training with TorchDistributor · Mar 2023
· source
· release history
＋Notebook diff viewsshippedAdds code diff and raw diff views to inspect cell-level or JSON metadata changes in notebooks.1 release · first seen Mar 2023▸
release
Introduces Code diff and Raw diff views for inspecting cell-level or JSON metadata changes in .ipynb notebooks
.ipynb (Jupyter) notebook support in Repos (preview) · Mar 2023
· source
· release history
＋Catalog Explorer Insights tabshippedDisplays frequent queries and users for registered tables within the Catalog Explorer interface.1 release · first seen Mar 2023▸
release
Adds the Insights tab in Catalog Explorer (Unity Catalog) to display the most frequent queries and users for any registered table.
View frequent queries and users of a table using the Insights tab · Mar 2023
· source
· release history
＋Serverless GPU inference supportshippedEnables automatic generation of streaming inference notebooks and serverless deployment configurations for ML models.1 release · first seen Oct 2022▸
release
Adds capability to automatically generate a Databricks notebook configured for streaming inference via DLT when deploying a model.
Deploy models for streaming inference with DLT notebooks · Oct 2022
· source
· release history
＋Secret reference in configurationshippedAllows referencing secrets directly within Spark configuration properties or environment variables for secure credential management.1 release · first seen Nov 2019▸
release
Adds the ability to reference a secret in a Spark configuration property or environment variable
Secrets referenced by Spark configuration properties and environment variables (Public Preview) · Nov 2019
· source
· release history
＋DBFS FUSE client performanceshippedImproves the DBFS FUSE client with faster and more reliable reads and writes, particularly during model training workloads.1 release · first seen Oct 2019▸
release
Enhances the DBFS FUSE client with faster and more reliable reads/writes during model training
Databricks Runtime 6.0 GA · Oct 2019
· source
· release history
Lines in monospace are the tool's own words: help text
parsed from its source, or an endpoint from its API document. Under
release, a line is our summary of a dated release. Under
docs, it is quoted from the tool's own documentation or
website. Each links back to the source it came from.
Command line
8 commands for Databricks, each
with where it came from. This tool has no source analysis yet, so there
is no option reference and no captured run beside them.
View
Source
No command matches.
Screenshots
From the release notes, newest first. Click one to see it full size.
Breaking-change disciplinehow rarely a release breaks users, and notice given
Maintenance riskquiet time against its own cadence, maintainers
Innovation & surfacenew capabilities, API and MCP surface
Five scores for Databricks, each built from the releases, notes and API history this site tracks — and, on Researcher and Business, where it stands among every measured tool in its category and how that has moved.
Each score is 0–100 on a published rubric, derived from data this site already shows.
A dimension we cannot measure says so — it is never scored 0 and never enters a rank.
How this is scored
Shipping velocity — releases a month over the last 12 months, on a log scale where 16 a month scores 100. Needs 3 releases in the window.
Documentation quality — the release-notes rubric published on the analytics page, unchanged.
Breaking-change discipline — the share of releases carrying a breaking change (none scores 100, half or more scores 0). Only projects that label breaking changes are measured: a clean record cannot be told from an unlabelled one.
Maintenance risk — quiet time measured against the tool's own release cadence (quiet longer than 90 days and three typical gaps scores 0), plus the number of active maintainers and whether contributors are growing, where known. Higher is lower risk.
Innovation & surface — new capabilities in the feature ledger this year, API and MCP operations added, and the share of commits that are features: the mean of whichever we hold.
Community health (open-source tools only) — each is a direction, not a size: contributors this year against last, the bus factor now against a year ago, and issues closed per issue opened, where steady scores 50, doubled 100 and halved 0; plus the median time to a maintainer's first reply (an hour scores about 100, a month or more 0). A commercial card has no repository and carries none of the four.
Documented delivery (commercial tools) — when a vendor's documented new capabilities have slowed against its own baseline, that counts against the overall standing as heavily as two low dimensions. Steady delivery, or too little history to judge, leaves the standing alone; it is never a sixth score.
Open-source tools are scored on repository signals; commercial tools on their published changelog. Ranks compare tools within one category and one profile and need at least five measured peers; the overall standing needs three ranked dimensions. Best-in-breed or consolidator is a shape, not a quality, and is never scored.
Release-note detail over time
See how much detail Databricks puts in its release notes, quarter by quarter, and compare it with tracked tools in the same category. This history uses up to ten retained, reviewed notes per tool; sparse or blank older quarters may reflect that limit.
Databricks's 9 pages as they looked each month from October 2026 to October 2026: 9 renders, 0 changes of tagline or palette. Step through them, play them, or put any two months side by side.
Website history is included with Researcher and Business.
What Databricks connects to, runs on and detects, read from its release notes and docs. So far: 23 new integrations, 4 new supported platforms, 2 retired supported platforms, 2 updated integrations, 2 updated compliance frameworks, 2 updated supported platforms.
Show
When
35 changes, tracked since Sep 28, 2026.
Nov 32026
newOkta connector for Lakeflow Connect (Beta)
The managed Okta connector is now available in Beta in Databricks Lakeflow Connect. Workspace admins can enable Lakeflow Connect for Okta on the Previews page . Use the connector to ingest identity and access data from Okta into Databricks, including users, groups, group memberships, app integrations, devices, policies, and administrator roles. The connector uses SSWS API token authentication and supports incremental ingestion.
Okta connector is available in Beta (2026-11-03)Source ↗
Oct 302026
newData freshness monitoring for CDC tables in Lakeflow Connect
With SQL Server, PostgreSQL, MySQL, Oracle
Data freshness is available for SQL Server, PostgreSQL, MySQL, and Oracle sources.
Monitor data freshness in Lakeflow Connect database connector pipelines (Public Preview) (2026-10-30)Source ↗
Oct 302026
retiredMoonshot AI Kimi K2.7 retirement
Moonshot AI Kimi K2.7 was retired on October 30, 2026. Kimi K3 is the recommended replacement.
Moonshot AI Kimi K2.7 is retired (2026-10-30)Source ↗
Oct 302026
retiredThinking Machine Labs Inkling retired
Thinking Machine Labs Inkling was retired on October 30, 2026. GLM 5.3 or Kimi K3 is the recommended replacement.
Thinking Machine Labs Inkling is retired (2026-10-30)Source ↗
Oct 302026
newMicrosoft Graph Logs connector (Beta) in Lakeflow Connect
With Microsoft Defender XDR, Microsoft Sentinel
The managed Microsoft Graph Logs connector is now available in Beta in Databricks Lakeflow Connect. Use the connector to ingest security alerts from Microsoft Defender XDR, Microsoft Sentinel, and other Microsoft security products into Databricks. The connector uses OAuth machine-to-machine authentication with a Microsoft Entra ID application and supports incremental ingestion.
Microsoft Graph Logs connector is available in Beta (2026-10-30)Source ↗
Oct 292026
newXero connector (Beta) in Lakeflow Connect
The managed Xero connector is now available in Beta in Databricks Lakeflow Connect. Workspace admins can enable it from the Previews page. Use the connector to ingest accounting data such as invoices, payments, and contacts from Xero into Databricks.
Xero connector is available in Beta (2026-10-29)Source ↗
Oct 272026
newDefault OAuth client IDs for external AI agents connecting to Databricks MCP servers
With ChatGPT, Codex, Claude, Claude Code, Cursor, Genie One MCP server
ChatGPT, Codex, Claude, Claude Code, and Cursor can now connect to Databricks MCP servers, including the Genie One MCP server, using default OAuth client IDs. An account admin doesn't need to create an OAuth app.
Default OAuth apps for external AI agents are now generally available (2026-10-27)Source ↗
Oct 262026
newQuickBooks Online connector (Beta) in Databricks Lakeflow Connect
The managed QuickBooks connector is now available in Beta in Databricks Lakeflow Connect. Use the connector to ingest accounting data such as accounts, customers, vendors, items, invoices, bills, payments, and journal entries from QuickBooks Online into Databricks. The connector uses OAuth user authorization and supports incremental ingestion with delete capture.
QuickBooks connector is available in Beta (2026-10-26)Source ↗
Oct 242026
newPayPal connector (Beta) in Databricks Lakeflow Connect
The managed PayPal connector is now available in Beta in Databricks Lakeflow Connect. Use the connector to ingest payments data such as transactions, disputes, invoices, balances, catalog products, and billing plans from PayPal into Databricks. The connector uses OAuth client credentials and supports incremental ingestion.
PayPal connector is available in Beta (2026-10-24)Source ↗
The Box Audit Logs connector in Lakeflow Connect is now available in Beta. Use the connector to ingest enterprise audit events from Box into Databricks.
With serverless environment version 5, Databricks Connect for Python 18.1.8, Databricks Connect for Scala 18.1.5
Caching requires serverless environment version 5 or above, Databricks Connect for Python 18.1.8 or above, or Databricks Connect for Scala 18.1.5 or above.
DataFrame caching on serverless compute is now in Public Preview (2026-10-23)Source ↗
Genie Ontology now also extracts snippets from queries that external tools , such as dbt, run on Databricks. These runs appear in query history alongside queries that you run in Databricks.
newMicrosoft Entra ID connector for Databricks Lakeflow Connect
The managed Microsoft Entra ID connector is now available in Beta in Databricks Lakeflow Connect. Use the connector to ingest Microsoft Entra ID users, groups, applications, service principals, directory roles, identity configuration, and audit and sign-in logs into Databricks. The connector uses OAuth machine-to-machine authentication and supports incremental ingestion for audit and sign-in logs.
Microsoft Entra ID connector is available in Beta (2026-10-22)Source ↗
Oct 202026
newAsana connector in Lakeflow Connect (Beta)
The managed Asana connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. Use the connector to ingest work management data such as workspaces, teams, projects, tasks, portfolios, and goals from Asana into Databricks. The connector uses OAuth user-to-machine (U2M) authentication.
Asana connector is available in Beta (2026-10-20)Source ↗
Oct 202026
newSurveyMonkey connector (Beta) in Lakeflow Connect
The managed SurveyMonkey connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. Use the connector to ingest surveys, survey structure, collectors, survey responses, and contacts from SurveyMonkey into Databricks. The connector uses OAuth user-to-machine (U2M) authentication and supports incremental ingestion, UI-based pipeline authoring, Declarative Automation Bundles, and API-based pipeline authoring.
SurveyMonkey connector is available in Beta (2026-10-20)Source ↗
Oct 192026
newDeepSeek V4.1 Flash (1017) on Unity Gateway
DeepSeek V4.1 Flash (1017) is now available on Unity Gateway with text and image inputs.
DeepSeek V4.1 Flash (1017) is now available on Unity Gateway (2026-10-19)Source ↗
Oct 162026
updatedFile upload support for compliance security profile workspaces in Genie One and Genie Agents
Starting November 15, 2026, file upload in Genie One and Genie Agents will be available by default for workspaces that have the compliance security profile enabled, if the workspace's compliance standard supports file upload.
File upload in Genie One and Genie Agents will soon be available by default for compliance security profile workspaces with supported compliance standards (2026-10-16)Source ↗
Oct 162026
newTypeSafe AI Jev 1.14.0 on Unity Gateway
TypeSafe AI Jev 1.14.0 is now available on Unity Gateway. TypeSafe AI hosts it, and an account admin must enable the Externally-hosted TypeSafe AI Models preview.
TypeSafe AI Jev 1.14.0 is now available on Unity Gateway (2026-10-16)Source ↗
Oct 162026
updatedREAD METADATA privilege support for compliance security profile standards
The READ METADATA privilege now supports all compliance security profile standards supported by Databricks and is available by default for workspaces with the compliance security profile enabled.
READ METADATA privilege support for compliance security profile standards (2026-10-16)Source ↗
Oct 152026
newPower BI .tmdl file import via /importBI Genie Code skill
Import Power BI .tmdl files : Authors can now upload Power BI .tmdl files to create metric views with the /importBI Genie Code skill.
Dashboard enhancements and bug fixes (2026-10-15)Source ↗
Oct 152026
newLakehouse Real-Time SQL warehouse support for AI/BI dashboards
With Lakehouse Real-Time SQL warehouses
Lakehouse Real-Time warehouse support (Beta) : AI/BI dashboards now work with Lakehouse Real-Time SQL warehouses.
Dashboard enhancements and bug fixes (2026-10-15)Source ↗
Oct 152026
newIntegrated CDC pipeline for MySQL — generally available
The integrated CDC pipeline for MySQL is now generally available. An integrated CDC pipeline ingests change data from MySQL into Databricks using a single pipeline, combining extraction and application into one pipeline update. Unlike the standard gateway-based architecture, an integrated CDC pipeline requires no separate ingestion gateway.
MySQL integrated CDC pipeline is now generally available (2026-10-15)Source ↗
Oct 152026
newPostgres logical replication for Lakebase
You can now use native Postgres logical replication to stream changes into and out of Lakebase. Migrate an existing Postgres database into Lakebase and keep it in sync until you cut over, or publish changes from Lakebase to external Postgres databases.
Replicate data in and out of Lakebase with Postgres logical replication (2026-10-15)Source ↗
Oct 132026
newAI Runtime for compliance security profile workspaces
With AWS, Azure
AI Runtime will be available by default for eligible workspaces with the compliance security profile enabled in mid November. Availability depends on the supported compliance standards and regions.
AI Runtime will soon be available by default for workspaces with the compliance security profile enabled (2026-10-13)Source ↗
Oct 132026
newGoogle Gemini 4 Argon on Unity Gateway
Google Gemini 4 Argon is now available on Unity Gateway. You can access this model using Foundation Model APIs.
Google Gemini 4 Argon is now available on Unity Gateway (2026-10-13)Source ↗
Oct 92026
newAmazon Bedrock Mantle model provider support in Unity Gateway
You can now access Amazon Bedrock Mantle models through Unity Gateway model provider services, with Unity Catalog permissions, rate limits, budgets, and inference tables.
newGoogle Workspace connector (Beta) in Databricks Lakeflow Connect
The managed Google Workspace connector is now available in Beta in Databricks Lakeflow Connect. Use the connector to ingest audit activity from Google Workspace applications and services into Databricks. The connector uses OAuth user authorization and supports incremental ingestion.
Google Workspace connector is available in Beta (2026-10-09)Source ↗
Oct 82026
newMCP connectors for Genie agents
With Google Drive, Slack
Attach MCP connectors so the agent can use external tools and sources such as Google Drive and Slack. (Beta)
updatedSalesforce Data 360 file sharing connector enabled by default for compliance security profile workspaces
With Lakehouse Federation
The Salesforce Data 360 file sharing connector (formerly Salesforce Data Cloud file sharing) will be available by default for workspaces with the compliance security profile enabled. Use the connector in Lakehouse Federation to query Salesforce Data 360 data directly from cloud object storage without copying it into Databricks.
Salesforce Data 360 file sharing will soon be available by default for workspaces with the compliance security profile enabled (2026-09-30)Source ↗
Sep 302026
updatedPostGIS and related extensions updated to newer versions on Postgres 16, 17, and 18
With postgis_raster, postgis_sfcgal, postgis_tiger_geocoder, postgis_topology, address_standardizer, address_standardizer_data_us
postgis , postgis_raster , postgis_sfcgal , postgis_tiger_geocoder , postgis_topology , address_standardizer , and address_standardizer_data_us : updated to 3.3.10 on Postgres 16, 3.5.7 on Postgres 17, and 3.6.4 on Postgres 18.
Supported Postgres extensions updated to new versions (2026-09-30)Source ↗
Sep 302026
updatedhll extension updated to version 2.21 on Postgres 16, 17, and 18
hll : updated to 2.21 on Postgres 16, 17, and 18.
Supported Postgres extensions updated to new versions (2026-09-30)Source ↗
Sep 282026
new1Password Event Logs connector
With 1Password Events API, audit events, item usages, sign-in attempts
The 1Password Event Logs connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector uses the 1Password Events API to ingest audit events, item usages, and sign-in attempts into Databricks. Authentication uses an Events Reporting bearer token.
The CrowdStrike Falcon Event Stream connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector ingests Falcon Event Stream events from CrowdStrike Falcon into Databricks. Authentication uses OAuth 2.0 client credentials from a CrowdStrike API client with Event streams Read permission.
newMicrosoft 365 Unified Audit Logs connector (Beta) in Lakeflow Connect
With Microsoft Entra ID, Exchange, SharePoint
The managed Microsoft 365 Unified Audit Logs connector is now available in Beta in Databricks Lakeflow Connect. Use the connector to ingest unified audit events from Microsoft Entra ID, Exchange, SharePoint, and other Microsoft 365 workloads into Databricks. The connector uses OAuth machine-to-machine authentication and supports incremental ingestion.
Microsoft 365 Unified Audit Logs connector is available in Beta (2026-09-28)Source ↗
Sep 282026
newWorkday Activity Logging connector
The Workday Activity Logging connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector incrementally ingests Workday user activity log events into Databricks. Authentication uses an OAuth refresh token.
Nothing first seen in this window. That doesn't mean Databricks shipped nothing, only that we found no record of it.
Changes per month New Updated Retired
2026-09
7
2026-10
27
2026-11
1
How we count
Read from 97 of 1491 release notes and docs updates we hold for Databricks. "First seen" is the earliest note that names something; "last" is the latest. Our history may start partway through Databricks's life, so an old integration can show a recent first-seen date.
Each change counts once: "added 40 checks" is one line, so the numbers measure how often coverage moves, not how big the catalogue is or how well it detects.
Releases
Show
Coverage in all entries
1491 entries
No entries match these filters.
November 20269
October 2026100
September 2026172
August 202678
July 202645
June 202670
May 202644
April 202635
March 202632
February 202621
January 202615
December 202523
November 202523
October 202529
September 202522
August 202536
July 202525
June 202530
May 202524
April 202515
March 202521
February 202514
January 202517
December 202420
November 20246
October 202411
September 202415
August 202422
July 202430
June 202422
May 202421
April 202411
March 202410
February 202410
January 202410
December 202310
November 20239
October 202316
September 202327
August 202320
July 202313
June 202322
May 202320
April 20238
March 20239
February 20237
January 20238
December 20229
November 20228
October 202211
September 20226
August 202216
July 20225
June 202210
May 20224
April 20221
March 20226
February 20223
January 20224
December 20215
November 20213
October 20214
September 20216
August 202112
July 20213
June 20213
May 20216
April 20212
March 20212
February 20212
January 20212
December 20206
November 20202
October 20202
September 20206
August 20207
July 20204
June 20206
May 20205
April 20201
February 20203
January 20203
December 20193
November 20192
October 20197
September 20191
August 20193
July 20192
June 20195
April 20194
March 20194
February 20191
January 20192
December 20183
November 20182
October 20181
September 20184
August 20181
May 20186
March 20183
February 20181
January 20181
Add the badge to your README
Maintain this project? The badge links readers straight to this page, so they can
follow every release here.
Choose a badge style and copy the code →
Unity Gateway Usage Dashboard v1.0 (2026-10-27) · Oct 2026
· source
· release history
Improved Lakeflow Performance Observability will soon be available by default for workspaces with the compliance security profile enabled (2026-10-26) · Oct 2026
· source
· release history
Lakebase Search supports Chinese, Japanese, and Korean full-text search (2026-10-15) · Oct 2026
· source
· release history
Genie Agents enhancements and bug fixes (2026-10-29) · Oct 2026
· source
· release history
docs update · Oct 2026
· source