Today, Databricks kicked off its annual Data and AI summit with a long-awaited move: the open sourcing of its three-year-old Unity Catalog platform that provides customers a unified solution for their ...

Today, at its annual Data + AI Summit, Databricks announced that it is open-sourcing its core declarative ETL framework as Apache Spark Declarative Pipelines, making it available to the entire Apache ...

A GitHub project now offers an Azure Databricks medallion architecture pipeline built with PySpark, Python, and SQL. It processes e-commerce data through Bronze, Silver, and Gold layers, adding ...

SAN FRANCISCO, June 11, 2025 /PRNewswire/ -- Data + AI Summit --Databricks, the Data and AI company, today announced it is open-sourcing the company's core declarative ETL framework as Apache Spark™ ...

Databricks CEO Ali Ghodsi and Nvidia CEO Jensen Huang announced an expansion of their companies’ partnership at the Databricks Data and AI Summit. I was recently back in San Francisco, attending the ...

Three main pressure points are transforming the modern data landscape: 1) Increased interest in adopting open table formats to allow any compute to operate on any data; 2) The point of control is ...

As customers try to “get artificial intelligence right,” the need to rationalize siloed data becomes increasingly important. Data practitioners could put all their data eggs into a single platform ...

Enterprises have spent years and considerable fortunes building data lakehouses, training models, and unifying customer records inside platforms like Databricks. The harder problem, it turns out, is ...

Databricks is getting ready to offer more support to enterprises building generative AI applications, with the addition of new Mosaic AI capabilities, it said Wednesday. First up, Mosaic AI Agent ...

Zaharia began building Apache Spark as a doctoral student at UC Berkeley in 2009, a faster alternative to Hadoop MapReduce, which had become the default framework for large-scale distributed data ...

Matei Zaharia has won the top honor from the Association for Computing Machinery. Now he's working on AI for research and says AGI is simply misunderstood.