Latest Posts

DatabricksForeignCatalogQueryFolding_00
Azure SQL Database, Databricks

Avoiding Issues: Monitoring Query Pushdowns in Databricks Federated Queries

A foreign catalog in Databricks is a specialized type of catalog that enables users to access and query data stored in external databases as if it were part of their own Databricks workspace. Currently, foreign catalogs can be created for multiple sources, including SQL Server, Synapse Analytics, and more. This feature is particularly valuable as […]

Azure SQL Database, Databricks, DevOps

Terraforming Databricks #3: Lakehouse Federation

In today’s post, the third in the Terraforming Databricks series, we’ll break down the process of setting a connection to an Azure SQL Database as part of the Lakehouse Federation functionality. Lakehouse Federation Before diving into the implementation, let’s first define what Lakehouse Federation is. Here’s a brief description from the documentation. Lakehouse Federation is […]