Author: Adrian Chodkowski

FabricFallingFromDirectLakeToDirectQuery_00
Microsoft Fabric

How to determine if Direct Lake dataset is falling back to Direct Query in Microsoft Fabric

When you create a Direct Lake semantic model, it typically operates in Direct Lake mode. This means it directly accesses the delta table from the OneLake. This is the preferred scenario because it helps queries run fast, sometimes as fast as import mode. In Power BI, when utilizing Direct Lake mode, the semantic models directly […]

FabricNotebooksOrchestration_00
Data Factory, Microsoft Fabric

Notebook orchestration in Microsoft Fabric made easy

When I meet with customers, we discuss how to efficiently organize notebook execution via orchestration mechanism. They often mention managing it manually using tools like Azure Data Factory. On the other hand, they sometimes express that Data Factory is too simplistic and they require other tools to address their needs. Similar questions arise regarding Microsoft […]

DatabricksQueryHistory_00
Databricks

Retrieve execution query history in Databricks

Collecting the history of query and command executions in Azure Databricks is essential for troubleshooting, optimizing performance, and ensuring robust security measures. This practice establishes an audit trail for swift issue resolution, aids in creating a usage baseline for objects, and contributes to maintaining a secure data processing environment. The historical data becomes a valuable […]