In the first part of the article, we discussed the basics of the Azure Policy service and provided examples of using definitions with audit and deny effects, or in simpler terms, policies that block the creation of incorrect resources. In this part, we will focus on a slightly more advanced concept: remediation, which involves automatically […]
Latest Posts
How to determine if Direct Lake dataset is falling back to Direct Query in Microsoft Fabric
When you create a Direct Lake semantic model, it typically operates in Direct Lake mode. This means it directly accesses the delta table from the OneLake. This is the preferred scenario because it helps queries run fast, sometimes as fast as import mode. In Power BI, when utilizing Direct Lake mode, the semantic models directly […]
Understanding CLONE Functionality in Databricks for Delta Tables
Introduction Databricks offers great functionality in the form of table CLONING, which works not only for Delta Tables but also for Parquet Table and Iceberg Tables. In this article we will focuse on Delta Tabels. Please note that in this article, whenever I mention: Source Table: This refers to the original table used as the […]
Azure Policy – an underrated component of a scalable data platform (part1)
Recently, we’ve been encountering an increasing number of projects where a complete data platform has to be designed and built almost from scratch. In such projects, in addition to the typical duties and tasks in the data area, such as data modeling, designing and implementing pipelines, or the final reporting layer, there is a growing […]
Last comments