Let’s continue our series on Delta Lake. In the first article, I covered the basics of the Delta format itself. Today, I would like to share with you some essential information about the Transaction Log. As you know, after our first article, Delta consists of a set of Parquet files that hold the data itself […]
Author: Adrian Chodkowski
Using variables in loops in Data Factory – why it’s not worth it
Loops are well-known constructs and they are a fundamental and necessary element of programming. This is no different in ADF, where loops play a standard role related to storing values fetched or calculated in a specific location of the data flow. The schema of Data Factory is rather well-known and involves nesting specific calls, etc. […]
Allow Azure Services and resources to access this server – How it works in Azure SQL Database?
One of the first options that Azure SQL Database users encounter when creating this resource is the “Allow Azure Services and resources to access this server” option, along with other network settings related to our server. While allowing traffic from a specific IP address or range of IP addresses to our server is fairly intuitive […]
Refreshing a Power BI Dataset using Azure Data Factory
As you probably know, Power BI datasets can be refreshed using the built-in schedule in the Power BI service. Depending on whether we’re talking about Premium Capacity or Shared Capacity, we have a certain number of refreshes available per day. Of course, the schedule is not the only option when it comes to refreshing the […]