Introduction Databricks offers great functionality in the form of table CLONING, which works not only for Delta Tables but also for Parquet Table and Iceberg Tables. In this article we will focuse on Delta Tabels. Please note that in this article, whenever I mention: Source Table: This refers to the original table used as the […]
Author: Wojciech Bukowski
Incrementally loading files from SharePoint to Azure Data Lake using Data Factory
Introduction Companies store a lot of useful data in SharePoint, OneDrive (which is essentially SharePoint), and MS Teams (also based on SharePoint). If you want to enhance your data platform with information that is usually stored in various file formats (Excel, MS Access, CSV, and others), you’ll need to save it to a more user-friendly […]
Azure Automation – Run As Account migration plan
If you’re utilizing an Azure Automation account in your data project, you’ve likely come across this information: Azure Automation Run As Account will retire on 30 September 2023 If not, now you’re aware of it. If you’re using it in your code, it will cease to function. Microsoft has provided an excellent article outlining migration […]