As you continue adding more files to your table, it keeps growing larger. One day, while reviewing it, you notice some records in the middle that contain mistakes. To troubleshoot this in an easy way, it’s essential to have proper metadata about the files you have already loaded. How can you obtain this information? Another […]
Latest Posts
Processing stream data with Microsoft Fabric Event Streams (part2)
In my earlier article (link), I initiated a discussion on the functionality of Microsoft Fabric Event Streams. I provided an overview of the tool and covered the steps for connecting to data sources. In this follow-up article, I will guide you through the process of data processing and demonstrate how to efficiently store it in […]
Incrementally loading files from SharePoint to Azure Data Lake using Data Factory
Introduction Companies store a lot of useful data in SharePoint, OneDrive (which is essentially SharePoint), and MS Teams (also based on SharePoint). If you want to enhance your data platform with information that is usually stored in various file formats (Excel, MS Access, CSV, and others), you’ll need to save it to a more user-friendly […]
Processing stream data with Microsoft Fabric Event Streams (part1)
As you probably know Microsoft Fabric addresses most data analytics scenarios but one of the most important ones is Real-Time Analytics: What does it mean? It means that Fabric gives us set of services where we can process our streaming data. We can del with such data in many different ways like: streaming datasets/push datasets […]
Last comments