In many projects, we have different tools that must integrate with each other. These scenarios are common when we talk about Synapse Analytics and Azure Databricks. Integrating those platforms can be beneficial in several ways. By combining the capabilities of Azure Synapse’s SQL pool with Azure Databricks’ Apache Spark cluster, you can analyze and transform […]
Author: Adrian Chodkowski
Dealing with ParquetInvalidColumnName error in Azure Data Factory
Data Factory or Integrated Pipelines under Synapse Analytics suite can be very useful as an extracting and orchestrating tool. It is a common scenario when we extract data from the source system and save it in a dedicated landing zone located in Azure Data Lake Storage Gen 2. The only question that can appear is […]
Provisioning AAD users and groups in Azure Databricks using SCIM
If you have services like Azure Databricks and you have to synchronize identities inside the tool with those that exist in Azure Active Directory then how you can do it? Creating it manually is not the case because it is time-consuming and maintenance overhead is not acceptable. The best solution will be to use SCIM […]
Most needed ideas from ideas.powerbi.com
Power BI is growing as a tool and as a platform. When you compare what we have now and what we had a few years ago you will see a completely different set of tools with a different set of capabilities. Some time ago in 2018, I wrote an article about top ideas that in […]