InvalidAbfsRestOperationException in Azure Synapse notebook
InvalidAbfsRestOperationException in Azure Synapse notebook
Problem The first issue that developers in my team noticed was when they tried to create database with Spark: Error message: org.apache.spark.sql.AnalysisException: org.apache.hadoop.hive.ql.metadata.HiveException: MetaException(meesage: Got exception: org.apache.hadoop.fs.azurebfs.contracts.exceptions.InvalidAbfsRestOperationException Status code: -1
Mounting ADLS point using Spark in Azure Synapse
Last weekend, I played a bit with Azure Synapse from a way of mounting Azure Data Lake Storage (ADLS) Gen2 in Synapse notebook within API in the Microsoft Spark Utilities
Cloud Formations – A New MVP Led Training Initiative
Hello, data friends! Let me spread a few words about the new MVP led training initiative started by my friend and fellow MVP – Paul Andrew. It’s called Cloud Formations
Discovering diagram of dependencies in Synapse Analytics and ADF pipelines
Documenting objects dependencies of ETL processes is a tough task. Regardless it is SSIS, ADF, pipelines in Azure Synapse or other systems. The reasons for understanding the current solution can
Database projects with SQL Server Data Tools (SSDT)
Last Year (2021) I released a full and comprehensive course about SSDT: developing and maintenance SQL Server database within SQL Server Data Tools in Visual Studio. Thank you to all
Last Week Reading (2022-01-02)
? Press Efficient Upserts into Data Lakes with Databricks Delta When MERGE on data lake is inefficient. Building a Data Mesh Architecture in Azure – part 1 With this post,
Last Week Reading (2021-11-28)
? Press SynapseML: A simple, multilingual, and massively parallel machine learning library Microsoft just announced the release of SynapseML (previously known as MMLSpark) SSH File Transfer Protocol (SFTP) support for
SQL Server 2022 is coming
SQL Server 2022 is still in private preview (Microsoft MVP folks have access to it), but you can now read about the new release before it is released: SQL Server
Skirmishes with automated deployment of Azure Data Factory
When it comes to Azure Data Factory deployment, I always have a few words to say. You might be aware that there are two approaches in this terms. I was
Showing images in gallery using URL to blob storage
Today, I explain how to create a simple app in Microsoft Power Apps where: the data are located in Excel, the table contains the path to the images from public
