InvalidAbfsRestOperationException in Azure Synapse notebook

Synapse 1 Comment

InvalidAbfsRestOperationException in Azure Synapse notebook

Problem The first issue that developers in my team noticed was when they tried to create database with Spark: Error message: org.apache.spark.sql.AnalysisException: org.apache.hadoop.hive.ql.metadata.HiveException: MetaException(meesage: Got exception:  org.apache.hadoop.fs.azurebfs.contracts.exceptions.InvalidAbfsRestOperationException Status code: -1

Mounting ADLS point using Spark in Azure Synapse

Last weekend, I played a bit with Azure Synapse from a way of mounting Azure Data Lake Storage (ADLS) Gen2 in Synapse notebook within API in the Microsoft Spark Utilities

General 0 Comments

Cloud Formations – A New MVP Led Training Initiative

Hello, data friends! Let me spread a few words about the new MVP led training initiative started by my friend and fellow MVP – Paul Andrew. It’s called Cloud Formations

General 4 Comments

Discovering diagram of dependencies in Synapse Analytics and ADF pipelines

Documenting objects dependencies of ETL processes is a tough task. Regardless it is SSIS, ADF, pipelines in Azure Synapse or other systems. The reasons for understanding the current solution can

General 2 Comments

Database projects with SQL Server Data Tools (SSDT)

Last Year (2021) I released a full and comprehensive course about SSDT: developing and maintenance SQL Server database within SQL Server Data Tools in Visual Studio. Thank you to all

Last Week Reading 0 Comments

Last Week Reading (2022-01-02)

? Press Efficient Upserts into Data Lakes with Databricks Delta When MERGE on data lake is inefficient. Building a Data Mesh Architecture in Azure – part 1 With this post,

Last Week Reading 0 Comments

Last Week Reading (2021-11-28)

? Press SynapseML: A simple, multilingual, and massively parallel machine learning library Microsoft just announced the release of SynapseML (previously known as MMLSpark) SSH File Transfer Protocol (SFTP) support for

SQL Server 0 Comments

SQL Server 2022 is coming

SQL Server 2022 is still in private preview (Microsoft MVP folks have access to it), but you can now read about the new release before it is released:  SQL Server

Azure Data Factory 4 Comments

Skirmishes with automated deployment of Azure Data Factory

When it comes to Azure Data Factory deployment, I always have a few words to say. You might be aware that there are two approaches in this terms. I was

General 1 Comment

Showing images in gallery using URL to blob storage

Today, I explain how to create a simple app in Microsoft Power Apps where: the data are located in Excel, the table contains the path to the images from public