Tag "spark"

Synapse 1 Comment

InvalidAbfsRestOperationException in Azure Synapse notebook

Problem The first issue that developers in my team noticed was when they tried to create database with Spark: Error message: org.apache.spark.sql.AnalysisException: org.apache.hadoop.hive.ql.metadata.HiveException: MetaException(meesage: Got exception:  org.apache.hadoop.fs.azurebfs.contracts.exceptions.InvalidAbfsRestOperationException Status code: -1

Last Week Reading 0 Comments

Last Week Reading (2020-06-28)

Press ExpandString in Powershell This function can do much more than you think. Pester – using -should -throw Useful example when you want to filter output by ExceptionType or ErrorId. ADF:

Azure Data Factory 13 Comments

Mapping Data Flow in Azure Data Factory (v2)

Azure Data Factory is more of an orchestration tool than a data movement tool, yes. It’s like using SSIS, with control flows only. Once they add Mapping Data Flows to

Last Week Reading 0 Comments

Last Week Reading (2019-05-05)

Hello folks! Another set of information about the Microsoft Data Platform. This time: Spark, SQL Edge(!), Power BI, Big Data, Pester, DevOps, YAML. Press Microsoft brings Azure SQL Database to

Last Week Reading 0 Comments

Last Week Reading (2019-04-28)

An unusual week has passed. SQL Server’s 30th birthday – learn a bit about history. Future? Here you are! .NET enters under Spark’s thatch, and more… Press Happy 30th Birthday

Last Week Reading 0 Comments

Last Week Reading (2019-04-07)

Good morning guys and gals! This time many updates and articles from ADF field, so keep reading once you sit comfortably with coffee in a hand. Press Handling Schema Drift

Last Week Reading 0 Comments

Last Week Reading (2019-01-20)

Hello folks! Good morning on Monday morning and let’s go through some interesting news from the #data world. Press Using Docker to run Integration Tests for dbachecks This time, my friend

General 0 Comments

BI Conference in Wroclaw

I would like to spread the word about a new conference which appears in my favourite city in Poland – Wroclaw. I’m talking to Jacek Biały, Business Intelligence Competency Center Manager