Pies, Lies and AIs

Exploring the world of data and organisational intransigence

dazfuller

May 1, 20222 min read

Dropping a SQL table in your Synapse Spark notebooks (Python Edition)

So since writing the original post about how to drop a SQL table from a Spark Notebook I've been meaning to follow it up with a version...

1,005 views3 comments

dazfuller

Oct 21, 20214 min read

For the Python version of the code below, see the follow-up post. One of the nice things with Spark Pools in Azure Synapse Analytics is...

2,412 views6 comments

dazfuller

Jul 24, 20219 min read

Having recently released the Excel data source for Spark 3, I wanted to follow up with a "lets use it to process some Excel data" post....

5,670 views2 comments

dazfuller

Jul 3, 20214 min read

People have data in Excel, so lets have a look at how we can read that data using Spark

14,298 views0 comments

azurecoder

Nov 29, 20201 min read

Over the past few months we've been hearing more and more about Azure Synapse. For those of you that heard my talk and saw my talk at the...