This week has been a good mix of working on a custom python library, building pipelines and planning further CI/CD pipelines for tech beyond Data Factory. I also published the first few posts in a series on CI/CD for Azure Data Factory. PS Happy Thanksgiving to everyone in the US!
Here’s what I’ve been reading and watching this week:
Advancing Spark - Databricks SQL Analytics & Power BI#
by Simon Whiteley
Simon does a great job of summing up how we connect Power BI to the new SQL Analytics, announced by Databricks this month. He covers some caveats and the new features available in Databricks, lots of really good detail as always Simon! This looks great and I can’t wait to get my hands on the preview. Thanks again Simon
Azure Synapse Source Control (preview)#
by Mark Pryce-Maher
I spotted the source control options just landing today and then Mark released a great video (before Simon Whiteley) on setting it up so I had to include it. Thanks Mark
Last-Minute Thanksgiving | Basics with Babish#
Some relevant food to finish off the day. Yum!