Azure Databricks & Spark For Data Engineers (PySpark / SQL) Course
Real World Project on Formula1 Racing using Azure Databricks, Delta Lake, Unity Catalog, Azure Data Factory [DP203]
I am looking forward to helping you with learning one of the in-demand data engineering tools in the cloud, Azure Databricks! This course has been taught with implementing a data engineering solution using Azure Databricks and Spark core for a real world project of analysing and reporting on Formula1 motor racing data.
This is like no other course in Udemy for Azure Databricks. Once you have completed the course including all the assignments, I strongly believe that you will be in a position to start a real world data engineering project on your own and also proficient on Azure Databricks. I have also included lessons on Azure Data Lake Storage Gen2, Azure Data Factory as well as PowerBI. The primary focus of the course is Azure Databricks and Spark core, but it also covers the relevant concepts and connectivity to the other technologies mentioned. Please note that the course doesn’t cover other aspects of Spark such as Spark streaming and Spark ML. Also the course has been taught using PySpark as well as Spark SQL; It doesn’t cover Scala or Java.
The course follows a logical progression of a real world project implementation with technical concepts being explained and the Databricks notebooks being built at the same time. Even though this course is not specifically designed to teach you the skills required for passing the Azure Data Engineer Associate Certification Exam DP203, it can greatly help you get most of the necessary skills required for the exam.
I value your time as much as I do mine. So, I have designed this course to be fast-paced and to the point. Also, the course has been taught with simple English and no jargons. I start the course from basics and by the end of the course you will be proficient in the technologies used.
What you’ll learn
- You will learn how to build a real world data project using Azure Databricks and Spark Core. This course has been taught using real world data.
- You will acquire professional level data engineering skills in Azure Databricks, Delta Lake, Spark Core, Azure Data Lake Gen2 and Azure Data Factory (ADF)
- You will learn how to create notebooks, dashboards, clusters, cluster pools and jobs in Azure Databricks
- You will learn how to ingest and transform data using PySpark in Azure Databricks
- You will learn how to transform and analyse data using Spark SQL in Azure Databricks
- You will learn about Data Lake architecture and Lakehouse Architecture. Also, you will learn how to implement a Lakehouse architecture using Delta Lake.
- You will learn how to create Azure Data Factory pipelines to execute Databricks notebooks
- You will learn how to create Azure Data Factory triggers to schedule pipelines as well as monitor them.
- You will gain the skills required around Azure Databricks and Data Factory to pass the Azure Data Engineer Associate certification exam DP203
- You will learn how to connect to Azure Databricks from PowerBI to create reports
- You will gain a comprehensive understanding about Unity Catalog and the data governance capabilities offered by Unity Catalog.
- You will learn to implement a data governance solution using Unity Catalog enabled Databricks workspace.
Recommended Databricks Course
Databricks Certified Data Engineer Associate – Preparation
Databricks Certified Data Engineer Professional -Preparation
