Hello Students,

I welcome you all to this course on Apache Spark 3.0 Programming and Databricks Associate Developer Certification 2022 using Python. In this course, you will learn about programming using Apache Spark 3.0 using Python, usually referred as PySpark, along with preparing you for the Databricks certification using Python in a fun and easy way from ground zero.

This course requires zero knowledge on PySpark, and it will take you to an advanced user level of PySpark by the end of this course. We will be only using Python language here, in this course. This course can also be taken by someone who is starting their journey with Apache Spark using Python.

This course focuses on the most important aspects of Apache Spark 3.0 without going into the esoteric side of the Spark framework. Therefore, you will be productive with PySpark with the help of this course in a couple of hours. Additionally, this course covers all the topics required for Databricks certification using Python language.

This course also comes with two bonus projects on Machine learning using PySpark. In those videos, I will talk about how to prepare your data so that it is ready for applying machine learning algorithms along with some hands-on on some machine learning algorithm from the PySpark machine learning framework. I have considered very gentle examples to illustrate the power of PySpark’s machine learning, so it will be very easy to follow along.

This course is ideal if you are an absolute beginner or someone with less than two years of experience with PySpark or if you wish to get certified as a Databricks Certified Associate Developer for Apache Spark 3.0. This course can also be used by experienced professionals to quickly brush up their basics in PySpark.

In terms of hardware requirements, you just need a computer with an internet connection. We will be using a free Databricks cluster to practice the problems here, so you also don't need to worry about any complicated installations. This is also helpful for many professionals because almost always, we do not have admin access to the computer and we cannot install any software on the computer. I will be teaching you how to use Databricks cloud platform for this course.