Apache Spark: Tips, Tricks, & Techniques

Rating 0 out of 5 (0 ratings in Udemy)

What you'll learn

Compose Spark jobs from actions and transformations
Create highly concurrent Spark programs by leveraging immutability
Ways to avoid the most expensive operation in the Spark API—Shuffle
How to save data for further processing by picking the proper data format saved by Spark
Parallelize keyed data; learn of how to use Spark's Key/Value API
Re-design your jobs to use reduceByKey instead of groupBy
Create robust processing pipelines …

Rating 0 out of 5 (0 ratings in Udemy)

What you'll learn

Compose Spark jobs from actions and transformations
Create highly concurrent Spark programs by leveraging immutability
Ways to avoid the most expensive operation in the Spark API—Shuffle
How to save data for further processing by picking the proper data format saved by Spark
Parallelize keyed data; learn of how to use Spark's Key/Value API
Re-design your jobs to use reduceByKey instead of groupBy
Create robust processing pipelines by testing Apache Spark jobs
Solve repeated problems by leveraging the GraphX API

Description

Apache Spark has been around for quite some time, but do you really know how to get the most out of Spark? This course aims at giving you new possibilities; you will explore many aspects of Spark, some you may have never heard of and some you never knew existed.

In this course you'll learn to implement some practical and proven techniques to improve particular aspects of programming and administration in Apache Spark. You will explore 7 sections that will address different aspects of Spark via 5 specific techniques with clear instructions on how to carry out different Apache Spark tasks with hands-on experience. The techniques are demonstrated using practical examples and best practices.

By the end of this course, you will have learned some exciting tips, best practices, and techniques with Apache Spark. You will be able to perform tasks and get the best data out of your databases much faster and with ease.

About the Author

Tomasz Lelek is a Software Engineer, programming mostly in Java and Scala. He is a fan of microservice architectures and functional programming. He dedicates considerable time and effort to getting better every day. He is passionate about nearly everything associated with software development, and believes that we should always try to consider different solutions and approaches before solving a problem. Recently he was a speaker at conferences in Poland -, Confitura and JDD (Java Developers Day), and also at Krakow Scala User Group. He has also conducted a live coding session at Geecon Conference.

He is a co-founder initlearn an e-learning platform that was built with the Java language.

Duration 2 Hours 58 Minutes

Paid

Self paced

Beginner Level

English (US)

Rating 0 out of 5 (0 ratings in Udemy)

Go to the Course
We have partnered with providers to bring you collection of courses, When you buy through links on our site, we may earn an affiliate commission from provider.