Home

/

Courses

/Spark Streaming with PySpark

Spark Streaming with PySpark

Ease With Data

2 modules

English

Lifetime access

Master real-time data processing with Spark Streaming and PySpark to unlock the power of continuous analytics and streaming applications!

Overview

Before you Buy this Course

 

This course is designed to:

  • Teach you the fundamentals of Spark Streaming using PySpark

  • Boost your confidence for interviews

  • Kickstart your journey into real-time data ingestion and its use cases

Before you begin, it's important to have a basic understanding of Python, PySparkUnix, and SQL.

Note: 

  1. This course is also available for free on YouTube with more than 100K+ views (with some content redacted), but that does not offer support for any Q&A.
  2. You will find references in the video pointing to YouTube videos, which is also available on this Paid Version. 
  3. The Paid version of the course provides the opportunity to get your questions answered, which is not available on YouTube.

Modules

01 Agenda and Pre-requisites

02 Course Content

16 attachments • 2 hrs

02 How Spark Streaming Works

03 Spark Streaming Local Environment Setup - Docker, Jupyter, PySpark and Kafka

04 Spark Streaming Read from Sockets | Convert Batch Code to Streaming Code

05 Spark Streaming Output Modes, Optimization and Background

06 Lambda and Kappa Architectures | Data Processing Architectures in Big Data

07 Spark Streaming Read from Files | Flatten JSON data

08 Spark Streaming Checkpoint Directory | Contents of Checkpoint Directory

09 Apache Kafka Basics & Architecture | Kafka Tutorial | Pub Sub Architecture | Learn Kafka in 15min

10 Spark Streaming Read from Kafka | Real time streaming from Kafka

11 Spark Streaming Triggers - Once, Processing Time & Continuous | Tune Kafka Streaming Performance

12 Spark Streaming Writing data to Multiple Sinks | foreachBatch | Writing data to JDBC(Postgres)

13 Spark Streaming Handling Errors and Exceptions | Handle Exception for data re-processing in Spark

14 Spark Streaming Event vs Processing Time | Late Arrival of Data | Stateful Processing |Watermarks

15 Tumbling, Sliding and Session Window Operations in Spark Streaming | Grouped Window Aggregations

16 Late Data Processing | Watermarks | Tumbling and Sliding Window Operations in Spark Streaming

17 Read and Write from Azure Cosmos DB using Spark | E2E Cosmos DB setup | NoSQL vs SQL Databases

FAQs

How can I enrol in a course?

Enrolling in a course is simple! Just browse through our website, select the course you're interested in, and click on the "Enrol Now" button. Follow the prompts to complete the enrolment process, and you'll gain immediate access to the course materials.

Can I access the course materials on any device?

Yes, our platform is designed to be accessible on various devices, including computers, laptops, tablets, and smartphones. You can access the course materials anytime, anywhere, as long as you have an internet connection.

How can I access the course materials?

Once you enrol in a course, you will gain access to a dedicated online learning platform. All course materials, including video lessons, lecture notes, and supplementary resources, can be accessed conveniently through the platform at any time.

Can I interact with the instructor during the course?

Absolutely! we are committed to providing an engaging and interactive learning experience. You will have opportunities to interact with them through our community. Take full advantage to enhance your understanding and gain insights directly from the expert.

About the creator

About the creator

Ease With Data

Ease With Data offers Data Engineering courses and free YouTube tutorials.

More Info on : https://youtube.com/@easewithdata

Rate this Course

₹ 299.00

499

×

Order ID:

This course is in your library

What are you waiting for? It’s time to start learning!

Illustration | Payment success

Share this course

https://undefined/courses/Spark-Streaming-with-PySpark-67c40a1dcf1a906d404c1618-67c40a1dcf1a906d404c1618

or

×

Wait up!

We see you’re already enrolled in this course till Lifetime. Do you still wish to enroll again?

Illustration | Already enrolled in course