Spark Streaming with PySpark
Ease With Data
2 modules
English
Lifetime access
Master real-time data processing with Spark Streaming and PySpark to unlock the power of continuous analytics and streaming applications!
Overview
Before you Buy this Course
This course is designed to:
Teach you the fundamentals of Spark Streaming using PySpark
Boost your confidence for interviews
Kickstart your journey into real-time data ingestion and its use cases
Before you begin, it's important to have a basic understanding of Python, PySpark, Unix, and SQL.
Note:
Modules
01 Agenda and Pre-requisites
02 Course Content
16 attachments • 2 hrs
02 How Spark Streaming Works
03 Spark Streaming Local Environment Setup - Docker, Jupyter, PySpark and Kafka
04 Spark Streaming Read from Sockets | Convert Batch Code to Streaming Code
05 Spark Streaming Output Modes, Optimization and Background
06 Lambda and Kappa Architectures | Data Processing Architectures in Big Data
07 Spark Streaming Read from Files | Flatten JSON data
08 Spark Streaming Checkpoint Directory | Contents of Checkpoint Directory
09 Apache Kafka Basics & Architecture | Kafka Tutorial | Pub Sub Architecture | Learn Kafka in 15min
10 Spark Streaming Read from Kafka | Real time streaming from Kafka
11 Spark Streaming Triggers - Once, Processing Time & Continuous | Tune Kafka Streaming Performance
12 Spark Streaming Writing data to Multiple Sinks | foreachBatch | Writing data to JDBC(Postgres)
13 Spark Streaming Handling Errors and Exceptions | Handle Exception for data re-processing in Spark
14 Spark Streaming Event vs Processing Time | Late Arrival of Data | Stateful Processing |Watermarks
15 Tumbling, Sliding and Session Window Operations in Spark Streaming | Grouped Window Aggregations
16 Late Data Processing | Watermarks | Tumbling and Sliding Window Operations in Spark Streaming
17 Read and Write from Azure Cosmos DB using Spark | E2E Cosmos DB setup | NoSQL vs SQL Databases
FAQs
How can I enrol in a course?
Enrolling in a course is simple! Just browse through our website, select the course you're interested in, and click on the "Enrol Now" button. Follow the prompts to complete the enrolment process, and you'll gain immediate access to the course materials.
Can I access the course materials on any device?
Yes, our platform is designed to be accessible on various devices, including computers, laptops, tablets, and smartphones. You can access the course materials anytime, anywhere, as long as you have an internet connection.
How can I access the course materials?
Once you enrol in a course, you will gain access to a dedicated online learning platform. All course materials, including video lessons, lecture notes, and supplementary resources, can be accessed conveniently through the platform at any time.
Can I interact with the instructor during the course?
Absolutely! we are committed to providing an engaging and interactive learning experience. You will have opportunities to interact with them through our community. Take full advantage to enhance your understanding and gain insights directly from the expert.
About the creator
Ease With Data
Ease With Data offers Data Engineering courses and free YouTube tutorials.
More Info on : https://youtube.com/@easewithdata
Rate this Course
₹ 299.00
₹499
Order ID:
This course is in your library
What are you waiting for? It’s time to start learning!
Wait up!
We see you’re already enrolled in this course till Lifetime. Do you still wish to enroll again?