Spark Internals

This chapter aims to answer the following questions:

Q1: After a successful deployment, what are the running services in each node?

Q2: How is the Spark application created and executed?

📄️ Overview

Prophecy deployment is flexible and supports multiple mechanisms

🗃️ Spark Planning

3 items

📄️ Shuffle Details

Prophecy deployment is flexible and supports multiple mechanisms

📄️ Architecture

Prophecy deployment is flexible and supports multiple mechanisms

📄️ Cache And Checkpoint

Prophecy deployment is flexible and supports multiple mechanisms

📄️ Broadcast

Prophecy deployment is flexible and supports multiple mechanisms