This example is taken directly from the Kubernetes GitHub page, which can be found at https://github.com/Kubernetes/Kubernetes/tree/master/examples/spark. We've done some modification to that example, since we are using a very specific Kubernetes deployment called Minikube. But we still want it to be based on the original example, since when you are using this link, you are guaranteed to always obtain an updated version compatible with the latest Kubernetes version in place. So these are the required steps, which are explained in detail in the next sections:
- Install Minikube local Kubernetes to your machine.
- Deploy the Apache Spark master node.
- Deploy the Apache Spark worker nodes.
- Deploy the Apache Kubernetes notebook application and test the whole cluster (optional).
The following section describes the prerequisites to run the example...
