Category: Uncategorized

Apache Spark Performance Tuning – Degree of Parallelism

Table of Content [show] 1 Overview 2 Spark Partition Principles 3 Understanding Use Case Performance 4 Understanding Spark Data Partitions 5 Spark Partition Tuning 5.1 Running Spark on YARN with Partition Tuning 6 Conclusion 7 References Overview This is the third article of a four-part series about Apache Spark on YARN. Apache Spark allows developers […]