Category: Uncategorized

The Beginner’s Guide to Remote Work & Running a Remote Team

The year 2020 will be known for a lot of things, not least of which is the rise of remote work. Companies like Facebook, Microsoft, Square and Spotify are all examples of huge companies transitioning to remote work, even beyond the forced “work from home” period enforced by mandated social distancing. Remote work, location-independent work, […]

Apache Spark Performance Tuning – Degree of Parallelism

Table of Content [show] 1 Overview 2 Spark Partition Principles 3 Understanding Use Case Performance 4 Understanding Spark Data Partitions 5 Spark Partition Tuning 5.1 Running Spark on YARN with Partition Tuning 6 Conclusion 7 References Overview This is the third article of a four-part series about Apache Spark on YARN. Apache Spark allows developers […]