Caching vs Persistence in Spark (PySpark)
Introduction Apache Spark is built on lazy evaluation. Transformations such as select, filter, join, and groupBy do not execute immediately. Instead, Spark builds a logical plan (DAG) and executes it
Feb 22, 20265 min read1