What it does
A Cursor rules file for writing and reviewing PySpark ETL code. It covers a base ETL class that manages the Spark session, configuration through a factory function, and code that is testable and safe for cumulative or snapshot tables, with Spark SQL and Apache Iceberg in mind.
Use cases
- 01Scaffold a new PySpark ETL job
- 02Review a job for snapshot table safety
- 03Make a job configurable without touching sys.argv