Skip to main content

A Lightning fast Apache Spark Framework

SparkPlusPlus

Build structured Spark applications with less boilerplate.

Structured Spark Apps

Use SparkApp to standardize config loading, SparkSession creation, logging, and shutdown for batch applications.

Typed YAML Config

Keep application configuration in YAML and decode it into Scala case classes with strict field validation.

Useful DataFrame Helpers

Layer in DataFrame utility methods without turning your jobs into a pile of ad hoc helper objects.