The Middle Way for Static Typing in Spark DataFrames
SkillsCastAbout the Speaker
Please log in to watch this conference skillscast.
Technically, the talk will show how to achieve this by implementing a thin DSL layer on top of the Spark DataFrame API. Particularly, it will show how this DSL builds upon common functional programming patterns and concepts such as Kleislis, type classes, type-level computing, etc., taking advantage of common libraries of the Scala ecosystem such as cats, shapeless, etc.
YOU MAY ALSO LIKE: