Skip to content

Latest commit

 

History

History
24 lines (14 loc) · 737 Bytes

CONTRIBUTING.md

File metadata and controls

24 lines (14 loc) · 737 Bytes

Developing

Parsers are implemented using fastparse (MIT)

Quick installation on Databricks: mvn -DskipTests=true package && databricks --profile=demo fs cp target/transpiler-0.4.jar dbfs:/tmp/transpiler.jar --overwrite

If you want to use TERM() function, you have to enable Spark extension:

spark.sql.extensions org.apache.spark.sql.SplExtension

mvn compile should give no warnings

Scalastyle complaints:

  • run mvn scalastyle:check
  • illegal start of simple expression - open file with vim and :goto <number>

Code coverage report:

  • open target/site/jacoco/index.html

PySpark tests assume that you have PySpark 3.3.0 installed in your Python environment.