Code repository for post, Using the Google Cloud Dataproc WorkflowTemplates API to Automate Spark and Hadoop Workloads on GCP.
template-demo-2.yaml
: Non-parametrized version of workflow template with three jobs, using a managed 3-node Spark clustertemplate-demo-3.yaml
: Parametrized version of workflow template with one Python-based PySpark job, using a managed 3-node Spark clustertemplate-demo-4.yaml
: Parametrized version of workflow template with one Python-based PySpark job, using an existing 3-node Spark clustertemplate-demo-5.yaml
: Parametrized version of workflow template with one Java-based Spark job, using an existing 3-node Spark cluster