Skip to content

Dataflow pipelines for Blockchain ETL. Connects Pub/Sub topics with BigQuery tables.

License

Notifications You must be signed in to change notification settings

immutable/im-data-blockchain-etl-dataflow

 
 

Repository files navigation

blockchain-etl-dataflow

Dataflow pipelines for Bitcoin ETL. Connects Pub/Sub topics with BigQuery tables.

Local development (All commands in Makefile)

  • Generate the jar file make generate.jar
  • Push the image to Google Artifact Repository make gcp.ar.push
  • Deploy dataflow job in dev workspace using terraform plan

About

Dataflow pipelines for Blockchain ETL. Connects Pub/Sub topics with BigQuery tables.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Java 94.0%
  • HCL 3.2%
  • Shell 1.4%
  • Makefile 1.2%
  • Dockerfile 0.2%