Skip to content

Commit

Permalink
Automation: Build global and wa-state phylogenetic trees
Browse files Browse the repository at this point in the history
Added a `phylogenetic_wa` GitHub Action in order to support building both
global and Washington state phylogenetic trees. Since both define custom_rules,
which would overwrite each other, we defined a config-public.yaml that combines
deploy-related and Washington state-specific custom rules, merging them into
a unified array.

For the Washington state build, the public-facing configuration required
additional overrides to access data from the public site, as opposed to
the original configuration, which relied on privately processed ingest.
  • Loading branch information
j23414 committed Jan 20, 2025
1 parent db714c9 commit 868ead7
Show file tree
Hide file tree
Showing 2 changed files with 40 additions and 1 deletion.
32 changes: 31 additions & 1 deletion .github/workflows/phylogenetic.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -76,7 +76,7 @@ jobs:
outputs:
config_overrides: ${{ steps.config.outputs.config }}

phylogenetic:
phylogenetic_global:
needs: [set_config_overrides]
permissions:
id-token: write
Expand Down Expand Up @@ -105,3 +105,33 @@ jobs:
phylogenetic/benchmarks/
phylogenetic/logs/
phylogenetic/.snakemake/log/
phylogenetic_wa:
needs: [set_config_overrides]
permissions:
id-token: write
uses: nextstrain/.github/.github/workflows/pathogen-repo-build.yaml@master
secrets: inherit
with:
# Starting with the default docker runtime
# We can migrate to AWS Batch when/if we need to for more resources or if
# the job runs longer than the GH Action limit of 6 hours.
runtime: docker
env: |
NEXTSTRAIN_DOCKER_IMAGE: ${{ inputs.image }}
CONFIG_OVERRIDES: ${{ needs.set_config_overrides.outputs.config_overrides }}
run: |
nextstrain build \
phylogenetic \
deploy_all \
--configfile build-configs/nextstrain-automation/config.yaml build-configs/washington-state/config.yaml build-configs/washington-state/config-public.yaml \
$CONFIG_OVERRIDES
# Specifying artifact name to differentiate ingest build outputs from
# the phylogenetic build outputs
artifact-name: phylogenetic-wa-build-output
artifact-paths: |
phylogenetic/auspice/
phylogenetic/results/
phylogenetic/benchmarks/
phylogenetic/logs/
phylogenetic/.snakemake/log/
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
# Use public data for the public tree
sequences_url: "https://data.nextstrain.org/files/workflows/WNV/sequences.fasta.zst"
metadata_url: "https://data.nextstrain.org/files/workflows/WNV/metadata.tsv.zst"
input_metadata: "data/metadata.tsv"
input_sequences: "data/sequences.fasta"

custom_rules:
- build-configs/nextstrain-automation/deploy.smk
- build-configs/washington-state/washington-state-rules.smk

0 comments on commit 868ead7

Please sign in to comment.