Code

51 reduce memory burden of pipeline#95

Code

Merged

DSilva27 merged 24 commits intodevflatironinstitute/Cryo-EM-Heterogeneity-Challenge-1:devfrom 51-reduce-memory-burden-of-pipeline-1flatironinstitute/Cryo-EM-Heterogeneity-Challenge-1:51-reduce-memory-burden-of-pipeline-1Copy head branch name to clipboardSep 18, 2024

+424-182

Commits

Commits on Sep 4, 2024

• low memory pasisng test

  geoffwoollard

  committed
  356696c

Commits on Sep 10, 2024

• tests passing for low memory mode t and f

  geoffwoollard

  committed
  5e3591f

Commits on Sep 11, 2024

• l2, corr, bioem working

  geoffwoollard

  committed
  7c8e247

• fsc low memory working

  geoffwoollard

  committed
  14805d7

• tests passing checking identical output

  geoffwoollard

  committed
  6f5e09e

• all metrics implemented and test passing for matched results

  geoffwoollard

  committed
  a7290aa

• all metrics implemented and test passing for matched results

  geoffwoollard

  committed
  22ec5a5

• all metrics implemented and test passing for matched results

  geoffwoollard

  committed
  de3cddc

• flags for masking and not masking

  geoffwoollard

  committed
  f20344e

• tests for masking and normalization

  geoffwoollard

  committed
  6def1bf

Commits on Sep 17, 2024

• code duplication for norm

  geoffwoollard

  committed
  c0f2f83

• tests passing. vmap over sub batch

  geoffwoollard

  committed
  f1f8cd8

• tests passing. get_sub_distance_matrix

  geoffwoollard

  committed
  61608cb

• tests passing with hard coded instantiation

  geoffwoollard

  committed
  1440d84

• map_to_map_distance.distance_matrix_precomputation

  geoffwoollard

  committed
  555a39f

• chunk_size_low_memory

  geoffwoollard

  committed
  b71e52b

• on the fly sub batch normalization

  geoffwoollard

  committed
  76fdb46

• normalization and masking on the fly in sub batch

  geoffwoollard

  committed
  0a2efc0

• tests passing

  geoffwoollard

  committed
  42525f4

• tests passing for low memory off

  geoffwoollard

  committed
  e472372

Commits on Sep 18, 2024

• tests passing. time to delete separate low memory

  geoffwoollard

  committed
  3077f6a

• all tests passing

  geoffwoollard

  committed
  cb7085e

• remove low memory versions

  geoffwoollard

  committed
  1f4057e

• update configs to remove low memory metrics

  geoffwoollard

  committed
  b33a6a0