Code

76 sharding in zarr#125

Code

Closed

aliddell wants to merge 50 commits intoacquire-project:mainacquire-project/acquire-driver-zarr:mainfrom aliddell:76-sharding-in-zarraliddell/acquire-driver-zarr:76-sharding-in-zarrCopy head branch name to clipboard

+3,181-2,309

Commits

Commits on Aug 17, 2023

• Implement and test basic Zarr v3.

  aliddell

  committed
  13382e9

• Update and document Zarr v3 test.

  aliddell

  committed
  b33e4ad

Commits on Aug 18, 2023

• Remove unused headers.

  aliddell

  committed
  3d51811

• Add compression to ZarrV3.

  aliddell

  committed
  e52db6f

• Rename data_dir_ to data_root_ to avoid confusion when calling get_data_directory_().

  aliddell

  committed
  94f46da

Commits on Aug 21, 2023

• Move zarr_v3_init to zarr.cpp.

  aliddell

  committed
  9e9d591

• Change zarr_version_ to chunk_dir_prefix_.

  aliddell

  committed
  7da3130

• Update CHANGELOG and README.

  aliddell

  committed
  2c21e7d

• Merge remote-tracking branch 'upstream/main' into basic-zarr-v3

  aliddell

  committed
  33a2685

Commits on Sep 5, 2023

• Merge remote-tracking branch 'upstream/main' into basic-zarr-v3

  aliddell

  committed
  0f63fa9

Commits on Sep 7, 2023

• Make a ZarrV2 class. Move ZarrV2 and ZarrV3 into their own directories.

  aliddell

  committed
  f28f4d5

Commits on Sep 14, 2023

• Pull out bytes_of_type.

  aliddell

  committed
  869fff2

• wip

  aliddell

  committed
  2bbfb88

Commits on Sep 15, 2023

• wip

  aliddell

  committed
  8253bca

Commits on Sep 18, 2023

• wip

  aliddell

  committed
  5037d4a

• wip

  aliddell

  committed
  8343fad

• Merge remote-tracking branch 'upstream/main' into 76-sharding-in-zarr

  aliddell

  committed
  82438d0

• wip

  aliddell

  committed
  ecd0ae5

Commits on Sep 19, 2023

• wip

  aliddell

  committed
  95860c4

• wip

  aliddell

  committed
  940b04f

Commits on Sep 20, 2023

• wip

  aliddell

  committed
  ec0b57d

• Add crc32 libs on Windows.

  aliddell

  committed
  b167b11

• Add crc32 lib on OSX.

  aliddell

  committed
  a58f9f2

• Some updates.

  aliddell

  committed
  38d5bb1

• wip (broken)

  aliddell

  committed
  a6bef7d

• wip (maybe not broken)

  aliddell

  committed
  487e065

• wip (testing)

  aliddell

  committed
  6f58496

Commits on Sep 21, 2023

• remove crc32c

  aliddell

  committed
  1d5528d

• wip

  aliddell

  committed
  fcc8a53

• bugfixes

  aliddell

  committed
  593d51c

• use simulated empty for zarr v3 tests

  aliddell

  committed
  6b1b550

• wip

  aliddell

  committed
  73e42cf

• Multiscale (v2 only) working (but seems a bit slow).

  aliddell

  committed
  e5535c7

• Build on Mac

  aliddell

  committed
  c7224bd

• Some cleanup

  aliddell

  committed
  f6f46b5

• Merge branch '76-sharding-in-zarr' of github.com:aliddell/acquire-driver-zarr into 76-sharding-in-zarr

  aliddell

  committed
  5cf012a

• Do error heandling a la acquire-project#117.

  aliddell

  committed
  e3ac59a

• Update c-blosc to v1.21.5 for Windows and Mac. Add debug lib for c-blosc on Mac.

  aliddell

  committed
  bd64020

• Rename Zarr::compression_params_ to Zarr::blosc_compression_params_.

  aliddell

  committed
  2400daf

• Account for early-morning delirium.

  aliddell

  committed
  45429fb

Commits on Sep 22, 2023

• Merge remote-tracking branch 'upstream/main' into 76-sharding-in-zarr

  aliddell

  committed
  e950f06

Commits on Sep 25, 2023

• Merge branch 'main' into 76-sharding-in-zarr

  aliddell

  committed
  4af66a6

Commits on Sep 26, 2023

• Do some error setting in Zarr writer.

  aliddell

  committed
  9b6b07c

Commits on Sep 27, 2023

• Move thread pool back to Zarr object.

  aliddell

  committed
  14fc9fa

• Pull directory creation out of innermost loops.

  aliddell

  committed
  85c0eae

Commits on Sep 29, 2023

• Create files in threads.

  aliddell

  committed
  36791f7

Commits on Oct 2, 2023

• Merge remote-tracking branch 'upstream/main' into 76-sharding-in-zarr

  aliddell

  committed
  b3ce792

• remove do-nothing files

  aliddell

  committed
  edf6a64

• Reinstate time limit in write-zarr-with-defaults.cpp

  aliddell

  committed
  9f0e49f

Commits on Oct 19, 2023

• Merge remote-tracking branch 'upstream/main' into 76-sharding-in-zarr

  aliddell

  committed
  391d0f6