Skip to content

v0.2.49: High level dataset api chunking (#184)

Compare
Choose a tag to compare
@rschwanhold rschwanhold released this 05 Mar 09:55
· 706 commits to master since this release
cd69fb7
* only log downsampling for each MB ob precessed data

* log every gigabyte instead of every megabyte

* implement PR feedback

* WIP: implement high level dataset api

* WIP: implement TiffMag

* implement test for dataset api

* refactor high level dataset api

* add test data for WKDataset

* improve high level dataset api and add more tests

* use seed in tests to achieve deterministic behaviour

* implement a test for writing out of bounds with a wk_slice

* add possibility to define pattern for TiffDatasets

* implement tiled tiff

* improve quality of dataset tests

* make naming schema of test files consistent

* implement PR feedback

* rename tiffs in testdata

* Improve error message and reformat code

* add type annotation

* rename Slice to View

* remove comments and reformat code

* add scikit-image (which is needed for skimage) as dependency

* update version of scikit-image

* fix relative paths in tests

* add possibility to get data of specific tile

* reformat code

* add test for png images

* reformat code

* make TiledTiffDataset a seperate class

* add support for opening datasets which do not have num_channels in properties.json

* add test for advanced pattern

* use more efficient method to detect tile_ranges

* rename file path of test case

* support largestSegmentationId in properties

* restructure properties

* add dataType attribute to properties

* WIP: implement chunking

* implement PR feedback

* remove comment

* fix relative paths

* fix writing data to an unopened dataset and support different orders of the dimensions with patterns

* Adjust docstring of method

Co-Authored-By: Philipp Otto <[email protected]>

* use type to call subclass constructor

* reformat code

* Support tiled tiffs in high level dataset API (#178)

* add possibility to define pattern for TiffDatasets

* implement tiled tiff

* add possibility to get data of specific tile

* add test for png images

* reformat code

* make TiledTiffDataset a seperate class

* add support for opening datasets which do not have num_channels in properties.json

* add test for advanced pattern

* use more efficient method to detect tile_ranges

* rename file path of test case

* support largestSegmentationId in properties

* restructure properties

* add dataType attribute to properties

* implement PR feedback

* fix writing data to an unopened dataset and support different orders of the dimensions with patterns

* Adjust docstring of method

Co-Authored-By: Philipp Otto <[email protected]>

Co-authored-by: Philipp Otto <[email protected]>

* implement get_view for a View; fix check_chunk_size for WKView

* reformat code

Co-authored-by: Philipp Otto <[email protected]>