Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

(feat): experimental read_backed method for zarr + hdf5 via read_dispatched #947

Closed
wants to merge 147 commits into from

Commits on Apr 29, 2022

  1. Configuration menu
    Copy the full SHA
    2f73576 View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2022

  1. Configuration menu
    Copy the full SHA
    df160f0 View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2022

  1. Configuration menu
    Copy the full SHA
    7983291 View commit details
    Browse the repository at this point in the history
  2. Fix sparse_to_dense

    ivirshup committed Nov 8, 2022
    Configuration menu
    Copy the full SHA
    a5e0311 View commit details
    Browse the repository at this point in the history

Commits on Feb 8, 2023

  1. Configuration menu
    Copy the full SHA
    b28448c View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    5e3cb02 View commit details
    Browse the repository at this point in the history

Commits on Mar 3, 2023

  1. Start write_dispatched

    ivirshup authored and ilan-gold committed Mar 3, 2023
    Configuration menu
    Copy the full SHA
    3ee693c View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    7e0825a View commit details
    Browse the repository at this point in the history
  3. (chore): rename

    ilan-gold committed Mar 3, 2023
    Configuration menu
    Copy the full SHA
    0b87230 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    f2de515 View commit details
    Browse the repository at this point in the history
  5. (fix): concatenation test

    ilan-gold committed Mar 3, 2023
    Configuration menu
    Copy the full SHA
    7bc0f76 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    7a12515 View commit details
    Browse the repository at this point in the history
  7. Start fixing error reporting

    To fix error reporting, I've put the attempt to catch an error during IO on top of the `read_elem` method.
    Since the decorator is sometimes used on functions, I modified it to be able to handle the signature of both a method and a function.
    
    What's weird is that sometimes the decorator is being passed the arguments of a method, that has a name like a method, but is a function.
    So that still needs to be fixed.
    ivirshup authored and ilan-gold committed Mar 3, 2023
    Configuration menu
    Copy the full SHA
    49e8069 View commit details
    Browse the repository at this point in the history
  8. Fixes after merge

    ivirshup authored and ilan-gold committed Mar 3, 2023
    Configuration menu
    Copy the full SHA
    c3a5e07 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    f22660d View commit details
    Browse the repository at this point in the history
  10. (wip): semi-working demo?

    ilan-gold committed Mar 3, 2023
    Configuration menu
    Copy the full SHA
    93b8778 View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    6d32d8e View commit details
    Browse the repository at this point in the history
  12. (chore): only use backed

    ilan-gold committed Mar 3, 2023
    Configuration menu
    Copy the full SHA
    3cf7036 View commit details
    Browse the repository at this point in the history
  13. Configuration menu
    Copy the full SHA
    d99dd56 View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    83aa3ab View commit details
    Browse the repository at this point in the history
  15. (chore): remove TODO

    ilan-gold committed Mar 3, 2023
    Configuration menu
    Copy the full SHA
    66c86fe View commit details
    Browse the repository at this point in the history
  16. (chore): write up to-do's

    ilan-gold committed Mar 3, 2023
    Configuration menu
    Copy the full SHA
    fca6fe5 View commit details
    Browse the repository at this point in the history
  17. (chore): add head method

    ilan-gold committed Mar 3, 2023
    Configuration menu
    Copy the full SHA
    2f31f91 View commit details
    Browse the repository at this point in the history
  18. Configuration menu
    Copy the full SHA
    2fad98e View commit details
    Browse the repository at this point in the history
  19. Configuration menu
    Copy the full SHA
    c07e71a View commit details
    Browse the repository at this point in the history
  20. [pre-commit.ci] auto fixes from pre-commit.com hooks

    for more information, see https://pre-commit.ci
    pre-commit-ci[bot] authored and ilan-gold committed Mar 3, 2023
    Configuration menu
    Copy the full SHA
    a785310 View commit details
    Browse the repository at this point in the history
  21. Configuration menu
    Copy the full SHA
    85a9006 View commit details
    Browse the repository at this point in the history
  22. (chore): remove todo

    ilan-gold committed Mar 3, 2023
    Configuration menu
    Copy the full SHA
    568241a View commit details
    Browse the repository at this point in the history
  23. Configuration menu
    Copy the full SHA
    a5bd7dc View commit details
    Browse the repository at this point in the history
  24. Configuration menu
    Copy the full SHA
    c1b090c View commit details
    Browse the repository at this point in the history
  25. (chore): more cleanup

    ilan-gold committed Mar 3, 2023
    Configuration menu
    Copy the full SHA
    ef3dd22 View commit details
    Browse the repository at this point in the history
  26. Configuration menu
    Copy the full SHA
    3b9b838 View commit details
    Browse the repository at this point in the history
  27. Configuration menu
    Copy the full SHA
    1827e26 View commit details
    Browse the repository at this point in the history
  28. Configuration menu
    Copy the full SHA
    4c5dcbe View commit details
    Browse the repository at this point in the history
  29. (fix): correct imports

    ilan-gold committed Mar 3, 2023
    Configuration menu
    Copy the full SHA
    009a426 View commit details
    Browse the repository at this point in the history
  30. Configuration menu
    Copy the full SHA
    289447e View commit details
    Browse the repository at this point in the history

Commits on Mar 7, 2023

  1. Configuration menu
    Copy the full SHA
    796839f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    f2f4aca View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    e8f654b View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    63aabc5 View commit details
    Browse the repository at this point in the history

Commits on Mar 8, 2023

  1. Configuration menu
    Copy the full SHA
    5776095 View commit details
    Browse the repository at this point in the history
  2. (fix): check _X for backed

    ilan-gold committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    87cf635 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    c50d9de View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    e384a19 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    4120ed3 View commit details
    Browse the repository at this point in the history

Commits on Mar 9, 2023

  1. Configuration menu
    Copy the full SHA
    6d13c82 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    3773551 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    7c38b30 View commit details
    Browse the repository at this point in the history
  4. (feat): begin unit tests

    ilan-gold committed Mar 9, 2023
    Configuration menu
    Copy the full SHA
    515a6d2 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    f4f5c7c View commit details
    Browse the repository at this point in the history

Commits on Mar 16, 2023

  1. (feat): swap out zarr categorical array for xarray (#946)

    * (feat): swap out `zarr` categorical array for `xarray`
    
    * (chore): siimplify `to_df`
    
    * (chore): add xarray dep
    
    * (fix): don't add `index` to df twice
    
    * (chore): add `LazyCategoricalArray` test
    
    * (feat): add full array `__eq__`
    
    * [pre-commit.ci] auto fixes from pre-commit.com hooks
    
    for more information, see https://pre-commit.ci
    
    * (chore): split tests
    
    * (chore): fully remove unused variables
    
    * (chore): remove auto-generated typing
    
    * (chore): return reading in categories at __init__
    
    * (fix): use `any` not `some`
    
    * (feat): add cache workaround
    
    * [pre-commit.ci] auto fixes from pre-commit.com hooks
    
    for more information, see https://pre-commit.ci
    
    ---------
    
    Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
    ilan-gold and pre-commit-ci[bot] authored Mar 16, 2023
    Configuration menu
    Copy the full SHA
    60fae25 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    1582864 View commit details
    Browse the repository at this point in the history

Commits on Mar 20, 2023

  1. Configuration menu
    Copy the full SHA
    943a4f6 View commit details
    Browse the repository at this point in the history

Commits on Mar 21, 2023

  1. (fix): implement __ne__

    ilan-gold committed Mar 21, 2023
    Configuration menu
    Copy the full SHA
    7d2d39f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    7988c4b View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    70165bb View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    5f19a37 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    d159805 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    ff2fdfa View commit details
    Browse the repository at this point in the history
  7. (fix): revert backed test

    ilan-gold committed Mar 21, 2023
    Configuration menu
    Copy the full SHA
    01089fc View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    e038314 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    28f0218 View commit details
    Browse the repository at this point in the history

Commits on Mar 23, 2023

  1. Configuration menu
    Copy the full SHA
    c552a73 View commit details
    Browse the repository at this point in the history

Commits on Mar 28, 2023

  1. Configuration menu
    Copy the full SHA
    58964c3 View commit details
    Browse the repository at this point in the history

Commits on Mar 29, 2023

  1. Configuration menu
    Copy the full SHA
    8ecc510 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    1e919e4 View commit details
    Browse the repository at this point in the history

Commits on Mar 30, 2023

  1. Configuration menu
    Copy the full SHA
    03757e4 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    fef1e38 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    30cf049 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    6e592b3 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    c110b3b View commit details
    Browse the repository at this point in the history
  6. (feat): add support for raw

    ilan-gold committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    c50e4f6 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    95f2e3f View commit details
    Browse the repository at this point in the history
  8. (feat): add some checks.

    ilan-gold committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    0e45fa6 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    27849c5 View commit details
    Browse the repository at this point in the history
  10. (feat): add indptr caching

    ilan-gold committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    cec72bc View commit details
    Browse the repository at this point in the history
  11. Merge branch 'ig/read_remote_dispatched' of github.com:scverse/anndat…

    …a into ig/read_remote_dispatched
    ilan-gold committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    de5b81f View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2023

  1. Configuration menu
    Copy the full SHA
    ff20982 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    8d315be View commit details
    Browse the repository at this point in the history
  3. (fix): clean categories

    ilan-gold committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    772b968 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    53b28a8 View commit details
    Browse the repository at this point in the history
  5. (chore): tests

    ilan-gold committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    cc76538 View commit details
    Browse the repository at this point in the history

Commits on May 4, 2023

  1. Configuration menu
    Copy the full SHA
    e338ce1 View commit details
    Browse the repository at this point in the history
  2. (feat): finish all dtypes

    ilan-gold committed May 4, 2023
    Configuration menu
    Copy the full SHA
    8233496 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    05423c3 View commit details
    Browse the repository at this point in the history

Commits on May 5, 2023

  1. Configuration menu
    Copy the full SHA
    1f592b1 View commit details
    Browse the repository at this point in the history
  2. Merge branch 'ig/read_remote_dispatched' of github.com:scverse/anndat…

    …a into ig/read_remote_dispatched
    ilan-gold committed May 5, 2023
    Configuration menu
    Copy the full SHA
    9e07da2 View commit details
    Browse the repository at this point in the history

Commits on May 8, 2023

  1. Configuration menu
    Copy the full SHA
    a22be07 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    70b4bfa View commit details
    Browse the repository at this point in the history

Commits on May 9, 2023

  1. (feat): reorganize dirs

    ilan-gold committed May 9, 2023
    Configuration menu
    Copy the full SHA
    65a0bc2 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    1c03335 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    dc107ad View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    7aae638 View commit details
    Browse the repository at this point in the history
  5. (fix): fix layers support

    ilan-gold committed May 9, 2023
    Configuration menu
    Copy the full SHA
    dfa6f52 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    d856f9b View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    57b87a2 View commit details
    Browse the repository at this point in the history

Commits on May 10, 2023

  1. Configuration menu
    Copy the full SHA
    6ca0003 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    0b2ae47 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    0533748 View commit details
    Browse the repository at this point in the history
  4. Merge branch 'ig/read_remote_dispatched' of github.com:scverse/anndat…

    …a into ig/read_remote_dispatched
    ilan-gold committed May 10, 2023
    Configuration menu
    Copy the full SHA
    5e8f7cc View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    d0cdcd6 View commit details
    Browse the repository at this point in the history

Commits on May 16, 2023

  1. Configuration menu
    Copy the full SHA
    d7e61d8 View commit details
    Browse the repository at this point in the history

Commits on May 19, 2023

  1. Configuration menu
    Copy the full SHA
    f212e30 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    a52d494 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    e3dcec8 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    a418313 View commit details
    Browse the repository at this point in the history

Commits on May 24, 2023

  1. Configuration menu
    Copy the full SHA
    800f688 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    8ef6aea View commit details
    Browse the repository at this point in the history

Commits on May 25, 2023

  1. Configuration menu
    Copy the full SHA
    944503e View commit details
    Browse the repository at this point in the history
  2. Merge branch 'ig/read_remote_dispatched' of github.com:scverse/anndat…

    …a into ig/read_remote_dispatched
    ilan-gold committed May 25, 2023
    Configuration menu
    Copy the full SHA
    e1d7388 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    15bbf78 View commit details
    Browse the repository at this point in the history

Commits on May 26, 2023

  1. Configuration menu
    Copy the full SHA
    db2a3ef View commit details
    Browse the repository at this point in the history
  2. Merge branch 'ig/read_remote_dispatched' of github.com:scverse/anndat…

    …a into ig/read_remote_dispatched
    ilan-gold committed May 26, 2023
    Configuration menu
    Copy the full SHA
    e4ffa0f View commit details
    Browse the repository at this point in the history

Commits on May 31, 2023

  1. Configuration menu
    Copy the full SHA
    e93306c View commit details
    Browse the repository at this point in the history

Commits on Jun 1, 2023

  1. Configuration menu
    Copy the full SHA
    c9de21d View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    7c911a8 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    4118928 View commit details
    Browse the repository at this point in the history
  4. (fix): legacy backed mode

    ilan-gold committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    5cedb9a View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    627be81 View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2023

  1. Configuration menu
    Copy the full SHA
    1e190f4 View commit details
    Browse the repository at this point in the history
  2. (fix): remove all

    ilan-gold committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    b330443 View commit details
    Browse the repository at this point in the history
  3. Merge branch 'ig/read_remote_dispatched' of github.com:scverse/anndat…

    …a into ig/read_remote_dispatched
    ilan-gold committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    74e71d0 View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2023

  1. (chore): add docstrings

    ilan-gold committed Jun 14, 2023
    Configuration menu
    Copy the full SHA
    64f178d View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    379c022 View commit details
    Browse the repository at this point in the history
  3. (fix): h5py support

    ilan-gold committed Jun 14, 2023
    Configuration menu
    Copy the full SHA
    716162d View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2023

  1. Configuration menu
    Copy the full SHA
    bdb93a2 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    f78a59b View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2023

  1. Configuration menu
    Copy the full SHA
    bc28910 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    f3b7bb3 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    c64c7e6 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    853cc0b View commit details
    Browse the repository at this point in the history

Commits on Jul 30, 2023

  1. Configuration menu
    Copy the full SHA
    703812c View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    8ce994b View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    e480700 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    cee7f6d View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2023

  1. Configuration menu
    Copy the full SHA
    b41a9a5 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    6fe7016 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    c3f6935 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    deced7c View commit details
    Browse the repository at this point in the history

Commits on Aug 8, 2023

  1. Configuration menu
    Copy the full SHA
    8617bd1 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    48a134b View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    2806a9f View commit details
    Browse the repository at this point in the history
  4. Merge branch 'ig/read_remote_dispatched' of github.com:scverse/anndat…

    …a into ig/read_remote_dispatched
    ilan-gold committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    e35603a View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    516f984 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    60b0ae6 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    9d53307 View commit details
    Browse the repository at this point in the history

Commits on Oct 10, 2023

  1. Configuration menu
    Copy the full SHA
    3a428f4 View commit details
    Browse the repository at this point in the history