Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

PathLike wrapper/cache for ExternalStorage #186

Open
wants to merge 64 commits into
base: main
Choose a base branch
from
Open

PathLike wrapper/cache for ExternalStorage #186

wants to merge 64 commits into from

Commits on Apr 26, 2023

  1. PathLike wrapper/cache for ExternalStorage

    @dwhswenson
    dwhswenson committed Apr 26, 2023
    Configuration menu
    Copy the full SHA
    ffdb901 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into shared-object-v2

    @dwhswenson
    dwhswenson authored Apr 26, 2023
    Configuration menu
    Copy the full SHA
    4ad7fb1 View commit details
    Browse the repository at this point in the history

  3. mypy

    @dwhswenson
    dwhswenson committed Apr 26, 2023
    Configuration menu
    Copy the full SHA
    eb19e0f View commit details
    Browse the repository at this point in the history

  4. Merge branch 'shared-object-v2' of github.com:OpenFreeEnergy/gufe int… 

    …o shared-object-v2
    @dwhswenson
    dwhswenson committed Apr 26, 2023
    Configuration menu
    Copy the full SHA
    8e6a78c View commit details
    Browse the repository at this point in the history

Commits on Apr 27, 2023

  1. docstrings

    @dwhswenson
    dwhswenson committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    3be13c0 View commit details
    Browse the repository at this point in the history

Commits on May 17, 2023

  1. Merge branch 'main' of github.com:OpenFreeEnergy/gufe into shared-obj… 

    …ect-v2
    @dwhswenson
    dwhswenson committed May 17, 2023
    Configuration menu
    Copy the full SHA
    dda02e2 View commit details
    Browse the repository at this point in the history

Commits on May 30, 2023

  1. Add StorageManager code

    @dwhswenson
    dwhswenson committed May 30, 2023
    Configuration menu
    Copy the full SHA
    472151e View commit details
    Browse the repository at this point in the history

  2. rename to Stagine

    @dwhswenson
    dwhswenson committed May 30, 2023
    Configuration menu
    Copy the full SHA
    b692c2f View commit details
    Browse the repository at this point in the history

  3. Add tests for _delete_empty_dirs

    @dwhswenson
    dwhswenson committed May 30, 2023
    Configuration menu
    Copy the full SHA
    7432ff4 View commit details
    Browse the repository at this point in the history

Commits on May 31, 2023

  1. Storage docs

    @dwhswenson
    dwhswenson committed May 31, 2023
    Configuration menu
    Copy the full SHA
    319d0d0 View commit details
    Browse the repository at this point in the history

  2. outline of storage manager tests

    @dwhswenson
    dwhswenson committed May 31, 2023
    Configuration menu
    Copy the full SHA
    5650609 View commit details
    Browse the repository at this point in the history

  3. minor improvements on staging directory

    @dwhswenson
    dwhswenson committed May 31, 2023
    Configuration menu
    Copy the full SHA
    ddbbd19 View commit details
    Browse the repository at this point in the history

  4. first storage lifecycle test works

    @dwhswenson
    dwhswenson committed May 31, 2023
    Configuration menu
    Copy the full SHA
    c5ce48a View commit details
    Browse the repository at this point in the history

  5. Merge branch 'main' of github.com:OpenFreeEnergy/gufe into shared-obj… 

    …ect-v2
    @dwhswenson
    dwhswenson committed May 31, 2023
    Configuration menu
    Copy the full SHA
    236b263 View commit details
    Browse the repository at this point in the history

  6. cleanup mypy

    @dwhswenson
    dwhswenson committed May 31, 2023
    Configuration menu
    Copy the full SHA
    b805aac View commit details
    Browse the repository at this point in the history

  7. change to unit taking in the label

    @dwhswenson
    dwhswenson committed May 31, 2023
    Configuration menu
    Copy the full SHA
    ed5e83c View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2023

  1. lots of updates; switched to harness for tests

    @dwhswenson
    dwhswenson committed Jun 5, 2023
    Configuration menu
    Copy the full SHA
    6181039 View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2023

  1. Big reorg for shared overlapping staging

    @dwhswenson
    dwhswenson committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    1880f73 View commit details
    Browse the repository at this point in the history

  2. remove _storage_path_conflict 

    Makes much more sense as _safe_to_delete_holding
    @dwhswenson
    dwhswenson committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    1e4ca2c View commit details
    Browse the repository at this point in the history

  3. docs & types

    @dwhswenson
    dwhswenson committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    a6d26f3 View commit details
    Browse the repository at this point in the history

  4. docs, types, logging

    @dwhswenson
    dwhswenson committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    aabbc33 View commit details
    Browse the repository at this point in the history

  5. finish TestHoldingOverlapsPermanentStorageManager

    @dwhswenson
    dwhswenson committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    b4d73b3 View commit details
    Browse the repository at this point in the history

  6. mypy

    @dwhswenson
    dwhswenson committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    7af006e View commit details
    Browse the repository at this point in the history

  7. test_repr

    @dwhswenson
    dwhswenson committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    58a58bc View commit details
    Browse the repository at this point in the history

  8. renaming around DAGContextManager

    @dwhswenson
    dwhswenson committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    8e429f5 View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2023

  1. holding => staging

    @dwhswenson
    dwhswenson committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    b70df48 View commit details
    Browse the repository at this point in the history

  2. finish docs (I think?)

    @dwhswenson
    dwhswenson committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    08e3ac2 View commit details
    Browse the repository at this point in the history

  3. remove completed TODO

    @dwhswenson
    dwhswenson committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    ca7871b View commit details
    Browse the repository at this point in the history

Commits on Jun 9, 2023

  1. start to testing edge case logging 

    right now, we seem to not be getting anything; see if this is
because someone has added a handler on the root logger or because
we can't caplog from a parent logger (may need specific __name__)
    @dwhswenson
    dwhswenson committed Jun 9, 2023
    Configuration menu
    Copy the full SHA
    2aa0616 View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2023

  1. Update stagingdirectory.py

    @richardjgowers
    richardjgowers authored Jun 12, 2023
    Configuration menu
    Copy the full SHA
    7c03dcd View commit details
    Browse the repository at this point in the history

  2. tests for single_file_transfer logging

    @dwhswenson
    dwhswenson committed Jun 12, 2023
    Configuration menu
    Copy the full SHA
    383075e View commit details
    Browse the repository at this point in the history

Commits on Jun 16, 2023

  1. tests for read-only transfers

    @dwhswenson
    dwhswenson committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    6365398 View commit details
    Browse the repository at this point in the history

  2. fix repr and cleanup tests

    @dwhswenson
    dwhswenson committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    d35bd60 View commit details
    Browse the repository at this point in the history

  3. test for permanent transfer to external

    @dwhswenson
    dwhswenson committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    7cc10f9 View commit details
    Browse the repository at this point in the history

Commits on Jun 17, 2023

  1. test for Permanent delete staging

    @dwhswenson
    dwhswenson committed Jun 17, 2023
    Configuration menu
    Copy the full SHA
    ab025f1 View commit details
    Browse the repository at this point in the history

  2. Add test for missing file on cleanup

    @dwhswenson
    dwhswenson committed Jun 17, 2023
    Configuration menu
    Copy the full SHA
    cd70ab2 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'shared-object-v2' of github.com:OpenFreeEnergy/gufe int… 

    …o shared-object-v2
    @dwhswenson
    dwhswenson committed Jun 17, 2023
    Configuration menu
    Copy the full SHA
    ac1b1d0 View commit details
    Browse the repository at this point in the history

Commits on Jun 22, 2023

  1. Merge branch 'main' of github.com:OpenFreeEnergy/gufe into shared-obj… 

    …ect-v2
    @dwhswenson
    dwhswenson committed Jun 22, 2023
    Configuration menu
    Copy the full SHA
    ea054be View commit details
    Browse the repository at this point in the history

  2. get_other_shared to private

    @dwhswenson
    dwhswenson committed Jun 22, 2023
    Configuration menu
    Copy the full SHA
    90f2597 View commit details
    Browse the repository at this point in the history

Commits on Jul 6, 2023

  1. Merge branch 'main' into shared-object-v2

    @dwhswenson
    dwhswenson authored Jul 6, 2023
    Configuration menu
    Copy the full SHA
    a2e05b2 View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2023

  1. Merge branch 'main' into shared-object-v2

    @dwhswenson
    dwhswenson authored Aug 28, 2023
    Configuration menu
    Copy the full SHA
    80eccc4 View commit details
    Browse the repository at this point in the history

Commits on Sep 8, 2023

  1. Merge branch 'main' of github.com:OpenFreeEnergy/gufe into shared-obj… 

    …ect-v2
    @dwhswenson
    dwhswenson committed Sep 8, 2023
    Configuration menu
    Copy the full SHA
    e9ed7a8 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into shared-object-v2

    @dotsdl
    dotsdl authored Sep 8, 2023
    Configuration menu
    Copy the full SHA
    b4e1d42 View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2023

  1. Merge branch 'shared-object-v2' of github.com:OpenFreeEnergy/gufe int… 

    …o shared-object-v2
    @dwhswenson
    dwhswenson committed Sep 9, 2023
    Configuration menu
    Copy the full SHA
    2b070ca View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2023

  1. Merge branch 'main' into shared-object-v2

    @dotsdl
    dotsdl authored Sep 12, 2023
    Configuration menu
    Copy the full SHA
    4fd4a66 View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2023

  1. Merge branch 'main' into shared-object-v2

    @dotsdl
    dotsdl authored Sep 19, 2023
    Configuration menu
    Copy the full SHA
    5e56461 View commit details
    Browse the repository at this point in the history

Commits on Nov 3, 2023

  1. Merge branch 'main' into shared-object-v2

    @dwhswenson
    dwhswenson authored Nov 3, 2023
    Configuration menu
    Copy the full SHA
    73d3a1e View commit details
    Browse the repository at this point in the history

Commits on Dec 1, 2023

  1. Merge branch 'main' of github.com:OpenFreeEnergy/gufe into shared-obj… 

    …ect-v2
    @dwhswenson
    dwhswenson committed Dec 1, 2023
    Configuration menu
    Copy the full SHA
    524cc6e View commit details
    Browse the repository at this point in the history

  2. updates from other branch

    @dwhswenson
    dwhswenson committed Dec 1, 2023
    Configuration menu
    Copy the full SHA
    dd1b6dc View commit details
    Browse the repository at this point in the history

  3. make mypy happy

    @dwhswenson
    dwhswenson committed Dec 1, 2023
    Configuration menu
    Copy the full SHA
    a575dd3 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into shared-object-v2

    @dwhswenson
    dwhswenson authored Dec 1, 2023
    Configuration menu
    Copy the full SHA
    ba6fcff View commit details
    Browse the repository at this point in the history

  5. pep8

    @dwhswenson
    dwhswenson committed Dec 1, 2023
    Configuration menu
    Copy the full SHA
    5d0df5f View commit details
    Browse the repository at this point in the history

  6. Merge branch 'shared-object-v2' of github.com:OpenFreeEnergy/gufe int… 

    …o shared-object-v2
    @dwhswenson
    dwhswenson committed Dec 1, 2023
    Configuration menu
    Copy the full SHA
    1418aee View commit details
    Browse the repository at this point in the history

  7. pep8

    @dwhswenson
    dwhswenson committed Dec 1, 2023
    Configuration menu
    Copy the full SHA
    e057332 View commit details
    Browse the repository at this point in the history

Commits on Dec 4, 2023

  1. StagingDirectory -> StagingRegistry 

    also, some docs cleanup/updates
    @dwhswenson
    dwhswenson committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    1cfe910 View commit details
    Browse the repository at this point in the history

Commits on Dec 7, 2023

  1. remove prefix; remove get_other_shared 

    This required a pretty significant rewrite of the code.
    @dwhswenson
    dwhswenson committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    78e003b View commit details
    Browse the repository at this point in the history

  2. delete_empty_dirs => keep_empty_dirs 

    Mainly matters for the StorageManager
    @dwhswenson
    dwhswenson committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    265e786 View commit details
    Browse the repository at this point in the history

Commits on Dec 11, 2023

  1. Merge branch 'main' into shared-object-v2

    @dwhswenson
    dwhswenson authored Dec 11, 2023
    Configuration menu
    Copy the full SHA
    006d787 View commit details
    Browse the repository at this point in the history

  2. Add logging to not clean up registered directory

    @dwhswenson
    dwhswenson committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    ce12326 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'shared-object-v2' of github.com:OpenFreeEnergy/gufe int… 

    …o shared-object-v2
    @dwhswenson
    dwhswenson committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    9afeb2f View commit details
    Browse the repository at this point in the history

Commits on Dec 13, 2023

  1. StagingPath.fspath => StagingPath.as_path() 

    Make a function that returns a pathlib.Path be the main thing, instead
of the property that returns a string.

Almost all usage of `.fspath` was to then wrap it in a pathlib.Path.
This is more convenient for users.
    @dwhswenson
    dwhswenson committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    aaa2aab View commit details
    Browse the repository at this point in the history

  2. pep8

    @dwhswenson
    dwhswenson committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    cf60d1b View commit details
    Browse the repository at this point in the history

Commits on Dec 22, 2023

  1. remove fspath from StagingRegistry 

    This is to avoid likely footguns related to using os.path.join. Includes
test of error on os.path.join.
    @dwhswenson
    dwhswenson committed Dec 22, 2023
    Configuration menu
    Copy the full SHA
    da9955e View commit details
    Browse the repository at this point in the history

Commits on Jan 22, 2024

  1. Merge branch 'main' into shared-object-v2

    @dwhswenson
    dwhswenson authored Jan 22, 2024
    Configuration menu
    Copy the full SHA
    8489c24 View commit details
    Browse the repository at this point in the history