Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: Snapshotter triggers segment snapshots #5287

Merged
merged 41 commits into from
Nov 14, 2023
Merged

feat: Snapshotter triggers segment snapshots #5287

merged 41 commits into from
Nov 14, 2023

Commits on Oct 31, 2023

  1. add snapshots_path to ChainPath

    @joshieDo
    joshieDo committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    eb00e6d View commit details
    Browse the repository at this point in the history

  2. move HighestSnapshots to primitives crate

    @joshieDo
    joshieDo committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    a8ef221 View commit details
    Browse the repository at this point in the history

  3. add with_highest_tracker to SnapshotProvider

    @joshieDo
    joshieDo committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    f1f32d7 View commit details
    Browse the repository at this point in the history

  4. add a shared snapshot provvider to providerfactory and dbprovider

    @joshieDo
    joshieDo committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    f5cadf8 View commit details
    Browse the repository at this point in the history

  5. add snapshot provider to shared blockchain_db

    @joshieDo
    joshieDo committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    1acd28f View commit details
    Browse the repository at this point in the history

  6. allow unused for now

    @joshieDo
    joshieDo committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    470a6b6 View commit details
    Browse the repository at this point in the history

  7. add get_highest_snapshot to SnapshotProvider

    @joshieDo
    joshieDo committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    113ef23 View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2023

  1. move hihgest snapshot channel inside snapshotter

    @joshieDo
    joshieDo committed Nov 2, 2023
    Configuration menu
    Copy the full SHA
    73fd00f View commit details
    Browse the repository at this point in the history

  2. add default receiver to snapshotter

    @joshieDo
    joshieDo committed Nov 2, 2023
    Configuration menu
    Copy the full SHA
    2fef51f View commit details
    Browse the repository at this point in the history

  3. replace with with_snapshot_provider on db provider

    @joshieDo
    joshieDo committed Nov 2, 2023
    Configuration menu
    Copy the full SHA
    33dc284 View commit details
    Browse the repository at this point in the history

Commits on Nov 3, 2023

  1. use strum for SnapshotSegment, compression and filters

    @joshieDo
    joshieDo committed Nov 3, 2023
    Configuration menu
    Copy the full SHA
    cda1ca7 View commit details
    Browse the repository at this point in the history

  2. snapshotter takes a directory and reads from it

    @joshieDo
    joshieDo committed Nov 3, 2023
    Configuration menu
    Copy the full SHA
    ec89704 View commit details
    Browse the repository at this point in the history

  3. default snapshot filename doesnt have configuration

    @joshieDo
    joshieDo committed Nov 3, 2023
    Configuration menu
    Copy the full SHA
    e87c64d View commit details
    Browse the repository at this point in the history

  4. create snapshots directory if it doesnt exist

    @joshieDo
    joshieDo committed Nov 3, 2023
    Configuration menu
    Copy the full SHA
    99c1fa5 View commit details
    Browse the repository at this point in the history

  5. add run_segment

    @joshieDo
    joshieDo committed Nov 3, 2023
    Configuration menu
    Copy the full SHA
    d4b5f61 View commit details
    Browse the repository at this point in the history

  6. add type SegmentConfig

    @joshieDo
    joshieDo committed Nov 3, 2023
    Configuration menu
    Copy the full SHA
    dd338e5 View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2023

  1. add docs for directory

    @joshieDo
    joshieDo committed Nov 8, 2023
    Configuration menu
    Copy the full SHA
    00ec5f5 View commit details
    Browse the repository at this point in the history

  2. replace PathBuf usage

    @joshieDo
    joshieDo committed Nov 8, 2023
    Configuration menu
    Copy the full SHA
    c1dd713 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/main' into joshie/db-snap-provider

    @joshieDo
    joshieDo committed Nov 8, 2023
    Configuration menu
    Copy the full SHA
    3be09cd View commit details
    Browse the repository at this point in the history

  4. Merge branch 'joshie/db-snap-provider' into joshie/db-snap-provider2

    @joshieDo
    joshieDo committed Nov 8, 2023
    Configuration menu
    Copy the full SHA
    96b255c View commit details
    Browse the repository at this point in the history

  5. Merge branch 'joshie/db-snap-provider2' into joshie/db-snap-provider3

    @joshieDo
    joshieDo committed Nov 8, 2023
    Configuration menu
    Copy the full SHA
    b281144 View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2023

  1. Update crates/snapshot/src/snapshotter.rs 

    Co-authored-by: Alexey Shekhirin <[email protected]>
    @joshieDo @shekhirin
    joshieDo and shekhirin authored Nov 13, 2023
    Configuration menu
    Copy the full SHA
    d0699f7 View commit details
    Browse the repository at this point in the history

  2. Update crates/snapshot/src/snapshotter.rs 

    Co-authored-by: Alexey Shekhirin <[email protected]>
    @joshieDo @shekhirin
    joshieDo and shekhirin authored Nov 13, 2023
    Configuration menu
    Copy the full SHA
    892b260 View commit details
    Browse the repository at this point in the history

  3. Update crates/storage/provider/src/providers/snapshot/manager.rs 

    Co-authored-by: Alexey Shekhirin <[email protected]>
    @joshieDo @shekhirin
    joshieDo and shekhirin authored Nov 13, 2023
    Configuration menu
    Copy the full SHA
    756d00b View commit details
    Browse the repository at this point in the history

  4. Update crates/primitives/src/snapshot/segment.rs 

    Co-authored-by: Alexey Shekhirin <[email protected]>
    @joshieDo @shekhirin
    joshieDo and shekhirin authored Nov 13, 2023
    Configuration menu
    Copy the full SHA
    5891d0a View commit details
    Browse the repository at this point in the history

  5. Update crates/snapshot/src/snapshotter.rs 

    Co-authored-by: Alexey Shekhirin <[email protected]>
    @joshieDo @shekhirin
    joshieDo and shekhirin authored Nov 13, 2023
    Configuration menu
    Copy the full SHA
    d2c21e9 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'joshie/db-snap-provider' into joshie/db-snap-provider2

    @joshieDo
    joshieDo committed Nov 13, 2023
    Configuration menu
    Copy the full SHA
    a11751f View commit details
    Browse the repository at this point in the history

  7. add fn block_range to snapshot cmd

    @joshieDo
    joshieDo committed Nov 13, 2023
    Configuration menu
    Copy the full SHA
    4574c68 View commit details
    Browse the repository at this point in the history

  8. add read_dir to primitives fs

    @joshieDo
    joshieDo committed Nov 13, 2023
    Configuration menu
    Copy the full SHA
    d47812a View commit details
    Browse the repository at this point in the history

  9. Merge branch 'joshie/db-snap-provider2' into joshie/db-snap-provider3

    @joshieDo
    joshieDo committed Nov 13, 2023
    Configuration menu
    Copy the full SHA
    e1dca84 View commit details
    Browse the repository at this point in the history

  10. trait Segment requires Default

    @joshieDo
    joshieDo committed Nov 13, 2023
    Configuration menu
    Copy the full SHA
    95e965a View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2023

  1. add reth_primitives::fs::rename

    @joshieDo
    joshieDo committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    7054744 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'joshie/db-snap-provider2' into joshie/db-snap-provider3

    @joshieDo
    joshieDo committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    a42ebaa View commit details
    Browse the repository at this point in the history

  3. use reth fs rename

    @joshieDo
    joshieDo committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    a865b59 View commit details
    Browse the repository at this point in the history

  4. clippy

    @joshieDo
    joshieDo committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    77094e5 View commit details
    Browse the repository at this point in the history

  5. Update crates/primitives/src/fs.rs 

    Co-authored-by: Matthias Seitz <[email protected]>
    @joshieDo @mattsse
    joshieDo and mattsse authored Nov 14, 2023
    Configuration menu
    Copy the full SHA
    622159b View commit details
    Browse the repository at this point in the history

  6. fmt

    @joshieDo
    joshieDo committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    975b47d View commit details
    Browse the repository at this point in the history

  7. Merge remote-tracking branch 'origin/main' into joshie/db-snap-provider2

    @joshieDo
    joshieDo committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    c9ee102 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'joshie/db-snap-provider2' into joshie/db-snap-provider3

    @joshieDo
    joshieDo committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    2bd3205 View commit details
    Browse the repository at this point in the history

  9. Merge remote-tracking branch 'origin/main' into joshie/db-snap-provider3

    @joshieDo
    joshieDo committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    bceba97 View commit details
    Browse the repository at this point in the history

  10. add missing imports

    @joshieDo
    joshieDo committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    986abfd View commit details
    Browse the repository at this point in the history