Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Kesque compaction (state prune) #8

Open
dcaoyuan opened this issue Sep 13, 2018 · 1 comment
Open

Kesque compaction (state prune) #8

dcaoyuan opened this issue Sep 13, 2018 · 1 comment
Labels
enhancement New feature or request
Milestone
0.2.0

Comments

@dcaoyuan
Copy link
Contributor

No description provided.

@dcaoyuan dcaoyuan added the enhancement New feature or request label Sep 13, 2018
@dcaoyuan dcaoyuan added this to the 0.2.0 milestone Sep 13, 2018
@dcaoyuan dcaoyuan changed the title Kesque compation Kesque compaction Sep 13, 2018
dcaoyuan added a commit that referenced this issue Jan 18, 2019
@dcaoyuan
Added KesqueCompactor. #8
97dfb22
dcaoyuan added a commit that referenced this issue Jan 18, 2019
@dcaoyuan
Compacting tables using storages of serviceBoard, bypassing cache. #8
63e1a7f
dcaoyuan added a commit that referenced this issue Mar 3, 2019
@dcaoyuan
HashKeyValueTable now read/write combination of snapshot (in file 0) …
615364e 
…and post-events (in file 1). #8
dcaoyuan added a commit that referenced this issue Mar 3, 2019
@dcaoyuan
Applied snap+post HashKeyValueTable on node kv storage (account/stora…
b8c8a5c 
…ge). #8
dcaoyuan added a commit that referenced this issue Mar 3, 2019
@dcaoyuan
Calculate fileno, offset by >>>, |, & bit operations. #8
23559b2
dcaoyuan added a commit that referenced this issue Mar 3, 2019
@dcaoyuan
Removed updatePost methods. #8
d19c5d1
dcaoyuan added a commit that referenced this issue Mar 24, 2019
@dcaoyuan
Removed updatePost methods. Cleanup. #8
deed43d
dcaoyuan added a commit that referenced this issue Mar 26, 2019
@dcaoyuan
Added offset to TVal/TKeyVal. #8
17608e0
dcaoyuan added a commit that referenced this issue Mar 26, 2019
@dcaoyuan
Added method HashKeyValueTable.removeIndexEntry. #8
aa2d558
dcaoyuan added a commit that referenced this issue Mar 26, 2019
@dcaoyuan
Try to get KesqueCompactor working properly. #8
1d772d8
dcaoyuan added a commit that referenced this issue Mar 26, 2019
@dcaoyuan
Avoid write multiple times for same key, got KesqueCompactor test pas…
7147bf1 
…sed. #8
dcaoyuan added a commit that referenced this issue Mar 28, 2019
@dcaoyuan
Added postAppend, gc methods for KesqueCompactor. #8
774bf71
dcaoyuan added a commit that referenced this issue Mar 28, 2019
@dcaoyuan
1. Check multipleValuesMap to see if the value could be moved to sing…
14dfe19 
…leValueMap

during removeValues etc. This will reduce the momery. KesqueCompactor.load() seems working now. #8
2. Only op on offset that > fromOffset during Kesque.readOnce
dcaoyuan added a commit that referenced this issue Mar 28, 2019
@dcaoyuan
Added Kesque.readBatch and applied on KesqueCompactor.postAppend. Com…
680c825 
…pactor seems working now. #8
dcaoyuan added a commit that referenced this issue Sep 21, 2019
@dcaoyuan
Use large fetch.max.bytes during post append. #8
c3e1152
dcaoyuan added a commit that referenced this issue Sep 21, 2019
@dcaoyuan
Key should be re-calculate via value for node data source. #8
803da16
@dcaoyuan
Copy link
Contributor Author

Also see ethereum/go-ethereum#18418

@dcaoyuan dcaoyuan changed the title Kesque compaction Kesque compaction (state prune) Sep 22, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
0.2.0
Development

No branches or pull requests
1 participant
@dcaoyuan