Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat!: adds support for gRPC streaming and removes dependency on RPC #3915

Merged

Conversation

rach-id
Copy link
Member

@rach-id rach-id commented Nov 4, 2024

The Celestia-node part of celestiaorg/celestia-core#1513

@rach-id rach-id self-assigned this Nov 4, 2024
@github-actions github-actions bot added the external Issues created by non node team members label Nov 4, 2024
@rach-id
Copy link
Member Author

rach-id commented Nov 4, 2024

PR still not fully ready, some tests are still failing. but would be good to get initial opinion + if someone can see if it's providing you with any performance increase

core/fetcher.go Show resolved Hide resolved
@rach-id rach-id marked this pull request as draft November 4, 2024 13:56
Comment on lines 79 to 84
fx.OnStart(func(_ context.Context, client core.Client) error {
return client.Start()
}),
fx.OnStop(func(_ context.Context, client core.Client) error {
return client.Stop()
}),
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[note for reviewers]
with the new implementation, the gRPC connection is started when creating the client instead of waiting until we call Start()

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes but we also need to close conn when node stops.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

go.mod Show resolved Hide resolved
go.mod Outdated
github.com/filecoin-project/dagstore => github.com/celestiaorg/dagstore v0.0.0-20230824094345-537c012aa403
github.com/gogo/protobuf => github.com/regen-network/protobuf v1.3.3-alpha.regen.1
// broken goleveldb needs to be replaced for the cosmos-sdk and celestia-app
github.com/syndtr/goleveldb => github.com/syndtr/goleveldb v1.0.1-0.20210819022825-2ae1ddf74ef7
github.com/tendermint/tendermint => github.com/celestiaorg/celestia-core v1.43.0-tm-v0.34.35
github.com/tendermint/tendermint => github.com/celestiaorg/celestia-core v1.43.0-tm-v0.34.35.0.20241104132041-3d2b32b7ddf2
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[note for reviewers]
will be updated once we merge the PRs and make release

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the same here

@codecov-commenter
Copy link

codecov-commenter commented Nov 5, 2024

Codecov Report

Attention: Patch coverage is 54.61847% with 113 lines in your changes missing coverage. Please review.

Project coverage is 45.34%. Comparing base (2469e7a) to head (b68c3f9).
Report is 400 commits behind head on main.

Files with missing lines Patch % Lines
core/fetcher.go 50.56% 59 Missing and 28 partials ⚠️
core/client.go 54.54% 13 Missing and 2 partials ⚠️
core/exchange.go 71.42% 2 Missing ⚠️
core/listener.go 50.00% 2 Missing ⚠️
nodebuilder/core/config.go 50.00% 2 Missing ⚠️
nodebuilder/core/constructors.go 0.00% 2 Missing ⚠️
nodebuilder/core/module.go 0.00% 2 Missing ⚠️
nodebuilder/core/opts.go 0.00% 1 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #3915      +/-   ##
==========================================
+ Coverage   44.83%   45.34%   +0.50%     
==========================================
  Files         265      308      +43     
  Lines       14620    22089    +7469     
==========================================
+ Hits         6555    10016    +3461     
- Misses       7313    10980    +3667     
- Partials      752     1093     +341     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@rach-id rach-id marked this pull request as ready for review November 5, 2024 09:36
core/fetcher.go Outdated Show resolved Hide resolved
core/fetcher.go Outdated Show resolved Hide resolved
Copy link
Contributor

@cristaloleg cristaloleg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM from me

core/fetcher.go Outdated Show resolved Hide resolved
core/fetcher.go Outdated Show resolved Hide resolved
@rach-id rach-id changed the base branch from main to feature_branch_grpc November 29, 2024 12:18
Copy link
Member

@renaynay renaynay left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you very much @rach-id this is great!

@renaynay renaynay merged commit 941dead into celestiaorg:feature_branch_grpc Nov 29, 2024
28 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
external Issues created by non node team members kind:break! Attached to breaking PRs kind:feat Attached to feature PRs
Projects
None yet
Development

Successfully merging this pull request may close these issues.

8 participants