Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Garbage Collecting past node contributions #683

Open
JulienVig opened this issue Jun 11, 2024 · 0 comments
Open

Garbage Collecting past node contributions #683

JulienVig opened this issue Jun 11, 2024 · 0 comments
Labels
decentralized For the decentralized setting discojs Related to Disco.js federated For the federated setting
Milestone

Comments

@JulienVig
Copy link
Collaborator

At every round, nodes receive weight updates from peers or the server which they store and/or aggregate to update their local model. Currently, weights from past rounds are kept indefinitely and accumulates over time. This is not prohibitive but is not efficient.

Specifically, in the federated case, the server results and the aggregated results are stored indefinitely

// client/federated.ts
const serverResult = await this.sendPayloadAndReceiveResult() // creates new tensors
// aggregator/mean.ts
this.aggregate() // creates new tensors
@JulienVig JulienVig added federated For the federated setting discojs Related to Disco.js decentralized For the decentralized setting labels Jun 11, 2024
@JulienVig JulienVig added this to the v4.0.0 milestone Jul 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
decentralized For the decentralized setting discojs Related to Disco.js federated For the federated setting
Projects
None yet
Development

No branches or pull requests

1 participant