Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Let users join federated training mid session #741

Merged
merged 98 commits into from
Sep 2, 2024
Merged

Let users join federated training mid session #741

merged 98 commits into from
Sep 2, 2024

Commits on Aug 14, 2024

  1. Fix merge conflicts

    @JulienVig
    JulienVig committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    eb5b533 View commit details
    Browse the repository at this point in the history

  2. Simplify isValidContribution flow

    @JulienVig
    JulienVig committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    17ec537 View commit details
    Browse the repository at this point in the history

  3. Enable server to send latest global model to stale participants

    @JulienVig
    JulienVig committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    dc43227 View commit details
    Browse the repository at this point in the history

  4. Make client rely on the aggregator's round rather than the trainer's … 

    …round
    @JulienVig
    JulienVig committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    7044836 View commit details
    Browse the repository at this point in the history

  5. Rm unused server logs

    @JulienVig
    JulienVig committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    dd162fd View commit details
    Browse the repository at this point in the history

  6. Prevent overflowing text for narrow screens

    @JulienVig
    JulienVig committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    b25bfc9 View commit details
    Browse the repository at this point in the history

  7. Enable multiple tries for clients to receive a server update

    @JulienVig
    JulienVig committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    6718fc9 View commit details
    Browse the repository at this point in the history

  8. Fix node ans browser ws API incompatibility

    @JulienVig
    JulienVig committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    67ecb81 View commit details
    Browse the repository at this point in the history

  9. Make client disconnect gracefully when leaving training session

    @JulienVig
    JulienVig committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    f87b60e View commit details
    Browse the repository at this point in the history

  10. Add a flag with min participant threshold when client connects to server

    @JulienVig
    JulienVig committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    3d1791a View commit details
    Browse the repository at this point in the history

  11. Refactor server router following Express conventions

    @JulienVig
    JulienVig committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    6f450c8 View commit details
    Browse the repository at this point in the history

  12. Rename 'feai' and 'deai' routes into 'federated' and 'decentralized'

    @JulienVig
    JulienVig committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    7d20de2 View commit details
    Browse the repository at this point in the history

  13. Split controller abstraction following MVC pattern

    @JulienVig
    JulienVig committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    f8f07ca View commit details
    Browse the repository at this point in the history

  14. Create one training controller per task rather than one for all tasks

    @JulienVig
    JulienVig committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    0a2f5b6 View commit details
    Browse the repository at this point in the history

  15. Add a space before DISCOllaboratives

    @JulienVig
    JulienVig committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    10088a8 View commit details
    Browse the repository at this point in the history

  16. Make info toaster less aggressive

    @JulienVig
    JulienVig committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    15c2730 View commit details
    Browse the repository at this point in the history

  17. Enable waiting for more participants when below a minimum number of c… 

    …lients
    @JulienVig
    JulienVig committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    fd554bd View commit details
    Browse the repository at this point in the history

  18. Rename Base class and files into FederatedClient and DecentralizedClient

    @JulienVig
    JulienVig committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    6fdf569 View commit details
    Browse the repository at this point in the history

  19. Rename Base abstract class into Client

    @JulienVig
    JulienVig committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    713ab20 View commit details
    Browse the repository at this point in the history

  20. Let client and trainer update the training status through the Logger … 

    …object
    @JulienVig
    JulienVig committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    e323bc9 View commit details
    Browse the repository at this point in the history

  21. Allow IconCard to grow with fill-space prop

    @JulienVig
    JulienVig committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    0800e97 View commit details
    Browse the repository at this point in the history

  22. Display training status while training

    @JulienVig
    JulienVig committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    67a561b View commit details
    Browse the repository at this point in the history

  23. Rename controller files

    @JulienVig
    JulienVig committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    f77f3eb View commit details
    Browse the repository at this point in the history

  24. Make client use MockLogger by default

    @JulienVig
    JulienVig committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    7af9cdc View commit details
    Browse the repository at this point in the history

  25. Update tests w new training buttons

    @JulienVig
    JulienVig committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    32081bb View commit details
    Browse the repository at this point in the history

  26. federated training now requires at least 2 users

    @JulienVig
    JulienVig committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    a86f7b8 View commit details
    Browse the repository at this point in the history

Commits on Aug 19, 2024

  1. Replace console by debug statements

    @JulienVig
    JulienVig committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    6c2d625 View commit details
    Browse the repository at this point in the history

  2. Update debug level

    @JulienVig
    JulienVig committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    aec8cc1 View commit details
    Browse the repository at this point in the history

  3. Add error context

    @JulienVig
    JulienVig committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    ad023cd View commit details
    Browse the repository at this point in the history

  4. Rm commented line

    @JulienVig
    JulienVig committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    b6e1709 View commit details
    Browse the repository at this point in the history

  5. simplify boolean prop

    @JulienVig
    JulienVig committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    c9ed1e8 View commit details
    Browse the repository at this point in the history

  6. Rm ClientDisconnected message logic

    @JulienVig
    JulienVig committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    788f6e4 View commit details
    Browse the repository at this point in the history

  7. Rm unused handle arguments

    @JulienVig
    JulienVig committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    aabd22b View commit details
    Browse the repository at this point in the history

  8. Make waitingForMoreParticipants a getter rather than an attribute

    @JulienVig
    JulienVig committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    a836481 View commit details
    Browse the repository at this point in the history

  9. Add more error info

    @JulienVig
    JulienVig committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    4fbcb0a View commit details
    Browse the repository at this point in the history

  10. Use trainingInformation minNbOfParticipant for both federated and dec… 

    …entralized
    @JulienVig
    JulienVig committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    26dd742 View commit details
    Browse the repository at this point in the history

  11. Use immutable map and minNbOfParticipant

    @JulienVig
    JulienVig committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    7f9d374 View commit details
    Browse the repository at this point in the history

  12. clean and inline code

    @JulienVig
    JulienVig committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    e29f7bc View commit details
    Browse the repository at this point in the history

  13. remove unnecessary process.nextTick

    @JulienVig
    JulienVig committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    6599b09 View commit details
    Browse the repository at this point in the history

  14. Clarify process.nextTick usage

    @JulienVig
    JulienVig committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    d4f8f43 View commit details
    Browse the repository at this point in the history

Commits on Aug 20, 2024

  1. Add "router" suffix to routes filenames

    @JulienVig
    JulienVig committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    11c35c1 View commit details
    Browse the repository at this point in the history

  2. Refactor TasksAndModels into TaskInitializer and add doc

    @JulienVig
    JulienVig committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    92b51a6 View commit details
    Browse the repository at this point in the history

  3. Add minNbOfParticipants field to trainingInformation

    @JulienVig
    JulienVig committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    c3e7082 View commit details
    Browse the repository at this point in the history

  4. Add comment for #718

    @JulienVig
    JulienVig committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    90e761a View commit details
    Browse the repository at this point in the history

  5. Simplify federated communication logic

    @JulienVig
    JulienVig committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    0f1f41a View commit details
    Browse the repository at this point in the history

  6. Rename MockLogger to DummyLogger

    @JulienVig
    JulienVig committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    65e9869 View commit details
    Browse the repository at this point in the history

  7. Add default value for fillSpace

    @JulienVig
    JulienVig committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    6a6cf8a View commit details
    Browse the repository at this point in the history

  8. Renaming Local to LocalClient

    @JulienVig
    JulienVig committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    b6c8c64 View commit details
    Browse the repository at this point in the history

  9. Make Disco and Client emit RoundStatus

    @JulienVig
    JulienVig committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    9569b42 View commit details
    Browse the repository at this point in the history

  10. Rm dummy logger

    @JulienVig
    JulienVig committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    fd92d19 View commit details
    Browse the repository at this point in the history

  11. Rm unused setStatus from logger

    @JulienVig
    JulienVig committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    a8a1c69 View commit details
    Browse the repository at this point in the history

  12. Add 'Retrieving peers information' round status to decentralized

    @JulienVig
    JulienVig committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    446777b View commit details
    Browse the repository at this point in the history

  13. Rename cleanupTrainingSessionFn to cleanupDisco

    @JulienVig
    JulienVig committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    08ea626 View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2024

  1. Keep models encoded rather than decoding them to re-encode them right… 

    … away
    @JulienVig
    JulienVig committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    cadb160 View commit details
    Browse the repository at this point in the history

  2. Export EncodedModel and EncodedWeights

    @JulienVig
    JulienVig committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    ad01291 View commit details
    Browse the repository at this point in the history

  3. Use EncodedModel import

    @JulienVig
    JulienVig committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    117c972 View commit details
    Browse the repository at this point in the history

  4. Simplify import

    @JulienVig
    JulienVig committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    4caa656 View commit details
    Browse the repository at this point in the history

  5. split NewNodeInfo between federated and decentralized to enable clien… 

    …t.connect to return latest model
    @JulienVig
    JulienVig committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    e4ba98e View commit details
    Browse the repository at this point in the history

  6. Rm initTask

    @JulienVig
    JulienVig committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    3ad5b2e View commit details
    Browse the repository at this point in the history

  7. send latest weight to clients joining task

    @JulienVig
    JulienVig committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    30c1314 View commit details
    Browse the repository at this point in the history

  8. overwrite working model with model fetched by client.connect

    @JulienVig
    JulienVig committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    192ef04 View commit details
    Browse the repository at this point in the history

  9. Use Disco constructor

    @JulienVig
    JulienVig committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    cd3902e View commit details
    Browse the repository at this point in the history

  10. simplify disco cleanup

    @JulienVig
    JulienVig committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    a4f2149 View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2024

  1. Fix round increment

    @JulienVig
    JulienVig committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    b08a93a View commit details
    Browse the repository at this point in the history

  2. Fix debug statement

    @JulienVig
    JulienVig committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    5e48c80 View commit details
    Browse the repository at this point in the history

  3. Improve debug statements

    @JulienVig
    JulienVig committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    6952bbe View commit details
    Browse the repository at this point in the history

  4. Merge with develop

    @JulienVig
    JulienVig committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    33959cb View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2024

  1. Expect client.connect to return the latest model

    @JulienVig
    JulienVig committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    0edbf04 View commit details
    Browse the repository at this point in the history

  2. clean code and add doc

    @JulienVig
    JulienVig committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    57fb179 View commit details
    Browse the repository at this point in the history

  3. Save server round and display waiting status immediately upon receiving

    @JulienVig
    JulienVig committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    fd3c0f0 View commit details
    Browse the repository at this point in the history

  4. Test client status emission

    @JulienVig
    JulienVig committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    1a7a514 View commit details
    Browse the repository at this point in the history

  5. Send nb of participants upon client connection

    @JulienVig
    JulienVig committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    c9c40c7 View commit details
    Browse the repository at this point in the history

  6. Clarify client event cycle

    @JulienVig
    JulienVig committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    10ae9fd View commit details
    Browse the repository at this point in the history

  7. Fix typo

    @JulienVig
    JulienVig committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    ad4c2b3 View commit details
    Browse the repository at this point in the history

  8. Fix disco object undefined during cleanup

    @JulienVig
    JulienVig committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    804ed49 View commit details
    Browse the repository at this point in the history

  9. increase beforeEach timeout

    @JulienVig
    JulienVig committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    a5a40a6 View commit details
    Browse the repository at this point in the history

  10. Increase wait time for status to update

    @JulienVig
    JulienVig committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    3b62c55 View commit details
    Browse the repository at this point in the history

  11. Increase wait time for status to update

    @JulienVig
    JulienVig committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    6a40184 View commit details
    Browse the repository at this point in the history

  12. Debug github action test

    @JulienVig
    JulienVig committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    f06dbae View commit details
    Browse the repository at this point in the history

  13. Show debug statements in github actions

    @JulienVig
    JulienVig committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    9d902ae View commit details
    Browse the repository at this point in the history

  14. debug github actions test

    @JulienVig
    JulienVig committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    5864334 View commit details
    Browse the repository at this point in the history

  15. Reject contribution when not enough participants

    @JulienVig
    JulienVig committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    44ce301 View commit details
    Browse the repository at this point in the history

  16. Decrease wait time for status update

    @JulienVig
    JulienVig committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    21314a3 View commit details
    Browse the repository at this point in the history

  17. Don't aggregate when below task minNbOfParticipants

    @JulienVig
    JulienVig committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    97b35c0 View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2024

  1. Rm verbose debug

    @JulienVig
    JulienVig committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    699645b View commit details
    Browse the repository at this point in the history

  2. Fix attribute increment

    @JulienVig
    JulienVig committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    b236578 View commit details
    Browse the repository at this point in the history

  3. Rm unused import

    @JulienVig
    JulienVig committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    94bfd7c View commit details
    Browse the repository at this point in the history

  4. Rm useless assertion

    @JulienVig
    JulienVig committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    a262b34 View commit details
    Browse the repository at this point in the history

  5. Clean chai expects

    @JulienVig
    JulienVig committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    25d9dfb View commit details
    Browse the repository at this point in the history

  6. make emit a private method

    @JulienVig
    JulienVig committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    f02df76 View commit details
    Browse the repository at this point in the history

  7. Expose a task getter

    @JulienVig
    JulienVig committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    9f926a8 View commit details
    Browse the repository at this point in the history

  8. Rely on task initializer set rather than duplicate it in router

    @JulienVig
    JulienVig committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    fac2708 View commit details
    Browse the repository at this point in the history

  9. Export EventEmitter

    @JulienVig
    JulienVig committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    03c989a View commit details
    Browse the repository at this point in the history

  10. Support async callbacks

    @JulienVig
    JulienVig committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    4285832 View commit details
    Browse the repository at this point in the history

  11. Rm Digest feature

    @JulienVig
    JulienVig committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    98f1df5 View commit details
    Browse the repository at this point in the history

  12. Fix event emitter callbacks

    @JulienVig
    JulienVig committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    954b6e1 View commit details
    Browse the repository at this point in the history

  13. Rm promise type callbacks

    @JulienVig
    JulienVig committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    6ea8dbf View commit details
    Browse the repository at this point in the history

  14. Prevent duplicate round increment

    @JulienVig
    JulienVig committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    e6f09e1 View commit details
    Browse the repository at this point in the history