Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Changes to control model sparsity and MTSS improvements #331

Open
wants to merge 34 commits into
base: 1.7.0
Choose a base branch
from

Commits on May 7, 2024

  1. (1) Added code to DCNNModelWrapper to track absolute sum of 1st hidde…

    …n layer weights for each feature as it evolves
    
    over epochs, to see effect of setting weight decay parameters; (2) Added model parameters xgb_alpha and xgb_lambda
    and corresponding hyperopt parameters xgba and xgbb to control strength of L1 and L2 regularization penalties.
    mcloughlin2 committed May 7, 2024
    Configuration menu
    Copy the full SHA
    b73b98a View commit details
    Browse the repository at this point in the history

Commits on May 22, 2024

  1. Configuration menu
    Copy the full SHA
    46a70ae View commit details
    Browse the repository at this point in the history

Commits on May 31, 2024

  1. Added two new parameters, wdp and wdt, to allow hyperopt domain searc…

    …hing on weight_decay_penalty and
    
    weight_decay_penalty_type parameters. Completed implementation of hyperopt domain specification for
    xgb_alpha and xgb_lambda.
    mcloughlin2 committed May 31, 2024
    Configuration menu
    Copy the full SHA
    5d3c897 View commit details
    Browse the repository at this point in the history
  2. Added sparsity-related parameters weight_decay_penalty, weight_decay_…

    …penalty_type, xgb_alpha and xgb_lambda to set
    
    of model parameters displayed by the various compare_models functions.
    mcloughlin2 committed May 31, 2024
    Configuration menu
    Copy the full SHA
    512d8eb View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2024

  1. Fixed MTSS bug where population was not sorted by score after calling…

    … step(); changed order of operations so that grading
    
    happens at end of step() method rather than at beginning. Added serial_grade_population method for debugging. Simplified
    code to address some performance issues.
    mcloughlin2 committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    b84098a View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2024

  1. Changed to use single-threaded function to grade chromosomes, after s…

    …eeing that it runs much faster than
    
    the multithreaded version. Added documentation.
    mcloughlin2 committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    e4a5f62 View commit details
    Browse the repository at this point in the history
  2. Implemented a new fitness function to more robustly enforce dissimila…

    …rity between test and training
    
    set scaffold structures. Fixed a bug where the splitter always returned the split from the last
    generation rather than the best-ever split. Added code to track the individual fitness function terms
    over generations so that they can be displayed in diagnostic plots.
    mcloughlin2 committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    c524a7b View commit details
    Browse the repository at this point in the history

Commits on Jun 18, 2024

  1. Normalize fitness scores to the range [0,1]. Add the total fitness sc…

    …ore to the fitness_scores dictionary so that it can
    
    be plotted together with the component scores.
    mcloughlin2 committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    be48c58 View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2024

  1. Added early stopping to terminate GA if no fitness improvement after …

    …specified number of generations. Replaced print() calls
    
    with log messages so we can control verbosity of output. Changed split() to use log_every_n argument to control frequency
    of messages during GA operation.
    mcloughlin2 committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    da5a121 View commit details
    Browse the repository at this point in the history
  2. Implemented enhancement request from AMPL issue #318: Random forest a…

    …nd XGBoost classification models now support
    
    class balancing weights when weight_transform_type parameter is set to 'balancing'.
    mcloughlin2 committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    035d283 View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2024

  1. Configuration menu
    Copy the full SHA
    b31769e View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    03b8642 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    39dc2c1 View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2024

  1. Configuration menu
    Copy the full SHA
    8ea481a View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2024

  1. Configuration menu
    Copy the full SHA
    35a8180 View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2024

  1. Added initial version of function to draw line plot of NN feature wei…

    …ght absolute sums vs epoch,
    
    to assess effect of weight decay penalty.
    mcloughlin2 committed Jul 12, 2024
    Configuration menu
    Copy the full SHA
    bc43bb5 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    f6c7a44 View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2024

  1. (1) Added code to DCNNModelWrapper to track absolute sum of 1st hidde…

    …n layer weights for each feature as it evolves
    
    over epochs, to see effect of setting weight decay parameters; (2) Added model parameters xgb_alpha and xgb_lambda
    and corresponding hyperopt parameters xgba and xgbb to control strength of L1 and L2 regularization penalties.
    mcloughlin2 authored and mauvais2 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    48a53cb View commit details
    Browse the repository at this point in the history
  2. Added two new parameters, wdp and wdt, to allow hyperopt domain searc…

    …hing on weight_decay_penalty and
    
    weight_decay_penalty_type parameters. Completed implementation of hyperopt domain specification for
    xgb_alpha and xgb_lambda.
    mcloughlin2 authored and mauvais2 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    0f0eded View commit details
    Browse the repository at this point in the history
  3. Added sparsity-related parameters weight_decay_penalty, weight_decay_…

    …penalty_type, xgb_alpha and xgb_lambda to set
    
    of model parameters displayed by the various compare_models functions.
    mcloughlin2 authored and mauvais2 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    7b5e99d View commit details
    Browse the repository at this point in the history
  4. Fixed MTSS bug where population was not sorted by score after calling…

    … step(); changed order of operations so that grading
    
    happens at end of step() method rather than at beginning. Added serial_grade_population method for debugging. Simplified
    code to address some performance issues.
    mcloughlin2 authored and mauvais2 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    812e13f View commit details
    Browse the repository at this point in the history
  5. Changed to use single-threaded function to grade chromosomes, after s…

    …eeing that it runs much faster than
    
    the multithreaded version. Added documentation.
    mcloughlin2 authored and mauvais2 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    120c6a1 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    0741178 View commit details
    Browse the repository at this point in the history
  7. Implemented enhancement request from AMPL issue #318: Random forest a…

    …nd XGBoost classification models now support
    
    class balancing weights when weight_transform_type parameter is set to 'balancing'.
    mcloughlin2 authored and mauvais2 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    8d1e759 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    9297ffa View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    f6d220d View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    a431188 View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    2d91eb7 View commit details
    Browse the repository at this point in the history
  12. Added initial version of function to draw line plot of NN feature wei…

    …ght absolute sums vs epoch,
    
    to assess effect of weight decay penalty.
    mcloughlin2 authored and mauvais2 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    4f48c6d View commit details
    Browse the repository at this point in the history
  13. Removed old PRC plot function.

    mcloughlin2 authored and mauvais2 committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    c7f4938 View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    a266200 View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2024

  1. Configuration menu
    Copy the full SHA
    d9df1f2 View commit details
    Browse the repository at this point in the history

Commits on Jul 23, 2024

  1. Configuration menu
    Copy the full SHA
    e39fbd1 View commit details
    Browse the repository at this point in the history

Commits on Aug 5, 2024

  1. Configuration menu
    Copy the full SHA
    6196638 View commit details
    Browse the repository at this point in the history