-
Notifications
You must be signed in to change notification settings - Fork 80
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Update imagenet paths #1406
Merged
Merged
Update imagenet paths #1406
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…score/vision into sw/update_imagenet_c_path merge remote changes
KartikP
approved these changes
Oct 29, 2024
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I assume the 'ImageNet' csv file autogenerated and unlikely to contain manual errors. LGTM me otherwise.
KartikP
added a commit
that referenced
this pull request
Oct 31, 2024
* Allow region_layer_map json to be loaded into BrainModel during commitment (#1314) * Add load_region_layer_map_from_json * Cleaned up load_region_layer_map_json function and added error handling. * Replaced print with logging * Recommended fix: - logger - Path instead of OS - Avoid cwd * Recommended fix: - logger - Path instead of OS - Avoid cwd * Layer Mapping Orchestrator (build:114) (#1399) * Add region_layer_map directories with .gitkeep for models: resnet18_imagenet_full resnet34_imagenet_full resnet50_imagenet_full * Add resnet18_imagenet_full.json to region_layer_map for model resnet18_imagenet_full * Add resnet34_imagenet_full.json to region_layer_map for model resnet34_imagenet_full * Add resnet50_imagenet_full.json to region_layer_map for model resnet50_imagenet_full * Delete brainscore_vision/models/scaling_models/region_layer_map/.gitkeep --------- Co-authored-by: Jenkins <[email protected]> Co-authored-by: Kartik Pradeepan <[email protected]> * Add layer-mapping workflow to trigger Jenkins (#1361) * Create map_new_plugins workflow * Create map_new_plugins workflow * Change trigger and status checks (#1408) * Add label change as trigger (#1410) * Updating sha (#1412) * Debug map_new_plugins.yml (#1414) * Remove parsing of status/checks in loop (#1416) * Quote mismatch fix (#1418) Recommended by ChatGPT because I got tired of trying to deal with quotes * Update imagenet paths (#1406) * update stim path to mounted s3 bucket * update imagenet csv paths --------- Co-authored-by: Katherine Fairchild <[email protected]> Co-authored-by: Jenkins <[email protected]> Co-authored-by: Sam Winebrake <[email protected]>
KartikP
added a commit
that referenced
this pull request
Nov 5, 2024
* Allow region_layer_map json to be loaded into BrainModel during commitment (#1314) * Add load_region_layer_map_from_json * Cleaned up load_region_layer_map_json function and added error handling. * Replaced print with logging * Recommended fix: - logger - Path instead of OS - Avoid cwd * Recommended fix: - logger - Path instead of OS - Avoid cwd * Layer Mapping Orchestrator (build:114) (#1399) * Add region_layer_map directories with .gitkeep for models: resnet18_imagenet_full resnet34_imagenet_full resnet50_imagenet_full * Add resnet18_imagenet_full.json to region_layer_map for model resnet18_imagenet_full * Add resnet34_imagenet_full.json to region_layer_map for model resnet34_imagenet_full * Add resnet50_imagenet_full.json to region_layer_map for model resnet50_imagenet_full * Delete brainscore_vision/models/scaling_models/region_layer_map/.gitkeep --------- Co-authored-by: Jenkins <[email protected]> Co-authored-by: Kartik Pradeepan <[email protected]> * Add layer-mapping workflow to trigger Jenkins (#1361) * Create map_new_plugins workflow * Create map_new_plugins workflow * Change trigger and status checks (#1408) * Add label change as trigger (#1410) * Updating sha (#1412) * Debug map_new_plugins.yml (#1414) * Remove parsing of status/checks in loop (#1416) * Quote mismatch fix (#1418) Recommended by ChatGPT because I got tired of trying to deal with quotes * Update imagenet paths (#1406) * update stim path to mounted s3 bucket * update imagenet csv paths * Loosen map-new-plugins trigger (#1422) * Update auto merge workflow to require mapping (#1424) * Separate map_new_plugins into two jobs and allow re-run (#1426) * Remove set and use GitHub_output (#1428) * Update map_new_plugins.yml (#1430) * remove ' from benchmark id (#1432) * brain-score.org submission (user:538) | (public:False) (#1434) * Layer Mapping Orchestrator (build:115) (#1400) * Add region_layer_map directories with .gitkeep for models: resnet101_imagenet_full resnet152_imagenet_full resnet18_ecoset_full resnet34_ecoset_full resnet50_ecoset_full resnet101_ecoset_full resnet152_ecoset_full * Add resnet18_ecoset_full.json to region_layer_map for model resnet18_ecoset_full * Add resnet34_ecoset_full.json to region_layer_map for model resnet34_ecoset_full * Add resnet50_ecoset_full.json to region_layer_map for model resnet50_ecoset_full * Add resnet101_imagenet_full.json to region_layer_map for model resnet101_imagenet_full * Add resnet101_ecoset_full.json to region_layer_map for model resnet101_ecoset_full * Add resnet152_ecoset_full.json to region_layer_map for model resnet152_ecoset_full * Add efficientnet_b2_imagenet_full.json to region_layer_map for model efficientnet_b2_imagenet_full * Add efficientnet_b0_imagenet_full.json to region_layer_map for model efficientnet_b0_imagenet_full * Add resnet50_imagenet_1_seed-0.json to region_layer_map for model resnet50_imagenet_1_seed-0 * Add resnet50_imagenet_100_seed-0.json to region_layer_map for model resnet50_imagenet_100_seed-0 * Add resnet50_imagenet_10_seed-0.json to region_layer_map for model resnet50_imagenet_10_seed-0 * Add deit_small_imagenet_10_seed-0.json to region_layer_map for model deit_small_imagenet_10_seed-0 * Add deit_small_imagenet_100_seed-0.json to region_layer_map for model deit_small_imagenet_100_seed-0 * Add deit_small_imagenet_full_seed-0.json to region_layer_map for model deit_small_imagenet_full_seed-0 * Add deit_small_imagenet_1_seed-0.json to region_layer_map for model deit_small_imagenet_1_seed-0 * Add deit_base_imagenet_full_seed-0.json to region_layer_map for model deit_base_imagenet_full_seed-0 * Add convnext_small_imagenet_100_seed-0.json to region_layer_map for model convnext_small_imagenet_100_seed-0 * Add efficientnet_b1_imagenet_full.json to region_layer_map for model efficientnet_b1_imagenet_full * Add convnext_small_imagenet_1_seed-0.json to region_layer_map for model convnext_small_imagenet_1_seed-0 * Add convnext_small_imagenet_10_seed-0.json to region_layer_map for model convnext_small_imagenet_10_seed-0 * Add convnext_small_imagenet_full_seed-0.json to region_layer_map for model convnext_small_imagenet_full_seed-0 * Add convnext_base_imagenet_full_seed-0.json to region_layer_map for model convnext_base_imagenet_full_seed-0 * Add convnext_large_imagenet_full_seed-0.json to region_layer_map for model convnext_large_imagenet_full_seed-0 * Add deit_large_imagenet_full_seed-0.json to region_layer_map for model deit_large_imagenet_full_seed-0 * Delete brainscore_vision/models/scaling_models/region_layer_map/.gitkeep --------- Co-authored-by: Jenkins <[email protected]> Co-authored-by: Kartik Pradeepan <[email protected]> --------- Co-authored-by: Katherine Fairchild <[email protected]> Co-authored-by: Jenkins <[email protected]> Co-authored-by: Sam Winebrake <[email protected]>
KartikP
added a commit
that referenced
this pull request
Nov 6, 2024
* Allow region_layer_map json to be loaded into BrainModel during commitment (#1314) * Add load_region_layer_map_from_json * Cleaned up load_region_layer_map_json function and added error handling. * Replaced print with logging * Recommended fix: - logger - Path instead of OS - Avoid cwd * Recommended fix: - logger - Path instead of OS - Avoid cwd * Layer Mapping Orchestrator (build:114) (#1399) * Add region_layer_map directories with .gitkeep for models: resnet18_imagenet_full resnet34_imagenet_full resnet50_imagenet_full * Add resnet18_imagenet_full.json to region_layer_map for model resnet18_imagenet_full * Add resnet34_imagenet_full.json to region_layer_map for model resnet34_imagenet_full * Add resnet50_imagenet_full.json to region_layer_map for model resnet50_imagenet_full * Delete brainscore_vision/models/scaling_models/region_layer_map/.gitkeep --------- Co-authored-by: Jenkins <[email protected]> Co-authored-by: Kartik Pradeepan <[email protected]> * Add layer-mapping workflow to trigger Jenkins (#1361) * Create map_new_plugins workflow * Create map_new_plugins workflow * Change trigger and status checks (#1408) * Add label change as trigger (#1410) * Updating sha (#1412) * Debug map_new_plugins.yml (#1414) * Remove parsing of status/checks in loop (#1416) * Quote mismatch fix (#1418) Recommended by ChatGPT because I got tired of trying to deal with quotes * Update imagenet paths (#1406) * update stim path to mounted s3 bucket * update imagenet csv paths * Loosen map-new-plugins trigger (#1422) * Update auto merge workflow to require mapping (#1424) * Separate map_new_plugins into two jobs and allow re-run (#1426) * Remove set and use GitHub_output (#1428) * Update map_new_plugins.yml (#1430) * remove ' from benchmark id (#1432) * brain-score.org submission (user:538) | (public:False) (#1434) * Layer Mapping Orchestrator (build:115) (#1400) * Add region_layer_map directories with .gitkeep for models: resnet101_imagenet_full resnet152_imagenet_full resnet18_ecoset_full resnet34_ecoset_full resnet50_ecoset_full resnet101_ecoset_full resnet152_ecoset_full * Add resnet18_ecoset_full.json to region_layer_map for model resnet18_ecoset_full * Add resnet34_ecoset_full.json to region_layer_map for model resnet34_ecoset_full * Add resnet50_ecoset_full.json to region_layer_map for model resnet50_ecoset_full * Add resnet101_imagenet_full.json to region_layer_map for model resnet101_imagenet_full * Add resnet101_ecoset_full.json to region_layer_map for model resnet101_ecoset_full * Add resnet152_ecoset_full.json to region_layer_map for model resnet152_ecoset_full * Add efficientnet_b2_imagenet_full.json to region_layer_map for model efficientnet_b2_imagenet_full * Add efficientnet_b0_imagenet_full.json to region_layer_map for model efficientnet_b0_imagenet_full * Add resnet50_imagenet_1_seed-0.json to region_layer_map for model resnet50_imagenet_1_seed-0 * Add resnet50_imagenet_100_seed-0.json to region_layer_map for model resnet50_imagenet_100_seed-0 * Add resnet50_imagenet_10_seed-0.json to region_layer_map for model resnet50_imagenet_10_seed-0 * Add deit_small_imagenet_10_seed-0.json to region_layer_map for model deit_small_imagenet_10_seed-0 * Add deit_small_imagenet_100_seed-0.json to region_layer_map for model deit_small_imagenet_100_seed-0 * Add deit_small_imagenet_full_seed-0.json to region_layer_map for model deit_small_imagenet_full_seed-0 * Add deit_small_imagenet_1_seed-0.json to region_layer_map for model deit_small_imagenet_1_seed-0 * Add deit_base_imagenet_full_seed-0.json to region_layer_map for model deit_base_imagenet_full_seed-0 * Add convnext_small_imagenet_100_seed-0.json to region_layer_map for model convnext_small_imagenet_100_seed-0 * Add efficientnet_b1_imagenet_full.json to region_layer_map for model efficientnet_b1_imagenet_full * Add convnext_small_imagenet_1_seed-0.json to region_layer_map for model convnext_small_imagenet_1_seed-0 * Add convnext_small_imagenet_10_seed-0.json to region_layer_map for model convnext_small_imagenet_10_seed-0 * Add convnext_small_imagenet_full_seed-0.json to region_layer_map for model convnext_small_imagenet_full_seed-0 * Add convnext_base_imagenet_full_seed-0.json to region_layer_map for model convnext_base_imagenet_full_seed-0 * Add convnext_large_imagenet_full_seed-0.json to region_layer_map for model convnext_large_imagenet_full_seed-0 * Add deit_large_imagenet_full_seed-0.json to region_layer_map for model deit_large_imagenet_full_seed-0 * Delete brainscore_vision/models/scaling_models/region_layer_map/.gitkeep --------- Co-authored-by: Jenkins <[email protected]> Co-authored-by: Kartik Pradeepan <[email protected]> * Adding CvTs (#1436) * Added CvTs with identifiers and image sizes * Adds the bibtex references to new and existing CvTs * Fixed cvt_13 and cvt_21 init.py swaps * Removed CvT W24 change * Renamed model identifiers * Layer Mapping Orchestrator (build:126) (#1437) * Add region_layer_map directories with .gitkeep for models: cvt_cvt-13-224-in1k_4_LucyV4 cvt_cvt-13-384-in1k_4_LucyV4 cvt_cvt-13-384-in22k_finetuned-in1k_4_LucyV4 cvt_cvt-21-224-in1k_4_LucyV4 cvt_cvt-21-384-in1k_4_LucyV4 cvt_cvt-21-384-in22k_finetuned-in1k_4_LucyV4 * Add cvt_cvt-13-384-in22k_finetuned-in1k_4_LucyV4.json to region_layer_map for model cvt_cvt-13-384-in22k_finetuned-in1k_4_LucyV4 * Add cvt_cvt-13-224-in1k_4_LucyV4.json to region_layer_map for model cvt_cvt-13-224-in1k_4_LucyV4 * Add cvt_cvt-13-384-in1k_4_LucyV4.json to region_layer_map for model cvt_cvt-13-384-in1k_4_LucyV4 * Add cvt_cvt-21-224-in1k_4_LucyV4.json to region_layer_map for model cvt_cvt-21-224-in1k_4_LucyV4 * Add cvt_cvt-21-384-in1k_4_LucyV4.json to region_layer_map for model cvt_cvt-21-384-in1k_4_LucyV4 * Add cvt_cvt-21-384-in22k_finetuned-in1k_4_LucyV4.json to region_layer_map for model cvt_cvt-21-384-in22k_finetuned-in1k_4_LucyV4 * Delete brainscore_vision/models/cvt_cvt_13_384_in1k_4/region_layer_map/.gitkeep * Delete brainscore_vision/models/cvt_cvt_13_384_in22k_finetuned_in1k_4/region_layer_map/.gitkeep * Delete brainscore_vision/models/cvt_cvt_21_224_in1k_4/region_layer_map/.gitkeep * Delete brainscore_vision/models/cvt_cvt_21_384_in1k_4/region_layer_map/.gitkeep * Delete brainscore_vision/models/cvt_cvt_21_384_in22k_finetuned_in1k_4/region_layer_map/.gitkeep --------- Co-authored-by: Jenkins <[email protected]> Co-authored-by: KartikP <[email protected]> Co-authored-by: Kartik Pradeepan <[email protected]> --------- Co-authored-by: Katherine Fairchild <[email protected]> Co-authored-by: Jenkins <[email protected]> Co-authored-by: Sam Winebrake <[email protected]> Co-authored-by: LucyV4 <[email protected]> Co-authored-by: KartikP <[email protected]>
KartikP
added a commit
that referenced
this pull request
Nov 8, 2024
* Allow region_layer_map json to be loaded into BrainModel during commitment (#1314) * Add load_region_layer_map_from_json * Cleaned up load_region_layer_map_json function and added error handling. * Replaced print with logging * Recommended fix: - logger - Path instead of OS - Avoid cwd * Recommended fix: - logger - Path instead of OS - Avoid cwd * Layer Mapping Orchestrator (build:114) (#1399) * Add region_layer_map directories with .gitkeep for models: resnet18_imagenet_full resnet34_imagenet_full resnet50_imagenet_full * Add resnet18_imagenet_full.json to region_layer_map for model resnet18_imagenet_full * Add resnet34_imagenet_full.json to region_layer_map for model resnet34_imagenet_full * Add resnet50_imagenet_full.json to region_layer_map for model resnet50_imagenet_full * Delete brainscore_vision/models/scaling_models/region_layer_map/.gitkeep --------- Co-authored-by: Jenkins <[email protected]> Co-authored-by: Kartik Pradeepan <[email protected]> * Add layer-mapping workflow to trigger Jenkins (#1361) * Create map_new_plugins workflow * Create map_new_plugins workflow * Change trigger and status checks (#1408) * Add label change as trigger (#1410) * Updating sha (#1412) * Debug map_new_plugins.yml (#1414) * Remove parsing of status/checks in loop (#1416) * Quote mismatch fix (#1418) Recommended by ChatGPT because I got tired of trying to deal with quotes * Update imagenet paths (#1406) * update stim path to mounted s3 bucket * update imagenet csv paths * Loosen map-new-plugins trigger (#1422) * Update auto merge workflow to require mapping (#1424) * Separate map_new_plugins into two jobs and allow re-run (#1426) * Remove set and use GitHub_output (#1428) * Update map_new_plugins.yml (#1430) * remove ' from benchmark id (#1432) * brain-score.org submission (user:538) | (public:False) (#1434) * Layer Mapping Orchestrator (build:115) (#1400) * Add region_layer_map directories with .gitkeep for models: resnet101_imagenet_full resnet152_imagenet_full resnet18_ecoset_full resnet34_ecoset_full resnet50_ecoset_full resnet101_ecoset_full resnet152_ecoset_full * Add resnet18_ecoset_full.json to region_layer_map for model resnet18_ecoset_full * Add resnet34_ecoset_full.json to region_layer_map for model resnet34_ecoset_full * Add resnet50_ecoset_full.json to region_layer_map for model resnet50_ecoset_full * Add resnet101_imagenet_full.json to region_layer_map for model resnet101_imagenet_full * Add resnet101_ecoset_full.json to region_layer_map for model resnet101_ecoset_full * Add resnet152_ecoset_full.json to region_layer_map for model resnet152_ecoset_full * Add efficientnet_b2_imagenet_full.json to region_layer_map for model efficientnet_b2_imagenet_full * Add efficientnet_b0_imagenet_full.json to region_layer_map for model efficientnet_b0_imagenet_full * Add resnet50_imagenet_1_seed-0.json to region_layer_map for model resnet50_imagenet_1_seed-0 * Add resnet50_imagenet_100_seed-0.json to region_layer_map for model resnet50_imagenet_100_seed-0 * Add resnet50_imagenet_10_seed-0.json to region_layer_map for model resnet50_imagenet_10_seed-0 * Add deit_small_imagenet_10_seed-0.json to region_layer_map for model deit_small_imagenet_10_seed-0 * Add deit_small_imagenet_100_seed-0.json to region_layer_map for model deit_small_imagenet_100_seed-0 * Add deit_small_imagenet_full_seed-0.json to region_layer_map for model deit_small_imagenet_full_seed-0 * Add deit_small_imagenet_1_seed-0.json to region_layer_map for model deit_small_imagenet_1_seed-0 * Add deit_base_imagenet_full_seed-0.json to region_layer_map for model deit_base_imagenet_full_seed-0 * Add convnext_small_imagenet_100_seed-0.json to region_layer_map for model convnext_small_imagenet_100_seed-0 * Add efficientnet_b1_imagenet_full.json to region_layer_map for model efficientnet_b1_imagenet_full * Add convnext_small_imagenet_1_seed-0.json to region_layer_map for model convnext_small_imagenet_1_seed-0 * Add convnext_small_imagenet_10_seed-0.json to region_layer_map for model convnext_small_imagenet_10_seed-0 * Add convnext_small_imagenet_full_seed-0.json to region_layer_map for model convnext_small_imagenet_full_seed-0 * Add convnext_base_imagenet_full_seed-0.json to region_layer_map for model convnext_base_imagenet_full_seed-0 * Add convnext_large_imagenet_full_seed-0.json to region_layer_map for model convnext_large_imagenet_full_seed-0 * Add deit_large_imagenet_full_seed-0.json to region_layer_map for model deit_large_imagenet_full_seed-0 * Delete brainscore_vision/models/scaling_models/region_layer_map/.gitkeep --------- Co-authored-by: Jenkins <[email protected]> Co-authored-by: Kartik Pradeepan <[email protected]> * Adding CvTs (#1436) * Added CvTs with identifiers and image sizes * Adds the bibtex references to new and existing CvTs * Fixed cvt_13 and cvt_21 init.py swaps * Removed CvT W24 change * Renamed model identifiers * Layer Mapping Orchestrator (build:126) (#1437) * Add region_layer_map directories with .gitkeep for models: cvt_cvt-13-224-in1k_4_LucyV4 cvt_cvt-13-384-in1k_4_LucyV4 cvt_cvt-13-384-in22k_finetuned-in1k_4_LucyV4 cvt_cvt-21-224-in1k_4_LucyV4 cvt_cvt-21-384-in1k_4_LucyV4 cvt_cvt-21-384-in22k_finetuned-in1k_4_LucyV4 * Add cvt_cvt-13-384-in22k_finetuned-in1k_4_LucyV4.json to region_layer_map for model cvt_cvt-13-384-in22k_finetuned-in1k_4_LucyV4 * Add cvt_cvt-13-224-in1k_4_LucyV4.json to region_layer_map for model cvt_cvt-13-224-in1k_4_LucyV4 * Add cvt_cvt-13-384-in1k_4_LucyV4.json to region_layer_map for model cvt_cvt-13-384-in1k_4_LucyV4 * Add cvt_cvt-21-224-in1k_4_LucyV4.json to region_layer_map for model cvt_cvt-21-224-in1k_4_LucyV4 * Add cvt_cvt-21-384-in1k_4_LucyV4.json to region_layer_map for model cvt_cvt-21-384-in1k_4_LucyV4 * Add cvt_cvt-21-384-in22k_finetuned-in1k_4_LucyV4.json to region_layer_map for model cvt_cvt-21-384-in22k_finetuned-in1k_4_LucyV4 * Delete brainscore_vision/models/cvt_cvt_13_384_in1k_4/region_layer_map/.gitkeep * Delete brainscore_vision/models/cvt_cvt_13_384_in22k_finetuned_in1k_4/region_layer_map/.gitkeep * Delete brainscore_vision/models/cvt_cvt_21_224_in1k_4/region_layer_map/.gitkeep * Delete brainscore_vision/models/cvt_cvt_21_384_in1k_4/region_layer_map/.gitkeep * Delete brainscore_vision/models/cvt_cvt_21_384_in22k_finetuned_in1k_4/region_layer_map/.gitkeep --------- Co-authored-by: Jenkins <[email protected]> Co-authored-by: KartikP <[email protected]> Co-authored-by: Kartik Pradeepan <[email protected]> * Layer Mapping Orchestrator (build:127) (#1441) * Add region_layer_map directories with .gitkeep for models: alexnet * Add alexnet.json to region_layer_map for model alexnet --------- Co-authored-by: Jenkins <[email protected]> Co-authored-by: KartikP <[email protected]> --------- Co-authored-by: Katherine Fairchild <[email protected]> Co-authored-by: Jenkins <[email protected]> Co-authored-by: Sam Winebrake <[email protected]> Co-authored-by: LucyV4 <[email protected]> Co-authored-by: KartikP <[email protected]>
KartikP
added a commit
that referenced
this pull request
Nov 8, 2024
* Allow region_layer_map json to be loaded into BrainModel during commitment (#1314) * Add load_region_layer_map_from_json * Cleaned up load_region_layer_map_json function and added error handling. * Replaced print with logging * Recommended fix: - logger - Path instead of OS - Avoid cwd * Recommended fix: - logger - Path instead of OS - Avoid cwd * Layer Mapping Orchestrator (build:114) (#1399) * Add region_layer_map directories with .gitkeep for models: resnet18_imagenet_full resnet34_imagenet_full resnet50_imagenet_full * Add resnet18_imagenet_full.json to region_layer_map for model resnet18_imagenet_full * Add resnet34_imagenet_full.json to region_layer_map for model resnet34_imagenet_full * Add resnet50_imagenet_full.json to region_layer_map for model resnet50_imagenet_full * Delete brainscore_vision/models/scaling_models/region_layer_map/.gitkeep --------- Co-authored-by: Jenkins <[email protected]> Co-authored-by: Kartik Pradeepan <[email protected]> * Add layer-mapping workflow to trigger Jenkins (#1361) * Create map_new_plugins workflow * Create map_new_plugins workflow * Change trigger and status checks (#1408) * Add label change as trigger (#1410) * Updating sha (#1412) * Debug map_new_plugins.yml (#1414) * Remove parsing of status/checks in loop (#1416) * Quote mismatch fix (#1418) Recommended by ChatGPT because I got tired of trying to deal with quotes * Update imagenet paths (#1406) * update stim path to mounted s3 bucket * update imagenet csv paths * Loosen map-new-plugins trigger (#1422) * Update auto merge workflow to require mapping (#1424) * Separate map_new_plugins into two jobs and allow re-run (#1426) * Remove set and use GitHub_output (#1428) * Update map_new_plugins.yml (#1430) * remove ' from benchmark id (#1432) * brain-score.org submission (user:538) | (public:False) (#1434) * Layer Mapping Orchestrator (build:115) (#1400) * Add region_layer_map directories with .gitkeep for models: resnet101_imagenet_full resnet152_imagenet_full resnet18_ecoset_full resnet34_ecoset_full resnet50_ecoset_full resnet101_ecoset_full resnet152_ecoset_full * Add resnet18_ecoset_full.json to region_layer_map for model resnet18_ecoset_full * Add resnet34_ecoset_full.json to region_layer_map for model resnet34_ecoset_full * Add resnet50_ecoset_full.json to region_layer_map for model resnet50_ecoset_full * Add resnet101_imagenet_full.json to region_layer_map for model resnet101_imagenet_full * Add resnet101_ecoset_full.json to region_layer_map for model resnet101_ecoset_full * Add resnet152_ecoset_full.json to region_layer_map for model resnet152_ecoset_full * Add efficientnet_b2_imagenet_full.json to region_layer_map for model efficientnet_b2_imagenet_full * Add efficientnet_b0_imagenet_full.json to region_layer_map for model efficientnet_b0_imagenet_full * Add resnet50_imagenet_1_seed-0.json to region_layer_map for model resnet50_imagenet_1_seed-0 * Add resnet50_imagenet_100_seed-0.json to region_layer_map for model resnet50_imagenet_100_seed-0 * Add resnet50_imagenet_10_seed-0.json to region_layer_map for model resnet50_imagenet_10_seed-0 * Add deit_small_imagenet_10_seed-0.json to region_layer_map for model deit_small_imagenet_10_seed-0 * Add deit_small_imagenet_100_seed-0.json to region_layer_map for model deit_small_imagenet_100_seed-0 * Add deit_small_imagenet_full_seed-0.json to region_layer_map for model deit_small_imagenet_full_seed-0 * Add deit_small_imagenet_1_seed-0.json to region_layer_map for model deit_small_imagenet_1_seed-0 * Add deit_base_imagenet_full_seed-0.json to region_layer_map for model deit_base_imagenet_full_seed-0 * Add convnext_small_imagenet_100_seed-0.json to region_layer_map for model convnext_small_imagenet_100_seed-0 * Add efficientnet_b1_imagenet_full.json to region_layer_map for model efficientnet_b1_imagenet_full * Add convnext_small_imagenet_1_seed-0.json to region_layer_map for model convnext_small_imagenet_1_seed-0 * Add convnext_small_imagenet_10_seed-0.json to region_layer_map for model convnext_small_imagenet_10_seed-0 * Add convnext_small_imagenet_full_seed-0.json to region_layer_map for model convnext_small_imagenet_full_seed-0 * Add convnext_base_imagenet_full_seed-0.json to region_layer_map for model convnext_base_imagenet_full_seed-0 * Add convnext_large_imagenet_full_seed-0.json to region_layer_map for model convnext_large_imagenet_full_seed-0 * Add deit_large_imagenet_full_seed-0.json to region_layer_map for model deit_large_imagenet_full_seed-0 * Delete brainscore_vision/models/scaling_models/region_layer_map/.gitkeep --------- Co-authored-by: Jenkins <[email protected]> Co-authored-by: Kartik Pradeepan <[email protected]> * Adding CvTs (#1436) * Added CvTs with identifiers and image sizes * Adds the bibtex references to new and existing CvTs * Fixed cvt_13 and cvt_21 init.py swaps * Removed CvT W24 change * Renamed model identifiers * Layer Mapping Orchestrator (build:126) (#1437) * Add region_layer_map directories with .gitkeep for models: cvt_cvt-13-224-in1k_4_LucyV4 cvt_cvt-13-384-in1k_4_LucyV4 cvt_cvt-13-384-in22k_finetuned-in1k_4_LucyV4 cvt_cvt-21-224-in1k_4_LucyV4 cvt_cvt-21-384-in1k_4_LucyV4 cvt_cvt-21-384-in22k_finetuned-in1k_4_LucyV4 * Add cvt_cvt-13-384-in22k_finetuned-in1k_4_LucyV4.json to region_layer_map for model cvt_cvt-13-384-in22k_finetuned-in1k_4_LucyV4 * Add cvt_cvt-13-224-in1k_4_LucyV4.json to region_layer_map for model cvt_cvt-13-224-in1k_4_LucyV4 * Add cvt_cvt-13-384-in1k_4_LucyV4.json to region_layer_map for model cvt_cvt-13-384-in1k_4_LucyV4 * Add cvt_cvt-21-224-in1k_4_LucyV4.json to region_layer_map for model cvt_cvt-21-224-in1k_4_LucyV4 * Add cvt_cvt-21-384-in1k_4_LucyV4.json to region_layer_map for model cvt_cvt-21-384-in1k_4_LucyV4 * Add cvt_cvt-21-384-in22k_finetuned-in1k_4_LucyV4.json to region_layer_map for model cvt_cvt-21-384-in22k_finetuned-in1k_4_LucyV4 * Delete brainscore_vision/models/cvt_cvt_13_384_in1k_4/region_layer_map/.gitkeep * Delete brainscore_vision/models/cvt_cvt_13_384_in22k_finetuned_in1k_4/region_layer_map/.gitkeep * Delete brainscore_vision/models/cvt_cvt_21_224_in1k_4/region_layer_map/.gitkeep * Delete brainscore_vision/models/cvt_cvt_21_384_in1k_4/region_layer_map/.gitkeep * Delete brainscore_vision/models/cvt_cvt_21_384_in22k_finetuned_in1k_4/region_layer_map/.gitkeep --------- Co-authored-by: Jenkins <[email protected]> Co-authored-by: KartikP <[email protected]> Co-authored-by: Kartik Pradeepan <[email protected]> * Layer Mapping Orchestrator (build:127) (#1441) * Add region_layer_map directories with .gitkeep for models: alexnet * Add alexnet.json to region_layer_map for model alexnet --------- Co-authored-by: Jenkins <[email protected]> Co-authored-by: KartikP <[email protected]> * Layer Mapping Orchestrator (build:128) (#1443) * Add region_layer_map directories with .gitkeep for models: resnet50_tutorial * Add resnet50_tutorial.json to region_layer_map for model resnet50_tutorial --------- Co-authored-by: Jenkins <[email protected]> Co-authored-by: KartikP <[email protected]> --------- Co-authored-by: Katherine Fairchild <[email protected]> Co-authored-by: Jenkins <[email protected]> Co-authored-by: Sam Winebrake <[email protected]> Co-authored-by: LucyV4 <[email protected]> Co-authored-by: KartikP <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
The imagenet and imagenet_c benchmarks currently point to braintree stimuli directories. These stimuli have been moved over to s3 and mounted on the docker container that runs scoring.