Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updates benchmarks for new S3 bucket/versions #1636

Open
wants to merge 11 commits into
base: master
Choose a base branch
from

Merge branch 'data_s3_updates' of https://github.com/brain-score/visi…

7516e89
Select commit
Loading
Failed to load commit list.
Open

Updates benchmarks for new S3 bucket/versions #1636

Merge branch 'data_s3_updates' of https://github.com/brain-score/visi…
7516e89
Select commit
Loading
Failed to load commit list.
Travis CI / Travis CI - Pull Request required action Dec 17, 2024 in 2h 0m 0s

Build Errored

The build errored. This is a change from the previous build, which passed.

Details

This is a pull request build.

It is running a build against the merge commit, after merging #1636 Updates benchmarks for new S3 bucket/versions.
Any changes that have been made to the master branch before the build ran are also included.

Jobs and Stages

This build has three jobs, running in two sequential stages.

Stage 1: test

This stage errored.

Job Python ENV OS State
7474.1 3.11 public 3.11 PYTEST_SETTINGS="not requires_gpu and not memory_intense and not slow and not travis_slow" Linux errored
7474.2 3.11 private 3.11 PYTEST_SETTINGS="not requires_gpu and not memory_intense and not slow and not travis_slow" Linux errored

Stage 2: Automerge check

This stage canceled.

Job Python ENV OS State
7474.3 3.11 PYTEST_SETTINGS="not requires_gpu and not memory_intense and not slow and not travis_slow" Linux canceled

Build Configuration

Build Option Setting
Language Python
Operating System Linux (Jammy)
Build Configuration
{
  "language": "python",
  "os": [
    "linux"
  ],
  "dist": "jammy",
  "version": "~> 1.0",
  "env": [
    "global={:PYTEST_SETTINGS=>\"\\\"not requires_gpu and not memory_intense and not slow and not travis_slow\\\"\"}={:DOMAIN=>\"\\\"vision\\\"\"}={:MODIFIES_PLUGIN=>\"\\\"False\\\"\"}={:PLUGIN_ONLY=>\"\\\"False\\\"\"}={:WEB_SUBMISSION=>\"\\\"False\\\"\"}"
  ],
  "before_install": [
    "pip install --upgrade pip",
    "pip install setuptools",
    "pip install pytest",
    "pip install awscli"
  ],
  "install": [
    "pip install --no-cache-dir torch torchvision --default-timeout=1000 --retries=5",
    "pip install --no-cache-dir -e \".[test]\"",
    "wget https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh -O miniconda.sh",
    "bash miniconda.sh -b -p $HOME/miniconda",
    "source \"$HOME/miniconda/etc/profile.d/conda.sh\"",
    "hash -r",
    "conda config --set always_yes yes --set changeps1 no",
    "conda update -q conda",
    "conda info -a",
    "pip list"
  ],
  "jobs": {
    "include": [
      {
        "name": "3.11 public",
        "python": "3.11"
      },
      {
        "name": "3.11 private",
        "if": "fork = false",
        "python": "3.11",
        "env": [
          {
            "PRIVATE_ACCESS": "1"
          },
          {
            "secure": "f1rWEwrslh7qa2g/QlKs001sGC3uaOxZNQSfNOPj+TMCqEo2c6OzImC4hyz+WqCyc6N/lFT4yYo2RhvaqStHMRmu/+9aZmuH05Bb0KQpfzNFA+yGa/U5WR3/4u6KRvDAeNEi9drT2LuacTyGbldmQsquujK0jrPpFWpe7zUUKv0zb0lJf0zcjeSrZlDXLlgD6DCqow7OqHRvW04dPZVy1OArRwtPV6DJ6Rqo1MqFQGHJ806VPlXhSoydb7a58dhGajqPjomdmZjhd3wS6Lv6uetTE/VVb4EP4e7n0qfZIx/TpnWG0SR44pcP7OCNARWYANsAivzxnQ0shyXnIzOo8ZcPYiPpt/5D53i5idTBxXyuDaHGQvgwuY5XLZzznEedBgZa4OvjxAXlLEQjdVDfSsZeYaV9gyFkeTlLnK1zvWi0US38eF2Qtm3Sx3D/5TtBKK2n38tyK5gg/XvJNycaXvIl7iVcnI2ifpqD1mUWI6C9j9Tk19/XEpWkwaFi91+0LZF1GhjBu8o3G5Np4RIOKXi3TIHkpbMM5mf11T6Bm9LvEMq1h8bgRQigEbeJF8CbUOSVFv+AaXsggGjQhuwdyvy2JZo+tO1nfhi+kW3XrDGPsz1R7Wfqduyn7UUh5OiFymeZwKseYKnwU47KyCqDwrq5Mnx1MlSidnVmPriadR4="
          },
          {
            "secure": "WE7FPwy07VzJTKAd2xwZdBhtmh8jk7ojwk4B2rIcBQu0vwUXc1MgO8tBLD7s08lBedBjqZiLZEW31uPMEyWNysouDt16a5gm2d149LR7flI3MOifBtxINfJuC3eOEG65bPgN/bYEsIpLKnu3469d5nxZkK7xsjbWTxHGoUpLvVPsmHY2ZM5/jftybs7fI0do4NMG2XffKfZbiFb447Ao3xeQeEfW6IkJllzgGnlG9FJATFidrbwDNdmzAnvPEnDoKAf7ZvhPV0x9yR5V6P4Ck5hxl8mlPdBa1cRMO8s/1ag1c7YJ3AF9ZlwcwqTiGsT8DHTVRxSz4nFHJTMlrm9j84u7WzLZJBhPgF0UeLN3AQgiAZ3c2TFDvjQWeHVuSPkV5GrKlfhSvR82s9yPEdHQxxwYymBbAr6rJR4NtXTyZX0vg8NRKHssZKLSafs/D/pt9xXspqu8HAHc+mS0lCips79XptSr5BEsioil3D2io3tbzrGugpTeJ7oEA787vKn2Cm4XmhyQ0UBhvwsPZ351l27wZYuNV07o9Ik83hN/w4o2v899QQ/zbX42Iy8ZUCWOPX7MV7+TA7SMxru3qx7HL5hDM8kTetxbLB6Ckr+JOdX8L2Fb5L3TVDpsvfv0ebXgwaQR/ez8/7bcXmBqcERApHDz73HaMXUap+iDR4FLdXE="
          },
          {
            "AWS_DEFAULT_REGION": "us-east-1"
          }
        ]
      },
      {
        "stage": "Automerge check",
        "python": "3.11",
        "install": [
          "pip install --no-cache-dir torch torchvision --default-timeout=1000 --retries=5",
          "pip install --no-cache-dir -e \".[test]\""
        ],
        "if": "type = pull_request",
        "script": [
          "CHANGED_FILES=$( git config remote.origin.fetch \"+refs/heads/*:refs/remotes/origin/*\" && git fetch && echo $(git diff --name-only origin/$TRAVIS_BRANCH...origin/$TRAVIS_PULL_REQUEST_BRANCH -C $TRAVIS_BUILD_DIR) | tr '\\n' ' ' ) &&\nPLUGIN_ONLY=$( python -c \"from brainscore_core.plugin_management.parse_plugin_changes import is_plugin_only; is_plugin_only(\\\"${CHANGED_FILES}\\\", \\\"brainscore_${DOMAIN}\\\")\" )\nif [ \"$PLUGIN_ONLY\" = \"True\" ] && [ \"$TRAVIS_SECURE_ENV_VARS\" = true ]; then\n  bash ${TRAVIS_BUILD_DIR}/.github/workflows/workflow_trigger.sh $GH_WORKFLOW_TRIGGER $TRAVIS_PULL_REQUEST_SHA \"Successful Travis PR build for plugin-only PR\" \"continuous-integration/travis\"; \nfi\n"
        ]
      }
    ]
  },
  "notifications": {
    "slack": [
]

},
"script": [
"echo 'travis_fold:start:configure'\nif [ ! -z "$TRAVIS_PULL_REQUEST_BRANCH" ]; then \n  CHANGED_FILES=$( git config remote.origin.fetch "+refs/heads/:refs/remotes/origin/" && git fetch && echo $(git diff --name-only origin/$TRAVIS_BRANCH...origin/$TRAVIS_PULL_REQUEST_BRANCH) | tr '\n' ' ' ) &&\n  TESTING_NEEDED=$( python -c "from brainscore_core.plugin_management.parse_plugin_changes import get_testing_info; get_testing_info(\"${CHANGED_FILES}\", \"brainscore_${DOMAIN}\")" ) && \n  read MODIFIES_PLUGIN PLUGIN_ONLY <<< $TESTING_NEEDED && echo MODIFIES_PLUGIN: $MODIFIES_PLUGIN && echo PLUGIN_ONLY: $PLUGIN_ONLY; \nfi\necho 'travis_fold:end:configure'\n",
"if [ "$MODIFIES_PLUGIN" = "True" ]; then \n  python -c "from brainscore_core.plugin_management.parse_plugin_changes import run_changed_plugin_tests; run_changed_plugin_tests(\"${CHANGED_FILES}\", \"brainscore_${DOMAIN}\")"; \nfi\n",
"if [ "$PRIVATE_ACCESS" = 1 ] && [ "$TRAVIS_SECURE_ENV_VARS" = true ] && [ "$PLUGIN_ONLY" = "False" ]; then \n  pytest -m "private_access and $PYTEST_SETTINGS"; \nfi\n",
"if [ "$PRIVATE_ACCESS" != 1 ] && [ "$PLUGIN_ONLY" = "False" ]; then \n  pytest -m "not private_access and $PYTEST_SETTINGS" --ignore "tests/test_submission"; \nfi"
],
"after_failure": [
"PR_TITLE=$(curl https://github.com/${TRAVIS_REPO_SLUG}/pull/${TRAVIS_PULL_REQUEST} 2> /dev/null | grep "title" | head -1)",
"if [[ "$PR_TITLE" == '<title>brain-score.org (user:' ]]; then \n  WEB_SUBMISSION="True"; \nfi\n",
"if [[ "$WEB_SUBMISSION" == "True" ]]; then\n  BS_UID="$(echo $PR_TITLE | sed -E 's/.\(user:([^)]+)\)./\1/')" && \n  python -c "from brainscore_$DOMAIN.submission.endpoints import send_email_to_submitter; send_email_to_submitter(\"${BS_UID}\", \"${$DOMAIN}\", \"${$TRAVIS_PULL_REQUEST}\", \"${$GMAIL_USERNAME}\", \"${GMAIL_PASSWORD}\")"; \nfi"
]
}