Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI runner running out of disk space for job with many incremental builds #52

Open
leojonathanoh opened this issue Sep 27, 2023 · 0 comments
Assignees
Labels
bug Something isn't working

Comments

@leojonathanoh
Copy link
Member

Bug

https://github.com/theohbrothers/docker-packer/actions/runs/6309620603/attempts/2

build-1-7-7-ubuntu-20-04
The job running on runner GitHub Actions 2 has exceeded the maximum execution time of 360 minutes.

build-1-7-7-ubuntu-20-04
Runner GitHub Actions 2 did not respond to a cancelation request with 00:05:00.

build-1-7-7-ubuntu-20-04
You are running out of disk space. The runner will stop working when the machine runs out of disk space. Free space left: 64 MB

df -h output of job:

                total        used        free      shared  buff/cache   available
Mem:         7088112      576932     5216364       22548     1294816     6170180
Swap:        4194300           0     4194300
Filesystem      Size  Used Avail Use% Mounted on
/dev/root        84G   65G   19G  78% /
tmpfs           3.4G  172K  3.4G   1% /dev/shm
tmpfs           1.4G  1.1M  1.4G   1% /run
tmpfs           5.0M     0  5.0M   0% /run/lock
/dev/sdb15      105M  6.1M   99M   6% /boot/efi
/dev/sda1        14G  4.1G  9.0G  31% /mnt
tmpfs           693M   12K  693M   1% /run/user/1001

Expectation

No error.

Discussion

Upon rerunning the job, it succeeded. df -h:

                total        used        free      shared  buff/cache   available
Mem:         7088120      585224     5207600       22008     1295296     6162548
Swap:        4194300           0     4194300
Filesystem      Size  Used Avail Use% Mounted on
/dev/root        84G   62G   22G  75% /
tmpfs           3.4G  172K  3.4G   1% /dev/shm
tmpfs           1.4G  1.1M  1.4G   1% /run
tmpfs           5.0M     0  5.0M   0% /run/lock
/dev/sda15      105M  6.1M   99M   6% /boot/efi
/dev/sdb1        14G  4.1G  9.0G  31% /mnt
tmpfs           693M   12K  693M   1% /run/user/1001

Hence it might be a random unfortunate circumstance where a runner had less disk space than most shared runners.

@leojonathanoh leojonathanoh added the bug Something isn't working label Sep 27, 2023
@leojonathanoh leojonathanoh self-assigned this Sep 27, 2023
@leojonathanoh leojonathanoh changed the title CI runner running out of disk space job with many incremental builds CI runner running out of disk space for job with many incremental builds Sep 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant