Install stuck for hours with 100% CPU usage

[polybluez]

When using nixos-anywhere to install, at one point the installation process gets stuck, VPS becomes highly unresponsive and CPU usage goes to the moon. I've tried to wait, but it doesn't seem to move further:

...
+ NIX_SSHOPTS='-o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -i /tmp/tmp.qIO9P4mhPY/nixos-anywhere '
+ nix copy --extra-experimental-features 'nix-command flakes' --no-write-lock-file -L --substitute-on-destination --to ssh://root@'*IP* /nix/store/00qm7gfcnb2r5z9n4qsk4ia2ivwcyngv-disko
warning: ignoring the client-specified setting 'trusted-public-keys', because it is a restricted setting and you are not a trusted user
Warning: Permanently added '*IP*' (ED25519) to the list of known hosts.
running auto-GC to free 2638921728 bytes
finding garbage collector roots...
copying path '/nix/store/if0c6a888a1ayn6h3pfa2nhy820vvzd5-dns-root-data-2024-06-20' from 'https://cache.nixos.org'...
copying path '/nix/store/q0iz2x35ki1aaqpjagjfi8s7q053cmc5-gcc-13.3.0-libgcc' from 'https://cache.nixos.org'...
copying path '/nix/store/7sy12xv4fwii421d920jxqx63c0ai3w3-jq-1.7.1' from 'https://cache.nixos.org'...
copying path '/nix/store/yfc9bsy7n9k66238s3cy7vw3cw1l1ap8-jq-1.7.1-doc' from 'https://cache.nixos.org'...
copying path '/nix/store/0jpj9xq83imjwhldsrmiyn8pp8wjazp5-jq-1.7.1-man' from 'https://cache.nixos.org'...
copying path '/nix/store/lw2macnzp3av47m41qv6vcnq2daibgl1-libunistring-1.2' from 'https://cache.nixos.org'...
copying path '/nix/store/6x7hirhpv7lpiaqg8dr72v284y84h2bv-liburing-2.7' from 'https://cache.nixos.org'...
copying path '/nix/store/3zrkasqf3sqr9ff6sv5fddhlbf072a36-mailcap-2.1.54' from 'https://cache.nixos.org'...
copying path '/nix/store/6fpgsfaxyqhs4cvc392744bqcz3ndn5i-publicsuffix-list-0-unstable-2024-08-21' from 'https://cache.nixos.org'...
copying path '/nix/store/897xqnq52vw76991r5m80h9j91370vj9-tzdata-2024a' from 'https://cache.nixos.org'...
copying path '/nix/store/x45xiwvk2v97bw1yp1vb6rnmvhagpgyz-xgcc-13.3.0-libgcc' from 'https://cache.nixos.org'...
deleting garbage...
deleting unused links...
note: currently hard linking saves 0.00 MiB
copying path '/nix/store/8hq38sx1hjgganlj6dn0fvvba0g7gcpi-libidn2-2.3.7' from 'https://cache.nixos.org'...
copying path '/nix/store/3dyw8dzj9ab4m8hv5dpyx7zii8d0w6fi-glibc-2.39-52' from 'https://cache.nixos.org'...
copying path '/nix/store/9g593pnsm5w1wmafp59bqzanpi1hp2qr-attr-2.5.2' from 'https://cache.nixos.org'...
copying path '/nix/store/izpf49b74i15pcr9708s3xdwyqs4jxwl-bash-5.2p32' from 'https://cache.nixos.org'...
copying path '/nix/store/4ky0v56fv5dj08ifz6dlns1idsk0kmkj-brotli-1.1.0-lib' from 'https://cache.nixos.org'...
copying path '/nix/store/qhf8n3srrg0vdd44k7q71fb0p5az15b5-bzip2-1.0.8' from 'https://cache.nixos.org'...
copying path '/nix/store/5sacm5pwy33dwwak0ffbggs9724a04ni-dosfstools-4.2' from 'https://cache.nixos.org'...
copying path '/nix/store/f0dmadrh535bpayz2r4q5lslg0m17lnw-expat-2.6.2' from 'https://cache.nixos.org'...
copying path '/nix/store/9hifsxkcrkvvb712ghnr3gy5g1aiym2d-gawk-5.2.2' from 'https://cache.nixos.org'...
copying path '/nix/store/22nxhmsfcv2q2rpkmfvzwg2w5z1l231z-gcc-13.3.0-lib' from 'https://cache.nixos.org'...
copying path '/nix/store/8ad0k7rbn3rr9qiya29464g52asndxqi-gdbm-1.24-lib' from 'https://cache.nixos.org'...
copying path '/nix/store/k4jv8fr725amxalmplzhnlyik93wvk3z-glibc-2.39-52-bin' from 'https://cache.nixos.org'...
copying path '/nix/store/jimhqfkgwjcp12wylw64xcwa6il5nx47-glibc-2.39-52-getent' from 'https://cache.nixos.org'...
copying path '/nix/store/gjlh1zvckhz0qv795lnzgw2zciklbzj2-gnused-4.9' from 'https://cache.nixos.org'...
copying path '/nix/store/9vfw2yd682i64rkf13fs900hin8sgcmq-jansson-2.14' from 'https://cache.nixos.org'...
copying path '/nix/store/2cck9cq8s2hz5nqnydlisnpf15m2kvmb-json-c-0.17' from 'https://cache.nixos.org'...
copying path '/nix/store/shxq4vm4qf9yfrcb5yawvqsaqvcrn643-keyutils-1.6.3-lib' from 'https://cache.nixos.org'...
copying path '/nix/store/cpxjynj0s2hrl88l19jhkcg048b54spi-libXau-1.0.11' from 'https://cache.nixos.org'...
copying path '/nix/store/gxi313jacghjjvxwr5cqa10w597qfslv-libXdmcp-1.1.5' from 'https://cache.nixos.org'...
copying path '/nix/store/p4zqsqz85smx06bis9jngnlkz6r9jmz3-acl-2.3.2' from 'https://cache.nixos.org'...
copying path '/nix/store/j9yjzgqvsdk5n51j48z9vycnx1j0rc69-libapparmor-4.0.1' from 'https://cache.nixos.org'...
copying path '/nix/store/8ywpryh3ngx85xwncilv1hgvk60ickl1-getent-glibc-2.39-52' from 'https://cache.nixos.org'...
copying path '/nix/store/6jca1hvv7206hjg8sqcksklb92zkf7d9-libargon2-20190702' from 'https://cache.nixos.org'...
copying path '/nix/store/20403s36z5dxrxzp1iaglr6wfmidpigh-libcap-2.70-lib' from 'https://cache.nixos.org'...
copying path '/nix/store/wlrdxz2jcc9q003yqgdjavk829alrgc5-libcap-ng-0.8.5' from 'https://cache.nixos.org'...
copying path '/nix/store/ddsra52n26scsmgxfhr2hzsxw3v606fk-libcbor-0.11.0' from 'https://cache.nixos.org'...
copying path '/nix/store/w5d1ak4kimncbf33ms2r99rx9knqm3sz-libevent-2.1.12' from 'https://cache.nixos.org'...
copying path '/nix/store/f8p74dj4r4my8sw5prmm3y4ddkz7591j-bzip2-1.0.8-bin' from 'https://cache.nixos.org'...
copying path '/nix/store/4ybgqxv43z9sk9lccwq6dgmz6j32syr1-libffi-3.4.6' from 'https://cache.nixos.org'...
copying path '/nix/store/gq8s5jh8sq8aqbkznhhanpvp3gnmgrcv-libgpg-error-1.50' from 'https://cache.nixos.org'...
copying path '/nix/store/lz2pm101if3y4hk4zdk7vfjcm6lnvpvp-libmd-1.1.0' from 'https://cache.nixos.org'...
copying path '/nix/store/393kila9i9qzp5m0ixpv0fsnik6dghzk-libmnl-1.0.5' from 'https://cache.nixos.org'...
copying path '/nix/store/cklnqcikprsyi9bwbvzmsdiv6d5szmw6-libnfnetlink-1.0.2' from 'https://cache.nixos.org'...
copying path '/nix/store/9592i2rn0a1kll7d8m1x2rpficfm64m5-libnl-3.8.0' from 'https://cache.nixos.org'...
copying path '/nix/store/jjaa3knw4qmby3v7wx1znsbncymry2g5-libpsl-0.21.5' from 'https://cache.nixos.org'...
copying path '/nix/store/3b236f74h1d25m3ny24w3j402y3p40k0-libseccomp-2.5.5-lib' from 'https://cache.nixos.org'...
copying path '/nix/store/l2l5xr2zczq19gqpqz4j8vxxia1j41s1-gnutar-1.35' from 'https://cache.nixos.org'...
copying path '/nix/store/66hnb6h7r7sxs3cky1xmhi4gg3fy8x10-libsodium-1.0.20' from 'https://cache.nixos.org'...
copying path '/nix/store/865mn68ini6hv0ch6fgl6mgyj8yfgj6z-libtasn1-4.19.0' from 'https://cache.nixos.org'...
copying path '/nix/store/pzksfmqi89gzapqnjbphwrqzhilb3wj4-libtool-2.4.7-lib' from 'https://cache.nixos.org'...
copying path '/nix/store/5542zk0i45x7licgq686cqbf4n9saync-libnftnl-1.2.7' from 'https://cache.nixos.org'...
copying path '/nix/store/5d4s33ys70ad8q9smw6brdidblpp0j03-libxcb-1.17.0' from 'https://cache.nixos.org'...
copying path '/nix/store/9gcqpm3p7pmvixl4ahy5sqavdq7yjldz-libbsd-0.12.2' from 'https://cache.nixos.org'...
copying path '/nix/store/18m36haf5csgj5fllfnb6njhrhpnjvgz-libxcrypt-4.4.36' from 'https://cache.nixos.org'...
copying path '/nix/store/lhfgwjwwdacygiq702yvbahvpqmxivpx-libxcrypt-4.4.36' from 'https://cache.nixos.org'...
copying path '/nix/store/aa709swcsjg04xq9m5am1yfaw4x23aqp-audit-4.0' from 'https://cache.nixos.org'...
copying path '/nix/store/164s7a7yscnicprzrr78bvk45d77a3yg-gzip-1.13' from 'https://cache.nixos.org'...
copying path '/nix/store/i7d0rd6p2mnmyvhwrnfrfknkwf3z4nbv-libnetfilter_conntrack-1.0.9' from 'https://cache.nixos.org'...
copying path '/nix/store/nr8mh99sfsb1gw1b1qmrwhzmxbhj84j7-libxml2-2.13.3' from 'https://cache.nixos.org'...
copying path '/nix/store/jd99f0mjpmsh2xkkqrxs15z8d2wfn6m7-libassuan-2.5.7' from 'https://cache.nixos.org'...
copying path '/nix/store/qfgj7wzs5jbmyarj94lgb36i47k7pbzh-libgcrypt-1.10.3-lib' from 'https://cache.nixos.org'...
copying path '/nix/store/ncicdi7m3nw0r1ygyv8ikddc7wlhkzdy-lz4-1.9.4-lib' from 'https://cache.nixos.org'...
copying path '/nix/store/3hxxbbjc8r66nravvjind6ixhz7cpij1-mpdecimal-4.0.0' from 'https://cache.nixos.org'...
copying path '/nix/store/z7nr6aqlzv51pk5ar8bgzg2alfqvi8fd-ncurses-6.4.20221231' from 'https://cache.nixos.org'...
copying path '/nix/store/4ldncp8hbqh5r44p3jfmp9jy1qzqdcaw-net-tools-2.10' from 'https://cache.nixos.org'...
copying path '/nix/store/kz2g7v2f9awzywvswi2d5m2552bi7ad7-nghttp2-1.62.1-lib' from 'https://cache.nixos.org'...
copying path '/nix/store/aikara3vi6q7fbmgwcam49mkmh9dfssc-npth-1.7' from 'https://cache.nixos.org'...
copying path '/nix/store/j57r4pj3kp7wqnaldyf6bx1hhdf1wd2f-oniguruma-6.9.9-lib' from 'https://cache.nixos.org'...
copying path '/nix/store/1w90l4fm5lzhlybipfilyjij2das6w98-openssl-3.0.14' from 'https://cache.nixos.org'...
copying path '/nix/store/mr70dzzc2j1nqvsm89wapmdn2bkax84i-p11-kit-0.25.5' from 'https://cache.nixos.org'...
copying path '/nix/store/9acpvpxwa33gcf5cnjs9136b38k5m62m-pcre2-10.44' from 'https://cache.nixos.org'...
copying path '/nix/store/1idvk9n73lg3ypfdjba9blx9dnsqzdi5-pcsclite-2.2.3-lib' from 'https://cache.nixos.org'...
copying path '/nix/store/vnpw4l44ixmvf82awirrp43rfzk21fj9-popt-1.19' from 'https://cache.nixos.org'...
copying path '/nix/store/sr5lx42h1zz17bjc5csxcrvp5rk8ggk6-qrencode-4.1.1' from 'https://cache.nixos.org'...
copying path '/nix/store/wc8xqc0yg79pkz8vzxi9sgwlslmc40p8-sysstat-12.7.4' from 'https://cache.nixos.org'...
copying path '/nix/store/lwhcdjlzin8bh5lpgwwj4bv5gyx07dd5-libpcap-1.10.4' from 'https://cache.nixos.org'...
copying path '/nix/store/llfrkl8va8kv49q0ymqwx04apa52mck3-libX11-1.8.10' from 'https://cache.nixos.org'...
copying path '/nix/store/qcnd58p4c60v8b4lcz5vwc5nm3c7ihs5-systemd-minimal-libs-256.4' from 'https://cache.nixos.org'...
copying path '/nix/store/acjy0knil4gg91xblial4bmkc8amg5y6-hostname-net-tools-2.10' from 'https://cache.nixos.org'...
copying path '/nix/store/n2vk1zmfzy726amnpr96jibk4zaya6qq-jq-1.7.1-lib' from 'https://cache.nixos.org'...
copying path '/nix/store/8isl4vsca7px4zcqi4ldmdj5gbycpqw9-util-linux-2.39.4-lib' from 'https://cache.nixos.org'...
copying path '/nix/store/2jyrzja39vpyy5ydi9apnksi163da75h-util-linux-minimal-2.39.4-lib' from 'https://cache.nixos.org'...
copying path '/nix/store/q760gyf323vf09xqbj848j2jxzdz0pb9-util-linux-minimal-2.39.4-login' from 'https://cache.nixos.org'...
copying path '/nix/store/4w3c2c11j2kmwxrznji2i7is53z5aldi-xz-5.6.2' from 'https://cache.nixos.org'...
copying path '/nix/store/rqs1zrcncqz3966khjndg1183cpdnqxs-zlib-1.3.1' from 'https://cache.nixos.org'...
copying path '/nix/store/181j2wyzgzkp14dv760vsiilrp6ir4am-gnupg-2.4.5' from 'https://cache.nixos.org'...
copying path '/nix/store/x8jzsy0y1zk30mcvav2rh6lrw1gbzzy3-jq-1.7.1-bin' from 'https://cache.nixos.org'...
copying path '/nix/store/q01y89dr5rfxjyb9w77lxxgnfk3rfxrx-cracklib-2.10.0' from 'https://cache.nixos.org'...
copying path '/nix/store/jxscs9x9pgskzgjcjiwbhz2iikx000gl-kexec-tools-2.0.28' from 'https://cache.nixos.org'...
copying path '/nix/store/g2i5j8i0bwfih7hg2wbc15k2969bckn3-sqlite-3.46.0' from 'https://cache.nixos.org'...
copying path '/nix/store/b0i8g7mmy4m9a3cfl0iwglxzxpmx5nbh-iptables-1.8.10' from 'https://cache.nixos.org'...
copying path '/nix/store/vsyc8jhsr4d9lm2r8yqq9n3j4i66inlj-gnugrep-3.11' from 'https://cache.nixos.org'...
copying path '/nix/store/02mf752h7f5fn7989awzca4ygy94k7w7-xz-5.6.2-bin' from 'https://cache.nixos.org'...
copying path '/nix/store/k45rbrfkd303a5via6kqdvz98bn9mx5b-lvm2-2.03.26-lib' from 'https://cache.nixos.org'...
copying path '/nix/store/nk2kgz84c639z42nbczfs8s5a6ik6p9m-util-linux-minimal-2.39.4-mount' from 'https://cache.nixos.org'...
copying path '/nix/store/a4km3a7yvacbz14ha4fivshwdif8p69l-util-linux-minimal-2.39.4-swap' from 'https://cache.nixos.org'...
copying path '/nix/store/3sfgsq8873ifn6z5fdvdv7sfqjs2wqa4-db-4.8.30' from 'https://cache.nixos.org'...
copying path '/nix/store/zmdic1fr9wndgq7rfs8lfxm364fgmria-db-5.3.28' from 'https://cache.nixos.org'...
copying path '/nix/store/mdnhaasvbh5mmxqd5yqc9qvyzc48i998-gmp-with-cxx-6.3.0' from 'https://cache.nixos.org'...
copying path '/nix/store/mfgj8cvp6jq4k5xbylj9zwaxwiq3gml7-gmp-with-cxx-6.3.0' from 'https://cache.nixos.org'...
copying path '/nix/store/d4gxkidyqn2b2yja6scfd89p7f3n3q70-libunwind-1.8.1' from 'https://cache.nixos.org'...
copying path '/nix/store/ycb0ic81bvi67fyfa82wzzz6qfkwirxz-smartmontools-7.4' from 'https://cache.nixos.org'...
copying path '/nix/store/31yx7grsg9qwywd85ci3yy2xvqh8a1ng-gptfdisk-1.0.10' from 'https://cache.nixos.org'...
copying path '/nix/store/6a6xr6phgvmd7djmzn7d7m5jww9lhjrp-krb5-1.21.3-lib' from 'https://cache.nixos.org'...
copying path '/nix/store/2pd9d26vp5f0gxsy2r8w2kbbh2lwvx2l-libfido2-1.15.0' from 'https://cache.nixos.org'...
copying path '/nix/store/cdrghx8g7vfz4g92gin1glxihz8h3ldn-libssh2-1.11.0' from 'https://cache.nixos.org'...
copying path '/nix/store/xxcf5gwyn5pldv4b4wa2jw6vqg7v55y6-readline-8.2p10' from 'https://cache.nixos.org'...
copying path '/nix/store/nf18v7rmqfb90qmd73i8q8ijc99j72mj-zstd-1.5.6' from 'https://cache.nixos.org'...
copying path '/nix/store/splhrrwlp19x8ns43agx2dm5p6wkk7jm-cryptsetup-2.7.3' from 'https://cache.nixos.org'...
copying path '/nix/store/japzhgfn52vgjpw5c4jc3x8hkx66sfy1-util-linux-2.39.4-login' from 'https://cache.nixos.org'...
copying path '/nix/store/hc3dzjdh5ipfv6anmjzvpw8x84y78n9w-util-linux-2.39.4-mount' from 'https://cache.nixos.org'...
copying path '/nix/store/b18sw15zqk7wcwqx0f7r8x66mx627nki-util-linux-2.39.4-swap' from 'https://cache.nixos.org'...
copying path '/nix/store/3rkmqbpa9x1cq16i7yz1rjl02z6i6p61-coreutils-full-9.5' from 'https://cache.nixos.org'...
copying path '/nix/store/0kg70swgpg45ipcz3pr2siidq9fn6d77-coreutils-9.5' from 'https://cache.nixos.org'...
copying path '/nix/store/fm29cmgs3mvmcbx89da4d7qxy250hirg-nettle-3.10' from 'https://cache.nixos.org'...
copying path '/nix/store/qqz0gj9iaidabp7g34r2fb9mds6ahk8i-bash-interactive-5.2p32' from 'https://cache.nixos.org'...
copying path '/nix/store/gyxcg3xlfjjbcj4ryg9sx4r2bmgk6lbh-parted-3.6' from 'https://cache.nixos.org'...
copying path '/nix/store/h3i0acpmr8mrjx07519xxmidv8mpax4y-python3-3.12.5' from 'https://cache.nixos.org'...
copying path '/nix/store/w87by4fr0n0rg8v4nqwpvwsksbh4z3bh-python3-3.12.5' from 'https://cache.nixos.org'...
copying path '/nix/store/pgyj2z5jksb8dpfjv1hwaqa0zl5rj3aa-kmod-31' from 'https://cache.nixos.org'...
copying path '/nix/store/f4a26g7p5ayyy5kzwwaq51racq84vp4k-kmod-31-lib' from 'https://cache.nixos.org'...
copying path '/nix/store/7w9r2sv5crvpdfsiq21pxrlkpkpd3g52-libarchive-3.7.4-lib' from 'https://cache.nixos.org'...
copying path '/nix/store/kbffxgss9pd8nrrayi1s0mmp6bpphcd5-zstd-1.5.6-bin' from 'https://cache.nixos.org'...
copying path '/nix/store/fvsswlqh6pc2f5x9qvahm4qbjgjlp86j-linux-pam-1.6.1' from 'https://cache.nixos.org'...
copying path '/nix/store/vy1xag14nlmbh1iazw7c5bj8macr1zbh-unbound-1.21.0-lib' from 'https://cache.nixos.org'...
copying path '/nix/store/x6ssc2mmx1kb52gchksqbzg5c2y0z7lf-curl-8.9.1' from 'https://cache.nixos.org'...
copying path '/nix/store/mdhzgl21xakj2mdr0bkkqczix5yywz4x-libtirpc-1.3.5' from 'https://cache.nixos.org'...
copying path '/nix/store/3l22gll62whaanhs0yvm3dsgcjnyfs3s-cyrus-sasl-2.1.28' from 'https://cache.nixos.org'...
running auto-GC to free 2832162816 bytes
finding garbage collector roots...
deleting garbage...
deleting unused links...
note: currently hard linking saves 0.00 MiB
copying path '/nix/store/frngrlq2xa2szv4bx91jkymv0dy9akmx-kbd-2.6.4' from 'https://cache.nixos.org'...
copying path '/nix/store/z0pak6frkzbj87d4bdn4bcd2q5hfb9a0-gnutls-3.8.6' from 'https://cache.nixos.org'...
copying path '/nix/store/6ikwp081lsvaawbg370i12j8y3k1j6hg-libpwquality-1.4.5-lib' from 'https://cache.nixos.org'...
copying path '/nix/store/sdgq1zyhpmsxglaabplvmncxxdk347np-tcb-1.2' from 'https://cache.nixos.org'...
copying path '/nix/store/2ip8yx9ak5h72608sv5da7fl69rh93br-openldap-2.6.8' from 'https://cache.nixos.org'...
copying path '/nix/store/hld4f6s0yapc7qp71zfyjrqgrpvk6k4d-elfutils-0.191' from 'https://cache.nixos.org'...
copying path '/nix/store/xc23i0n923dlfpy34qf9iy4rbbxclnvp-tpm2-tss-4.1.3' from 'https://cache.nixos.org'...
copying path '/nix/store/jym4iki8xqvxldgyqjahki11myfpsfbd-shadow-4.16.0' from 'https://cache.nixos.org'...
copying path '/nix/store/zdlkg4swdw4smrq2xkmkanh93y84m3id-systemd-minimal-256.4' from 'https://cache.nixos.org'...
copying path '/nix/store/251i04kqvd3vizlp59xfap5cfgnni7bb-libbpf-1.4.5' from 'https://cache.nixos.org'...
copying path '/nix/store/6a4jxy0r2g5w1r556p2h02cdjxjzy9f6-libmicrohttpd-1.0.1' from 'https://cache.nixos.org'...
copying path '/nix/store/8s4mfdql3gc297cz1zpaa6x1lhryg3bl-nfs-utils-2.7.1-lib' from 'https://cache.nixos.org'...
copying path '/nix/store/1lbc6v5p1a3rn4rjaqnz0694xfbq8dxq-systemd-256.4' from 'https://cache.nixos.org'...
copying path '/nix/store/na3hy5k969zmdrlqm857y06cdzxjb1cv-dbus-1.14.10-lib' from 'https://cache.nixos.org'...
running auto-GC to free 3024797696 bytes
finding garbage collector roots...

[polybluez]

This problem seems to occur only in configurations where I use ZFS. If I change it to use F2FS, everything works fine. Perhaps I've made a mistake with ZFS, but both vmWithDisko and --vm-test seem to work fine.

[sedlund]

why are you auto-gc'ing so much == thats so crazy