Unable to change etcd wal-dir

[aretecarpe]

Bug Report

Attempting to change the etcd wal-dir to to a mounted disk separate from the install disk causes a permission denied. Thus basically forcing me to utilize a static pod one shot to give nobody:nobody permissions to that mount point so it can work.

  etcd:
    extraArgs:
      wal-dir: /var/mnt/etcd-wal

Description

Adding in another disk to be used as the etcd wal-dir for example mounted to: /var/mnt/etcd-wal will deny permissions. Or even mounting the disk to /var/lib/etcd causes issues as well. Is there no way to attach a dedicated disc to be the location of the WAL files?

Logs

192.168.0.2: {"level":"warn","ts":"2024-11-15T05:06:46.465315Z","caller":"wal/wal.go:119","msg":"failed to create a temporary WAL directory","tmp-dir-path":"/var/mnt/etcd-wal.tmp","dir-path":"/var/mnt/etcd-wal","error":"mkdir /var/mnt: permission denied"}

192.168.0.2: {"level":"panic","ts":"2024-11-15T05:06:46.465335Z","caller":"etcdserver/raft.go:490","msg":"failed to create WAL","error":"mkdir /var/mnt: permission denied","stacktrace":"go.etcd.io/etcd/server/v3/etcdserver.startNode\n\tgo.etcd.io/etcd/server/v3/etcdserver/raft.go:490\ngo.etcd.io/etcd/server/v3/etcdserver.NewServer\n\tgo.etcd.io/etcd/server/v3/etcdserver/server.go:469\ngo.etcd.io/etcd/server/v3/embed.StartEtcd\n\tgo.etcd.io/etcd/server/v3/embed/etcd.go:248\ngo.etcd.io/etcd/server/v3/etcdmain.startEtcd\n\tgo.etcd.io/etcd/server/v3/etcdmain/etcd.go:228\ngo.etcd.io/etcd/server/v3/etcdmain.startEtcdOrProxyV2\n\tgo.etcd.io/etcd/server/v3/etcdmain/etcd.go:123\ngo.etcd.io/etcd/server/v3/etcdmain.Main\n\tgo.etcd.io/etcd/server/v3/etcdmain/main.go:40\nmain.main\n\tgo.etcd.io/etcd/server/v3/main.go:31\nruntime.main\n\truntime/proc.go:271"}

Environment

• Talos version: 1.8.3
• Kubernetes version: 1.31.1
• Platform: bare-metal

[smira]

This is not supported at the moment, I will link to #8367 to get it supported eventually.

[aretecarpe]

Would it be possible to mount a dedicated disk to /var/lib/etcd or would this cause collisions/UB with the EPHEMERAL disk that is used by the install ?

[smira]

You can move whole /var to a different disk with Talos 1.8+, please see documentation.

Eventually via #8367 we will support separate volumes for etcd.