Hi wave I m creating the cluster with embedded etcd I wonder rancher-users #k3d

Title

flat-bird-89111

05/26/2023, 12:04 PM

Hi 👋 I’m creating the cluster with embedded etcd, I wonder what’s the best way to configure the default etcd storage? The etcd doc says it can be tuned via

--quota-backend-bytes

, is this exposed by k3d?

wide-garage-9465

05/26/2023, 12:13 PM

k3d does not hide any functionality. You can use everything that K3s exposes. See K3s options: https://docs.k3s.io/cli/server

In k3d, you pass the flags to K3s via

--k3s-arg ARG@NODEFILTER[;@NODEFILTER]                           Additional args passed to k3s command (Format: ARG@NODEFILTER[;@NODEFILTER])

flat-bird-89111

05/26/2023, 12:16 PM

Thanks for the quick response! However I see no option to configure the storage limit. Can you point me to the flag?

Is that via ``--etcd-arg``?

wide-garage-9465

05/26/2023, 12:32 PM

THe K3s docs show you all available flags to configure etcd in K3s. @creamy-pencil-82913 is there anything else exposed or possible, e.g. via env vars?

creamy-pencil-82913

05/26/2023, 2:33 PM

Yeah, --etcd-arg would be the way to go.

flat-bird-89111

05/26/2023, 2:36 PM

Yes, I configured it via

--k3s-arg "--etcd-arg=quota-backend-bytes=8589934592@server:*"

. And this seems setting the storage size to 8GB correctly:

/ # cat /var/lib/rancher/k3s/server/db/etcd/config | tail -2
quota-backend-bytes: 8589934592

One thing I don’t understand is the free db size when I get it from etcdctl, per this post, the free space is dbSize-dbSizeInUse:

Let’s use the first endpoint as an example, its
dbSize
is 5177344 bytes, and
dbSizeInUse
is 2039808 bytes. It means that there are (5177344-2039808) bytes of free space, which can be reclaimed by executing the defragmentation operation.

My result doesn’t seem to be align with that though, my “dbSize”:291110912 and “dbSizeInUse”:160505856.

creamy-pencil-82913

05/26/2023, 3:35 PM

If you have specific questions about etcd, you might take them to the etcd project maintainers?

flat-bird-89111

05/26/2023, 3:36 PM

right, I figured this may not be the right channel for such questions. Thanks for you explaination!

2 Views

#k3d Join Slack