This will be a very short but helpful post.
I use k3s on my VPS server because it is a very stable and simple K8s distribution. Upgrading is also very easy.
To upgrade to the latest stable release I simply run the command I originally used to install K3s.
curl