When backing up k3s running against an external SQL DB, do you also need to back up files in the datadir? Certs or anything

no, the CA certs are stored in the database. Just back up the DB and the token.