I’ve been fighting Rancher for weeks trying to get the legacy components removed, however in the Rancher server container logs (rancher is in docker), I keep seeing the following for all the clusters. I don’t have cluster or project monitoring or logging enabled, all the alerts and notifers, etc have all been removed. I can’t find anything left over. What in the heck can I do?

2023/01/19 16:17:49 [ERROR] error syncing 'system-library': handler system-image-upgrade-catalog-controller: upgrade cluster local system service alerting failed: template system-library-rancher-monitoring incompatible with rancher version or cluster's [local] kubernetes version, handler system-image-upgrade-catalog-controller: upgrade cluster c-m-5hcbznvh system service alerting failed: template system-library-rancher-monitoring incompatible with rancher version or cluster's [c-m-5hcbznvh] kubernetes version, handler system-image-upgrade-catalog-controller: upgrade cluster c-qjpsc system service alerting failed: template system-library-rancher-monitoring incompatible with rancher version or cluster's [c-qjpsc] kubernetes version, handler system-image-upgrade-catalog-controller: upgrade cluster c-tgk45 system service alerting failed: template system-library-rancher-monitoring incompatible with rancher version or cluster's [c-tgk45] kubernetes version, handler system-image-upgrade-catalog-controller: upgrade cluster c-jpmb8 system service alerting failed: template system-library-rancher-monitoring incompatible with rancher version or cluster's [c-jpmb8] kubernetes version, handler system-image-upgrade-catalog-controller: upgrade cluster c-hpvn8 system service alerting failed: template system-library-rancher-monitoring incompatible with rancher version or cluster's [c-hpvn8] kubernetes version, requeuing

2023/01/19 161759 [ERROR] error syncing ‘c-tgk45/cl-zf689’: handler cluster-logging-deployer: timeout checking app status, app deployed namespace: cattle-logging, labels: map[app:fluentd], handler cluster-logging-configsyncer: get secret cattle-logging:rancher-logging-fluentd-ssl failed: secrets “rancher-logging-fluentd-ssl” not found, requeuing 2023/01/19 161829 [ERROR] error syncing ‘c-tgk45/cl-zf689’: handler cluster-logging-deployer: timeout checking app status, app deployed namespace: cattle-logging, labels: map[app:log-aggregator], handler cluster-logging-configsyncer: get secret cattle-logging:rancher-logging-fluentd-ssl failed: secrets “rancher-logging-fluentd-ssl” not found, requeuing