aloof-honey-35027
09/28/2022, 2:30 PMThe(https://fleet.rancher.io/examples/) Is the fleet-agent able to report back to GitRepo? Is there any additional information on this? Appricate your support and feedback.will continue to monitor the application bundle and report statuses back in the following order: bundledeployment > bundle > GitRepo > cluster.fleet-agent
square-farmer-52927
09/29/2022, 2:15 PMabundant-horse-74503
09/29/2022, 6:13 PMhundreds-terabyte-36933
09/29/2022, 8:44 PMacoustic-sunset-13848
10/07/2022, 12:59 PMfleet.yaml
file can only reference a single chart. So that if i want multiple helm releases (for different charts) I have to have multiple directories, each with their own fleet.yaml
file? Is that accurate? For context, these are not inline charts.powerful-farmer-23811
10/11/2022, 6:53 PMFailed to register agent: looking up secret cattle-fleet-local-system/fleet-agent-bootstrap: Unauthorized
I have done some research and found when I run this
kubectl auth can-i get secret --as=system:serviceaccount:cattle-fleet-system:fleet-agent -n cattle-fleet-system
I get "no" and instead of "yes"
Running this does show I have the secrets in place
kubectl get secret -n cattle-fleet-system
NAME TYPE DATA AGE
c-9rmhj kubernetes.io/tls 2 43h
default-token-x24mk kubernetes.io/service-account-token 3 43h
fleet-controller-bootstrap-token-2lfsx kubernetes.io/service-account-token 3 43h
fleet-controller-token-9gdts kubernetes.io/service-account-token 3 43h
gitjob-token-r5jmr kubernetes.io/service-account-token 3 43h
sh.helm.release.v1.fleet-crd.v1 helm.sh/release.v1 1 43h
sh.helm.release.v1.fleet-crd.v2 helm.sh/release.v1 1 40h
sh.helm.release.v1.fleet.v1 helm.sh/release.v1 1 43h
sh.helm.release.v1.fleet.v2 helm.sh/release.v1 1 43h
sh.helm.release.v1.fleet.v3 helm.sh/release.v1 1 40h
sh.helm.release.v1.fleet.v4 helm.sh/release.v1 1 40h
stv-aggregation Opaque 3 43h
Any help would be great appreciatedquick-sandwich-76600
10/11/2022, 9:36 PMlimited-potato-16824
10/12/2022, 3:00 PMhelm list
that REVISION
is increased a couple of times and then the helm chart for fleet-agent is removed and it all repeats again. The cycle time of installing fleet-agent with helm and then bumping REVISION
and uninstalling the helm chart for fleet-agent is ~10 seconds.
It should be said that we have used this cluster for upgrade-tests earlier that might have caused this to happen, but if I can get some hints where I might find the cause for this I will be very grateful since I have spent too much time going round in circles.
Note:
1. The fleet-agent pod is not restarted, but the fleet-agent bundle is jumping between states "Pending" and "Wait applied".
2. We are managing 12 clusters with this Rancher installation and this k3s cluster is the only one fighting the fleet-agent bundle.
fleet-agent time="2022-10-12T14:38:44Z" level=error msg="error syncing 'cluster-fleet-default-k3s-rnd-11e91fbf4d78/fleet-agent-k3s-rnd': handler bundle-deploy: Operation cannot be fulfilled on <http://bundledeployments.fleet.cattle.io|bundledeployments.fleet.cattle.io> \"fleet-agent-k3s-rnd\": StorageError: invalid object, Code: 4, Key: /registry/fleet.cattle.io/bundledeployments/cluster-fleet-default-k3s-rnd-11e91fbf4d78/fleet-agent-k3s-rnd, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: a70272d3-e2fb-4864-aa9f-a7565c7570b4, UID in object meta: , handler bundle-monitor: Operation cannot be fulfilled on <http://bundledeployments.fleet.cattle.io|bundledeployments.fleet.cattle.io> \"fleet-agent-k3s-rnd\": StorageError: invalid object, Code: 4, Key: /registry/fleet.cattle.io/bundledeployments/cluster-fleet-default-k3s-rnd-11e91fbf4d78/fleet-agent-k3s-rnd, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: a70272d3-e2fb-4864-aa9f-a7565c7570b4, UID in object meta: , requeuing"
fleet-agent time="2022-10-12T14:38:46Z" level=info msg="Helm: Deleting release fleet-agent-k3s-rnd 1"
fleet-agent time="2022-10-12T14:38:46Z" level=info msg="Helm: Installing fleet-agent-k3s-rnd"
fleet-agent time="2022-10-12T14:38:46Z" level=info msg="getting history for release fleet-agent-k3s-rnd"
fleet-agent time="2022-10-12T14:38:46Z" level=info msg="getting history for release fleet-agent-k3s-rnd"
fleet-agent time="2022-10-12T14:38:46Z" level=info msg="getting history for release fleet-agent-k3s-rnd"
fleet-agent time="2022-10-12T14:38:46Z" level=info msg="getting history for release fleet-agent-k3s-rnd"
fleet-agent time="2022-10-12T14:38:46Z" level=info msg="getting history for release fleet-agent-k3s-rnd"
fleet-agent time="2022-10-12T14:38:48Z" level=info msg="Helm: Deleting release fleet-agent-k3s-rnd 1"
fleet-agent time="2022-10-12T14:38:48Z" level=info msg="Helm: Installing fleet-agent-k3s-rnd"
fleet-agent time="2022-10-12T14:38:48Z" level=info msg="getting history for release fleet-agent-k3s-rnd"
fleet-agent time="2022-10-12T14:38:48Z" level=info msg="getting history for release fleet-agent-k3s-rnd"
fleet-agent time="2022-10-12T14:38:48Z" level=error msg="error syncing 'cluster-fleet-default-k3s-rnd-11e91fbf4d78/fleet-agent-k3s-rnd': handler bundle-deploy: Operation cannot be fulfilled on <http://bundledeployments.fleet.cattle.io|bundledeployments.fleet.cattle.io> \"fleet-agent-k3s-rnd\": StorageError: invalid object, Code: 4, Key: /registry/fleet.cattle.io/bundledeployments/cluster-fleet-default-k3s-rnd-11e91fbf4d78/fleet-agent-k3s-rnd, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: aae9c7b4-452f-418a-a5bc-4a43b6f2fa66, UID in object meta: , handler bundle-monitor: Operation cannot be fulfilled on <http://bundledeployments.fleet.cattle.io|bundledeployments.fleet.cattle.io> \"fleet-agent-k3s-rnd\": StorageError: invalid object, Code: 4, Key: /registry/fleet.cattle.io/bundledeployments/cluster-fleet-default-k3s-rnd-11e91fbf4d78/fleet-agent-k3s-rnd, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: aae9c7b4-452f-418a-a5bc-4a43b6f2fa66, UID in object meta: , requeuing"
lively-tent-36039
10/17/2022, 5:59 PMtargetCustomizations:
- name: dev
helm:
values:
replication: false
clusterSelector:
matchLabels:
env: dev
- name: test
helm:
values:
replicas: 3
clusterSelector:
matchLabels:
env: test
- name: prod
helm:
values:
serviceType: LoadBalancer
replicas: 3
clusterSelector:
matchLabels:
env: prod
calm-twilight-27465
10/17/2022, 11:16 PMpolite-father-50599
10/21/2022, 12:05 PMtargetCustomizations:
- name: distinct
helm:
valuesFiles:
- values-DISTINCT.yaml
clusterSelector:
matchLabels:
env: distinct
polite-father-50599
10/21/2022, 12:05 PMpolite-father-50599
10/25/2022, 1:24 PMpolite-father-50599
10/25/2022, 2:00 PMmany-area-51777
10/26/2022, 2:25 PMquiet-area-89381
10/28/2022, 6:16 PMhundreds-state-15112
11/01/2022, 9:16 PMnumerous-lighter-90852
11/07/2022, 10:18 AMmany-area-51777
11/08/2022, 12:42 PMnumerous-lighter-90852
11/11/2022, 10:22 AMModified(1) [Bundle ci-k8s-aon-oneflex2]; <http://certificate.cert-manager.io|certificate.cert-manager.io> <namespace>/<secret name>-secret extra; <http://certificate.cert-manager.io|certificate.cert-manager.io> <namespace>/<secret name>-secret extra
Any idea to resolve?careful-mouse-48712
11/11/2022, 3:44 PMcareful-mouse-48712
11/11/2022, 3:44 PMcareful-piano-35019
11/14/2022, 10:34 AMbland-area-30120
11/15/2022, 2:00 PMbland-area-30120
11/16/2022, 9:16 AMsteep-furniture-72588
11/25/2022, 2:18 PMtime="2022-11-25T14:11:46Z" level=fatal msg="error converting YAML to JSON: yaml: line 31: found character that cannot start any token"
The fleet.yaml looks like this:
defaultnamespace: metallb-system
helm:
# Use a custom location for the Helm chart. This can refer to any go-getter URL or
# OCI registry based helm chart URL e.g. "oci://ghcr.io/fleetrepoci/guestbook".
# This allows one to download charts from most any location. Also know that
# go-getter URL supports adding a digest to validate the download. If repo
# is set below this field is the name of the chart to lookup
chart: metallb
# A https URL to a Helm repo to download the chart from. It's typically easier
# to just use chart
field and refer to a tgz file. If repo is used the
# value of chart
will be used as the chart name to lookup in the Helm repository.
repo: https://charts.bitnami.com/bitnami
# A custom release name to deploy the chart as. If not specified a release name
# will be generated.
releaseName: metallb-bitnami
# The version of the chart or semver constraint of the chart to find. If a constraint
# is specified it is evaluated each time git changes.
# The version also determines which chart to download from OCI registries.
version: 4.1.11
values:
speaker:
secretName: metallb-bitnami-memberlist
secretKey: secretkey
# Any values that should be placed in the values.yaml
and passed to helm during
# install.
# Override immutable resources. This could be dangerous.
force: false
# Set the Helm --atomic flag when upgrading
diff:
comparePatches:
- apiVersion: apiextensions.k8s.io/v1
kind: CustomResourceDefinition
name: addresspools.metallb.io
operations:
- {"op":"remove", "path":"/spec/conversion/webhook/clientConfig/caBundle"}
- {"op":"remove", "path":"/status/acceptedNames/kind"}
- {"op":"remove", "path":"/status/acceptedNames/plural"}
- {"op":"remove", "path":"/status/conditions"}
- {"op":"remove", "path":"/status/storedVersions"}
- apiVersion: apiextensions.k8s.io/v1
kind: CustomResourceDefinition
name: bgppeers.metallb.io
operations:
- {"op":"remove", "path":"/spec/conversion/webhook/clientConfig/caBundle"}
- {"op":"remove", "path":"/status/acceptedNames/kind"}
- {"op":"remove", "path":"/status/acceptedNames/plural"}
- {"op":"remove", "path":"/status/conditions"}
- {"op":"remove", "path":"/status/storedVersions"}
clusterGroup: downstream
any help appreciatedcareful-piano-35019
11/29/2022, 9:03 PMancient-air-32350
11/30/2022, 8:26 AM"/spec/rkeConfig/machinePools/0/etcdRole"
"/spec/rkeConfig/machinePools/1/etcdRole"
"/spec/rkeConfig/machinePools/2/etcdRole"
the real “problem” ist that, i specifically set “etcdRole = False” in my Template and it looks like that all non-default elements get deleted in the config after deploymentsteep-furniture-72588
12/01/2022, 5:11 AMancient-air-32350
12/01/2022, 1:41 PM