https://rancher.com/ logo
Docs
Join the conversationJoin Slack
Channels
academy
amazon
arm
azure
cabpr
chinese
ci-cd
danish
deutsch
developer
elemental
epinio
espanol
events
extensions
fleet
français
gcp
general
harvester
harvester-dev
hobbyfarm
hypper
japanese
k3d
k3os
k3s
k3s-contributor
kim
kubernetes
kubewarden
lima
logging
longhorn-dev
longhorn-storage
masterclass
mesos
mexico
nederlands
neuvector-security
office-hours
one-point-x
onlinemeetup
onlinetraining
opni
os
ozt
phillydotnet
portugues
rancher-desktop
rancher-extensions
rancher-setup
rancher-wrangler
random
rfed_ara
rio
rke
rke2
russian
s3gw
service-mesh
storage
submariner
supermicro-sixsq
swarm
terraform-controller
terraform-provider-rancher2
terraform-provider-rke
theranchcast
training-0110
training-0124
training-0131
training-0207
training-0214
training-1220
ukranian
v16-v21-migration
vsphere
windows
Powered by Linen
fleet
  • c

    careful-mouse-48712

    02/20/2023, 4:59 PM
    I do have a GitRepo with 3 paths, 1*helmchart, 2*kustomize. Is it normal that fleet creates a helmchart (or at least a helm-secret) for each of the kustomize-folders?
  • d

    dazzling-chef-87126

    02/21/2023, 10:04 AM
    Hi, I'm unable to edit a GitRepo configuration because the resource version continuously changes. Have you experienced this? How can I edit the GitRepo without recreate it?
  • w

    wide-magician-63081

    02/21/2023, 3:42 PM
    Hello everybody, I'm contacting you because I'm trying to set up Keda and as usual I want to use Fleet to deploy its objects. Keda is installed (still KubeVersion problem but that's not the topic here. I deployed a fleet that contains a helm chart of a project of mine with, among other things, two deployments and 2 ScaledObject. Just like the HPAs, Keda modifies the replicas so I added a diff in fleet and it works fine. On the other hand, ScaledObject objects have an “Activating” status when the trigger is pending. This is a normal status (from what I understand). But Rancher sees it in error on its UI and the bundle is also in error.
    NotReady(1) [Bundle ebad]; scaledobject.keda.sh ebad-ma7/ebad-back error] Scaling is not performed because triggers are not active, Resource is Ready; scaledobject.keda.sh ebad-ma7/ebad-back modified {"spec":{"triggers":[{"metadata":{"desiredReplicas":"2","end":"35 14 * * *","start":"29 14 * * *","timezone":"Europe/Paris"},"type":"cron"}]}}; scaledobject.keda.sh ebad-ma7/ebad-front error] Scaling is not performed because triggers are not active, Resource is Ready
    Is there a way to ignore this type of status? I think it's related to this issue: https://github.com/rancher/fleet/issues/937
    c
    i
    +2
    • 5
    • 14
  • m

    mammoth-postman-10874

    02/24/2023, 4:25 PM
    is there a way to patch resource coming from a helm chart with kustomize?
    • 1
    • 1
  • a

    ambitious-plastic-3551

    02/27/2023, 5:50 PM
    Question... it has occurred now many times that resources delete (on sync) and cause rewrite of resources?? causes some downtime, it is also possible that on sync resources are not available and hence it happens, is there any threshold?
  • i

    important-kitchen-32874

    02/27/2023, 8:21 PM
    Hi folks! I was reading over the Fleet documentation regarding how a
    GitRepo
    is mapped to clusters, as well as the
    ClusterGroup
    concepts, and they're both using label selectors if I'm not mistaken. I'm wondering - is there a doc or proposal for how Fleet manages the case where the set of clusters matching the label selector changes? In "normal" kube, e.g. a
    NodeSelector
    will allow for transparent selection, movement, re-scheduling, etc - is that also what happens in Fleet?
  • a

    ambitious-plastic-3551

    02/27/2023, 9:18 PM
    it syncs indeed, occasionally
  • i

    important-kitchen-32874

    02/27/2023, 10:20 PM
    Sorry, not sure my question was phrased well - for instance, if I have some
    GitRepo
    that should select
    region=us-west,cloud=aws,machine-type=xxl
    or whatever, will I get instant failover if a cluster in that
    ClusterGroup
    goes down? Is there anything that balances out the usage of the group so, as an admin providing these clusters, I have less maintenance to do?
  • s

    salmon-train-47748

    03/01/2023, 9:58 PM
    Has anyone used fleet to deploy the Rancher applications (https://git.rancher.io/charts) across multiple downstream clusters? I'm particularly interested in trying to roll out Rancher CIS Benchmarking.
    w
    d
    s
    • 4
    • 7
  • s

    steep-furniture-72588

    03/03/2023, 10:58 AM
    I am working on a rancher implementation v2.69 with fleet. In the gitrepo object I have it pointing to a cluster group. In the git repo I have a few bundles. What I am trying to do is have a bundle only applied to a certain cluster. The documentation is not clear on how this is done. I could create multiple git repo of the same git project and define it differently but I was wondering if there is a way I could further enhance the filter through fleet.yaml in the bundle that it resides in
  • n

    numerous-lighter-90852

    03/08/2023, 9:11 AM
    HI! I need to force pause the fleet git update process at a scheduled time. How can I schedule this operation? Thank you.
  • q

    quick-sandwich-76600

    03/08/2023, 4:50 PM
    You may need to do it repo by repo (there's no global flag to pause all syncs AFAIK). If you go to your git repo object you can set the pause attribute to true. Example: apiVersion: fleet.cattle.io/v1alpha1 kind: GitRepo metadata: name: fleet-examples-single-cluster-helm annotations: {} # key: string creationTimestamp: '2022-10-02T21:59:18Z' generation: 4 labels: {} # key: string namespace: fleet-default resourceVersion: '85196906' uid: a2cd4b38-fc81-474b-bbd1-0ac0a5d938ad fields: - fleet-examples-single-cluster-helm - https://github.com/juanbrny/fleet-examples.git - 8b480f244d0b4edb51cdbb048dc8aa5488e53f66 - 0/0 - null spec: branch: master insecureSkipTLSVerify: false paths: - /single-cluster/helm # - string paused: true repo: https://github.com/juanbrny/fleet-examples.git targets: - clusterSelector: matchExpressions: - key: provider.cattle.io operator: NotIn values: - harvester
  • q

    quick-sandwich-76600

    03/08/2023, 4:51 PM
    May that work for you @numerous-lighter-90852?
  • q

    quick-sandwich-76600

    03/08/2023, 4:56 PM
    Instead of using Kubernetes API to change that you can also use Rancher's REST API. Visit: https://myclusterfqdn/v1/fleet.cattle.io.gitrepos/fleet-default/mygit-repo-name and click on Edit to see an example request you can just use with curl to modify the paused attribute.
  • n

    numerous-lighter-90852

    03/09/2023, 8:07 AM
    Thanks @quick-sandwich-76600, I test today this tips and I'll let you know.
  • n

    numerous-lighter-90852

    03/09/2023, 8:30 AM
    Hi @quick-sandwich-76600. Thanks to your idea, I came up with this solution:
    kubectl patch gitrepo/<repo name> -n fleet-local -p '{"spec": {"paused":false}}' --type merge
    What do you think about it?
  • q

    quick-sandwich-76600

    03/09/2023, 9:09 AM
    Yes, that should work great @numerous-lighter-90852 👍 At the end of the day, all Fleet and Rancher objects are just CRDs that can be easily modified/automated either through the standard Kubernetes way or through REST API (that's why I added the other example).
    👏 1
  • n

    numerous-lighter-90852

    03/09/2023, 9:11 AM
    Thank you, it is clearer to me now. TOP! 😄
  • n

    numerous-lighter-90852

    03/09/2023, 9:13 AM
    I really like Fleet; it is young, but it works well. I have joined the SUSE community.
    q
    • 2
    • 1
  • m

    millions-pizza-50389

    03/13/2023, 10:27 AM
    👋 … how can you handle CRD’s in fleet? I have applications that is part helm chart and part CRD’s that are usually applied with kubectl BUT can I do that with fleet? ex. for appscode Stash
    # Update catalog CRDs
    $ kubectl apply -f <https://github.com/stashed/installer/raw/v2023.03.13/crds/stash-catalog-crds.yaml>
    
    # Update the helm repositories
    $ helm repo update
    
    # Upgrade Stash Community operator chart
    $ helm upgrade stash appscode/stash \
      --version v2023.03.13 \
      --namespace kube-system \
      --set features.community=true               \
      --set-file global.license=/path/to/the/license.txt
    n
    • 2
    • 4
  • m

    microscopic-knife-52274

    03/13/2023, 1:36 PM
    Hello everyone, I have an issue with Fleet and the Rancher CD Feature. Rancher does not seem to overwrite the version in targetCustomizations. Here is an example fleet.yaml:
    namespace: example-namespace
    helm:
    releaseName: dfl
    chart: "<oci://custom.registry.net/test/example>"
    repo: ""
    version: "1.0.0"
    targetCustomizations:
    - name: dev
    helm:
    chart: "<oci://custom.registry.net/test/example>"
    version: "0.0.0-dev"
    clusterName: cluster-dev
    On our cluster "cluster-dev" it tries to deploy the Version 1.0.0 instead of 0.0.0-dev. Do you know what could be wrong? Thank you in advance.
    • 1
    • 2
  • c

    careful-mouse-48712

    03/13/2023, 1:57 PM
    Hi everyone! I have a weird issue regarding fleet + overlays (kustomize as well as simple manifests; rancher-2.7.1). I am trying to deploy an app, with a cluster-specific configMap:
  • c

    careful-mouse-48712

    03/13/2023, 1:58 PM
    targetCustomizations:
    - name: cluster-0530
    clusterName: cluster-0530
    yaml:
    overlays:
    - cluster-0530
    - name: cluster-0531
    clusterName: cluster-0531
    yaml:
    overlays:
    - cluster-0531
    - name: cluster-0532
    clusterName: cluster-0532
    yaml:
    overlays:
    - cluster-0532
    • 1
    • 1
  • c

    careful-mouse-48712

    03/13/2023, 1:58 PM
    Now i put the configMap in each cluster-folder, but it will get deployed only on 1 cluster.. Even though
    fleet test -t cluster-xyz .
    shows the correct manifests.
  • c

    careful-mouse-48712

    03/13/2023, 6:21 PM
    I created an example - you can see the overlays, but only one of them gets deployed.. https://gitlab.com/strowi/fleet-test/-/tree/master/test
  • n

    nutritious-garage-22695

    03/15/2023, 5:59 PM
    I am using rancher fleet. I wanna know if the fleet agents can communicate with teh fleet manager without needed the certificate (API_SERVER_CA_DATA) for the kube api server. I am essentialy looking to have some auth server in between
  • f

    flat-whale-67864

    03/16/2023, 7:56 PM
    @flat-whale-67864 has left the channel
  • n

    numerous-lighter-90852

    03/17/2023, 2:10 PM
    Hi, I have a problem with the rancher-logging-root-fluentbit daemon. Some pods start correctly, others have this error. Error: Error response from daemon: Duplicate mount point: /var/lib/docker/containers Any ideas to solve this error? Thanks.
  • c

    calm-twilight-27465

    03/20/2023, 11:36 PM
    I have a bundle that needs to be customized on multiple axes (region, environment), I think I'm missing something in how targetCustomization or how clusterSelector work to cover such a use case.
    • 1
    • 1
  • r

    refined-analyst-8898

    03/21/2023, 3:46 PM
    I noticed Fleet uses a custom resource named "Bundle" which is the same name as Trust Manager's custom resource for CA cert bundles. Is it a non-issue because they use different APIs or is it a collision that prevents installing both CRDs?
Powered by Linen
Title
r

refined-analyst-8898

03/21/2023, 3:46 PM
I noticed Fleet uses a custom resource named "Bundle" which is the same name as Trust Manager's custom resource for CA cert bundles. Is it a non-issue because they use different APIs or is it a collision that prevents installing both CRDs?
View count: 1