https://rancher.com/ logo
Join Slack
Powered by
This message was deleted.
# harvester
a
This message was deleted.
q
it looks like it's made about backing images. but i'm not sure how to fix 😞
h
Are all 3 backing disks available? Do you have enough disk availability or just barely? If you go into Longhorn, do you see any warnings?
q
no warnings, far as i can tell all disks are available, note each server has like 15 disks, so they should be able to bounce around even if a disk or two were full
here's an example:
it's just like the replicas are all "stopped"
but i cant see what it's waiting for
h
Are you sure there is no network issue?
q
there are no issues, all 3 nodes are up and health, storage seems fine. just seems like something is hung up somewhere, i just dont know where to look
looks like it's waiting for a backing image, but the backing image shows all are ready.
Copy code
Name:         pvc-3e0af5b3-89b4-42b9-8576-f15978efb2b5-r-507d50b9
Namespace:    longhorn-system
Labels:       <http://longhorn.io/backing-image=iso-image-rr8cw|longhorn.io/backing-image=iso-image-rr8cw>
              longhorndiskuuid=9f7d2015-48c7-4eaa-8206-921ac09de70e
              longhornnode=harvester-02
              longhornvolume=pvc-3e0af5b3-89b4-42b9-8576-f15978efb2b5
Annotations:  <none>
API Version:  <http://longhorn.io/v1beta2|longhorn.io/v1beta2>
Kind:         Replica
Metadata:
  Creation Timestamp:  2025-01-21T03:18:52Z
  Finalizers:
    <http://longhorn.io|longhorn.io>
  Generation:  2
  Owner References:
    API Version:     <http://longhorn.io/v1beta2|longhorn.io/v1beta2>
    Kind:            Volume
    Name:            pvc-3e0af5b3-89b4-42b9-8576-f15978efb2b5
    UID:             770fd837-ad0f-43c8-8fcb-d1ac5016f78e
  Resource Version:  820797959
  UID:               ad007d1c-d08e-48ea-bf13-9c0b633f0b6e
Spec:
  Active:                                 true
  Backend Store Driver:
  Backing Image:                          iso-image-rr8cw
  Data Directory Name:                    pvc-3e0af5b3-89b4-42b9-8576-f15978efb2b5-766aac7e
  Data Engine:                            v1
  Desire State:                           running
  Disk ID:                                9f7d2015-48c7-4eaa-8206-921ac09de70e
  Disk Path:                              /var/lib/harvester/extra-disks/3dbda838b92d822823d43cc1e54def22
  Engine Image:
  Engine Name:                            pvc-3e0af5b3-89b4-42b9-8576-f15978efb2b5-e-0
  Eviction Requested:                     false
  Failed At:
  Hard Node Affinity:
  Healthy At:
  Image:                                  longhornio/longhorn-engine:v1.6.2
  Last Failed At:
  Last Healthy At:
  Log Requested:                          false
  Node ID:                                harvester-02
  Rebuild Retry Count:                    5
  Revision Counter Disabled:              false
  Salvage Requested:                      false
  Snapshot Max Count:                     250
  Snapshot Max Size:                      0
  Unmap Mark Disk Chain Removed Enabled:  false
  Volume Name:                            pvc-3e0af5b3-89b4-42b9-8576-f15978efb2b5
  Volume Size:                            558345748480
Status:
  Conditions:
    Last Probe Time:
    Last Transition Time:  2025-01-21T03:18:52Z
    Message:
    Reason:
    Status:                True
    Type:                  InstanceCreation
    Last Probe Time:
    Last Transition Time:  2025-01-21T03:18:52Z
    Message:
    Reason:
    Status:                False
    Type:                  FilesystemReadOnly
    Last Probe Time:
    Last Transition Time:  2025-01-21T03:28:20Z
    Message:
    Reason:
    Status:                False
    Type:                  WaitForBackingImage
  Current Image:
  Current State:           stopped
  Eviction Requested:      false
  Instance Manager Name:
  Ip:
  Log Fetched:             false
  Owner ID:                harvester-02
  Port:                    0
  Salvage Executed:        false
  Started:                 false
  Storage IP:
Events:
  Type    Reason  Age                     From                         Message
  ----    ------  ----                    ----                         -------
  Normal  Start   61s (x7388 over 2d11h)  longhorn-replica-controller  Starts pvc-3e0af5b3-89b4-42b9-8576-f15978efb2b5-r-507d50b9
10 Views
Open in Slack
PreviousNext
Powered by