Hello everyone! i had an issue where one of my nodes locked up (3 node cluster) but now none of my volumes will re-replicate. seems liek it's rooted in a backing images, but not 100% sure. here's my support bundle, also some info i found on one of the pvc replcias that's pending. any help would be appreciated.

Name:         pvc-3e0af5b3-89b4-42b9-8576-f15978efb2b5-r-507d50b9
Namespace:    longhorn-system
Labels:       longhorn.io/backing-image=iso-image-rr8cw
              longhorndiskuuid=9f7d2015-48c7-4eaa-8206-921ac09de70e
              longhornnode=harvester-02
              longhornvolume=pvc-3e0af5b3-89b4-42b9-8576-f15978efb2b5
Annotations:  <none>
API Version:  longhorn.io/v1beta2
Kind:         Replica
Metadata:
  Creation Timestamp:  2025-01-21T03:18:52Z
  Finalizers:
    longhorn.io
  Generation:  2
  Owner References:
    API Version:     longhorn.io/v1beta2
    Kind:            Volume
    Name:            pvc-3e0af5b3-89b4-42b9-8576-f15978efb2b5
    UID:             770fd837-ad0f-43c8-8fcb-d1ac5016f78e
  Resource Version:  820797959
  UID:               ad007d1c-d08e-48ea-bf13-9c0b633f0b6e
Spec:
  Active:                                 true
  Backend Store Driver:
  Backing Image:                          iso-image-rr8cw
  Data Directory Name:                    pvc-3e0af5b3-89b4-42b9-8576-f15978efb2b5-766aac7e
  Data Engine:                            v1
  Desire State:                           running
  Disk ID:                                9f7d2015-48c7-4eaa-8206-921ac09de70e
  Disk Path:                              /var/lib/harvester/extra-disks/3dbda838b92d822823d43cc1e54def22
  Engine Image:
  Engine Name:                            pvc-3e0af5b3-89b4-42b9-8576-f15978efb2b5-e-0
  Eviction Requested:                     false
  Failed At:
  Hard Node Affinity:
  Healthy At:
  Image:                                  longhornio/longhorn-engine:v1.6.2
  Last Failed At:
  Last Healthy At:
  Log Requested:                          false
  Node ID:                                harvester-02
  Rebuild Retry Count:                    5
  Revision Counter Disabled:              false
  Salvage Requested:                      false
  Snapshot Max Count:                     250
  Snapshot Max Size:                      0
  Unmap Mark Disk Chain Removed Enabled:  false
  Volume Name:                            pvc-3e0af5b3-89b4-42b9-8576-f15978efb2b5
  Volume Size:                            558345748480
Status:
  Conditions:
    Last Probe Time:
    Last Transition Time:  2025-01-21T03:18:52Z
    Message:
    Reason:
    Status:                True
    Type:                  InstanceCreation
    Last Probe Time:
    Last Transition Time:  2025-01-21T03:18:52Z
    Message:
    Reason:
    Status:                False
    Type:                  FilesystemReadOnly
    Last Probe Time:
    Last Transition Time:  2025-01-21T03:28:20Z
    Message:
    Reason:
    Status:                False
    Type:                  WaitForBackingImage
  Current Image:
  Current State:           stopped
  Eviction Requested:      false
  Instance Manager Name:
  Ip:
  Log Fetched:             false
  Owner ID:                harvester-02
  Port:                    0
  Salvage Executed:        false
  Started:                 false
  Storage IP:
Events:
  Type    Reason  Age                     From                         Message
  ----    ------  ----                    ----                         -------
  Normal  Start   61s (x7388 over 2d11h)  longhorn-replica-controller  Starts pvc-3e0af5b3-89b4-42b9-8576-f15978efb2b5-r-507d50b9

backing image manager:

Name:         backing-image-manager-c16a-9f7d
Namespace:    longhorn-system
Labels:       longhorn.io/component=backing-image-manager
              longhorn.io/disk-uuid=9f7d2015-48c7-4eaa-8206-921ac09de70e
              longhorn.io/managed-by=longhorn-manager
              longhorn.io/node=harvester-02
Annotations:  <none>
API Version:  longhorn.io/v1beta2
Kind:         BackingImageManager
Metadata:
  Creation Timestamp:  2025-01-21T03:18:52Z
  Finalizers:
    longhorn.io
  Generation:        1
  Resource Version:  820797957
  UID:               f3192d39-9e6a-4d0b-a763-4d9b44dbbc7c
Spec:
  Backing Images:
    iso-image-rr8cw:  f85a2e55
  Disk Path:          /var/lib/harvester/extra-disks/3dbda838b92d822823d43cc1e54def22
  Disk UUID:          9f7d2015-48c7-4eaa-8206-921ac09de70e
  Image:              longhornio/backing-image-manager:v1.6.2
  Node ID:            harvester-02
Status:
  API Min Version:  3
  API Version:      3
  Backing Image File Map:
    iso-image-rr8cw:
      Current Checksum:        ae6cf5143436a22dcd012c23831fa387877cbc7cc729b7edf87e4b21bfae91cb0868d66eac15d44d118260002eab1fcf4d58db181eb515fda07a39d796a9e2f5
      Message:
      Name:                    iso-image-rr8cw
      Progress:                100
      Sender Manager Address:
      Sending Reference:       0
      Size:                    107374182400
      State:                   ready
      Uuid:                    f85a2e55
      Virtual Size:            107374182400
  Current State:               running
  Ip:                          10.52.0.65
  Owner ID:                    harvester-02
  Storage IP:                  10.52.0.65
Events:                        <none>