Anyone can help me diagnose problem with longhorn 1.4.0. For some reason instance-manager pods shutdown on all nodes and then start multiple times a day at irregular intervals. I see shutdwon messages but cannot find the trigger. What is causing this?

time="2023-04-07T10:37:26Z" level=warning msg="Received signal interrupt to shutdown"
[longhorn-instance-manager] time="2023-04-07T10:40:12Z" level=info msg="Shutdown all instance processes successfully"

Could you describe your cluster environment more or provide the support bundle? Is there any abnormal log in

longhorn-manager

related to

longhorn-instance-manager

?

we've found the problem it was

PriorityClass

that was added a month ago. For some reason it only started impacting us now and unlike in the article it was not happening every hour but randomly, once the

PriorityClass

was added in Longhorn all started working properly again https://longhorn.io/kb/troubleshooting-instance-manager-pods-are-restarted-every-hour/