This message was deleted.
# harvestera
adamant-kite-43734
11/02/2023, 7:52 AMThis message was deleted.
m
magnificent-pencil-261
11/02/2023, 8:07 AMDo you mean to download the image to Harvester from a certain URL? Can you provide the SB ? Thanks.
o
orange-businessperson-74585
11/02/2023, 8:09 AMCorrect, downloading an images from a certain URL directly to Harvester. What do you mean with SB?
m
magnificent-pencil-261
11/02/2023, 8:12 AMI just tried to download a 5GB image from my own HTTP server, and it works as expected.
SB means the support bundle https://docs.harvesterhci.io/v1.2/troubleshooting/harvester/#generate-a-support-bundle
o
orange-businessperson-74585
11/02/2023, 8:20 AMIts so weird that files < 1GB are uploaded without any issues from the same URL. I tried with another single node harvester (1.2.1) cluster and their the upload > 1GB went fine. Any tips were to start debugging? I see that the storage "backing" pod is stopping at 1GB, but its not throwing any logs.
orange-businessperson-74585
11/02/2023, 8:27 AMHere is the requested SB from the Harvester cluster.
m
magnificent-pencil-261
11/02/2023, 9:31 AMCould you provide the backing-image-ds-xxxx pod log during the download ? It tears down after the image process finishes, thanks.
magnificent-pencil-261
11/02/2023, 9:34 AMhttps://github.com/longhorn/backing-image-manager/blob/00de674e0c86ecea5e65464bafc807c3b17c94d6/pkg/sync/handler.go#L66-L102
https://github.com/longhorn/backing-image-manager/blob/00de674e0c86ecea5e65464bafc807c3b17c94d6/pkg/sync/handler.go#L105-L178
It seems like the server response latency is longer than Longhorn's expectation. Maybe you can try to download from a local server first?
👍 1
o
orange-businessperson-74585
11/02/2023, 9:40 AMHere's the log during download, no errors nor warnings in it.
orange-businessperson-74585
11/02/2023, 9:55 AMCreated a VM on the cluster and copied the 2GB image in there and created a python http server to serve the image locally. And guess what, I could upload it without any problems. I will talk to the IT guys here to fix the network latency here. Thanks for your help! Really appreciate it.
👍 1
p
prehistoric-balloon-31801
11/03/2023, 6:34 AMif it always stops at 1GB, perhaps it would be helpful to check if there is any limitation in the web server.
👀 1
o
orange-businessperson-74585
11/09/2023, 8:07 AMIn front of the nexus service there was an nginx for https offloading. nginx limits the max download limit to 1GB. Adding the following options to the nginx config solved the problem
proxy_buffering off;
proxy_max_temp_file_size 0;