Hi all :wave: I was looking at the harvester/test...
# harvester
l
Hi all 👋 I was looking at the harvester/tests repo (github.com/harvester/tests) and had a couple of questions: 1. Releases: Does this repo publish releases tied to specific Harvester versions? From what I can tell it doesn't seem to, it looks more like an aggregation of tests rather than versioned release artifacts. Can someone confirm? 2. Use case: I'm looking for test cases to validate that my cluster is working fine after an upgrade. I found some of the regression tests under the harvester_robot_tests folder that seem well-suited for my use case. Any advice on: • Whether there's a recommended/supported way to run these post-upgrade? • If there's a curated subset of tests meant for upgrade validation? Thank you.
s
Does this repo publish releases tied to specific Harvester versions?
No, we don’t publish releases tied to specific Harvester versions. We’ll handle specific versioning in the code.
I’m looking for test cases to validate that my cluster is working fine after an upgrade.
We built most of the test cases with pytest, but some of them are flaky, so it’s hard to say if you see any errors with pytest. For the Robot Framework, yes, we are trying to migrate to the Robot Framework, but the test cases are still fewer than in pytest. If you want to check anything after the upgrade, I suggest you do some general operations of your daily work. It might be more efficient than running some tests you might not use.
If there’s a curated subset of tests meant for upgrade validation?
We have various test scenarios for upgrades (some manual tests, some automations), but they might not really be covered by the tests you saw.
l
Thank you @salmon-city-57654. Validating through our daily operations makes perfect sense. You mentioned there are some specific manual and automated test scenarios for upgrades. Could you please point me to where I can find those?