stale-orange-90901
09/06/2022, 6:27 PMrefined-toddler-64572
09/06/2022, 7:31 PM$ k get nodes
NAME STATUS ROLES AGE VERSION
k3s01 Ready control-plane,etcd,master 159d v1.24.4+k3s1
k3s02 Ready control-plane,etcd,master 132d v1.24.4+k3s1
k3s03 Ready control-plane,etcd,master 139d v1.24.4+k3s1
stale-orange-90901
09/06/2022, 7:34 PMrefined-toddler-64572
09/06/2022, 7:43 PMhdparm
to be provisioned as 240GB drives. Leaving all that extra space for Host Protected Area for bad sector remapping. Hopefully will improve write durability over the long term. My nodes are 2.5GbE connected with 10GbE uplink to PVC / iSCSI storage for application use.stale-orange-90901
09/06/2022, 8:04 PMrefined-toddler-64572
09/06/2022, 8:46 PMbrainy-electrician-41196
09/07/2022, 10:40 PMrefined-toddler-64572
09/08/2022, 1:48 PMbrainy-electrician-41196
09/08/2022, 1:52 PMdemocratic-csi
?refined-toddler-64572
09/08/2022, 1:58 PMhdparm
my understanding is that enterprise level SSDs include a sizable Host Protected Area (HPA) which help enable long term write endurance. Consumer grade SSDs have a much smaller HPA for cost cutting, lower requirements, etc. You can use hdparm
to more or less, tell it an alternate last sector of the device and assign everything beyond that to the HPA. As an example I tried a batch of WD Blue M.2 SSDs with 24x7 etcd on them and had 100% failure rate within 1 week. Switched to Samsung and very large HPA and has been fine for many weeks. Still testing, but seems to be a good combo. Output from smartctl:
Device Model: Samsung SSD 860 EVO M.2 1TB
User Capacity: 240,049,281,024 bytes [240 GB]
democratic-csi
iSCSI for PVs needing heavy disk writes. It does work very well. But is a single point of failure for cluster storage. Patching and rebooting TrueNAS now and then requires me to down my applications during that. Not something that can be easily converted to a Ceph cluster, hopefully TrueNAS Scale can help with this in the future.brainy-electrician-41196
09/12/2022, 3:20 PMrefined-toddler-64572
09/12/2022, 3:42 PMbrainy-electrician-41196
09/12/2022, 3:45 PMrefined-toddler-64572
09/12/2022, 5:11 PM