Single System, 25 x CSRBnode w/ External SAS, ZFS RAID-Z3, Demo #1 (2023-12-30)
System Configuration
HP DL360p Gen8, 2 x E5-2697v2, 24c/48t, 256GB PC3-14900R
LSI SAS2008 SAS interconnect (6Gbps)
HP D2700 external SFF SAS Enclosure
25 x HP 72GB 10K 3Gbps SAS (Single Port, various models)
CSRB configuration
25 x CSRBnode: CSRBblockDB direct raw-data access to a 72GB SAS disk
1 x CSRBvfsFUSE: DIRECTIO, 256 VFS Workers
LAN interconnection (accessed via Loopback)
ZPool Configuration
RAID-Z3
ashift=15 (32KB sector)
25 x 2205538 sector CSRB OBJECTBLOCK devices (CSRBnodes)
recordsize=1MB
primarycache=metadata, compression=off, atime=off, relatime=off
00:05 - First read of a 32GB file
00:37 - Recreate the file
01:36 - Read the new file
04:11 - Re-read the new file (cached)
05:20 - Re-read the new file (uncached)
06:33 - zpool scrub
07:48 - Corrupt a Node's VDEV by writing random data
08:22 - Trigger the detection of the corrupted VDEV
08:26 - Re-insert the corrupted VDEV to trigger resilvering