I don't know what I'm doing.
https://arstech.net/how-to-measure-disk-performance-iops-with-fio-in-linux/
fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=64 --size=4G --readwrite=randrw --rwmixread=75
ioDrive2
test: Laying out IO file (1 file / 4096MiB) Jobs: 1 (f=1): [m(1)][100.0%][r=222MiB/s,w=73.3MiB/s][r=56.8k,w=18.8k IOPS][eta 00m:00s] test: (groupid=0, jobs=1): err= 0: pid=16770: Wed Sep 4 10:20:39 2019 read: IOPS=56.7k, BW=221MiB/s (232MB/s)(3070MiB/13868msec) bw ( KiB/s): min=196880, max=232944, per=99.91%, avg=226479.11, stdev=6574.92, samples=27 iops : min=49220, max=58236, avg=56619.78, stdev=1643.73, samples=27 write: IOPS=18.9k, BW=73.0MiB/s (77.6MB/s)(1026MiB/13868msec) bw ( KiB/s): min=65536, max=78168, per=99.94%, avg=75711.70, stdev=2337.16, samples=27 iops : min=16384, max=19542, avg=18927.93, stdev=584.29, samples=27 cpu : usr=15.03%, sys=52.34%, ctx=451474, majf=0, minf=22 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% issued rwt: total=785920,262656,0, short=0,0,0, dropped=0,0,0 latency : target=0, window=0, percentile=100.00%, depth=64 Run status group 0 (all jobs): READ: bw=221MiB/s (232MB/s), 221MiB/s-221MiB/s (232MB/s-232MB/s), io=3070MiB (3219MB), run=13868-13868msec WRITE: bw=73.0MiB/s (77.6MB/s), 73.0MiB/s-73.0MiB/s (77.6MB/s-77.6MB/s), io=1026MiB (1076MB), run=13868-13868msec Disk stats (read/write): fioa: ios=774488/258871, merge=0/0, ticks=344456/23701, in_queue=18717, util=56.08%
ioScale2
test: Laying out IO file (1 file / 4096MiB) Jobs: 1 (f=1): [m(1)][100.0%][r=204MiB/s,w=67.3MiB/s][r=52.2k,w=17.2k IOPS][eta 00m:00s] test: (groupid=0, jobs=1): err= 0: pid=9572: Wed Sep 4 10:45:00 2019 read: IOPS=51.9k, BW=203MiB/s (213MB/s)(3070MiB/15141msec) bw ( KiB/s): min=185616, max=215648, per=100.00%, avg=207700.90, stdev=6024.06, samples=30 iops : min=46404, max=53912, avg=51925.20, stdev=1506.00, samples=30 write: IOPS=17.3k, BW=67.8MiB/s (71.1MB/s)(1026MiB/15141msec) bw ( KiB/s): min=62048, max=71976, per=100.00%, avg=69405.47, stdev=1991.82, samples=30 iops : min=15512, max=17994, avg=17351.37, stdev=497.96, samples=30 cpu : usr=14.75%, sys=49.09%, ctx=428129, majf=0, minf=22 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% issued rwt: total=785920,262656,0, short=0,0,0, dropped=0,0,0 latency : target=0, window=0, percentile=100.00%, depth=64 Run status group 0 (all jobs): READ: bw=203MiB/s (213MB/s), 203MiB/s-203MiB/s (213MB/s-213MB/s), io=3070MiB (3219MB), run=15141-15141msec WRITE: bw=67.8MiB/s (71.1MB/s), 67.8MiB/s-67.8MiB/s (71.1MB/s-71.1MB/s), io=1026MiB (1076MB), run=15141-15141msec Disk stats (read/write): fioa: ios=773851/258672, merge=0/0, ticks=452661/32417, in_queue=42526, util=61.84%