Sample Header Ad - 728x90

understanding fio test results - 90th percentiles benchmark - Latency --> avg/stdev?

0 votes
0 answers
809 views
What are the relationships in storage benchmarking with fio between the average(avg) and standard deviation (stdev) at latency? Avg / stdev at latency is important for sequential or random test? Most I/O subsystems are very well tuned that the standard deviation has little significance for sequential accesses. Furthermore, it is of interest how the standard deviation is with the random test. is that right? I was advised that in cases where the avg/stdev ratio related to latency is 5 %, the system is still problem-free in cases where the system is optimal 10% but at higher rates there is a problem in the system. fio --rw=randrw --name=test_zufaellig_oci --bs=4k --direct=1 --size=10G --ioengine=libaio --runtime=5400 --time_based OCI test_zufaellig_oci: (groupid=0, jobs=1): err= 0: pid=16244: Thu Dec 29 17:16:45 2022 read: IOPS=1313, BW=5255KiB/s (5381kB/s)(27.1GiB/5400001msec) slat (usec): min=7, max=1665, avg=16.39, stdev= 6.30 clat (usec): min=3, max=202186, avg=354.88, stdev=167.22 lat (usec): min=290, max=202206, **avg=371.52, stdev=167.53** clat percentiles (usec): | 1.00th=[ 310], 5.00th=[ 318], 10.00th=[ 322], 20.00th=[ 330], | 30.00th=[ 334], 40.00th=[ 338], 50.00th=[ 343], 60.00th=[ 351], | 70.00th=[ 355], 80.00th=[ 363], 90.00th=[ 383], 95.00th=[ 408], | 99.00th=[ 498], 99.50th=[ 611], 99.90th=[ 1762], 99.95th=[ 2376], | 99.99th=[ 6128] bw ( KiB/s): min= 816, max= 6096, per=100.00%, avg=5263.74, stdev=325.49, samples=10781 iops : min= 204, max= 1524, avg=1315.94, stdev=81.37, samples=10781 ----- AWS test_zufaellig_aws: (groupid=0, jobs=1): err= 0: pid=2960: Thu Dec 29 17:16:54 2022 read: IOPS=315, BW=1261KiB/s (1291kB/s)(6648MiB/5400007msec) slat (usec): min=6, max=107, avg=19.35, stdev= 4.90 clat (usec): min=190, max=113470, avg=1472.25, stdev=2373.50 lat (usec): min=207, max=113491, **avg=1492.51, stdev=2374.87** clat percentiles (usec): | 1.00th=[ 318], 5.00th=[ 347], 10.00th=[ 363], 20.00th=[ 392], | 30.00th=[ 412], 40.00th=[ 429], 50.00th=[ 453], 60.00th=[ 482], | 70.00th=[ 529], 80.00th=[ 644], 90.00th=[ 6915], 95.00th=[ 7046], | 99.00th=[ 7177], 99.50th=[ 7242], 99.90th=[ 7504], 99.95th=[ 7635], | 99.99th= bw ( KiB/s): min= 144, max= 4184, per=100.00%, avg=1262.50, stdev=1493.09, samples=10783 iops : min= 36, max= 1046, avg=315.63, stdev=373.27, samples=10783
Asked by Hamza Karabulut (1 rep)
Dec 29, 2022, 09:42 PM