dd if=/dev/zero of=benchmark bs=64K count=32K conv=fdatasync 32768+0 records in 32768+0 records out 2147483648 bytes (2.1 GB) copied, 4.61407 s, 465 MB/s dd if=/dev/zero of=benchmark bs=1M count=2048 conv=fdatasync 2048+0 records in 2048+0 records out 2147483648 bytes (2.1 GB) copied, 3.09957 s, 693 MB/s
./fio --time_based --name=benchmark --size=256M --runtime=60 --randrepeat=1 --iodepth=32 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randread --blocksize=4k --group_reporting
benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: (groupid=0, jobs=8): err= 0: pid=16538: Thu Nov 23 09:53:55 2017
read : io=647652KB, bw=10784KB/s, iops=2695, runt= 60058msec
clat (usec): min=27, max=378192, avg=2961.47, stdev=9475.16
lat (usec): min=27, max=378193, avg=2961.63, stdev=9475.17
clat percentiles (usec):
| 1.00th=[ 37], 5.00th=[ 51], 10.00th=[ 155], 20.00th=[ 187],
| 30.00th=[ 237], 40.00th=[ 318], 50.00th=[ 804], 60.00th=[ 1032],
| 70.00th=[ 1864], 80.00th=[ 2008], 90.00th=[ 5216], 95.00th=[12352],
| 99.00th=[52992], 99.50th=[72192], 99.90th=[96768], 99.95th=[142336],
| 99.99th=[162816]
bw (KB /s): min= 63, max= 7544, per=12.80%, avg=1379.74, stdev=1349.08
lat (usec) : 50=4.58%, 100=3.66%, 250=26.56%, 500=9.48%, 750=4.68%
lat (usec) : 1000=8.20%
lat (msec) : 2=20.94%, 4=10.79%, 10=5.14%, 20=3.04%, 50=1.87%
lat (msec) : 100=0.98%, 250=0.09%, 500=0.01%
cpu : usr=0.12%, sys=0.61%, ctx=218898, majf=0, minf=316
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=161913/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
READ: io=647652KB, aggrb=10783KB/s, minb=10783KB/s, maxb=10783KB/s, mint=60058msec, maxt=60058msec
./fio --time_based --name=benchmark --size=256M --runtime=60 --randrepeat=1 --iodepth=32 --direct=1 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randread --blocksize=4k --group_reporting
benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: (groupid=0, jobs=8): err= 0: pid=16552: Thu Nov 23 09:54:55 2017
read : io=57364KB, bw=978278B/s, iops=238, runt= 60045msec
clat (usec): min=38, max=1088.7K, avg=33454.19, stdev=63093.28
lat (usec): min=38, max=1088.7K, avg=33454.46, stdev=63093.29
clat percentiles (usec):
| 1.00th=[ 175], 5.00th=[ 362], 10.00th=[ 900], 20.00th=[ 1704],
| 30.00th=[ 2896], 40.00th=[ 4896], 50.00th=[ 8384], 60.00th=[14016],
| 70.00th=[27264], 80.00th=[65280], 90.00th=[84480], 95.00th=[138240],
| 99.00th=[305152], 99.50th=[428032], 99.90th=[643072], 99.95th=[782336],
| 99.99th=[921600]
bw (KB /s): min= 6, max= 365, per=12.84%, avg=122.66, stdev=55.44
lat (usec) : 50=0.04%, 100=0.47%, 250=2.36%, 500=3.28%, 750=2.04%
lat (usec) : 1000=3.63%
lat (msec) : 2=11.09%, 4=13.69%, 10=16.60%, 20=12.70%, 50=10.24%
lat (msec) : 100=16.87%, 250=5.60%, 500=1.05%, 750=0.29%, 1000=0.05%
lat (msec) : 2000=0.01%
cpu : usr=0.02%, sys=0.10%, ctx=15215, majf=0, minf=300
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=14341/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
READ: io=57364KB, aggrb=955KB/s, minb=955KB/s, maxb=955KB/s, mint=60045msec, maxt=60045msec
./fio --time_based --name=benchmark --size=256M --runtime=60 --filename=benchmark --randrepeat=1 --iodepth=32 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randwrite --blocksize=4k --group_reporting
benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: (groupid=0, jobs=8): err= 0: pid=16620: Thu Nov 23 09:56:56 2017
write: io=47293MB, bw=806971KB/s, iops=201742, runt= 60012msec
clat (usec): min=1, max=1146.2K, avg=13.17, stdev=958.11
lat (usec): min=1, max=1146.2K, avg=13.44, stdev=962.64
clat percentiles (usec):
| 1.00th=[ 2], 5.00th=[ 2], 10.00th=[ 2], 20.00th=[ 2],
| 30.00th=[ 3], 40.00th=[ 3], 50.00th=[ 3], 60.00th=[ 3],
| 70.00th=[ 3], 80.00th=[ 3], 90.00th=[ 4], 95.00th=[ 5],
| 99.00th=[ 7], 99.50th=[ 11], 99.90th=[ 988], 99.95th=[ 5600],
| 99.99th=[17280]
bw (KB /s): min= 10, max=291436, per=13.20%, avg=106555.54, stdev=43891.41
lat (usec) : 2=0.28%, 4=87.23%, 10=11.89%, 20=0.29%, 50=0.13%
lat (usec) : 100=0.03%, 250=0.02%, 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.02%, 4=0.02%, 10=0.04%, 20=0.02%, 50=0.01%
lat (msec) : 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2000=0.01%
cpu : usr=1.77%, sys=9.29%, ctx=180568, majf=0, minf=285
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=0/w=12106985/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
WRITE: io=47293MB, aggrb=806970KB/s, minb=806970KB/s, maxb=806970KB/s, mint=60012msec, maxt=60012msec
./fio --time_based --name=benchmark --size=256M --runtime=60 --filename=benchmark --randrepeat=1 --iodepth=32 --direct=1 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randwrite --blocksize=4k --group_reporting
benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: (groupid=0, jobs=8): err= 0: pid=16567: Thu Nov 23 09:55:56 2017
write: io=41655MB, bw=710901KB/s, iops=177725, runt= 60001msec
clat (usec): min=1, max=917846, avg=15.26, stdev=1153.14
lat (usec): min=1, max=917847, avg=15.55, stdev=1160.40
clat percentiles (usec):
| 1.00th=[ 1], 5.00th=[ 2], 10.00th=[ 2], 20.00th=[ 2],
| 30.00th=[ 3], 40.00th=[ 3], 50.00th=[ 3], 60.00th=[ 3],
| 70.00th=[ 3], 80.00th=[ 3], 90.00th=[ 4], 95.00th=[ 5],
| 99.00th=[ 7], 99.50th=[ 12], 99.90th=[ 1208], 99.95th=[ 5984],
| 99.99th=[21120]
bw (KB /s): min= 4, max=229905, per=13.07%, avg=92925.88, stdev=48251.65
lat (usec) : 2=1.17%, 4=86.59%, 10=11.60%, 20=0.28%, 50=0.15%
lat (usec) : 100=0.04%, 250=0.02%, 500=0.02%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.02%, 4=0.02%, 10=0.04%, 20=0.02%, 50=0.01%
lat (msec) : 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
cpu : usr=1.57%, sys=8.03%, ctx=161606, majf=0, minf=302
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=0/w=10663690/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
WRITE: io=41655MB, aggrb=710900KB/s, minb=710900KB/s, maxb=710900KB/s, mint=60001msec, maxt=60001msec
Downloaded 104857600 bytes in 0.980 sec Downloaded 104857600 bytes in 0.965 sec Downloaded 104857600 bytes in 0.979 sec Downloaded 104857600 bytes in 0.735 sec Downloaded 104857600 bytes in 1.087 sec Finished! Average download speed is 842.82 Mbit/s