dd if=/dev/zero of=benchmark bs=64K count=32K conv=fdatasync 32768+0 records in 32768+0 records out 2147483648 bytes (2.1 GB) copied, 4.61822 s, 465 MB/s dd if=/dev/zero of=benchmark bs=1M count=2048 conv=fdatasync 2048+0 records in 2048+0 records out 2147483648 bytes (2.1 GB) copied, 4.49197 s, 478 MB/s
./fio --time_based --name=benchmark --size=256M --runtime=60 --randrepeat=1 --iodepth=32 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randread --blocksize=4k --group_reporting
benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: (groupid=0, jobs=8): err= 0: pid=4281: Sun Mar 12 11:18:29 2017
read : io=9947.2MB, bw=169760KB/s, iops=42439, runt= 60001msec
clat (usec): min=1, max=14929, avg=186.35, stdev=126.99
lat (usec): min=1, max=14929, avg=186.58, stdev=127.01
clat percentiles (usec):
| 1.00th=[ 1], 5.00th=[ 4], 10.00th=[ 139], 20.00th=[ 161],
| 30.00th=[ 173], 40.00th=[ 181], 50.00th=[ 191], 60.00th=[ 199],
| 70.00th=[ 211], 80.00th=[ 223], 90.00th=[ 245], 95.00th=[ 266],
| 99.00th=[ 330], 99.50th=[ 402], 99.90th=[ 1704], 99.95th=[ 1912],
| 99.99th=[ 2800]
bw (KB /s): min=17672, max=29680, per=12.50%, avg=21226.19, stdev=2203.24
lat (usec) : 2=1.16%, 4=3.83%, 10=3.45%, 20=0.48%, 50=0.03%
lat (usec) : 100=0.01%, 250=82.77%, 500=7.91%, 750=0.08%, 1000=0.03%
lat (msec) : 2=0.21%, 4=0.03%, 10=0.01%, 20=0.01%
cpu : usr=1.56%, sys=4.92%, ctx=2322366, majf=0, minf=80
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=2546436/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
READ: io=9947.2MB, aggrb=169759KB/s, minb=169759KB/s, maxb=169759KB/s, mint=60001msec, maxt=60001msec
Disk stats (read/write):
vda: ios=2310657/12, merge=0/3, ticks=422616/0, in_queue=422376, util=98.60%
./fio --time_based --name=benchmark --size=256M --runtime=60 --randrepeat=1 --iodepth=32 --direct=1 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randread --blocksize=4k --group_reporting
benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: (groupid=0, jobs=8): err= 0: pid=4293: Sun Mar 12 11:19:29 2017
read : io=9537.2MB, bw=162764KB/s, iops=40691, runt= 60001msec
clat (usec): min=111, max=13705, avg=194.22, stdev=76.84
lat (usec): min=111, max=13705, avg=194.45, stdev=76.85
clat percentiles (usec):
| 1.00th=[ 135], 5.00th=[ 147], 10.00th=[ 155], 20.00th=[ 165],
| 30.00th=[ 173], 40.00th=[ 181], 50.00th=[ 187], 60.00th=[ 197],
| 70.00th=[ 205], 80.00th=[ 219], 90.00th=[ 237], 95.00th=[ 255],
| 99.00th=[ 310], 99.50th=[ 354], 99.90th=[ 780], 99.95th=[ 1240],
| 99.99th=[ 2672]
bw (KB /s): min=15144, max=22656, per=12.50%, avg=20351.67, stdev=944.60
lat (usec) : 250=93.87%, 500=5.94%, 750=0.08%, 1000=0.04%
lat (msec) : 2=0.05%, 4=0.02%, 10=0.01%, 20=0.01%
cpu : usr=1.60%, sys=3.63%, ctx=2443515, majf=0, minf=79
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=2441503/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
READ: io=9537.2MB, aggrb=162764KB/s, minb=162764KB/s, maxb=162764KB/s, mint=60001msec, maxt=60001msec
Disk stats (read/write):
vda: ios=2438576/6, merge=0/0, ticks=418976/0, in_queue=418592, util=99.66%
./fio --time_based --name=benchmark --size=256M --runtime=60 --filename=benchmark --randrepeat=1 --iodepth=32 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randwrite --blocksize=4k --group_reporting
benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: (groupid=0, jobs=8): err= 0: pid=4316: Sun Mar 12 11:21:30 2017
write: io=47978MB, bw=818696KB/s, iops=204674, runt= 60009msec
clat (usec): min=0, max=160202, avg=34.36, stdev=1117.35
lat (usec): min=1, max=160202, avg=35.14, stdev=1130.34
clat percentiles (usec):
| 1.00th=[ 1], 5.00th=[ 2], 10.00th=[ 2], 20.00th=[ 2],
| 30.00th=[ 2], 40.00th=[ 2], 50.00th=[ 2], 60.00th=[ 2],
| 70.00th=[ 2], 80.00th=[ 3], 90.00th=[ 3], 95.00th=[ 3],
| 99.00th=[ 5], 99.50th=[ 10], 99.90th=[12096], 99.95th=[19072],
| 99.99th=[47872]
bw (KB /s): min=18703, max=148896, per=12.53%, avg=102592.94, stdev=17064.43
lat (usec) : 2=3.95%, 4=93.43%, 10=2.10%, 20=0.23%, 50=0.08%
lat (usec) : 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.01%, 10=0.05%, 20=0.08%, 50=0.03%
lat (msec) : 100=0.01%, 250=0.01%
cpu : usr=2.10%, sys=6.82%, ctx=45208, majf=0, minf=91
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=0/w=12282285/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
WRITE: io=47978MB, aggrb=818696KB/s, minb=818696KB/s, maxb=818696KB/s, mint=60009msec, maxt=60009msec
Disk stats (read/write):
vda: ios=0/732184, merge=0/0, ticks=0/5916908, in_queue=5916792, util=89.28%
./fio --time_based --name=benchmark --size=256M --runtime=60 --filename=benchmark --randrepeat=1 --iodepth=32 --direct=1 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randwrite --blocksize=4k --group_reporting
benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: (groupid=0, jobs=8): err= 0: pid=4306: Sun Mar 12 11:20:29 2017
write: io=2565.7MB, bw=43783KB/s, iops=10945, runt= 60004msec
clat (usec): min=55, max=63494, avg=728.07, stdev=5097.88
lat (usec): min=55, max=63494, avg=728.38, stdev=5097.90
clat percentiles (usec):
| 1.00th=[ 59], 5.00th=[ 66], 10.00th=[ 75], 20.00th=[ 83],
| 30.00th=[ 83], 40.00th=[ 84], 50.00th=[ 85], 60.00th=[ 86],
| 70.00th=[ 89], 80.00th=[ 94], 90.00th=[ 106], 95.00th=[ 124],
| 99.00th=[39680], 99.50th=[42752], 99.90th=[47360], 99.95th=[50944],
| 99.99th=[56064]
bw (KB /s): min= 3600, max= 8176, per=12.51%, avg=5476.87, stdev=695.68
lat (usec) : 100=87.28%, 250=11.02%, 500=0.08%, 750=0.02%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 50=1.51%
lat (msec) : 100=0.06%
cpu : usr=0.64%, sys=2.13%, ctx=1324150, majf=0, minf=81
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=0/w=656791/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
WRITE: io=2565.7MB, aggrb=43783KB/s, minb=43783KB/s, maxb=43783KB/s, mint=60004msec, maxt=60004msec
Disk stats (read/write):
vda: ios=1/657444, merge=0/187, ticks=0/49508, in_queue=49320, util=82.20%