dd if=/dev/zero of=benchmark bs=64K count=32K conv=fdatasync 32768+0 records in 32768+0 records out 2147483648 bytes (2.1 GB) copied, 43.3759 s, 49.5 MB/s dd if=/dev/zero of=benchmark bs=1M count=2048 conv=fdatasync 2048+0 records in 2048+0 records out 2147483648 bytes (2.1 GB) copied, 41.0644 s, 52.3 MB/s
./fio --time_based --name=benchmark --size=256M --runtime=60 --randrepeat=1 --iodepth=32 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randread --blocksize=4k --group_reporting
benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: (groupid=0, jobs=8): err= 0: pid=16846: Mon Mar 13 22:52:04 2017
read : io=96144KB, bw=1601.9KB/s, iops=400, runt= 60020msec
clat (usec): min=143, max=1132.1K, avg=19964.22, stdev=10066.38
lat (usec): min=144, max=1132.1K, avg=19965.05, stdev=10066.38
clat percentiles (msec):
| 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 18], 20.00th=[ 19],
| 30.00th=[ 20], 40.00th=[ 20], 50.00th=[ 20], 60.00th=[ 21],
| 70.00th=[ 21], 80.00th=[ 21], 90.00th=[ 22], 95.00th=[ 25],
| 99.00th=[ 28], 99.50th=[ 31], 99.90th=[ 51], 99.95th=[ 59],
| 99.99th=[ 108]
bw (KB /s): min= 3, max= 357, per=12.53%, avg=200.54, stdev=17.21
lat (usec) : 250=0.13%, 500=0.10%
lat (msec) : 2=0.01%, 4=0.08%, 10=0.05%, 20=58.00%, 50=41.52%
lat (msec) : 100=0.09%, 250=0.01%, 2000=0.01%
cpu : usr=0.08%, sys=0.31%, ctx=24143, majf=0, minf=89
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=24036/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
READ: io=96144KB, aggrb=1601KB/s, minb=1601KB/s, maxb=1601KB/s, mint=60020msec, maxt=60020msec
Disk stats (read/write):
sda: ios=24019/8, merge=0/13, ticks=478196/24, in_queue=724708, util=99.91%
./fio --time_based --name=benchmark --size=256M --runtime=60 --randrepeat=1 --iodepth=32 --direct=1 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randread --blocksize=4k --group_reporting
benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: (groupid=0, jobs=8): err= 0: pid=16864: Mon Mar 13 22:53:04 2017
read : io=96176KB, bw=1602.4KB/s, iops=400, runt= 60022msec
clat (usec): min=129, max=52763, avg=19955.22, stdev=1242.01
lat (usec): min=129, max=52763, avg=19956.04, stdev=1242.01
clat percentiles (usec):
| 1.00th=[17792], 5.00th=[19328], 10.00th=[19328], 20.00th=[19584],
| 30.00th=[19584], 40.00th=[19584], 50.00th=[19840], 60.00th=[20352],
| 70.00th=[20352], 80.00th=[20608], 90.00th=[20608], 95.00th=[20608],
| 99.00th=[20864], 99.50th=[22656], 99.90th=[26752], 99.95th=[28800],
| 99.99th=[50432]
bw (KB /s): min= 186, max= 326, per=12.50%, avg=200.33, stdev= 5.07
lat (usec) : 250=0.09%, 500=0.05%, 750=0.01%, 1000=0.01%
lat (msec) : 4=0.06%, 10=0.04%, 20=55.83%, 50=43.91%, 100=0.01%
cpu : usr=0.07%, sys=0.32%, ctx=24084, majf=0, minf=81
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=24044/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
READ: io=96176KB, aggrb=1602KB/s, minb=1602KB/s, maxb=1602KB/s, mint=60022msec, maxt=60022msec
Disk stats (read/write):
sda: ios=24015/2, merge=0/2, ticks=478044/4, in_queue=864564, util=99.91%
./fio --time_based --name=benchmark --size=256M --runtime=60 --filename=benchmark --randrepeat=1 --iodepth=32 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randwrite --blocksize=4k --group_reporting
benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: (groupid=0, jobs=8): err= 0: pid=16902: Mon Mar 13 22:55:20 2017
write: io=9389.5MB, bw=128552KB/s, iops=32138, runt= 74793msec
clat (usec): min=1, max=32391K, avg=247.01, stdev=82323.52
lat (usec): min=1, max=32391K, avg=247.31, stdev=82323.54
clat percentiles (usec):
| 1.00th=[ 2], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3],
| 30.00th=[ 4], 40.00th=[ 4], 50.00th=[ 5], 60.00th=[ 5],
| 70.00th=[ 5], 80.00th=[ 5], 90.00th=[ 6], 95.00th=[ 6],
| 99.00th=[ 10], 99.50th=[ 16], 99.90th=[10176], 99.95th=[16320],
| 99.99th=[23936]
bw (KB /s): min= 213, max=215203, per=87.37%, avg=112315.43, stdev=62153.45
lat (usec) : 2=0.89%, 4=21.58%, 10=76.32%, 20=0.90%, 50=0.12%
lat (usec) : 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.01%, 10=0.04%, 20=0.08%, 50=0.02%
lat (msec) : 500=0.01%, 750=0.01%, 2000=0.01%, >=2000=0.01%
cpu : usr=0.29%, sys=1.97%, ctx=24380, majf=0, minf=94
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=0/w=2403702/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
WRITE: io=9389.5MB, aggrb=128552KB/s, minb=128552KB/s, maxb=128552KB/s, mint=74793msec, maxt=74793msec
Disk stats (read/write):
sda: ios=0/29790, merge=0/25624, ticks=0/9587788, in_queue=9627908, util=99.45%
./fio --time_based --name=benchmark --size=256M --runtime=60 --filename=benchmark --randrepeat=1 --iodepth=32 --direct=1 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randwrite --blocksize=4k --group_reporting
benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: (groupid=0, jobs=8): err= 0: pid=16884: Mon Mar 13 22:54:04 2017
write: io=95472KB, bw=1590.7KB/s, iops=397, runt= 60020msec
clat (usec): min=185, max=2717.1K, avg=20104.44, stdev=114941.16
lat (usec): min=186, max=2717.1K, avg=20105.43, stdev=114941.20
clat percentiles (usec):
| 1.00th=[ 262], 5.00th=[ 326], 10.00th=[ 1416], 20.00th=[ 2384],
| 30.00th=[ 2448], 40.00th=[ 2448], 50.00th=[ 2480], 60.00th=[ 2480],
| 70.00th=[ 2512], 80.00th=[ 2544], 90.00th=[ 3632], 95.00th=[ 7968],
| 99.00th=[544768], 99.50th=[757760], 99.90th=[1515520], 99.95th=[2088960],
| 99.99th=[2310144]
bw (KB /s): min= 1, max= 1672, per=14.88%, avg=236.67, stdev=319.62
lat (usec) : 250=0.53%, 500=6.61%, 750=0.06%, 1000=0.21%
lat (msec) : 2=11.06%, 4=74.58%, 10=2.52%, 20=0.81%, 50=0.06%
lat (msec) : 100=0.04%, 250=0.74%, 500=1.57%, 750=0.71%, 1000=0.21%
lat (msec) : 2000=0.25%, >=2000=0.05%
cpu : usr=0.07%, sys=0.38%, ctx=48206, majf=0, minf=83
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=0/w=23868/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
WRITE: io=95472KB, aggrb=1590KB/s, minb=1590KB/s, maxb=1590KB/s, mint=60020msec, maxt=60020msec
Disk stats (read/write):
sda: ios=0/23968, merge=0/1603, ticks=0/60272, in_queue=60232, util=95.69%