dd if=/dev/zero of=benchmark bs=64K count=32K conv=fdatasync 32768+0 xd0xb7xd0xb0xd0xbfxd0xb8xd1x81xd0xb5xd0xb9 xd0xbfxd0xbexd0xbbxd1x83xd1x87xd0xb5xd0xbdxd0xbe 32768+0 xd0xb7xd0xb0xd0xbfxd0xb8xd1x81xd0xb5xd0xb9 xd0xbexd1x82xd0xbfxd1x80xd0xb0xd0xb2xd0xbbxd0xb5xd0xbdxd0xbe xd1x81xd0xbaxd0xbexd0xbfxd0xb8xd1x80xd0xbexd0xb2xd0xb0xd0xbdxd0xbe 2147483648 xd0xb1xd0xb0xd0xb9xd1x82 (2,1 GB), 10,734 c, 200 MB/c dd if=/dev/zero of=benchmark bs=1M count=2048 conv=fdatasync 2048+0 xd0xb7xd0xb0xd0xbfxd0xb8xd1x81xd0xb5xd0xb9 xd0xbfxd0xbexd0xbbxd1x83xd1x87xd0xb5xd0xbdxd0xbe 2048+0 xd0xb7xd0xb0xd0xbfxd0xb8xd1x81xd0xb5xd0xb9 xd0xbexd1x82xd0xbfxd1x80xd0xb0xd0xb2xd0xbbxd0xb5xd0xbdxd0xbe xd1x81xd0xbaxd0xbexd0xbfxd0xb8xd1x80xd0xbexd0xb2xd0xb0xd0xbdxd0xbe 2147483648 xd0xb1xd0xb0xd0xb9xd1x82 (2,1 GB), 10,0817 c, 213 MB/c
./fio --time_based --name=benchmark --size=256M --runtime=60 --randrepeat=1 --iodepth=32 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randread --blocksize=4k --group_reporting benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32 ... fio-2.8 Starting 8 processes benchmark: Laying out IO file(s) (1 file(s) / 256MB) benchmark: Laying out IO file(s) (1 file(s) / 256MB) benchmark: Laying out IO file(s) (1 file(s) / 256MB) benchmark: Laying out IO file(s) (1 file(s) / 256MB) benchmark: Laying out IO file(s) (1 file(s) / 256MB) benchmark: Laying out IO file(s) (1 file(s) / 256MB) benchmark: Laying out IO file(s) (1 file(s) / 256MB) benchmark: Laying out IO file(s) (1 file(s) / 256MB) benchmark: (groupid=0, jobs=8): err= 0: pid=1210: Fri Sep 15 20:34:15 2017 read : io=58583MB, bw=999786KB/s, iops=249946, runt= 60002msec clat (usec): min=3, max=44246, avg=22.92, stdev=253.08 lat (usec): min=3, max=44247, avg=24.18, stdev=265.33 clat percentiles (usec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 4], | 30.00th=[ 4], 40.00th=[ 4], 50.00th=[ 4], 60.00th=[ 5], | 70.00th=[ 5], 80.00th=[ 5], 90.00th=[ 5], 95.00th=[ 6], | 99.00th=[ 422], 99.50th=[ 564], 99.90th=[ 1336], 99.95th=[ 5472], | 99.99th=[10304] bw (KB /s): min= 4528, max=410640, per=12.44%, avg=124326.46, stdev=104759.42 lat (usec) : 4=0.12%, 10=95.75%, 20=0.22%, 50=0.18%, 100=0.12% lat (usec) : 250=1.34%, 500=1.61%, 750=0.42%, 1000=0.11% lat (msec) : 2=0.06%, 4=0.02%, 10=0.01%, 20=0.04%, 50=0.01% cpu : usr=13.25%, sys=22.55%, ctx=565318, majf=0, minf=99 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued : total=r=14997286/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0 latency : target=0, window=0, percentile=100.00%, depth=32 Run status group 0 (all jobs): READ: io=58583MB, aggrb=999785KB/s, minb=999785KB/s, maxb=999785KB/s, mint=60002msec, maxt=60002msec Disk stats (read/write): vda: ios=524288/55, merge=0/97, ticks=158610/580, in_queue=159610, util=48.89%
./fio --time_based --name=benchmark --size=256M --runtime=60 --randrepeat=1 --iodepth=32 --direct=1 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randread --blocksize=4k --group_reporting benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32 ... fio-2.8 Starting 8 processes benchmark: (groupid=0, jobs=8): err= 0: pid=1220: Fri Sep 15 20:35:15 2017 read : io=6493.1MB, bw=110826KB/s, iops=27706, runt= 60002msec clat (usec): min=60, max=35892, avg=275.90, stdev=345.69 lat (usec): min=61, max=35893, avg=277.11, stdev=346.48 clat percentiles (usec): | 1.00th=[ 106], 5.00th=[ 129], 10.00th=[ 147], 20.00th=[ 169], | 30.00th=[ 187], 40.00th=[ 203], 50.00th=[ 221], 60.00th=[ 241], | 70.00th=[ 270], 80.00th=[ 314], 90.00th=[ 406], 95.00th=[ 532], | 99.00th=[ 1080], 99.50th=[ 1688], 99.90th=[ 4832], 99.95th=[ 6688], | 99.99th=[12224] bw (KB /s): min= 5544, max=20288, per=12.49%, avg=13846.80, stdev=2097.15 lat (usec) : 100=0.43%, 250=62.86%, 500=30.83%, 750=3.76%, 1000=0.98% lat (msec) : 2=0.73%, 4=0.26%, 10=0.13%, 20=0.02%, 50=0.01% cpu : usr=4.48%, sys=15.12%, ctx=1681627, majf=0, minf=90 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued : total=r=1662449/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0 latency : target=0, window=0, percentile=100.00%, depth=32 Run status group 0 (all jobs): READ: io=6493.1MB, aggrb=110826KB/s, minb=110826KB/s, maxb=110826KB/s, mint=60002msec, maxt=60002msec Disk stats (read/write): vda: ios=1662307/18, merge=0/13, ticks=310590/10, in_queue=311570, util=99.48%
./fio --time_based --name=benchmark --size=256M --runtime=60 --filename=benchmark --randrepeat=1 --iodepth=32 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randwrite --blocksize=4k --group_reporting benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32 ... fio-2.8 Starting 8 processes benchmark: (groupid=0, jobs=8): err= 0: pid=1242: Fri Sep 15 20:37:16 2017 write: io=34056MB, bw=581189KB/s, iops=145297, runt= 60003msec clat (usec): min=5, max=539766, avg=47.03, stdev=1084.89 lat (usec): min=6, max=539767, avg=48.11, stdev=1088.18 clat percentiles (usec): | 1.00th=[ 7], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 9], 50.00th=[ 10], 60.00th=[ 13], | 70.00th=[ 14], 80.00th=[ 15], 90.00th=[ 16], 95.00th=[ 18], | 99.00th=[ 109], 99.50th=[ 231], 99.90th=[12224], 99.95th=[20352], | 99.99th=[30592] bw (KB /s): min= 3662, max=132933, per=12.53%, avg=72819.61, stdev=19946.98 lat (usec) : 10=45.65%, 20=50.08%, 50=2.43%, 100=0.74%, 250=0.64% lat (usec) : 500=0.17%, 750=0.04%, 1000=0.02% lat (msec) : 2=0.03%, 4=0.02%, 10=0.05%, 20=0.09%, 50=0.06% lat (msec) : 100=0.01%, 500=0.01%, 750=0.01% cpu : usr=10.79%, sys=28.11%, ctx=84071, majf=0, minf=92 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued : total=r=0/w=8718273/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0 latency : target=0, window=0, percentile=100.00%, depth=32 Run status group 0 (all jobs): WRITE: io=34056MB, aggrb=581189KB/s, minb=581189KB/s, maxb=581189KB/s, mint=60003msec, maxt=60003msec Disk stats (read/write): vda: ios=0/132431, merge=0/409, ticks=0/1120670, in_queue=1120750, util=27.99%
./fio --time_based --name=benchmark --size=256M --runtime=60 --filename=benchmark --randrepeat=1 --iodepth=32 --direct=1 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randwrite --blocksize=4k --group_reporting benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32 ... fio-2.8 Starting 8 processes benchmark: Laying out IO file(s) (1 file(s) / 256MB) benchmark: (groupid=0, jobs=8): err= 0: pid=1232: Fri Sep 15 20:36:15 2017 write: io=761036KB, bw=12642KB/s, iops=3160, runt= 60200msec clat (usec): min=111, max=1201.9K, avg=2517.68, stdev=11928.04 lat (usec): min=112, max=1201.9K, avg=2519.03, stdev=11928.22 clat percentiles (usec): | 1.00th=[ 122], 5.00th=[ 139], 10.00th=[ 155], 20.00th=[ 181], | 30.00th=[ 207], 40.00th=[ 247], 50.00th=[ 402], 60.00th=[ 1992], | 70.00th=[ 2416], 80.00th=[ 2992], 90.00th=[ 4384], 95.00th=[ 7264], | 99.00th=[26496], 99.50th=[39680], 99.90th=[85504], 99.95th=[216064], | 99.99th=[399360] bw (KB /s): min= 69, max= 8072, per=12.86%, avg=1625.54, stdev=1184.81 lat (usec) : 250=40.70%, 500=10.57%, 750=1.20%, 1000=0.26% lat (msec) : 2=7.51%, 4=28.01%, 10=8.14%, 20=2.16%, 50=1.09% lat (msec) : 100=0.27%, 250=0.03%, 500=0.04%, 2000=0.01% cpu : usr=0.73%, sys=4.63%, ctx=391459, majf=0, minf=93 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued : total=r=0/w=190259/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0 latency : target=0, window=0, percentile=100.00%, depth=32 Run status group 0 (all jobs): WRITE: io=761036KB, aggrb=12641KB/s, minb=12641KB/s, maxb=12641KB/s, mint=60200msec, maxt=60200msec Disk stats (read/write): vda: ios=0/190423, merge=0/2425, ticks=0/48180, in_queue=48280, util=69.35%
Downloaded 104857600 bytes in 0,633 sec Downloaded 104857600 bytes in 0,842 sec Downloaded 104857600 bytes in 0,535 sec Downloaded 104857600 bytes in 0,859 sec Downloaded 104857600 bytes in 0,740 sec Finished! Average download speed is 1108.34 Mbit/s