Stopwatch
Performance report #4317
SSD NodesKVM - LEB Large
Report
Share test result

Test results for KVM - LEB Large at SSD Nodes


Server specs:


4 × Intel Core Processor (Haswell, no TSX)
8 GB RAM / 82 GB disk space
Ubuntu 16.04 Xenial
Tustin, United States

Benchmark results summary:


UnixBench - 3920.9
Disk Read - 8000 MB/s
Disk Write - 1940 MB/s
Bandwidth - 268.87 MB/s

More: https://serverscope.io/trials/41d9
Share
Share this page
Cpu chip
Server Specs
CPU
4 × Intel Core Processor (Haswell, no TSX)
CPU Cores
4 × 2600 MHz
RAM
8 GB
Disk
82 GB
OS
Ubuntu 16.04 Xenial
Location
Tustin, United States
Benchmark summary
Benchmark summary
UnixBench
3920.9
Disk Read
8000 MB/s
Disk Write
1940 MB/s
Bandwidth
268.87 Mbit/s
Speedtest
133.2 Mbit/s
Graph analysis
UnixBench Score
UnixBench (all CPUs)
3920.9
UnixBench (one CPU)
2154.9
Terminal
Raw Output
gcc -o pgms/arithoh -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Darithoh src/arith.c 
gcc -o pgms/register -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum="register int" src/arith.c 
gcc -o pgms/short -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum=short src/arith.c 
gcc -o pgms/int -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum=int src/arith.c 
gcc -o pgms/long -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum=long src/arith.c 
gcc -o pgms/float -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum=float src/arith.c 
gcc -o pgms/double -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum=double src/arith.c 
gcc -o pgms/hanoi -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/hanoi.c 
gcc -o pgms/syscall -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/syscall.c 
gcc -o pgms/context1 -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/context1.c 
gcc -o pgms/pipe -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/pipe.c 
src/pipe.c: In function xe2x80x98mainxe2x80x99:
src/pipe.c:52:2: warning: ignoring return value of xe2x80x98pipexe2x80x99, declared with attribute warn_unused_result [-Wunused-result]
  pipe(pvec);
  ^
gcc -o pgms/spawn -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/spawn.c 
gcc -o pgms/execl -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/execl.c 
In file included from src/execl.c:34:0:
src/big.c: In function xe2x80x98dummyxe2x80x99:
src/big.c:109:5: warning: ignoring return value of xe2x80x98freopenxe2x80x99, declared with attribute warn_unused_result [-Wunused-result]
     freopen("masterlog.00", "a", stderr);
     ^
src/big.c:197:6: warning: ignoring return value of xe2x80x98freopenxe2x80x99, declared with attribute warn_unused_result [-Wunused-result]
      freopen(logname, "w", stderr);
      ^
src/big.c:221:3: warning: ignoring return value of xe2x80x98dupxe2x80x99, declared with attribute warn_unused_result [-Wunused-result]
   dup(pvec[0]);
   ^
src/big.c:225:6: warning: ignoring return value of xe2x80x98freopenxe2x80x99, declared with attribute warn_unused_result [-Wunused-result]
      freopen(logname, "w", stderr);
      ^
src/big.c:318:4: warning: ignoring return value of xe2x80x98writexe2x80x99, declared with attribute warn_unused_result [-Wunused-result]
    write(fcopy, cp->line, p - cp->line + 1);
    ^
gcc -o pgms/dhry2 -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -DHZ= ./src/dhry_1.c ./src/dhry_2.c
gcc -o pgms/dhry2reg -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -DHZ= -DREG=register ./src/dhry_1.c ./src/dhry_2.c
gcc -o pgms/looper -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/looper.c 
gcc -o pgms/fstime -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/fstime.c 
gcc -o pgms/whetstone-double -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -DDP -DUNIX -DUNIXBENCH src/whets.c -lm
make all
make[1]: Entering directory "/serverscope-Mew32N/byte-unixbench/UnixBench"
make distr
make[2]: Entering directory "/serverscope-Mew32N/byte-unixbench/UnixBench"
Checking distribution of files
./pgms  exists
./src  exists
./testdir  exists
make[2]: Leaving directory "/serverscope-Mew32N/byte-unixbench/UnixBench"
make programs
make[2]: Entering directory "/serverscope-Mew32N/byte-unixbench/UnixBench"
make[2]: Nothing to be done for "programs".
make[2]: Leaving directory "/serverscope-Mew32N/byte-unixbench/UnixBench"
make[1]: Leaving directory "/serverscope-Mew32N/byte-unixbench/UnixBench"
sh: 1: 3dinfo: not found

   #    #  #    #  #  #    #          #####   ######  #    #   ####   #    #
   #    #  ##   #  #   #  #           #    #  #       ##   #  #    #  #    #
   #    #  # #  #  #    ##            #####   #####   # #  #  #       ######
   #    #  #  # #  #    ##            #    #  #       #  # #  #       #    #
   #    #  #   ##  #   #  #           #    #  #       #   ##  #    #  #    #
    ####   #    #  #  #    #          #####   ######  #    #   ####   #    #

   Version 5.1.3                      Based on the Byte Magazine Unix Benchmark

   Multi-CPU version                  Version 5 revisions by Ian Smith,
                                      Sunnyvale, CA, USA
   January 13, 2011                   johantheghost at yahoo period com


1 x Dhrystone 2 using register variables  1 2 3 4 5 6 7 8 9 10

1 x Double-Precision Whetstone  1 2 3 4 5 6 7 8 9 10

1 x Execl Throughput  1 2 3

1 x File Copy 1024 bufsize 2000 maxblocks  1 2 3

1 x File Copy 256 bufsize 500 maxblocks  1 2 3

1 x File Copy 4096 bufsize 8000 maxblocks  1 2 3

1 x Pipe Throughput  1 2 3 4 5 6 7 8 9 10

1 x Pipe-based Context Switching  1 2 3 4 5 6 7 8 9 10

1 x Process Creation  1 2 3

1 x System Call Overhead  1 2 3 4 5 6 7 8 9 10

1 x Shell Scripts (1 concurrent)  1 2 3

1 x Shell Scripts (8 concurrent)  1 2 3

4 x Dhrystone 2 using register variables  1 2 3 4 5 6 7 8 9 10

4 x Double-Precision Whetstone  1 2 3 4 5 6 7 8 9 10

4 x Execl Throughput  1 2 3

4 x File Copy 1024 bufsize 2000 maxblocks  1 2 3

4 x File Copy 256 bufsize 500 maxblocks  1 2 3

4 x File Copy 4096 bufsize 8000 maxblocks  1 2 3

4 x Pipe Throughput  1 2 3 4 5 6 7 8 9 10

4 x Pipe-based Context Switching  1 2 3 4 5 6 7 8 9 10

4 x Process Creation  1 2 3

4 x System Call Overhead  1 2 3 4 5 6 7 8 9 10

4 x Shell Scripts (1 concurrent)  1 2 3

4 x Shell Scripts (8 concurrent)  1 2 3

========================================================================
   BYTE UNIX Benchmarks (Version 5.1.3)

   System: ubuntu: GNU/Linux
   OS: GNU/Linux -- 4.4.0-72-generic -- #93-Ubuntu SMP Fri Mar 31 14:07:41 UTC 2017
   Machine: x86_64 (x86_64)
   Language: en_US.utf8 (charmap="UTF-8", collate="UTF-8")
   CPU 0: Intel Core Processor (Haswell, no TSX) (5200.0 bogomips)
          Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET
   CPU 1: Intel Core Processor (Haswell, no TSX) (5200.0 bogomips)
          Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET
   CPU 2: Intel Core Processor (Haswell, no TSX) (5200.0 bogomips)
          Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET
   CPU 3: Intel Core Processor (Haswell, no TSX) (5200.0 bogomips)
          Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET
   15:06:34 up 6 min,  0 users,  load average: 7.35, 4.46, 1.87; runlevel 2017-10-11

------------------------------------------------------------------------
Benchmark Run: Wed Oct 11 2017 15:06:34 - 15:34:36
4 CPUs in system; running 1 parallel copy of tests

Dhrystone 2 using register variables       41264209.3 lps   (10.0 s, 7 samples)
Double-Precision Whetstone                     4381.7 MWIPS (9.8 s, 7 samples)
Execl Throughput                               4872.6 lps   (30.0 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks       1385424.1 KBps  (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks          373645.6 KBps  (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks       4007549.5 KBps  (30.0 s, 2 samples)
Pipe Throughput                             2767761.1 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                 172003.5 lps   (10.0 s, 7 samples)
Process Creation                              13023.6 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                  13650.2 lpm   (60.0 s, 2 samples)
Shell Scripts (8 concurrent)                   3862.7 lpm   (60.0 s, 2 samples)
System Call Overhead                        4211330.0 lps   (10.0 s, 7 samples)

System Benchmarks Index Values               BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0   41264209.3   3535.9
Double-Precision Whetstone                       55.0       4381.7    796.7
Execl Throughput                                 43.0       4872.6   1133.2
File Copy 1024 bufsize 2000 maxblocks          3960.0    1385424.1   3498.5
File Copy 256 bufsize 500 maxblocks            1655.0     373645.6   2257.7
File Copy 4096 bufsize 8000 maxblocks          5800.0    4007549.5   6909.6
Pipe Throughput                               12440.0    2767761.1   2224.9
Pipe-based Context Switching                   4000.0     172003.5    430.0
Process Creation                                126.0      13023.6   1033.6
Shell Scripts (1 concurrent)                     42.4      13650.2   3219.4
Shell Scripts (8 concurrent)                      6.0       3862.7   6437.8
System Call Overhead                          15000.0    4211330.0   2807.6
                                                                   ========
System Benchmarks Index Score                                        2154.9

------------------------------------------------------------------------
Benchmark Run: Wed Oct 11 2017 15:34:36 - 16:02:42
4 CPUs in system; running 4 parallel copies of tests

Dhrystone 2 using register variables      156190798.7 lps   (10.0 s, 7 samples)
Double-Precision Whetstone                    16656.9 MWIPS (9.8 s, 7 samples)
Execl Throughput                              16129.1 lps   (29.8 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks        725559.7 KBps  (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks          201973.9 KBps  (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks       2456419.3 KBps  (30.0 s, 2 samples)
Pipe Throughput                            10605421.0 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                 934825.7 lps   (10.0 s, 7 samples)
Process Creation                              33977.4 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                  36818.6 lpm   (60.0 s, 2 samples)
Shell Scripts (8 concurrent)                   4867.3 lpm   (60.0 s, 2 samples)
System Call Overhead                        3633998.5 lps   (10.0 s, 7 samples)

System Benchmarks Index Values               BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0  156190798.7  13384.0
Double-Precision Whetstone                       55.0      16656.9   3028.5
Execl Throughput                                 43.0      16129.1   3751.0
File Copy 1024 bufsize 2000 maxblocks          3960.0     725559.7   1832.2
File Copy 256 bufsize 500 maxblocks            1655.0     201973.9   1220.4
File Copy 4096 bufsize 8000 maxblocks          5800.0    2456419.3   4235.2
Pipe Throughput                               12440.0   10605421.0   8525.3
Pipe-based Context Switching                   4000.0     934825.7   2337.1
Process Creation                                126.0      33977.4   2696.6
Shell Scripts (1 concurrent)                     42.4      36818.6   8683.6
Shell Scripts (8 concurrent)                      6.0       4867.3   8112.2
System Call Overhead                          15000.0    3633998.5   2422.7
                                                                   ========
System Benchmarks Index Score                                        3920.9

Hard drive
dd
dd if=/dev/zero of=benchmark bs=64K count=32K conv=fdatasync
32768+0 records in
32768+0 records out
2147483648 bytes (2.1 GB, 2.0 GiB) copied, 1.80852 s, 1.2 GB/s


dd if=/dev/zero of=benchmark bs=1M count=2048 conv=fdatasync
2048+0 records in
2048+0 records out
2147483648 bytes (2.1 GB, 2.0 GiB) copied, 1.71726 s, 1.3 GB/s


Hard drive
FIO random read
Performance
8000.4 MB/s
IOPS
2097254
./fio --time_based --name=benchmark --size=256M --runtime=60 --randrepeat=1 --iodepth=32 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randread --blocksize=4k --group_reporting
benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=5564: Wed Oct 11 15:03:31 2017
  read : io=480031MB, bw=8000.4MB/s, iops=2048.1K, runt= 60001msec
    clat (usec): min=0, max=20194, avg= 2.64, stdev=100.12
     lat (usec): min=0, max=20194, avg= 2.84, stdev=105.37
    clat percentiles (usec):
     |  1.00th=[    0],  5.00th=[    0], 10.00th=[    1], 20.00th=[    1],
     | 30.00th=[    1], 40.00th=[    1], 50.00th=[    1], 60.00th=[    1],
     | 70.00th=[    1], 80.00th=[    1], 90.00th=[    1], 95.00th=[    2],
     | 99.00th=[    2], 99.50th=[    6], 99.90th=[  199], 99.95th=[  215],
     | 99.99th=[ 4016]
    bw (KB  /s): min=20904, max=2499560, per=12.48%, avg=1022591.83, stdev=493827.30
    lat (usec) : 2=94.02%, 4=5.38%, 10=0.14%, 20=0.02%, 50=0.01%
    lat (usec) : 100=0.03%, 250=0.40%, 500=0.01%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%
  cpu          : usr=11.50%, sys=30.77%, ctx=572591, majf=0, minf=81
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=122887808/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=480031MB, aggrb=8000.4MB/s, minb=8000.4MB/s, maxb=8000.4MB/s, mint=60001msec, maxt=60001msec

Disk stats (read/write):
    dm-0: ios=524288/823, merge=0/0, ticks=77736/1460, in_queue=79316, util=19.90%, aggrios=524288/67, aggrmerge=0/731, aggrticks=77728/76, aggrin_queue=77748, aggrutil=19.89%
  sda: ios=524288/67, merge=0/731, ticks=77728/76, in_queue=77748, util=19.89%
Hard drive
FIO random direct read
Performance
184.78 MB/s
IOPS
47303
./fio --time_based --name=benchmark --size=256M --runtime=60 --randrepeat=1 --iodepth=32 --direct=1 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randread --blocksize=4k --group_reporting
benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes

benchmark: (groupid=0, jobs=8): err= 0: pid=5574: Wed Oct 11 15:04:31 2017
  read : io=11087MB, bw=189214KB/s, iops=47303, runt= 60001msec
    clat (usec): min=50, max=4229, avg=167.65, stdev=41.10
     lat (usec): min=50, max=4229, avg=167.79, stdev=41.10
    clat percentiles (usec):
     |  1.00th=[   77],  5.00th=[   99], 10.00th=[  113], 20.00th=[  129],
     | 30.00th=[  141], 40.00th=[  159], 50.00th=[  177], 60.00th=[  187],
     | 70.00th=[  195], 80.00th=[  203], 90.00th=[  213], 95.00th=[  223],
     | 99.00th=[  245], 99.50th=[  253], 99.90th=[  274], 99.95th=[  286],
     | 99.99th=[  588]
    bw (KB  /s): min=17840, max=28384, per=12.50%, avg=23653.83, stdev=2240.72
    lat (usec) : 100=5.25%, 250=94.08%, 500=0.66%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%
  cpu          : usr=1.14%, sys=6.22%, ctx=2853131, majf=0, minf=79
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=2838252/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=11087MB, aggrb=189213KB/s, minb=189213KB/s, maxb=189213KB/s, mint=60001msec, maxt=60001msec

Disk stats (read/write):
    dm-0: ios=2833619/4, merge=0/0, ticks=443800/0, in_queue=446528, util=99.90%, aggrios=2838252/4, aggrmerge=0/1, aggrticks=444212/0, aggrin_queue=444040, aggrutil=99.74%
  sda: ios=2838252/4, merge=0/1, ticks=444212/0, in_queue=444040, util=99.74%
Hard drive
FIO random write
Performance
1940.8 MB/s
IOPS
496833
./fio --time_based --name=benchmark --size=256M --runtime=60 --filename=benchmark --randrepeat=1 --iodepth=32 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randwrite --blocksize=4k --group_reporting
benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes

benchmark: (groupid=0, jobs=8): err= 0: pid=5594: Wed Oct 11 15:06:32 2017
  write: io=116449MB, bw=1940.8MB/s, iops=496833, runt= 60002msec
    clat (usec): min=0, max=56186, avg=15.25, stdev=406.82
     lat (usec): min=0, max=56186, avg=15.38, stdev=407.35
    clat percentiles (usec):
     |  1.00th=[    1],  5.00th=[    2], 10.00th=[    2], 20.00th=[    3],
     | 30.00th=[    4], 40.00th=[    4], 50.00th=[    5], 60.00th=[    6],
     | 70.00th=[    6], 80.00th=[    7], 90.00th=[    8], 95.00th=[    8],
     | 99.00th=[    9], 99.50th=[   11], 99.90th=[   28], 99.95th=[ 9664],
     | 99.99th=[20352]
    bw (KB  /s): min=82849, max=354019, per=12.51%, avg=248549.49, stdev=31981.33
    lat (usec) : 2=4.01%, 4=25.46%, 10=69.80%, 20=0.60%, 50=0.04%
    lat (usec) : 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.01%, 4=0.01%, 10=0.03%, 20=0.04%, 50=0.01%
    lat (msec) : 100=0.01%
  cpu          : usr=2.91%, sys=33.00%, ctx=872907, majf=0, minf=82
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=29811019/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=116449MB, aggrb=1940.8MB/s, minb=1940.8MB/s, maxb=1940.8MB/s, mint=60002msec, maxt=60002msec

Disk stats (read/write):
    dm-0: ios=0/50641, merge=0/0, ticks=0/132332, in_queue=132332, util=2.53%, aggrios=0/53700, aggrmerge=0/20, aggrticks=0/184760, aggrin_queue=184692, aggrutil=2.37%
  sda: ios=0/53700, merge=0/20, ticks=0/184760, in_queue=184692, util=2.37%
Hard drive
FIO random direct write
Performance
41.14 MB/s
IOPS
10530
./fio --time_based --name=benchmark --size=256M --runtime=60 --filename=benchmark --randrepeat=1 --iodepth=32 --direct=1 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randwrite --blocksize=4k --group_reporting
benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=5584: Wed Oct 11 15:05:31 2017
  write: io=2468.3MB, bw=42123KB/s, iops=10530, runt= 60002msec
    clat (usec): min=68, max=240016, avg=758.11, stdev=6397.94
     lat (usec): min=68, max=240016, avg=758.29, stdev=6397.95
    clat percentiles (usec):
     |  1.00th=[   73],  5.00th=[   77], 10.00th=[   81], 20.00th=[   85],
     | 30.00th=[   88], 40.00th=[   89], 50.00th=[   92], 60.00th=[   94],
     | 70.00th=[   97], 80.00th=[  100], 90.00th=[  109], 95.00th=[  120],
     | 99.00th=[22144], 99.50th=[46848], 99.90th=[97792], 99.95th=[115200],
     | 99.99th=[162816]
    bw (KB  /s): min=   20, max=27649, per=12.65%, avg=5328.86, stdev=5967.71
    lat (usec) : 100=78.77%, 250=18.98%, 500=0.01%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.08%, 4=0.17%, 10=0.52%, 20=0.40%, 50=0.62%
    lat (msec) : 100=0.36%, 250=0.09%
  cpu          : usr=0.25%, sys=1.53%, ctx=1265687, majf=0, minf=82
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=631873/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=2468.3MB, aggrb=42123KB/s, minb=42123KB/s, maxb=42123KB/s, mint=60002msec, maxt=60002msec

Disk stats (read/write):
    dm-0: ios=0/632871, merge=0/0, ticks=0/53204, in_queue=53204, util=88.68%, aggrios=0/632035, aggrmerge=0/1840, aggrticks=0/52896, aggrin_queue=52848, aggrutil=87.94%
  sda: ios=0/632035, merge=0/1840, ticks=0/52896, in_queue=52848, util=87.94%
Download
Download benchmark results
Download speed
268.87 Mbit/s
Downloaded 104857600 bytes in 2.998 sec
Downloaded 104857600 bytes in 2.969 sec
Downloaded 104857600 bytes in 2.996 sec
Downloaded 104857600 bytes in 2.968 sec
Downloaded 104857600 bytes in 2.946 sec
Finished! Average download speed is 268.87 Mbit/s
Upload
Speedtest results
Upload speed
133.2 Mbit/s
Retrieving speedtest.net configuration...
Retrieving speedtest.net server list...
Testing from Strasmore ...
Selecting 15 servers that are not too close:
  1. Ultimate Internet Access (Ontario, CA) [38.83 km]: 54.524 ms
  2. T-Mobile (Riverside, CA) [45.65 km]: 52.808 ms
  3. Atlantic Metro (Los Angeles, CA) [51.71 km]: 44.331 ms
  4. Time Warner Cable (Los Angeles, CA) [51.71 km]: 683.25 ms
  5. Race Communications (Los Angeles, CA) [51.71 km]: 69.771 ms
  6. AT&T (Los Angeles, CA) [51.71 km]: 39.429 ms
  7. Speedtest.net (Los Angeles, CA) [51.71 km]: 65.874 ms
  8. Race Communications (Los Angeles, CA) [51.71 km]: 44.767 ms
  9. SingTel (Los Angeles, CA) [51.71 km]: 132.82 ms
  10. QuadraNet, Inc (Los Angeles, CA) [51.71 km]: 48.128 ms
  11. GorillaServers (Los Angeles, CA) [51.71 km]: 54.667 ms
  12. Phyber Communications (Los Angeles, CA) [51.71 km]: 74.998 ms
  13. Host Duplex (Los Angeles, CA) [51.71 km]: 45.143 ms
  14. WebNX (Los Angeles, CA) [51.71 km]: 48.47 ms
  15. psychz.net (Los Angeles, CA) [51.71 km]: 50.895 ms
Testing upload speeds
  1. Ultimate Internet Access (Ontario, CA):      ......................... 165.70 Mbit/s
  2. T-Mobile (Riverside, CA):                    ......................... 3.66 Mbit/s
  3. Atlantic Metro (Los Angeles, CA):            ......................... 146.27 Mbit/s
  4. Time Warner Cable (Los Angeles, CA):         ......................... 125.44 Mbit/s
  5. Race Communications (Los Angeles, CA):       ......................... 156.81 Mbit/s
  6. AT&T (Los Angeles, CA):                      ......................... 115.67 Mbit/s
  7. Speedtest.net (Los Angeles, CA):             ......................... 116.56 Mbit/s
  8. Race Communications (Los Angeles, CA):       ......................... 101.20 Mbit/s
  9. SingTel (Los Angeles, CA):                   ......................... 113.99 Mbit/s
  10. QuadraNet, Inc (Los Angeles, CA):           ......................... 102.36 Mbit/s
  11. GorillaServers (Los Angeles, CA):           ......................... 185.19 Mbit/s
  12. Phyber Communications (Los Angeles, CA):    ......................... 143.19 Mbit/s
  13. Host Duplex (Los Angeles, CA):              ......................... 156.93 Mbit/s
  14. WebNX (Los Angeles, CA):                    ......................... 102.35 Mbit/s
  15. psychz.net (Los Angeles, CA):               ......................... 19.27 Mbit/s
Average upload speed is 116.97 Mbit/s