Stopwatch
Performance report #3477
SSD NodesPreon (Large)
Report
Share test result

Test results for Preon (Large) at SSD Nodes


Server specs:


4 × Intel(R) Xeon(R) CPU E5-2660 v3 @ 2.60GHz
16 GB RAM / 82 GB disk space
Ubuntu 16.04 Xenial
Montreal, Canada

Benchmark results summary:


UnixBench - 3565.1
Disk Read - 6223 MB/s
Disk Write - 1644 MB/s
Bandwidth - 1050.42 MB/s

More: https://serverscope.io/trials/PA5A
Share
Share this page
Cpu chip
Server Specs
CPU
4 × Intel(R) Xeon(R) CPU E5-2660 v3 @ 2.60GHz
CPU Cores
10 × 2601 MHz
RAM
16 GB
Disk
82 GB
OS
Ubuntu 16.04 Xenial
Location
Montreal, Canada
Benchmark summary
Benchmark summary
UnixBench
3565.1
Disk Read
6223 MB/s
Disk Write
1644 MB/s
Bandwidth
1050.42 Mbit/s
Speedtest
118.15 Mbit/s
Graph analysis
UnixBench Score
UnixBench (all CPUs)
3565.1
UnixBench (one CPU)
1458.6
Terminal
Raw Output
gcc -o pgms/arithoh -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Darithoh src/arith.c 
gcc -o pgms/register -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum="register int" src/arith.c 
gcc -o pgms/short -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum=short src/arith.c 
gcc -o pgms/int -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum=int src/arith.c 
gcc -o pgms/long -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum=long src/arith.c 
gcc -o pgms/float -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum=float src/arith.c 
gcc -o pgms/double -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum=double src/arith.c 
gcc -o pgms/hanoi -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/hanoi.c 
gcc -o pgms/syscall -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/syscall.c 
gcc -o pgms/context1 -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/context1.c 
gcc -o pgms/pipe -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/pipe.c 
src/pipe.c: In function "main":
src/pipe.c:52:2: warning: ignoring return value of "pipe", declared with attribute warn_unused_result [-Wunused-result]
  pipe(pvec);
  ^
gcc -o pgms/spawn -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/spawn.c 
gcc -o pgms/execl -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/execl.c 
In file included from src/execl.c:34:0:
src/big.c: In function "dummy":
src/big.c:109:5: warning: ignoring return value of "freopen", declared with attribute warn_unused_result [-Wunused-result]
     freopen("masterlog.00", "a", stderr);
     ^
src/big.c:197:6: warning: ignoring return value of "freopen", declared with attribute warn_unused_result [-Wunused-result]
      freopen(logname, "w", stderr);
      ^
src/big.c:221:3: warning: ignoring return value of "dup", declared with attribute warn_unused_result [-Wunused-result]
   dup(pvec[0]);
   ^
src/big.c:225:6: warning: ignoring return value of "freopen", declared with attribute warn_unused_result [-Wunused-result]
      freopen(logname, "w", stderr);
      ^
src/big.c:318:4: warning: ignoring return value of "write", declared with attribute warn_unused_result [-Wunused-result]
    write(fcopy, cp->line, p - cp->line + 1);
    ^
gcc -o pgms/dhry2 -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -DHZ= ./src/dhry_1.c ./src/dhry_2.c
gcc -o pgms/dhry2reg -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -DHZ= -DREG=register ./src/dhry_1.c ./src/dhry_2.c
gcc -o pgms/looper -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/looper.c 
gcc -o pgms/fstime -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/fstime.c 
gcc -o pgms/whetstone-double -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -DDP -DUNIX -DUNIXBENCH src/whets.c -lm
make all
make[1]: Entering directory "/serverscope-OoAxxO/byte-unixbench/UnixBench"
make distr
make[2]: Entering directory "/serverscope-OoAxxO/byte-unixbench/UnixBench"
Checking distribution of files
./pgms  exists
./src  exists
./testdir  exists
make[2]: Leaving directory "/serverscope-OoAxxO/byte-unixbench/UnixBench"
make programs
make[2]: Entering directory "/serverscope-OoAxxO/byte-unixbench/UnixBench"
make[2]: Nothing to be done for "programs".
make[2]: Leaving directory "/serverscope-OoAxxO/byte-unixbench/UnixBench"
make[1]: Leaving directory "/serverscope-OoAxxO/byte-unixbench/UnixBench"
locale: Cannot set LC_CTYPE to default locale: No such file or directory
locale: Cannot set LC_MESSAGES to default locale: No such file or directory
locale: Cannot set LC_ALL to default locale: No such file or directory
locale: Cannot set LC_CTYPE to default locale: No such file or directory
locale: Cannot set LC_MESSAGES to default locale: No such file or directory
locale: Cannot set LC_ALL to default locale: No such file or directory
sh: 1: 3dinfo: not found

   #    #  #    #  #  #    #          #####   ######  #    #   ####   #    #
   #    #  ##   #  #   #  #           #    #  #       ##   #  #    #  #    #
   #    #  # #  #  #    ##            #####   #####   # #  #  #       ######
   #    #  #  # #  #    ##            #    #  #       #  # #  #       #    #
   #    #  #   ##  #   #  #           #    #  #       #   ##  #    #  #    #
    ####   #    #  #  #    #          #####   ######  #    #   ####   #    #

   Version 5.1.3                      Based on the Byte Magazine Unix Benchmark

   Multi-CPU version                  Version 5 revisions by Ian Smith,
                                      Sunnyvale, CA, USA
   January 13, 2011                   johantheghost at yahoo period com


1 x Dhrystone 2 using register variables  1 2 3 4 5 6 7 8 9 10

1 x Double-Precision Whetstone  1 2 3 4 5 6 7 8 9 10

1 x Execl Throughput  1 2 3

1 x File Copy 1024 bufsize 2000 maxblocks  1 2 3

1 x File Copy 256 bufsize 500 maxblocks  1 2 3

1 x File Copy 4096 bufsize 8000 maxblocks  1 2 3

1 x Pipe Throughput  1 2 3 4 5 6 7 8 9 10

1 x Pipe-based Context Switching  1 2 3 4 5 6 7 8 9 10

1 x Process Creation  1 2 3

1 x System Call Overhead  1 2 3 4 5 6 7 8 9 10

1 x Shell Scripts (1 concurrent)  1 2 3

1 x Shell Scripts (8 concurrent)  1 2 3

4 x Dhrystone 2 using register variables  1 2 3 4 5 6 7 8 9 10

4 x Double-Precision Whetstone  1 2 3 4 5 6 7 8 9 10

4 x Execl Throughput  1 2 3

4 x File Copy 1024 bufsize 2000 maxblocks  1 2 3

4 x File Copy 256 bufsize 500 maxblocks  1 2 3

4 x File Copy 4096 bufsize 8000 maxblocks  1 2 3

4 x Pipe Throughput  1 2 3 4 5 6 7 8 9 10

4 x Pipe-based Context Switching  1 2 3 4 5 6 7 8 9 10

4 x Process Creation  1 2 3

4 x System Call Overhead  1 2 3 4 5 6 7 8 9 10

4 x Shell Scripts (1 concurrent)  1 2 3

4 x Shell Scripts (8 concurrent)  1 2 3

========================================================================
   BYTE UNIX Benchmarks (Version 5.1.3)

   System: speedtest-bhs1-vo3: GNU/Linux
   OS: GNU/Linux -- 4.4.0 -- #1 SMP Sat Apr 29 20:28:55 MSK 2017
   Machine: x86_64 (x86_64)
   Language: en_US.utf8 (charmap="ANSI_X3.4-1968", collate="ANSI_X3.4-1968")
   CPU 0: Intel(R) Xeon(R) CPU E5-2660 v3 @ 2.60GHz (5200.4 bogomips)
          Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET, Intel virtualization
   CPU 1: Intel(R) Xeon(R) CPU E5-2660 v3 @ 2.60GHz (5200.4 bogomips)
          Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET, Intel virtualization
   CPU 2: Intel(R) Xeon(R) CPU E5-2660 v3 @ 2.60GHz (5200.4 bogomips)
          Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET, Intel virtualization
   CPU 3: Intel(R) Xeon(R) CPU E5-2660 v3 @ 2.60GHz (5200.4 bogomips)
          Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET, Intel virtualization
   01:28:22 up 14 min,  0 users,  load average: 7.83, 4.76, 2.22; runlevel Jun

------------------------------------------------------------------------
Benchmark Run: Mon Jun 12 2017 01:28:22 - 01:56:36
4 CPUs in system; running 1 parallel copy of tests

Dhrystone 2 using register variables       33101283.8 lps   (10.0 s, 7 samples)
Double-Precision Whetstone                     3608.8 MWIPS (9.9 s, 7 samples)
Execl Throughput                               2440.2 lps   (29.7 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks        987809.2 KBps  (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks          250130.0 KBps  (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks       2542396.9 KBps  (30.0 s, 2 samples)
Pipe Throughput                             1882282.2 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                 147322.7 lps   (10.0 s, 7 samples)
Process Creation                               6365.8 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                   7850.9 lpm   (60.0 s, 2 samples)
Shell Scripts (8 concurrent)                   2431.3 lpm   (60.0 s, 2 samples)
System Call Overhead                        3772922.9 lps   (10.0 s, 7 samples)

System Benchmarks Index Values               BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0   33101283.8   2836.4
Double-Precision Whetstone                       55.0       3608.8    656.1
Execl Throughput                                 43.0       2440.2    567.5
File Copy 1024 bufsize 2000 maxblocks          3960.0     987809.2   2494.5
File Copy 256 bufsize 500 maxblocks            1655.0     250130.0   1511.4
File Copy 4096 bufsize 8000 maxblocks          5800.0    2542396.9   4383.4
Pipe Throughput                               12440.0    1882282.2   1513.1
Pipe-based Context Switching                   4000.0     147322.7    368.3
Process Creation                                126.0       6365.8    505.2
Shell Scripts (1 concurrent)                     42.4       7850.9   1851.6
Shell Scripts (8 concurrent)                      6.0       2431.3   4052.1
System Call Overhead                          15000.0    3772922.9   2515.3
                                                                   ========
System Benchmarks Index Score                                        1458.6

------------------------------------------------------------------------
Benchmark Run: Mon Jun 12 2017 01:56:36 - 02:25:01
4 CPUs in system; running 4 parallel copies of tests

Dhrystone 2 using register variables      121779103.7 lps   (10.0 s, 7 samples)
Double-Precision Whetstone                    14294.0 MWIPS (10.0 s, 7 samples)
Execl Throughput                              12531.8 lps   (29.9 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks        847007.9 KBps  (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks          206620.5 KBps  (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks       2518196.8 KBps  (30.0 s, 2 samples)
Pipe Throughput                             7482416.7 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                1069815.0 lps   (10.0 s, 7 samples)
Process Creation                              27962.4 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                  25311.2 lpm   (60.0 s, 2 samples)
Shell Scripts (8 concurrent)                   3414.8 lpm   (60.0 s, 2 samples)
System Call Overhead                        5689252.7 lps   (10.0 s, 7 samples)

System Benchmarks Index Values               BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0  121779103.7  10435.2
Double-Precision Whetstone                       55.0      14294.0   2598.9
Execl Throughput                                 43.0      12531.8   2914.4
File Copy 1024 bufsize 2000 maxblocks          3960.0     847007.9   2138.9
File Copy 256 bufsize 500 maxblocks            1655.0     206620.5   1248.5
File Copy 4096 bufsize 8000 maxblocks          5800.0    2518196.8   4341.7
Pipe Throughput                               12440.0    7482416.7   6014.8
Pipe-based Context Switching                   4000.0    1069815.0   2674.5
Process Creation                                126.0      27962.4   2219.2
Shell Scripts (1 concurrent)                     42.4      25311.2   5969.6
Shell Scripts (8 concurrent)                      6.0       3414.8   5691.3
System Call Overhead                          15000.0    5689252.7   3792.8
                                                                   ========
System Benchmarks Index Score                                        3565.1

Hard drive
dd
dd if=/dev/zero of=benchmark bs=64K count=32K conv=fdatasync
32768+0 records in
32768+0 records out
2147483648 bytes (2.1 GB, 2.0 GiB) copied, 2.26873 s, 947 MB/s


dd if=/dev/zero of=benchmark bs=1M count=2048 conv=fdatasync
2048+0 records in
2048+0 records out
2147483648 bytes (2.1 GB, 2.0 GiB) copied, 2.12256 s, 1.0 GB/s


Hard drive
FIO random read
Performance
6223.6 MB/s
IOPS
1631539
./fio --time_based --name=benchmark --size=256M --runtime=60 --randrepeat=1 --iodepth=32 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randread --blocksize=4k --group_reporting
benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=16482: Mon Jun 12 01:25:18 2017
  read : io=373432MB, bw=6223.6MB/s, iops=1593.3K, runt= 60003msec
    clat (usec): min=0, max=101069, avg= 3.77, stdev=168.38
     lat (usec): min=0, max=101069, avg= 3.86, stdev=171.13
    clat percentiles (usec):
     |  1.00th=[    0],  5.00th=[    1], 10.00th=[    1], 20.00th=[    1],
     | 30.00th=[    1], 40.00th=[    1], 50.00th=[    1], 60.00th=[    1],
     | 70.00th=[    1], 80.00th=[    2], 90.00th=[    2], 95.00th=[    2],
     | 99.00th=[    3], 99.50th=[   53], 99.90th=[  211], 99.95th=[  229],
     | 99.99th=[ 2544]
    bw (KB  /s): min=13600, max=3306464, per=12.50%, avg=796495.16, stdev=665954.72
    lat (usec) : 2=71.92%, 4=27.24%, 10=0.21%, 20=0.04%, 50=0.07%
    lat (usec) : 100=0.05%, 250=0.43%, 500=0.01%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%
    lat (msec) : 100=0.01%, 250=0.01%
  cpu          : usr=12.09%, sys=26.51%, ctx=600333, majf=0, minf=312
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=95598598/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=373432MB, aggrb=6223.6MB/s, minb=6223.6MB/s, maxb=6223.6MB/s, mint=60003msec, maxt=60003msec

Disk stats (read/write):
  ploop43323: ios=524396/152, merge=0/0, ticks=0/0, in_queue=0, util=0.00%
Hard drive
FIO random direct read
Performance
140.71 MB/s
IOPS
36022
./fio --time_based --name=benchmark --size=256M --runtime=60 --randrepeat=1 --iodepth=32 --direct=1 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randread --blocksize=4k --group_reporting
benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes

benchmark: (groupid=0, jobs=8): err= 0: pid=16496: Mon Jun 12 01:26:18 2017
  read : io=8442.1MB, bw=144091KB/s, iops=36022, runt= 60001msec
    clat (usec): min=61, max=20328, avg=220.26, stdev=295.88
     lat (usec): min=61, max=20328, avg=220.34, stdev=295.89
    clat percentiles (usec):
     |  1.00th=[  153],  5.00th=[  159], 10.00th=[  161], 20.00th=[  165],
     | 30.00th=[  169], 40.00th=[  177], 50.00th=[  191], 60.00th=[  197],
     | 70.00th=[  201], 80.00th=[  207], 90.00th=[  221], 95.00th=[  253],
     | 99.00th=[ 1416], 99.50th=[ 2024], 99.90th=[ 3664], 99.95th=[ 4768],
     | 99.99th=[10176]
    bw (KB  /s): min= 5920, max=21464, per=12.51%, avg=18023.06, stdev=2267.94
    lat (usec) : 100=0.01%, 250=94.84%, 500=2.99%, 750=0.40%, 1000=0.35%
    lat (msec) : 2=0.90%, 4=0.43%, 10=0.07%, 20=0.01%, 50=0.01%
  cpu          : usr=0.96%, sys=5.41%, ctx=2167142, majf=0, minf=306
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=2161394/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=8442.1MB, aggrb=144090KB/s, minb=144090KB/s, maxb=144090KB/s, mint=60001msec, maxt=60001msec

Disk stats (read/write):
  ploop43323: ios=2160222/0, merge=0/0, ticks=0/0, in_queue=0, util=0.00%
Hard drive
FIO random write
Performance
1644.3 MB/s
IOPS
420869
./fio --time_based --name=benchmark --size=256M --runtime=60 --filename=benchmark --randrepeat=1 --iodepth=32 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randwrite --blocksize=4k --group_reporting
benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes

benchmark: (groupid=0, jobs=8): err= 0: pid=16524: Mon Jun 12 01:28:19 2017
  write: io=98648MB, bw=1644.3MB/s, iops=420869, runt= 60004msec
    clat (usec): min=0, max=422293, avg=18.29, stdev=566.00
     lat (usec): min=1, max=422293, avg=18.36, stdev=566.07
    clat percentiles (usec):
     |  1.00th=[    1],  5.00th=[    2], 10.00th=[    2], 20.00th=[    3],
     | 30.00th=[    3], 40.00th=[    4], 50.00th=[    5], 60.00th=[    6],
     | 70.00th=[    6], 80.00th=[    7], 90.00th=[    8], 95.00th=[    9],
     | 99.00th=[   12], 99.50th=[   15], 99.90th=[  438], 99.95th=[12096],
     | 99.99th=[24704]
    bw (KB  /s): min=59430, max=361720, per=12.53%, avg=210923.40, stdev=41452.28
    lat (usec) : 2=1.73%, 4=28.59%, 10=65.88%, 20=3.52%, 50=0.17%
    lat (usec) : 100=0.02%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.01%, 4=0.01%, 10=0.02%, 20=0.04%, 50=0.02%
    lat (msec) : 100=0.01%, 250=0.01%, 500=0.01%
  cpu          : usr=3.37%, sys=29.03%, ctx=865211, majf=0, minf=292
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=25253880/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=98648MB, aggrb=1644.3MB/s, minb=1644.3MB/s, maxb=1644.3MB/s, mint=60004msec, maxt=60004msec

Disk stats (read/write):
  ploop43323: ios=0/284536, merge=0/0, ticks=0/0, in_queue=0, util=0.00%
Hard drive
FIO random direct write
Performance
14.2 MB/s
IOPS
3635
./fio --time_based --name=benchmark --size=256M --runtime=60 --filename=benchmark --randrepeat=1 --iodepth=32 --direct=1 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randwrite --blocksize=4k --group_reporting
benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=16510: Mon Jun 12 01:27:19 2017
  write: io=872540KB, bw=14540KB/s, iops=3635, runt= 60009msec
    clat (usec): min=129, max=110124, avg=2198.69, stdev=4119.29
     lat (usec): min=129, max=110125, avg=2198.89, stdev=4119.31
    clat percentiles (usec):
     |  1.00th=[  137],  5.00th=[  139], 10.00th=[  143], 20.00th=[  147],
     | 30.00th=[  151], 40.00th=[  163], 50.00th=[  346], 60.00th=[  374],
     | 70.00th=[ 1752], 80.00th=[ 4448], 90.00th=[ 7008], 95.00th=[ 9920],
     | 99.00th=[15168], 99.50th=[18304], 99.90th=[43264], 99.95th=[60672],
     | 99.99th=[84480]
    bw (KB  /s): min=   89, max= 5248, per=12.51%, avg=1818.58, stdev=797.53
    lat (usec) : 250=45.93%, 500=19.29%, 750=0.45%, 1000=0.28%
    lat (msec) : 2=5.56%, 4=7.55%, 10=15.97%, 20=4.57%, 50=0.32%
    lat (msec) : 100=0.07%, 250=0.01%
  cpu          : usr=0.14%, sys=1.40%, ctx=435997, majf=0, minf=296
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=218135/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=872540KB, aggrb=14540KB/s, minb=14540KB/s, maxb=14540KB/s, mint=60009msec, maxt=60009msec

Disk stats (read/write):
  ploop43323: ios=0/220585, merge=0/0, ticks=0/0, in_queue=0, util=0.00%
Download
Download benchmark results
Download speed
1050.42 Mbit/s
Downloaded 104857600 bytes in 0.844 sec
Downloaded 104857600 bytes in 0.771 sec
Downloaded 104857600 bytes in 0.819 sec
Downloaded 104857600 bytes in 0.885 sec
Downloaded 104857600 bytes in 0.489 sec
Finished! Average download speed is 1050.42 Mbit/s
Upload
Speedtest results
Upload speed
118.15 Mbit/s
Retrieving speedtest.net configuration...
Retrieving speedtest.net server list...
Testing from OVH ...
Selecting 15 servers that are not too close:
  1. Caramania.Ca (Beauharnois, QC) [31.64 km]: 24.01 ms
  2. ToxicPVP (Beauharnois, QC) [31.64 km]: 22.81 ms
  3. Hostix Technologies Inc. (Saint-Paul-de-l'lle-aux-Noix, QC) [46.58 km]: 270.484 ms
  4. Internexe (Knowlton, QC) [88.84 km]: 30.112 ms
  5. Sovernet Communications (Burlington, VT) [120.08 km]: 48.601 ms
  6. Green Mountain Access (Richmond, VT) [130.60 km]: 39.84 ms
  7. Slic Network Solutions (Potsdam, NY) [144.32 km]: 52.151 ms
  8. SSI Micro (Kanata, ON) [182.47 km]: 40.355 ms
  9. WTC Communications (Kingston, ON) [270.56 km]: 42.651 ms
  10. Northland Communications (Utica, NY) [297.99 km]: 39.218 ms
  11. Oxford Networks (Lewiston, ME) [307.58 km]: 45.286 ms
  12. MassiveMesh Networks (Troy, NY) [308.77 km]: 50.411 ms
  13. INOC, LLC (Albany, NY) [317.41 km]: 37.979 ms
  14. TurnKey Internet, Inc. (Albany, NY) [317.41 km]: 34.331 ms
  15. Time Warner Cable (Syracuse, NY) [341.28 km]: 57.414 ms
Testing upload speeds
  1. Caramania.Ca (Beauharnois, QC):              ......................... 248.32 Mbit/s
  2. ToxicPVP (Beauharnois, QC):                  ......................... 225.04 Mbit/s
  3. Hostix Technologies Inc. (Saint-Paul-de-l'lle-aux-Noix, QC):......................... 116.09 Mbit/s
  4. Internexe (Knowlton, QC):                    ......................... 131.85 Mbit/s
  5. Sovernet Communications (Burlington, VT):    ......................... 66.91 Mbit/s
  6. Green Mountain Access (Richmond, VT):        ......................... 105.61 Mbit/s
  7. Slic Network Solutions (Potsdam, NY):        ......................... 31.83 Mbit/s
  8. SSI Micro (Kanata, ON):                      ......................... 31.58 Mbit/s
  9. WTC Communications (Kingston, ON):           ......................... 187.71 Mbit/s
  10. Northland Communications (Utica, NY):       ......................... 45.04 Mbit/s
  11. Oxford Networks (Lewiston, ME):             ......................... 137.84 Mbit/s
  12. MassiveMesh Networks (Troy, NY):            ......................... 119.27 Mbit/s
  13. INOC, LLC (Albany, NY):                     ......................... 0.16 Mbit/s
  14. TurnKey Internet, Inc. (Albany, NY):        ......................... 88.85 Mbit/s
  15. Time Warner Cable (Syracuse, NY):           ......................... 19.36 Mbit/s
Average upload speed is 103.70 Mbit/s