Stopwatch
Benchmark report #3842
Hetzner – AX60-SSD
Report
Share test result

Test results for AX60-SSD at Hetzner


Server specs:


16 × AMD Ryzen 7 1700X Eight-Core Processor
63 GB RAM / 459 GB disk space
Centos 7.3.1611 Core
Germany

Benchmark results summary:


UnixBench - 7450.1
Disk Read - 9927 MB/s
Disk Write - 2008 MB/s
Bandwidth - 726.22 MB/s

More: https://serverscope.io/trials/Jo05
Share
Share this page
Cpu chip
Server Specs
CPU
16 × AMD Ryzen 7 1700X Eight-Core Processor
CPU Cores
8 × 2200 MHz
RAM
63 GB
Disk
459 GB
OS
Centos 7.3.1611 Core
Location
Benchmark summary
Benchmark summary
UnixBench
7450.1
Disk Read
9927 MB/s
Disk Write
2008 MB/s
Bandwidth
726.22 Mbit/s
Speedtest
183.88 Mbit/s
Graph analysis
UnixBench Score
UnixBench (all CPUs)
7450.1
UnixBench (one CPU)
1670.0
Terminal
Raw Output
gcc -o pgms/arithoh -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Darithoh src/arith.c 
gcc -o pgms/register -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum="register int" src/arith.c 
gcc -o pgms/short -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum=short src/arith.c 
gcc -o pgms/int -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum=int src/arith.c 
gcc -o pgms/long -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum=long src/arith.c 
gcc -o pgms/float -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum=float src/arith.c 
gcc -o pgms/double -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum=double src/arith.c 
gcc -o pgms/hanoi -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/hanoi.c 
gcc -o pgms/syscall -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/syscall.c 
gcc -o pgms/context1 -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/context1.c 
gcc -o pgms/pipe -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/pipe.c 
gcc -o pgms/spawn -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/spawn.c 
gcc -o pgms/execl -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/execl.c 
gcc -o pgms/dhry2 -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -DHZ= ./src/dhry_1.c ./src/dhry_2.c
gcc -o pgms/dhry2reg -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -DHZ= -DREG=register ./src/dhry_1.c ./src/dhry_2.c
gcc -o pgms/looper -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/looper.c 
gcc -o pgms/fstime -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/fstime.c 
gcc -o pgms/whetstone-double -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -DDP -DUNIX -DUNIXBENCH src/whets.c -lm
make all
make[1]: Entering directory `/root/serverscope-kF0lqA/byte-unixbench/UnixBench"
make distr
make[2]: Entering directory `/root/serverscope-kF0lqA/byte-unixbench/UnixBench"
Checking distribution of files
./pgms  exists
./src  exists
./testdir  exists
make[2]: Leaving directory `/root/serverscope-kF0lqA/byte-unixbench/UnixBench"
make programs
make[2]: Entering directory `/root/serverscope-kF0lqA/byte-unixbench/UnixBench"
make[2]: Nothing to be done for `programs".
make[2]: Leaving directory `/root/serverscope-kF0lqA/byte-unixbench/UnixBench"
make[1]: Leaving directory `/root/serverscope-kF0lqA/byte-unixbench/UnixBench"
sh: 3dinfo: command not found

   #    #  #    #  #  #    #          #####   ######  #    #   ####   #    #
   #    #  ##   #  #   #  #           #    #  #       ##   #  #    #  #    #
   #    #  # #  #  #    ##            #####   #####   # #  #  #       ######
   #    #  #  # #  #    ##            #    #  #       #  # #  #       #    #
   #    #  #   ##  #   #  #           #    #  #       #   ##  #    #  #    #
    ####   #    #  #  #    #          #####   ######  #    #   ####   #    #

   Version 5.1.3                      Based on the Byte Magazine Unix Benchmark

   Multi-CPU version                  Version 5 revisions by Ian Smith,
                                      Sunnyvale, CA, USA
   January 13, 2011                   johantheghost at yahoo period com


1 x Dhrystone 2 using register variables  1 2 3 4 5 6 7 8 9 10

1 x Double-Precision Whetstone  1 2 3 4 5 6 7 8 9 10

1 x Execl Throughput  1 2 3

1 x File Copy 1024 bufsize 2000 maxblocks  1 2 3

1 x File Copy 256 bufsize 500 maxblocks  1 2 3

1 x File Copy 4096 bufsize 8000 maxblocks  1 2 3

1 x Pipe Throughput  1 2 3 4 5 6 7 8 9 10

1 x Pipe-based Context Switching  1 2 3 4 5 6 7 8 9 10

1 x Process Creation  1 2 3

1 x System Call Overhead  1 2 3 4 5 6 7 8 9 10

1 x Shell Scripts (1 concurrent)  1 2 3

1 x Shell Scripts (8 concurrent)  1 2 3

16 x Dhrystone 2 using register variables  1 2 3 4 5 6 7 8 9 10

16 x Double-Precision Whetstone  1 2 3 4 5 6 7 8 9 10

16 x Execl Throughput  1 2 3

16 x File Copy 1024 bufsize 2000 maxblocks  1 2 3

16 x File Copy 256 bufsize 500 maxblocks  1 2 3

16 x File Copy 4096 bufsize 8000 maxblocks  1 2 3

16 x Pipe Throughput  1 2 3 4 5 6 7 8 9 10

16 x Pipe-based Context Switching  1 2 3 4 5 6 7 8 9 10

16 x Process Creation  1 2 3

16 x System Call Overhead  1 2 3 4 5 6 7 8 9 10

16 x Shell Scripts (1 concurrent)  1 2 3

16 x Shell Scripts (8 concurrent)  1 2 3

========================================================================
   BYTE UNIX Benchmarks (Version 5.1.3)

   System: sw-svr1: GNU/Linux
   OS: GNU/Linux -- 4.12.4-1.el7.elrepo.x86_64 -- #1 SMP Thu Jul 27 20:03:28 EDT 2017
   Machine: x86_64 (x86_64)
   Language: en_US.utf8 (charmap="UTF-8", collate="UTF-8")
   CPU 0: AMD Ryzen 7 1700X Eight-Core Processor (6786.8 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 1: AMD Ryzen 7 1700X Eight-Core Processor (6778.9 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 2: AMD Ryzen 7 1700X Eight-Core Processor (6778.9 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 3: AMD Ryzen 7 1700X Eight-Core Processor (6778.9 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 4: AMD Ryzen 7 1700X Eight-Core Processor (6778.9 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 5: AMD Ryzen 7 1700X Eight-Core Processor (6778.9 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 6: AMD Ryzen 7 1700X Eight-Core Processor (6778.9 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 7: AMD Ryzen 7 1700X Eight-Core Processor (6778.9 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 8: AMD Ryzen 7 1700X Eight-Core Processor (6778.9 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 9: AMD Ryzen 7 1700X Eight-Core Processor (6778.9 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 10: AMD Ryzen 7 1700X Eight-Core Processor (6778.9 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 11: AMD Ryzen 7 1700X Eight-Core Processor (6778.9 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 12: AMD Ryzen 7 1700X Eight-Core Processor (6778.9 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 13: AMD Ryzen 7 1700X Eight-Core Processor (6778.9 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 14: AMD Ryzen 7 1700X Eight-Core Processor (6778.9 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 15: AMD Ryzen 7 1700X Eight-Core Processor (6778.9 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   17:31:45 up 8 min,  1 user,  load average: 8.10, 4.59, 1.91; runlevel 2017-08-04

------------------------------------------------------------------------
Benchmark Run: Fri Aug 04 2017 17:31:45 - 18:03:24
16 CPUs in system; running 1 parallel copy of tests

Dhrystone 2 using register variables       44291291.1 lps   (10.0 s, 7 samples)
Double-Precision Whetstone                     1978.7 MWIPS (31.8 s, 7 samples)
Execl Throughput                               8015.9 lps   (30.0 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks       1077587.9 KBps  (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks          297588.1 KBps  (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks       2717309.7 KBps  (30.0 s, 2 samples)
Pipe Throughput                             1928463.8 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                 153950.5 lps   (10.0 s, 7 samples)
Process Creation                              11073.0 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                   6697.6 lpm   (60.0 s, 2 samples)
Shell Scripts (8 concurrent)                   4160.4 lpm   (60.0 s, 2 samples)
System Call Overhead                        2106641.3 lps   (10.0 s, 7 samples)

System Benchmarks Index Values               BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0   44291291.1   3795.3
Double-Precision Whetstone                       55.0       1978.7    359.8
Execl Throughput                                 43.0       8015.9   1864.2
File Copy 1024 bufsize 2000 maxblocks          3960.0    1077587.9   2721.2
File Copy 256 bufsize 500 maxblocks            1655.0     297588.1   1798.1
File Copy 4096 bufsize 8000 maxblocks          5800.0    2717309.7   4685.0
Pipe Throughput                               12440.0    1928463.8   1550.2
Pipe-based Context Switching                   4000.0     153950.5    384.9
Process Creation                                126.0      11073.0    878.8
Shell Scripts (1 concurrent)                     42.4       6697.6   1579.6
Shell Scripts (8 concurrent)                      6.0       4160.4   6934.1
System Call Overhead                          15000.0    2106641.3   1404.4
                                                                   ========
System Benchmarks Index Score                                        1670.0

------------------------------------------------------------------------
Benchmark Run: Fri Aug 04 2017 18:03:24 - 18:31:31
16 CPUs in system; running 16 parallel copies of tests

Dhrystone 2 using register variables      368660411.2 lps   (10.0 s, 7 samples)
Double-Precision Whetstone                    62288.5 MWIPS (10.0 s, 7 samples)
Execl Throughput                              43518.1 lps   (30.0 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks        793911.8 KBps  (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks          204450.6 KBps  (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks       2476321.7 KBps  (30.0 s, 2 samples)
Pipe Throughput                            18751058.7 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                2325565.1 lps   (10.0 s, 7 samples)
Process Creation                              70793.2 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                  66061.7 lpm   (60.0 s, 2 samples)
Shell Scripts (8 concurrent)                  10036.0 lpm   (60.1 s, 2 samples)
System Call Overhead                        8926406.4 lps   (10.0 s, 7 samples)

System Benchmarks Index Values               BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0  368660411.2  31590.4
Double-Precision Whetstone                       55.0      62288.5  11325.2
Execl Throughput                                 43.0      43518.1  10120.5
File Copy 1024 bufsize 2000 maxblocks          3960.0     793911.8   2004.8
File Copy 256 bufsize 500 maxblocks            1655.0     204450.6   1235.4
File Copy 4096 bufsize 8000 maxblocks          5800.0    2476321.7   4269.5
Pipe Throughput                               12440.0   18751058.7  15073.2
Pipe-based Context Switching                   4000.0    2325565.1   5813.9
Process Creation                                126.0      70793.2   5618.5
Shell Scripts (1 concurrent)                     42.4      66061.7  15580.6
Shell Scripts (8 concurrent)                      6.0      10036.0  16726.7
System Call Overhead                          15000.0    8926406.4   5950.9
                                                                   ========
System Benchmarks Index Score                                        7450.1

Hard drive
dd
dd if=/dev/zero of=benchmark bs=64K count=32K conv=fdatasync
32768+0 records in
32768+0 records out
2147483648 bytes (2.1 GB) copied, 5.81416 s, 369 MB/s


dd if=/dev/zero of=benchmark bs=1M count=2048 conv=fdatasync
2048+0 records in
2048+0 records out
2147483648 bytes (2.1 GB) copied, 5.17468 s, 415 MB/s


Hard drive
FIO random read
Performance
9927.8 MB/s
IOPS
2602598
./fio --time_based --name=benchmark --size=256M --runtime=60 --randrepeat=1 --iodepth=32 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randread --blocksize=4k --group_reporting
benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=6495: Fri Aug  4 17:28:42 2017
  read : io=595674MB, bw=9927.8MB/s, iops=2541.6K, runt= 60001msec
    clat (usec): min=0, max=14191, avg= 1.74, stdev=10.71
     lat (usec): min=1, max=14191, avg= 1.98, stdev=10.72
    clat percentiles (usec):
     |  1.00th=[    1],  5.00th=[    1], 10.00th=[    1], 20.00th=[    1],
     | 30.00th=[    1], 40.00th=[    1], 50.00th=[    1], 60.00th=[    1],
     | 70.00th=[    1], 80.00th=[    1], 90.00th=[    2], 95.00th=[    2],
     | 99.00th=[    2], 99.50th=[    2], 99.90th=[  177], 99.95th=[  221],
     | 99.99th=[  274]
    bw (MB  /s): min=   20, max= 1556, per=12.48%, avg=1238.61, stdev=590.32
    lat (usec) : 2=84.63%, 4=14.96%, 10=0.06%, 20=0.01%, 50=0.01%
    lat (usec) : 100=0.01%, 250=0.33%, 500=0.02%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%
  cpu          : usr=20.85%, sys=61.75%, ctx=563027, majf=0, minf=96
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=152492609/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=595674MB, aggrb=9927.8MB/s, minb=9927.8MB/s, maxb=9927.8MB/s, mint=60001msec, maxt=60001msec

Disk stats (read/write):
    md2: ios=524288/697, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=262144/99, aggrmerge=0/610, aggrticks=42381/466, aggrin_queue=42847, aggrutil=19.68%
  sdb: ios=227172/93, merge=0/614, ticks=42439/593, in_queue=43034, util=19.68%
  sda: ios=297116/106, merge=0/607, ticks=42323/340, in_queue=42661, util=19.47%
Hard drive
FIO random direct read
Performance
181.58 MB/s
IOPS
46484
./fio --time_based --name=benchmark --size=256M --runtime=60 --randrepeat=1 --iodepth=32 --direct=1 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randread --blocksize=4k --group_reporting
benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes

benchmark: (groupid=0, jobs=8): err= 0: pid=6521: Fri Aug  4 17:29:42 2017
  read : io=10895MB, bw=185939KB/s, iops=46484, runt= 60001msec
    clat (usec): min=61, max=5576, avg=169.11, stdev=44.46
     lat (usec): min=61, max=5576, avg=169.54, stdev=44.47
    clat percentiles (usec):
     |  1.00th=[  133],  5.00th=[  135], 10.00th=[  137], 20.00th=[  139],
     | 30.00th=[  141], 40.00th=[  145], 50.00th=[  149], 60.00th=[  163],
     | 70.00th=[  175], 80.00th=[  209], 90.00th=[  225], 95.00th=[  243],
     | 99.00th=[  322], 99.50th=[  354], 99.90th=[  406], 99.95th=[  438],
     | 99.99th=[  498]
    bw (KB  /s): min=18784, max=24904, per=12.50%, avg=23246.51, stdev=871.93
    lat (usec) : 100=0.31%, 250=95.24%, 500=4.44%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%
  cpu          : usr=1.04%, sys=6.48%, ctx=2789544, majf=0, minf=91
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=2789133/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=10895MB, aggrb=185939KB/s, minb=185939KB/s, maxb=185939KB/s, mint=60001msec, maxt=60001msec

Disk stats (read/write):
    md2: ios=2785971/10, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=1394566/12, aggrmerge=0/5, aggrticks=224236/19, aggrin_queue=224196, aggrutil=99.76%
  sdb: ios=1211299/12, merge=0/5, ticks=225466/30, in_queue=225463, util=99.76%
  sda: ios=1577834/12, merge=0/5, ticks=223007/8, in_queue=222929, util=99.76%
Hard drive
FIO random write
Performance
2008.9 MB/s
IOPS
514270
./fio --time_based --name=benchmark --size=256M --runtime=60 --filename=benchmark --randrepeat=1 --iodepth=32 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randwrite --blocksize=4k --group_reporting
benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes

benchmark: (groupid=0, jobs=8): err= 0: pid=6574: Fri Aug  4 17:31:43 2017
  write: io=120534MB, bw=2008.9MB/s, iops=514270, runt= 60001msec
    clat (usec): min=1, max=351150, avg=13.90, stdev=189.44
     lat (usec): min=1, max=351151, avg=14.21, stdev=189.44
    clat percentiles (usec):
     |  1.00th=[    2],  5.00th=[    3], 10.00th=[    4], 20.00th=[    8],
     | 30.00th=[   11], 40.00th=[   12], 50.00th=[   13], 60.00th=[   13],
     | 70.00th=[   14], 80.00th=[   15], 90.00th=[   16], 95.00th=[   17],
     | 99.00th=[   23], 99.50th=[   28], 99.90th=[  756], 99.95th=[ 1432],
     | 99.99th=[ 3024]
    bw (KB  /s): min=110158, max=292272, per=12.52%, avg=257524.30, stdev=16954.71
    lat (usec) : 2=0.07%, 4=7.39%, 10=16.39%, 20=74.65%, 50=1.26%
    lat (usec) : 100=0.03%, 250=0.04%, 500=0.04%, 750=0.03%, 1000=0.02%
    lat (msec) : 2=0.05%, 4=0.03%, 10=0.01%, 20=0.01%, 500=0.01%
  cpu          : usr=5.06%, sys=82.90%, ctx=5104467, majf=0, minf=97
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=30856768/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=120534MB, aggrb=2008.9MB/s, minb=2008.9MB/s, maxb=2008.9MB/s, mint=60001msec, maxt=60001msec

Disk stats (read/write):
    md2: ios=0/8517, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=0/8533, aggrmerge=0/78, aggrticks=0/501265, aggrin_queue=501267, aggrutil=7.90%
  sdb: ios=0/8525, merge=0/85, ticks=0/565502, in_queue=565511, util=7.90%
  sda: ios=0/8541, merge=0/71, ticks=0/437028, in_queue=437024, util=6.64%
Hard drive
FIO random direct write
Performance
89.52 MB/s
IOPS
22916
./fio --time_based --name=benchmark --size=256M --runtime=60 --filename=benchmark --randrepeat=1 --iodepth=32 --direct=1 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randwrite --blocksize=4k --group_reporting
benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=6547: Fri Aug  4 17:30:42 2017
  write: io=5371.2MB, bw=91666KB/s, iops=22916, runt= 60001msec
    clat (usec): min=32, max=53709, avg=346.35, stdev=303.14
     lat (usec): min=32, max=53710, avg=346.76, stdev=303.15
    clat percentiles (usec):
     |  1.00th=[   35],  5.00th=[   36], 10.00th=[   37], 20.00th=[  338],
     | 30.00th=[  350], 40.00th=[  374], 50.00th=[  378], 60.00th=[  386],
     | 70.00th=[  394], 80.00th=[  418], 90.00th=[  454], 95.00th=[  498],
     | 99.00th=[  620], 99.50th=[  780], 99.90th=[ 1608], 99.95th=[ 2608],
     | 99.99th=[ 9280]
    bw (KB  /s): min= 6312, max=26864, per=12.50%, avg=11461.34, stdev=3658.10
    lat (usec) : 50=15.66%, 100=0.22%, 250=0.01%, 500=79.59%, 750=3.99%
    lat (usec) : 1000=0.25%
    lat (msec) : 2=0.23%, 4=0.02%, 10=0.04%, 20=0.01%, 50=0.01%
    lat (msec) : 100=0.01%
  cpu          : usr=0.76%, sys=7.42%, ctx=2749717, majf=0, minf=84
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=1375015/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=5371.2MB, aggrb=91666KB/s, minb=91666KB/s, maxb=91666KB/s, mint=60001msec, maxt=60001msec

Disk stats (read/write):
    md2: ios=0/1374647, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=0/1375205, aggrmerge=0/793, aggrticks=0/33672, aggrin_queue=33546, aggrutil=57.00%
  sdb: ios=0/1375205, merge=0/793, ticks=0/32887, in_queue=32784, util=54.45%
  sda: ios=0/1375205, merge=0/793, ticks=0/34457, in_queue=34309, util=57.00%
Download
Download benchmark results
Download speed
726.22 Mbit/s
Downloaded 104857600 bytes in 0.998 sec
Downloaded 104857600 bytes in 1.011 sec
Downloaded 104857600 bytes in 0.947 sec
Downloaded 104857600 bytes in 0.995 sec
Downloaded 104857600 bytes in 1.557 sec
Finished! Average download speed is 726.22 Mbit/s
Upload
Speedtest results
Upload speed
183.88 Mbit/s
Retrieving speedtest.net configuration...
Retrieving speedtest.net server list...
Testing from Hetzner ...
Selecting 15 servers that are not too close:
  1. Onlime GmbH (Aerzen) [83.89 km]: 38.172 ms
  2. IT Ohlendorf (Salzgitter) [111.93 km]: 11.95 ms
  3. Hanne & Fomenko GbR (Salzgitter) [111.93 km]: 11.579 ms
  4. Newone (Ilmenau) [120.64 km]: 15.132 ms
  5. Thueringer Netkom GmbH (Weimar) [132.12 km]: 19.81 ms
  6. Vodafone DE (Frankfurt) [143.27 km]: 9.382 ms
  7. DEAC (Frankfurt) [143.27 km]: 40.297 ms
  8. 23media GmbH (Frankfurt) [143.27 km]: 9.187 ms
  9. x-ion GmbH (Frankfurt) [143.27 km]: 10.65 ms
  10. IP-Projects GmbH & Co. KG (Frankfurt) [143.27 km]: 7.668 ms
  11. LWLcom GmbH (Frankfurt) [143.27 km]: 9.213 ms
  12. fdcservers.net (Frankfurt) [143.27 km]: 10.819 ms
  13. Interoute VDC (Frankfurt) [143.27 km]: 10.358 ms
  14. Jublo Solutions (Frankfurt) [143.27 km]: 225.432 ms
  15. ShadowGaming (Frankfurt) [143.27 km]: 34.403 ms
Testing upload speeds
  1. Onlime GmbH (Aerzen):                        ......................... 60.12 Mbit/s
  2. IT Ohlendorf (Salzgitter):                   ......................... 195.11 Mbit/s
  3. Hanne & Fomenko GbR (Salzgitter):            ......................... 168.15 Mbit/s
  4. Newone (Ilmenau):                            ......................... 251.86 Mbit/s
  5. Thueringer Netkom GmbH (Weimar):             ......................... 174.48 Mbit/s
  6. Vodafone DE (Frankfurt):                     ......................... 202.15 Mbit/s
  7. DEAC (Frankfurt):                            ......................... 128.75 Mbit/s
  8. 23media GmbH (Frankfurt):                    ......................... 207.35 Mbit/s
  9. x-ion GmbH (Frankfurt):                      ......................... 102.60 Mbit/s
  10. IP-Projects GmbH & Co. KG (Frankfurt):      ......................... 203.83 Mbit/s
  11. LWLcom GmbH (Frankfurt):                    ......................... 194.26 Mbit/s
  12. fdcservers.net (Frankfurt):                 ......................... 94.77 Mbit/s
  13. Interoute VDC (Frankfurt):                  ......................... 95.90 Mbit/s
  14. Jublo Solutions (Frankfurt):                ......................... 186.17 Mbit/s
  15. ShadowGaming (Frankfurt):                   ......................... 110.55 Mbit/s
Average upload speed is 158.40 Mbit/s