Stopwatch
Benchmark report #5991
Hivelocity – AMD EPYC 16-Core 7351P
Report
Share test result

Test results for AMD EPYC 16-Core 7351P at Hivelocity


Server specs:


32 × AMD EPYC 7351P 16-Core Processor
126 GB RAM / 790 GB disk space
Debian 9.3
Tampa, United States

Benchmark results summary:


UnixBench - 8898.0
Disk Read - 11869 MB/s
Disk Write - 1431 MB/s
Bandwidth - 711.88 MB/s

More: https://serverscope.io/trials/m0ZD
Share
Share this page
Cpu chip
Server Specs
CPU
32 × AMD EPYC 7351P 16-Core Processor
CPU Cores
16 × 2400 MHz
RAM
126 GB
Disk
790 GB
OS
Debian 9.3
Location
Tampa, United States
Benchmark summary
Benchmark summary
UnixBench
8898.0
Disk Read
11869 MB/s
Disk Write
1431 MB/s
Bandwidth
711.88 Mbit/s
Speedtest
232.48 Mbit/s
Graph analysis
UnixBench Score
UnixBench (all CPUs)
8898.0
UnixBench (one CPU)
1677.4
Terminal
Raw Output
gcc -o pgms/arithoh -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Darithoh src/arith.c 
gcc -o pgms/register -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum="register int" src/arith.c 
gcc -o pgms/short -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum=short src/arith.c 
gcc -o pgms/int -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum=int src/arith.c 
gcc -o pgms/long -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum=long src/arith.c 
gcc -o pgms/float -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum=float src/arith.c 
gcc -o pgms/double -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum=double src/arith.c 
gcc -o pgms/hanoi -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/hanoi.c 
gcc -o pgms/syscall -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/syscall.c 
gcc -o pgms/context1 -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/context1.c 
gcc -o pgms/pipe -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/pipe.c 
gcc -o pgms/spawn -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/spawn.c 
gcc -o pgms/execl -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/execl.c 
gcc -o pgms/dhry2 -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -DHZ= ./src/dhry_1.c ./src/dhry_2.c
gcc -o pgms/dhry2reg -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -DHZ= -DREG=register ./src/dhry_1.c ./src/dhry_2.c
gcc -o pgms/looper -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/looper.c 
gcc -o pgms/fstime -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/fstime.c 
gcc -o pgms/whetstone-double -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -DDP -DUNIX -DUNIXBENCH src/whets.c -lm
make all
make[1]: Entering directory "/root/serverscope-9qjaeJ/byte-unixbench/UnixBench"
make distr
make[2]: Entering directory "/root/serverscope-9qjaeJ/byte-unixbench/UnixBench"
Checking distribution of files
./pgms  exists
./src  exists
./testdir  exists
make[2]: Leaving directory "/root/serverscope-9qjaeJ/byte-unixbench/UnixBench"
make programs
make[2]: Entering directory "/root/serverscope-9qjaeJ/byte-unixbench/UnixBench"
make[2]: Nothing to be done for "programs".
make[2]: Leaving directory "/root/serverscope-9qjaeJ/byte-unixbench/UnixBench"
make[1]: Leaving directory "/root/serverscope-9qjaeJ/byte-unixbench/UnixBench"
sh: 1: 3dinfo: not found

   #    #  #    #  #  #    #          #####   ######  #    #   ####   #    #
   #    #  ##   #  #   #  #           #    #  #       ##   #  #    #  #    #
   #    #  # #  #  #    ##            #####   #####   # #  #  #       ######
   #    #  #  # #  #    ##            #    #  #       #  # #  #       #    #
   #    #  #   ##  #   #  #           #    #  #       #   ##  #    #  #    #
    ####   #    #  #  #    #          #####   ######  #    #   ####   #    #

   Version 5.1.3                      Based on the Byte Magazine Unix Benchmark

   Multi-CPU version                  Version 5 revisions by Ian Smith,
                                      Sunnyvale, CA, USA
   January 13, 2011                   johantheghost at yahoo period com


1 x Dhrystone 2 using register variables  1 2 3 4 5 6 7 8 9 10

1 x Double-Precision Whetstone  1 2 3 4 5 6 7 8 9 10

1 x Execl Throughput  1 2 3

1 x File Copy 1024 bufsize 2000 maxblocks  1 2 3

1 x File Copy 256 bufsize 500 maxblocks  1 2 3

1 x File Copy 4096 bufsize 8000 maxblocks  1 2 3

1 x Pipe Throughput  1 2 3 4 5 6 7 8 9 10

1 x Pipe-based Context Switching  1 2 3 4 5 6 7 8 9 10

1 x Process Creation  1 2 3

1 x System Call Overhead  1 2 3 4 5 6 7 8 9 10

1 x Shell Scripts (1 concurrent)  1 2 3

1 x Shell Scripts (8 concurrent)  1 2 3

32 x Dhrystone 2 using register variables  1 2 3 4 5 6 7 8 9 10

32 x Double-Precision Whetstone  1 2 3 4 5 6 7 8 9 10

32 x Execl Throughput  1 2 3

32 x File Copy 1024 bufsize 2000 maxblocks  1 2 3

32 x File Copy 256 bufsize 500 maxblocks  1 2 3

32 x File Copy 4096 bufsize 8000 maxblocks  1 2 3

32 x Pipe Throughput  1 2 3 4 5 6 7 8 9 10

32 x Pipe-based Context Switching  1 2 3 4 5 6 7 8 9 10

32 x Process Creation  1 2 3

32 x System Call Overhead  1 2 3 4 5 6 7 8 9 10

32 x Shell Scripts (1 concurrent)  1 2 3

32 x Shell Scripts (8 concurrent)  1 2 3

========================================================================
   BYTE UNIX Benchmarks (Version 5.1.3)

   System: epycbench: GNU/Linux
   OS: GNU/Linux -- 4.9.0-4-amd64 -- #1 SMP Debian 4.9.65-3+deb9u1 (2017-12-23)
   Machine: x86_64 (unknown)
   Language: en_US.utf8 (charmap="UTF-8", collate="UTF-8")
   CPU 0: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 1: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 2: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 3: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 4: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 5: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 6: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 7: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 8: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 9: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 10: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 11: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 12: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 13: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 14: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 15: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 16: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 17: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 18: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 19: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 20: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 21: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 22: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 23: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 24: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 25: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 26: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 27: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 28: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 29: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 30: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   CPU 31: AMD EPYC 7351P 16-Core Processor (4790.6 bogomips)
          Hyper-Threading, x86-64, MMX, AMD MMX, Physical Address Ext, SYSENTER/SYSEXIT, AMD virtualization, SYSCALL/SYSRET
   22:21:16 up  3:05,  1 user,  load average: 7.87, 4.82, 2.82; runlevel 2018-02-15

------------------------------------------------------------------------
Benchmark Run: Thu Feb 15 2018 22:21:16 - 22:49:24
32 CPUs in system; running 1 parallel copy of tests

Dhrystone 2 using register variables       34254498.9 lps   (10.0 s, 7 samples)
Double-Precision Whetstone                     4539.0 MWIPS (10.4 s, 7 samples)
Execl Throughput                               3544.7 lps   (30.0 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks       1033366.5 KBps  (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks          281787.5 KBps  (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks       2673887.0 KBps  (30.0 s, 2 samples)
Pipe Throughput                             2023991.4 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                 156634.7 lps   (10.0 s, 7 samples)
Process Creation                               5114.2 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                   9806.3 lpm   (60.0 s, 2 samples)
Shell Scripts (8 concurrent)                   5157.5 lpm   (60.0 s, 2 samples)
System Call Overhead                        3540673.2 lps   (10.0 s, 7 samples)

System Benchmarks Index Values               BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0   34254498.9   2935.3
Double-Precision Whetstone                       55.0       4539.0    825.3
Execl Throughput                                 43.0       3544.7    824.3
File Copy 1024 bufsize 2000 maxblocks          3960.0    1033366.5   2609.5
File Copy 256 bufsize 500 maxblocks            1655.0     281787.5   1702.6
File Copy 4096 bufsize 8000 maxblocks          5800.0    2673887.0   4610.2
Pipe Throughput                               12440.0    2023991.4   1627.0
Pipe-based Context Switching                   4000.0     156634.7    391.6
Process Creation                                126.0       5114.2    405.9
Shell Scripts (1 concurrent)                     42.4       9806.3   2312.8
Shell Scripts (8 concurrent)                      6.0       5157.5   8595.8
System Call Overhead                          15000.0    3540673.2   2360.4
                                                                   ========
System Benchmarks Index Score                                        1677.4

------------------------------------------------------------------------
Benchmark Run: Thu Feb 15 2018 22:49:24 - 23:17:32
32 CPUs in system; running 32 parallel copies of tests

Dhrystone 2 using register variables      724642870.2 lps   (10.0 s, 7 samples)
Double-Precision Whetstone                   133922.6 MWIPS (9.9 s, 7 samples)
Execl Throughput                              27515.3 lps   (30.0 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks        472795.0 KBps  (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks          121540.2 KBps  (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks       1488877.6 KBps  (30.0 s, 2 samples)
Pipe Throughput                            45311049.5 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                5627106.5 lps   (10.0 s, 7 samples)
Process Creation                              81663.4 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                 114368.2 lpm   (60.0 s, 2 samples)
Shell Scripts (8 concurrent)                  15593.3 lpm   (60.1 s, 2 samples)
System Call Overhead                        7288484.4 lps   (10.0 s, 7 samples)

System Benchmarks Index Values               BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0  724642870.2  62094.5
Double-Precision Whetstone                       55.0     133922.6  24349.6
Execl Throughput                                 43.0      27515.3   6398.9
File Copy 1024 bufsize 2000 maxblocks          3960.0     472795.0   1193.9
File Copy 256 bufsize 500 maxblocks            1655.0     121540.2    734.4
File Copy 4096 bufsize 8000 maxblocks          5800.0    1488877.6   2567.0
Pipe Throughput                               12440.0   45311049.5  36423.7
Pipe-based Context Switching                   4000.0    5627106.5  14067.8
Process Creation                                126.0      81663.4   6481.2
Shell Scripts (1 concurrent)                     42.4     114368.2  26973.6
Shell Scripts (8 concurrent)                      6.0      15593.3  25988.8
System Call Overhead                          15000.0    7288484.4   4859.0
                                                                   ========
System Benchmarks Index Score                                        8898.0

Hard drive
dd
dd if=/dev/zero of=benchmark bs=64K count=32K conv=fdatasync
32768+0 records in
32768+0 records out
2147483648 bytes (2.1 GB, 2.0 GiB) copied, 3.21617 s, 668 MB/s


dd if=/dev/zero of=benchmark bs=1M count=2048 conv=fdatasync
2048+0 records in
2048+0 records out
2147483648 bytes (2.1 GB, 2.0 GiB) copied, 3.20875 s, 669 MB/s


Hard drive
FIO random read
Performance
11869.0 MB/s
IOPS
3111321
./fio --time_based --name=benchmark --size=256M --runtime=60 --randrepeat=1 --iodepth=32 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randread --blocksize=4k --group_reporting
benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=18439: Thu Feb 15 22:18:13 2018
  read : io=712128MB, bw=11869MB/s, iops=3038.4K, runt= 60001msec
    clat (usec): min=0, max=2352, avg= 1.43, stdev= 4.72
     lat (usec): min=0, max=2352, avg= 1.64, stdev= 4.72
    clat percentiles (usec):
     |  1.00th=[    0],  5.00th=[    1], 10.00th=[    1], 20.00th=[    1],
     | 30.00th=[    1], 40.00th=[    1], 50.00th=[    1], 60.00th=[    1],
     | 70.00th=[    1], 80.00th=[    2], 90.00th=[    2], 95.00th=[    2],
     | 99.00th=[    2], 99.50th=[    2], 99.90th=[   91], 99.95th=[   95],
     | 99.99th=[  131]
    bw (MB  /s): min=   43, max= 1814, per=12.49%, avg=1482.32, stdev=477.52
    lat (usec) : 2=79.71%, 4=19.96%, 10=0.05%, 20=0.01%, 50=0.01%
    lat (usec) : 100=0.25%, 250=0.04%, 500=0.01%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.01%, 4=0.01%
  cpu          : usr=27.00%, sys=64.30%, ctx=524767, majf=0, minf=62
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=182304697/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=712128MB, aggrb=11869MB/s, minb=11869MB/s, maxb=11869MB/s, mint=60001msec, maxt=60001msec

Disk stats (read/write):
  nvme0n1: ios=524288/185, merge=0/543, ticks=42340/4, in_queue=42464, util=9.72%
Hard drive
FIO random direct read
Performance
360.36 MB/s
IOPS
92251
./fio --time_based --name=benchmark --size=256M --runtime=60 --randrepeat=1 --iodepth=32 --direct=1 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randread --blocksize=4k --group_reporting
benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes

benchmark: (groupid=0, jobs=8): err= 0: pid=18481: Thu Feb 15 22:19:13 2018
  read : io=21622MB, bw=369006KB/s, iops=92251, runt= 60001msec
    clat (usec): min=58, max=488, avg=84.97, stdev=17.82
     lat (usec): min=58, max=488, avg=85.22, stdev=17.82
    clat percentiles (usec):
     |  1.00th=[   66],  5.00th=[   71], 10.00th=[   72], 20.00th=[   72],
     | 30.00th=[   73], 40.00th=[   74], 50.00th=[   78], 60.00th=[   88],
     | 70.00th=[   89], 80.00th=[   91], 90.00th=[  104], 95.00th=[  122],
     | 99.00th=[  153], 99.50th=[  167], 99.90th=[  199], 99.95th=[  213],
     | 99.99th=[  255]
    bw (KB  /s): min=33936, max=47256, per=12.50%, avg=46130.23, stdev=1140.02
    lat (usec) : 100=87.88%, 250=12.11%, 500=0.01%
  cpu          : usr=2.77%, sys=4.95%, ctx=5535377, majf=0, minf=81
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=5535181/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=21622MB, aggrb=369005KB/s, minb=369005KB/s, maxb=369005KB/s, mint=60001msec, maxt=60001msec

Disk stats (read/write):
  nvme0n1: ios=5527032/3, merge=0/1, ticks=443216/0, in_queue=445272, util=100.00%
Hard drive
FIO random write
Performance
1431.4 MB/s
IOPS
366420
./fio --time_based --name=benchmark --size=256M --runtime=60 --filename=benchmark --randrepeat=1 --iodepth=32 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randwrite --blocksize=4k --group_reporting
benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes

benchmark: (groupid=0, jobs=8): err= 0: pid=18567: Thu Feb 15 22:21:14 2018
  write: io=85881MB, bw=1431.4MB/s, iops=366420, runt= 60001msec
    clat (usec): min=1, max=128091, avg=20.42, stdev=111.37
     lat (usec): min=1, max=128091, avg=20.66, stdev=111.37
    clat percentiles (usec):
     |  1.00th=[    2],  5.00th=[    4], 10.00th=[    9], 20.00th=[   18],
     | 30.00th=[   19], 40.00th=[   20], 50.00th=[   21], 60.00th=[   21],
     | 70.00th=[   22], 80.00th=[   23], 90.00th=[   24], 95.00th=[   25],
     | 99.00th=[   31], 99.50th=[   33], 99.90th=[   42], 99.95th=[  115],
     | 99.99th=[ 2704]
    bw (KB  /s): min=131424, max=234408, per=12.50%, avg=183192.84, stdev=13498.98
    lat (usec) : 2=0.01%, 4=4.53%, 10=5.61%, 20=20.73%, 50=69.05%
    lat (usec) : 100=0.01%, 250=0.02%, 500=0.01%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%
    lat (msec) : 250=0.01%
  cpu          : usr=3.98%, sys=91.93%, ctx=615244, majf=0, minf=80
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=21985601/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=85881MB, aggrb=1431.4MB/s, minb=1431.4MB/s, maxb=1431.4MB/s, mint=60001msec, maxt=60001msec

Disk stats (read/write):
  nvme0n1: ios=0/98144, merge=0/26, ticks=0/3682196, in_queue=3682188, util=7.09%
Hard drive
FIO random direct write
Performance
222.16 MB/s
IOPS
56873
./fio --time_based --name=benchmark --size=256M --runtime=60 --filename=benchmark --randrepeat=1 --iodepth=32 --direct=1 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randwrite --blocksize=4k --group_reporting
benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=18523: Thu Feb 15 22:20:13 2018
  write: io=13330MB, bw=227495KB/s, iops=56873, runt= 60001msec
    clat (usec): min=14, max=2281, avg=139.05, stdev=12.47
     lat (usec): min=14, max=2282, avg=139.30, stdev=12.48
    clat percentiles (usec):
     |  1.00th=[  133],  5.00th=[  135], 10.00th=[  135], 20.00th=[  137],
     | 30.00th=[  137], 40.00th=[  137], 50.00th=[  139], 60.00th=[  139],
     | 70.00th=[  139], 80.00th=[  139], 90.00th=[  141], 95.00th=[  143],
     | 99.00th=[  193], 99.50th=[  209], 99.90th=[  249], 99.95th=[  258],
     | 99.99th=[  298]
    bw (KB  /s): min=19232, max=42160, per=12.50%, avg=28438.53, stdev=1470.09
    lat (usec) : 20=0.18%, 50=0.05%, 100=0.01%, 250=99.67%, 500=0.09%
    lat (usec) : 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.01%, 4=0.01%
  cpu          : usr=3.21%, sys=5.67%, ctx=6825026, majf=0, minf=76
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=3412478/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=13330MB, aggrb=227494KB/s, minb=227494KB/s, maxb=227494KB/s, mint=60001msec, maxt=60001msec

Disk stats (read/write):
  nvme0n1: ios=0/3407516, merge=0/577, ticks=0/39976, in_queue=39676, util=66.13%
Download
Download benchmark results
Download speed
711.88 Mbit/s
Downloaded 104857600 bytes in 1.275077 sec
Downloaded 104857600 bytes in 0.940173 sec
Downloaded 104857600 bytes in 1.064855 sec
Downloaded 104857600 bytes in 1.142333 sec
Downloaded 104857600 bytes in 1.196455 sec
Finished! Average download speed is 711.88 Mbit/s
Upload
Speedtest results
Upload speed
232.48 Mbit/s
Retrieving speedtest.net configuration...
Retrieving speedtest.net server list...
Testing from NOC4HOST ...
Selecting 15 servers that are not too close:
  1. Alternative Choice Wireless (Winter Haven, FL) [73.45 km]: 73.727 ms
  2. CCI Systems, Inc (Lake Buena Vista, FL) [103.53 km]: 231.972 ms
  3. AT&T (Orlando, FL) [125.01 km]: 42.935 ms
  4. CenturyLink, Inc (Orlando, FL) [125.01 km]: 118.39 ms
  5. Webby Enterprises LLC (Orlando, FL) [125.01 km]: 150.092 ms
  6. Sprint (Orlando, FL) [125.01 km]: 70.343 ms
  7. T-Mobile (Orlando, FL) [125.01 km]: 60.174 ms
  8. Verizon (Orlando, FL) [125.01 km]: 63.873 ms
  9. T3 Communications, Inc. (Fort Myers, FL) [157.91 km]: 54.649 ms
  10. CenturyLink, Inc (Fort Myers, FL) [157.91 km]: 53.974 ms
  11. CenturyLink, Inc (Fort Myers, FL) [157.91 km]: 150.197 ms
  12. FL High Speed Internet (Cocoa, FL) [174.50 km]: 70.653 ms
  13. Comcast (Bonita Springs, FL) [190.88 km]: 58.883 ms
  14. Nefcom Internet (Macclenny, FL) [261.84 km]: 119.349 ms
  15. Comcast (Jacksonville, FL) [274.90 km]: 52.674 ms
Testing upload speeds
  1. Alternative Choice Wireless (Winter Haven, FL):......................... 415.76 Mbit/s
  2. CCI Systems, Inc (Lake Buena Vista, FL):     ......................... 157.18 Mbit/s
  3. AT&T (Orlando, FL):                          ......................... 166.35 Mbit/s
  4. CenturyLink, Inc (Orlando, FL):              ......................... 233.30 Mbit/s
  5. Webby Enterprises LLC (Orlando, FL):         ......................... 23.27 Mbit/s
  6. Sprint (Orlando, FL):                        ......................... 363.94 Mbit/s
  7. T-Mobile (Orlando, FL):                      ......................... 363.30 Mbit/s
  8. Verizon (Orlando, FL):                       ......................... 173.12 Mbit/s
  9. T3 Communications, Inc. (Fort Myers, FL):    ......................... 341.22 Mbit/s
  10. CenturyLink, Inc (Fort Myers, FL):          ......................... 217.21 Mbit/s
  11. CenturyLink, Inc (Fort Myers, FL):          ......................... 29.20 Mbit/s
  12. FL High Speed Internet (Cocoa, FL):         ......................... 96.58 Mbit/s
  13. Comcast (Bonita Springs, FL):               ......................... 131.93 Mbit/s
  14. Nefcom Internet (Macclenny, FL):            ......................... 72.23 Mbit/s
  15. Comcast (Jacksonville, FL):                 ......................... 129.84 Mbit/s
Average upload speed is 194.30 Mbit/s