Stopwatch
Benchmark report #3950
SSD Nodes – Preon (Large)
Report
Share test result

Test results for Preon (Large) at SSD Nodes


Server specs:


4 × Intel(R) Xeon(R) CPU E5-2660 v3 @ 2.60GHz
16 GB RAM / 82 GB disk space
Ubuntu 16.04 Xenial
Trumbull, United States

Benchmark results summary:


UnixBench - 2668.1
Disk Read - 5780 MB/s
Disk Write - 1330 MB/s
Bandwidth - 660.83 MB/s

More: https://serverscope.io/trials/36ZB
Share
Share this page
Cpu chip
Server Specs
CPU
4 × Intel(R) Xeon(R) CPU E5-2660 v3 @ 2.60GHz
CPU Cores
10 × 2900 MHz
RAM
16 GB
Disk
82 GB
OS
Ubuntu 16.04 Xenial
Location
Trumbull, United States
Benchmark summary
Benchmark summary
UnixBench
2668.1
Disk Read
5780 MB/s
Disk Write
1330 MB/s
Bandwidth
660.83 Mbit/s
Speedtest
69.81 Mbit/s
Graph analysis
UnixBench Score
UnixBench (all CPUs)
2668.1
UnixBench (one CPU)
1246.7
Terminal
Raw Output
gcc -o pgms/arithoh -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Darithoh src/arith.c 
gcc -o pgms/register -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum="register int" src/arith.c 
gcc -o pgms/short -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum=short src/arith.c 
gcc -o pgms/int -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum=int src/arith.c 
gcc -o pgms/long -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum=long src/arith.c 
gcc -o pgms/float -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum=float src/arith.c 
gcc -o pgms/double -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum=double src/arith.c 
gcc -o pgms/hanoi -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/hanoi.c 
gcc -o pgms/syscall -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/syscall.c 
gcc -o pgms/context1 -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/context1.c 
gcc -o pgms/pipe -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/pipe.c 
src/pipe.c: In function xe2x80x98mainxe2x80x99:
src/pipe.c:52:2: warning: ignoring return value of xe2x80x98pipexe2x80x99, declared with attribute warn_unused_result [-Wunused-result]
  pipe(pvec);
  ^
gcc -o pgms/spawn -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/spawn.c 
gcc -o pgms/execl -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/execl.c 
In file included from src/execl.c:34:0:
src/big.c: In function xe2x80x98dummyxe2x80x99:
src/big.c:109:5: warning: ignoring return value of xe2x80x98freopenxe2x80x99, declared with attribute warn_unused_result [-Wunused-result]
     freopen("masterlog.00", "a", stderr);
     ^
src/big.c:197:6: warning: ignoring return value of xe2x80x98freopenxe2x80x99, declared with attribute warn_unused_result [-Wunused-result]
      freopen(logname, "w", stderr);
      ^
src/big.c:221:3: warning: ignoring return value of xe2x80x98dupxe2x80x99, declared with attribute warn_unused_result [-Wunused-result]
   dup(pvec[0]);
   ^
src/big.c:225:6: warning: ignoring return value of xe2x80x98freopenxe2x80x99, declared with attribute warn_unused_result [-Wunused-result]
      freopen(logname, "w", stderr);
      ^
src/big.c:318:4: warning: ignoring return value of xe2x80x98writexe2x80x99, declared with attribute warn_unused_result [-Wunused-result]
    write(fcopy, cp->line, p - cp->line + 1);
    ^
gcc -o pgms/dhry2 -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -DHZ= ./src/dhry_1.c ./src/dhry_2.c
gcc -o pgms/dhry2reg -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -DHZ= -DREG=register ./src/dhry_1.c ./src/dhry_2.c
gcc -o pgms/looper -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/looper.c 
gcc -o pgms/fstime -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/fstime.c 
gcc -o pgms/whetstone-double -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -DDP -DUNIX -DUNIXBENCH src/whets.c -lm
make all
make[1]: Entering directory "/home/shadow/benchmark/serverscope-TS6P65/byte-unixbench/UnixBench"
make distr
make[2]: Entering directory "/home/shadow/benchmark/serverscope-TS6P65/byte-unixbench/UnixBench"
Checking distribution of files
./pgms  exists
./src  exists
./testdir  exists
make[2]: Leaving directory "/home/shadow/benchmark/serverscope-TS6P65/byte-unixbench/UnixBench"
make programs
make[2]: Entering directory "/home/shadow/benchmark/serverscope-TS6P65/byte-unixbench/UnixBench"
make[2]: Nothing to be done for "programs".
make[2]: Leaving directory "/home/shadow/benchmark/serverscope-TS6P65/byte-unixbench/UnixBench"
make[1]: Leaving directory "/home/shadow/benchmark/serverscope-TS6P65/byte-unixbench/UnixBench"
sh: 1: 3dinfo: not found

   #    #  #    #  #  #    #          #####   ######  #    #   ####   #    #
   #    #  ##   #  #   #  #           #    #  #       ##   #  #    #  #    #
   #    #  # #  #  #    ##            #####   #####   # #  #  #       ######
   #    #  #  # #  #    ##            #    #  #       #  # #  #       #    #
   #    #  #   ##  #   #  #           #    #  #       #   ##  #    #  #    #
    ####   #    #  #  #    #          #####   ######  #    #   ####   #    #

   Version 5.1.3                      Based on the Byte Magazine Unix Benchmark

   Multi-CPU version                  Version 5 revisions by Ian Smith,
                                      Sunnyvale, CA, USA
   January 13, 2011                   johantheghost at yahoo period com


1 x Dhrystone 2 using register variables  1 2 3 4 5 6 7 8 9 10

1 x Double-Precision Whetstone  1 2 3 4 5 6 7 8 9 10

1 x Execl Throughput  1 2 3

1 x File Copy 1024 bufsize 2000 maxblocks  1 2 3

1 x File Copy 256 bufsize 500 maxblocks  1 2 3

1 x File Copy 4096 bufsize 8000 maxblocks  1 2 3

1 x Pipe Throughput  1 2 3 4 5 6 7 8 9 10

1 x Pipe-based Context Switching  1 2 3 4 5 6 7 8 9 10

1 x Process Creation  1 2 3

1 x System Call Overhead  1 2 3 4 5 6 7 8 9 10

1 x Shell Scripts (1 concurrent)  1 2 3

1 x Shell Scripts (8 concurrent)  1 2 3

4 x Dhrystone 2 using register variables  1 2 3 4 5 6 7 8 9 10

4 x Double-Precision Whetstone  1 2 3 4 5 6 7 8 9 10

4 x Execl Throughput  1 2 3

4 x File Copy 1024 bufsize 2000 maxblocks  1 2 3

4 x File Copy 256 bufsize 500 maxblocks  1 2 3

4 x File Copy 4096 bufsize 8000 maxblocks  1 2 3

4 x Pipe Throughput  1 2 3 4 5 6 7 8 9 10

4 x Pipe-based Context Switching  1 2 3 4 5 6 7 8 9 10

4 x Process Creation  1 2 3

4 x System Call Overhead  1 2 3 4 5 6 7 8 9 10

4 x Shell Scripts (1 concurrent)  1 2 3

4 x Shell Scripts (8 concurrent)  1 2 3

========================================================================
   BYTE UNIX Benchmarks (Version 5.1.3)

   System: fuserver: GNU/Linux
   OS: GNU/Linux -- 4.4.0 -- #1 SMP Sat Jul 29 14:57:34 MSK 2017
   Machine: x86_64 (x86_64)
   Language: en_US.utf8 (charmap="UTF-8", collate="UTF-8")
   CPU 0: Intel(R) Xeon(R) CPU E5-2660 v3 @ 2.60GHz (5200.2 bogomips)
          Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET, Intel virtualization
   CPU 1: Intel(R) Xeon(R) CPU E5-2660 v3 @ 2.60GHz (5200.2 bogomips)
          Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET, Intel virtualization
   CPU 2: Intel(R) Xeon(R) CPU E5-2660 v3 @ 2.60GHz (5200.2 bogomips)
          Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET, Intel virtualization
   CPU 3: Intel(R) Xeon(R) CPU E5-2660 v3 @ 2.60GHz (5200.2 bogomips)
          Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET, Intel virtualization
   06:46:15 up 3 days, 17:00,  2 users,  load average: 8,48, 5,13, 2,39; runlevel 2017-08-16

------------------------------------------------------------------------
Benchmark Run: sxf6n aug 20 2017 06:46:15 - 07:15:34
4 CPUs in system; running 1 parallel copy of tests

Dhrystone 2 using register variables       30190712.2 lps   (10.0 s, 7 samples)
Double-Precision Whetstone                     3567.9 MWIPS (10.0 s, 7 samples)
Execl Throughput                               3376.4 lps   (29.8 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks        669822.5 KBps  (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks          193883.1 KBps  (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks       1562525.9 KBps  (30.0 s, 2 samples)
Pipe Throughput                             1298802.0 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                 187747.7 lps   (10.0 s, 7 samples)
Process Creation                               5929.1 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                   6411.6 lpm   (60.0 s, 2 samples)
Shell Scripts (8 concurrent)                   1418.8 lpm   (60.0 s, 2 samples)
System Call Overhead                        3644256.0 lps   (10.0 s, 7 samples)

System Benchmarks Index Values               BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0   30190712.2   2587.0
Double-Precision Whetstone                       55.0       3567.9    648.7
Execl Throughput                                 43.0       3376.4    785.2
File Copy 1024 bufsize 2000 maxblocks          3960.0     669822.5   1691.5
File Copy 256 bufsize 500 maxblocks            1655.0     193883.1   1171.5
File Copy 4096 bufsize 8000 maxblocks          5800.0    1562525.9   2694.0
Pipe Throughput                               12440.0    1298802.0   1044.1
Pipe-based Context Switching                   4000.0     187747.7    469.4
Process Creation                                126.0       5929.1    470.6
Shell Scripts (1 concurrent)                     42.4       6411.6   1512.2
Shell Scripts (8 concurrent)                      6.0       1418.8   2364.7
System Call Overhead                          15000.0    3644256.0   2429.5
                                                                   ========
System Benchmarks Index Score                                        1246.7

------------------------------------------------------------------------
Benchmark Run: sxf6n aug 20 2017 07:15:34 - 07:45:49
4 CPUs in system; running 4 parallel copies of tests

Dhrystone 2 using register variables       95760756.0 lps   (10.0 s, 7 samples)
Double-Precision Whetstone                    14036.5 MWIPS (9.8 s, 7 samples)
Execl Throughput                              11116.3 lps   (29.8 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks        799192.1 KBps  (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks          228604.1 KBps  (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks       2095633.9 KBps  (30.0 s, 2 samples)
Pipe Throughput                             4521113.8 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                 813550.6 lps   (10.0 s, 7 samples)
Process Creation                              23188.1 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                  10523.9 lpm   (68.1 s, 2 samples)
Shell Scripts (8 concurrent)                   1388.4 lpm   (64.4 s, 2 samples)
System Call Overhead                        4581026.8 lps   (10.0 s, 7 samples)

System Benchmarks Index Values               BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0   95760756.0   8205.7
Double-Precision Whetstone                       55.0      14036.5   2552.1
Execl Throughput                                 43.0      11116.3   2585.2
File Copy 1024 bufsize 2000 maxblocks          3960.0     799192.1   2018.2
File Copy 256 bufsize 500 maxblocks            1655.0     228604.1   1381.3
File Copy 4096 bufsize 8000 maxblocks          5800.0    2095633.9   3613.2
Pipe Throughput                               12440.0    4521113.8   3634.3
Pipe-based Context Switching                   4000.0     813550.6   2033.9
Process Creation                                126.0      23188.1   1840.3
Shell Scripts (1 concurrent)                     42.4      10523.9   2482.0
Shell Scripts (8 concurrent)                      6.0       1388.4   2314.1
System Call Overhead                          15000.0    4581026.8   3054.0
                                                                   ========
System Benchmarks Index Score                                        2668.1

Hard drive
dd
dd if=/dev/zero of=benchmark bs=64K count=32K conv=fdatasync
32768+0 records in
32768+0 records out
2147483648 bytes (2,1 GB, 2,0 GiB) copied, 7,21579 s, 298 MB/s


dd if=/dev/zero of=benchmark bs=1M count=2048 conv=fdatasync
2048+0 records in
2048+0 records out
2147483648 bytes (2,1 GB, 2,0 GiB) copied, 7,64314 s, 281 MB/s


Hard drive
FIO random read
Performance
5780.2 MB/s
IOPS
1514598
./fio --time_based --name=benchmark --size=256M --runtime=60 --randrepeat=1 --iodepth=32 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randread --blocksize=4k --group_reporting
benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=30853: Sun Aug 20 06:43:11 2017
  read : io=346871MB, bw=5780.2MB/s, iops=1479.1K, runt= 60002msec
    clat (usec): min=0, max=122054, avg= 4.11, stdev=155.31
     lat (usec): min=0, max=122054, avg= 4.20, stdev=157.71
    clat percentiles (usec):
     |  1.00th=[    0],  5.00th=[    1], 10.00th=[    1], 20.00th=[    1],
     | 30.00th=[    1], 40.00th=[    1], 50.00th=[    1], 60.00th=[    1],
     | 70.00th=[    2], 80.00th=[    2], 90.00th=[    2], 95.00th=[    2],
     | 99.00th=[    3], 99.50th=[  165], 99.90th=[  225], 99.95th=[  278],
     | 99.99th=[ 3888]
    bw (KB  /s): min= 8560, max=2984488, per=12.51%, avg=740413.13, stdev=586439.87
    lat (usec) : 2=65.85%, 4=33.24%, 10=0.21%, 20=0.04%, 50=0.09%
    lat (usec) : 100=0.03%, 250=0.48%, 500=0.03%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%
    lat (msec) : 250=0.01%
  cpu          : usr=12.05%, sys=25.92%, ctx=659907, majf=0, minf=319
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=88798995/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=346871MB, aggrb=5780.2MB/s, minb=5780.2MB/s, maxb=5780.2MB/s, mint=60002msec, maxt=60002msec

Disk stats (read/write):
  ploop16217: ios=524292/668, merge=0/0, ticks=0/0, in_queue=0, util=0.00%
Hard drive
FIO random direct read
Performance
6306.1 MB/s
IOPS
1653350
./fio --time_based --name=benchmark --size=256M --runtime=60 --randrepeat=1 --iodepth=32 --direct=1 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randread --blocksize=4k --group_reporting
benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes

benchmark: (groupid=0, jobs=8): err= 0: pid=30869: Sun Aug 20 06:44:12 2017
  read : io=378475MB, bw=6306.1MB/s, iops=1614.6K, runt= 60009msec
    clat (usec): min=0, max=111105, avg= 3.79, stdev=131.93
     lat (usec): min=0, max=111105, avg= 3.86, stdev=133.66
    clat percentiles (usec):
     |  1.00th=[    0],  5.00th=[    0], 10.00th=[    1], 20.00th=[    1],
     | 30.00th=[    1], 40.00th=[    1], 50.00th=[    1], 60.00th=[    1],
     | 70.00th=[    1], 80.00th=[    2], 90.00th=[    2], 95.00th=[    2],
     | 99.00th=[    3], 99.50th=[  165], 99.90th=[  225], 99.95th=[  314],
     | 99.99th=[ 4256]
    bw (KB  /s): min= 7904, max=3022368, per=12.48%, avg=806230.07, stdev=657380.74
    lat (usec) : 2=79.83%, 4=19.40%, 10=0.17%, 20=0.02%, 50=0.01%
    lat (usec) : 100=0.01%, 250=0.50%, 500=0.03%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%
    lat (msec) : 250=0.01%
  cpu          : usr=11.35%, sys=24.55%, ctx=586941, majf=0, minf=305
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=96889592/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=378475MB, aggrb=6306.1MB/s, minb=6306.1MB/s, maxb=6306.1MB/s, mint=60009msec, maxt=60009msec

Disk stats (read/write):
  ploop16217: ios=524288/301, merge=0/0, ticks=0/0, in_queue=0, util=0.00%
Hard drive
FIO random write
Performance
1330.7 MB/s
IOPS
340481
./fio --time_based --name=benchmark --size=256M --runtime=60 --filename=benchmark --randrepeat=1 --iodepth=32 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randwrite --blocksize=4k --group_reporting
benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes

benchmark: (groupid=0, jobs=8): err= 0: pid=31274: Sun Aug 20 06:46:12 2017
  write: io=79819MB, bw=1330.7MB/s, iops=340481, runt= 60014msec
    clat (usec): min=1, max=671841, avg=22.16, stdev=1146.80
     lat (usec): min=1, max=671841, avg=22.28, stdev=1148.80
    clat percentiles (usec):
     |  1.00th=[    1],  5.00th=[    2], 10.00th=[    2], 20.00th=[    2],
     | 30.00th=[    2], 40.00th=[    2], 50.00th=[    3], 60.00th=[    3],
     | 70.00th=[    3], 80.00th=[    4], 90.00th=[    4], 95.00th=[    5],
     | 99.00th=[    8], 99.50th=[   10], 99.90th=[ 3184], 99.95th=[13632],
     | 99.99th=[34560]
    bw (KB  /s): min= 3343, max=335560, per=12.82%, avg=174621.18, stdev=45974.04
    lat (usec) : 2=4.03%, 4=73.98%, 10=21.45%, 20=0.32%, 50=0.09%
    lat (usec) : 100=0.02%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.01%, 4=0.01%, 10=0.03%, 20=0.03%, 50=0.03%
    lat (msec) : 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%
  cpu          : usr=2.86%, sys=12.71%, ctx=200228, majf=0, minf=292
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=20433676/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=79819MB, aggrb=1330.7MB/s, minb=1330.7MB/s, maxb=1330.7MB/s, mint=60014msec, maxt=60014msec

Disk stats (read/write):
  ploop16217: ios=0/212317, merge=0/0, ticks=0/0, in_queue=0, util=0.00%
Hard drive
FIO random direct write
Performance
1472.9 MB/s
IOPS
377048
./fio --time_based --name=benchmark --size=256M --runtime=60 --filename=benchmark --randrepeat=1 --iodepth=32 --direct=1 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randwrite --blocksize=4k --group_reporting
benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=30898: Sun Aug 20 06:45:12 2017
  write: io=88380MB, bw=1472.9MB/s, iops=377048, runt= 60006msec
    clat (usec): min=1, max=424131, avg=19.53, stdev=716.84
     lat (usec): min=1, max=424131, avg=19.68, stdev=719.40
    clat percentiles (usec):
     |  1.00th=[    1],  5.00th=[    2], 10.00th=[    2], 20.00th=[    2],
     | 30.00th=[    2], 40.00th=[    2], 50.00th=[    3], 60.00th=[    3],
     | 70.00th=[    3], 80.00th=[    4], 90.00th=[    4], 95.00th=[    5],
     | 99.00th=[    7], 99.50th=[    9], 99.90th=[ 2128], 99.95th=[12864],
     | 99.99th=[33024]
    bw (KB  /s): min=    3, max=495648, per=12.63%, avg=190438.98, stdev=45412.93
    lat (usec) : 2=4.85%, 4=74.43%, 10=20.24%, 20=0.29%, 50=0.06%
    lat (usec) : 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.01%, 4=0.01%, 10=0.03%, 20=0.03%, 50=0.03%
    lat (msec) : 100=0.01%, 250=0.01%, 500=0.01%
  cpu          : usr=3.15%, sys=13.72%, ctx=236844, majf=0, minf=303
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=22625185/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=88380MB, aggrb=1472.9MB/s, minb=1472.9MB/s, maxb=1472.9MB/s, mint=60006msec, maxt=60006msec

Disk stats (read/write):
  ploop16217: ios=1/270389, merge=0/0, ticks=0/0, in_queue=0, util=0.00%
Download
Download benchmark results
Download speed
660.83 Mbit/s
Downloaded 104857600 bytes in 0,696 sec
Downloaded 104857600 bytes in 0,585 sec
Downloaded 104857600 bytes in 0,542 sec
Downloaded 104857600 bytes in 3,712 sec
Downloaded 104857600 bytes in 0,518 sec
Finished! Average download speed is 660.83 Mbit/s
Upload
Speedtest results
Upload speed
69.81 Mbit/s
Retrieving speedtest.net configuration...
Retrieving speedtest.net server list...
Testing from OVH ...
Selecting 15 servers that are not too close:
  1. T-Mobile (Syosset, NY) [55.46 km]: 33.229 ms
  2. Webair.com (Garden City, NY) [69.92 km]: 33.97 ms
  3. Connecticut Education Network (Hartford, CT) [70.89 km]: 36.591 ms
  4. Interserver, inc (Secaucus, NJ) [88.39 km]: 221.459 ms
  5. AT&T (New York City, NY) [90.51 km]: 45.55 ms
  6. Atlantic Metro (New York City, NY) [90.51 km]: 46.177 ms
  7. Optimum Online (New York City, NY) [90.51 km]: 33.704 ms
  8. Speedtest.net (New York City, NY) [90.51 km]: 31.68 ms
  9. fdcservers.net (New York City, NY) [90.51 km]: 32.823 ms
  10. Citybridge (New York City, NY) [90.51 km]: 31.229 ms
  11. ISPnet, Inc (New York City, NY) [90.51 km]: 31.59 ms
  12. UNMETERED.Online (New York City, NY) [90.51 km]: 44.996 ms
  13. Interoute VDC (New York, NY) [90.51 km]: 172.751 ms
  14. Sprint (New York City, NY) [90.51 km]: 35.172 ms
  15. Charter Communications (New York, NY) [90.51 km]: 37.111 ms
Testing upload speeds
  1. T-Mobile (Syosset, NY):                      ......................... 215.49 Mbit/s
  2. Webair.com (Garden City, NY):                ......................... 127.37 Mbit/s
  3. Connecticut Education Network (Hartford, CT):......................... 171.68 Mbit/s
  4. Interserver, inc (Secaucus, NJ):             ......................... 14.06 Mbit/s
  5. AT&T (New York City, NY):                    ......................... 52.19 Mbit/s
  6. Atlantic Metro (New York City, NY):          ......................... 29.76 Mbit/s
  7. Optimum Online (New York City, NY):          ......................... 7.30 Mbit/s
  8. Speedtest.net (New York City, NY):           ......................... 11.14 Mbit/s
  9. fdcservers.net (New York City, NY):          ......................... 6.79 Mbit/s
  10. Citybridge (New York City, NY):             ......................... 2.31 Mbit/s
  11. ISPnet, Inc (New York City, NY):            ......................... 47.38 Mbit/s
  12. UNMETERED.Online (New York City, NY):       ......................... 86.28 Mbit/s
  13. Interoute VDC (New York, NY):               ......................... 30.03 Mbit/s
  14. Sprint (New York City, NY):                 ......................... 176.38 Mbit/s
  15. Charter Communications (New York, NY):      ......................... 68.94 Mbit/s
Average upload speed is 69.81 Mbit/s