Stopwatch
Benchmark report #3260
SSD Nodes – Preon (Large)
Report
Share test result

Test results for Preon (Large) at SSD Nodes


Server specs:


4 × Intel(R) Xeon(R) CPU E5-2667 v4 @ 3.20GHz
16 GB RAM / 82 GB disk space
Ubuntu 14.04 Trusty
Tustin, United States

Benchmark results summary:


UnixBench - 3445.7
Disk Read - 6030 MB/s
Disk Write - 1437 MB/s
Bandwidth - 615.57 MB/s

More: https://serverscope.io/trials/Ya4Y
Share
Share this page
Cpu chip
Server Specs
CPU
4 × Intel(R) Xeon(R) CPU E5-2667 v4 @ 3.20GHz
CPU Cores
8 × 3200 MHz
RAM
16 GB
Disk
82 GB
OS
Ubuntu 14.04 Trusty
Location
Tustin, United States
Benchmark summary
Benchmark summary
UnixBench
3445.7
Disk Read
6030 MB/s
Disk Write
1437 MB/s
Bandwidth
615.57 Mbit/s
Speedtest
125.54 Mbit/s
Graph analysis
UnixBench Score
UnixBench (all CPUs)
3445.7
UnixBench (one CPU)
1521.6
Terminal
Raw Output
gcc -o pgms/arithoh -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Darithoh src/arith.c 
gcc -o pgms/register -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum="register int" src/arith.c 
gcc -o pgms/short -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum=short src/arith.c 
gcc -o pgms/int -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum=int src/arith.c 
gcc -o pgms/long -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum=long src/arith.c 
gcc -o pgms/float -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum=float src/arith.c 
gcc -o pgms/double -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -Ddatum=double src/arith.c 
gcc -o pgms/hanoi -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/hanoi.c 
gcc -o pgms/syscall -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/syscall.c 
gcc -o pgms/context1 -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/context1.c 
gcc -o pgms/pipe -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/pipe.c 
src/pipe.c: In function "main":
src/pipe.c:52:6: warning: ignoring return value of "pipe", declared with attribute warn_unused_result [-Wunused-result]
  pipe(pvec);
      ^
gcc -o pgms/spawn -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/spawn.c 
gcc -o pgms/execl -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/execl.c 
In file included from src/execl.c:34:0:
src/big.c: In function "dummy":
src/big.c:109:12: warning: ignoring return value of "freopen", declared with attribute warn_unused_result [-Wunused-result]
     freopen("masterlog.00", "a", stderr);
            ^
src/big.c:197:13: warning: ignoring return value of "freopen", declared with attribute warn_unused_result [-Wunused-result]
      freopen(logname, "w", stderr);
             ^
src/big.c:221:6: warning: ignoring return value of "dup", declared with attribute warn_unused_result [-Wunused-result]
   dup(pvec[0]);
      ^
src/big.c:225:13: warning: ignoring return value of "freopen", declared with attribute warn_unused_result [-Wunused-result]
      freopen(logname, "w", stderr);
             ^
src/big.c:318:9: warning: ignoring return value of "write", declared with attribute warn_unused_result [-Wunused-result]
    write(fcopy, cp->line, p - cp->line + 1);
         ^
gcc -o pgms/dhry2 -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -DHZ= ./src/dhry_1.c ./src/dhry_2.c
gcc -o pgms/dhry2reg -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -DHZ= -DREG=register ./src/dhry_1.c ./src/dhry_2.c
gcc -o pgms/looper -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/looper.c 
gcc -o pgms/fstime -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME src/fstime.c 
gcc -o pgms/whetstone-double -Wall -pedantic -O3 -ffast-math -march=native -mtune=native -I ./src -DTIME -DDP -DUNIX -DUNIXBENCH src/whets.c -lm
make all
make[1]: Entering directory `/root/serverscope-JYMu6Z/byte-unixbench/UnixBench"
make distr
make[2]: Entering directory `/root/serverscope-JYMu6Z/byte-unixbench/UnixBench"
Checking distribution of files
./pgms  exists
./src  exists
./testdir  exists
make[2]: Leaving directory `/root/serverscope-JYMu6Z/byte-unixbench/UnixBench"
make programs
make[2]: Entering directory `/root/serverscope-JYMu6Z/byte-unixbench/UnixBench"
make[2]: Nothing to be done for `programs".
make[2]: Leaving directory `/root/serverscope-JYMu6Z/byte-unixbench/UnixBench"
make[1]: Leaving directory `/root/serverscope-JYMu6Z/byte-unixbench/UnixBench"
locale: Cannot set LC_CTYPE to default locale: No such file or directory
locale: Cannot set LC_MESSAGES to default locale: No such file or directory
locale: Cannot set LC_ALL to default locale: No such file or directory
locale: Cannot set LC_CTYPE to default locale: No such file or directory
locale: Cannot set LC_MESSAGES to default locale: No such file or directory
locale: Cannot set LC_ALL to default locale: No such file or directory
sh: 1: 3dinfo: not found

   #    #  #    #  #  #    #          #####   ######  #    #   ####   #    #
   #    #  ##   #  #   #  #           #    #  #       ##   #  #    #  #    #
   #    #  # #  #  #    ##            #####   #####   # #  #  #       ######
   #    #  #  # #  #    ##            #    #  #       #  # #  #       #    #
   #    #  #   ##  #   #  #           #    #  #       #   ##  #    #  #    #
    ####   #    #  #  #    #          #####   ######  #    #   ####   #    #

   Version 5.1.3                      Based on the Byte Magazine Unix Benchmark

   Multi-CPU version                  Version 5 revisions by Ian Smith,
                                      Sunnyvale, CA, USA
   January 13, 2011                   johantheghost at yahoo period com


1 x Dhrystone 2 using register variables  1 2 3 4 5 6 7 8 9 10

1 x Double-Precision Whetstone  1 2 3 4 5 6 7 8 9 10

1 x Execl Throughput  1 2 3

1 x File Copy 1024 bufsize 2000 maxblocks  1 2 3

1 x File Copy 256 bufsize 500 maxblocks  1 2 3

1 x File Copy 4096 bufsize 8000 maxblocks  1 2 3

1 x Pipe Throughput  1 2 3 4 5 6 7 8 9 10

1 x Pipe-based Context Switching  1 2 3 4 5 6 7 8 9 10

1 x Process Creation  1 2 3

1 x System Call Overhead  1 2 3 4 5 6 7 8 9 10

1 x Shell Scripts (1 concurrent)  1 2 3

1 x Shell Scripts (8 concurrent)  1 2 3

4 x Dhrystone 2 using register variables  1 2 3 4 5 6 7 8 9 10

4 x Double-Precision Whetstone  1 2 3 4 5 6 7 8 9 10

4 x Execl Throughput  1 2 3

4 x File Copy 1024 bufsize 2000 maxblocks  1 2 3

4 x File Copy 256 bufsize 500 maxblocks  1 2 3

4 x File Copy 4096 bufsize 8000 maxblocks  1 2 3

4 x Pipe Throughput  1 2 3 4 5 6 7 8 9 10

4 x Pipe-based Context Switching  1 2 3 4 5 6 7 8 9 10

4 x Process Creation  1 2 3

4 x System Call Overhead  1 2 3 4 5 6 7 8 9 10

4 x Shell Scripts (1 concurrent)  1 2 3

4 x Shell Scripts (8 concurrent)  1 2 3

========================================================================
   BYTE UNIX Benchmarks (Version 5.1.3)

   System: ssdnodes-server1: GNU/Linux
   OS: GNU/Linux -- 2.6.32-042stab120.16 -- #1 SMP Tue Dec 13 20:58:28 MSK 2016
   Machine: x86_64 (x86_64)
   Language: en_US.utf8 (charmap="ANSI_X3.4-1968", collate="ANSI_X3.4-1968")
   CPU 0: Intel(R) Xeon(R) CPU E5-2667 v4 @ 3.20GHz (6400.0 bogomips)
          Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET, Intel virtualization
   CPU 1: Intel(R) Xeon(R) CPU E5-2667 v4 @ 3.20GHz (6400.0 bogomips)
          Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET, Intel virtualization
   CPU 2: Intel(R) Xeon(R) CPU E5-2667 v4 @ 3.20GHz (6400.0 bogomips)
          Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET, Intel virtualization
   CPU 3: Intel(R) Xeon(R) CPU E5-2667 v4 @ 3.20GHz (6400.0 bogomips)
          Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET, Intel virtualization
   13:24:03 up 19:50,  1 user,  load average: 7.85, 4.51, 1.87; runlevel Apr

------------------------------------------------------------------------
Benchmark Run: Sun Apr 30 2017 13:24:03 - 13:53:14
4 CPUs in system; running 1 parallel copy of tests

Dhrystone 2 using register variables       36702620.1 lps   (10.0 s, 7 samples)
Double-Precision Whetstone                     3716.5 MWIPS (14.9 s, 7 samples)
Execl Throughput                               3586.2 lps   (29.7 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks        824834.1 KBps  (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks          228136.6 KBps  (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks       1658496.4 KBps  (30.0 s, 2 samples)
Pipe Throughput                             1696928.9 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                 228854.5 lps   (10.0 s, 7 samples)
Process Creation                               9495.8 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                   9362.7 lpm   (60.0 s, 2 samples)
Shell Scripts (8 concurrent)                   2714.5 lpm   (60.0 s, 2 samples)
System Call Overhead                        2702341.3 lps   (10.0 s, 7 samples)

System Benchmarks Index Values               BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0   36702620.1   3145.0
Double-Precision Whetstone                       55.0       3716.5    675.7
Execl Throughput                                 43.0       3586.2    834.0
File Copy 1024 bufsize 2000 maxblocks          3960.0     824834.1   2082.9
File Copy 256 bufsize 500 maxblocks            1655.0     228136.6   1378.5
File Copy 4096 bufsize 8000 maxblocks          5800.0    1658496.4   2859.5
Pipe Throughput                               12440.0    1696928.9   1364.1
Pipe-based Context Switching                   4000.0     228854.5    572.1
Process Creation                                126.0       9495.8    753.6
Shell Scripts (1 concurrent)                     42.4       9362.7   2208.2
Shell Scripts (8 concurrent)                      6.0       2714.5   4524.2
System Call Overhead                          15000.0    2702341.3   1801.6
                                                                   ========
System Benchmarks Index Score                                        1521.6

------------------------------------------------------------------------
Benchmark Run: Sun Apr 30 2017 13:53:14 - 14:22:35
4 CPUs in system; running 4 parallel copies of tests

Dhrystone 2 using register variables      132396577.1 lps   (10.0 s, 7 samples)
Double-Precision Whetstone                    14519.8 MWIPS (15.0 s, 7 samples)
Execl Throughput                              15955.1 lps   (29.8 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks        687635.0 KBps  (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks          208557.6 KBps  (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks       1940121.4 KBps  (30.0 s, 2 samples)
Pipe Throughput                             6184949.6 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                1031545.7 lps   (10.0 s, 7 samples)
Process Creation                              28938.8 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                  26226.5 lpm   (60.0 s, 2 samples)
Shell Scripts (8 concurrent)                   3687.7 lpm   (60.0 s, 2 samples)
System Call Overhead                        4614016.7 lps   (10.0 s, 7 samples)

System Benchmarks Index Values               BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0  132396577.1  11345.0
Double-Precision Whetstone                       55.0      14519.8   2640.0
Execl Throughput                                 43.0      15955.1   3710.5
File Copy 1024 bufsize 2000 maxblocks          3960.0     687635.0   1736.5
File Copy 256 bufsize 500 maxblocks            1655.0     208557.6   1260.2
File Copy 4096 bufsize 8000 maxblocks          5800.0    1940121.4   3345.0
Pipe Throughput                               12440.0    6184949.6   4971.8
Pipe-based Context Switching                   4000.0    1031545.7   2578.9
Process Creation                                126.0      28938.8   2296.7
Shell Scripts (1 concurrent)                     42.4      26226.5   6185.5
Shell Scripts (8 concurrent)                      6.0       3687.7   6146.1
System Call Overhead                          15000.0    4614016.7   3076.0
                                                                   ========
System Benchmarks Index Score                                        3445.7

Hard drive
dd
dd if=/dev/zero of=benchmark bs=64K count=32K conv=fdatasync
32768+0 records in
32768+0 records out
2147483648 bytes (2.1 GB) copied, 2.65753 s, 808 MB/s


dd if=/dev/zero of=benchmark bs=1M count=2048 conv=fdatasync
2048+0 records in
2048+0 records out
2147483648 bytes (2.1 GB) copied, 2.4483 s, 877 MB/s


Hard drive
FIO random read
Performance
6030.2 MB/s
IOPS
1580851
./fio --time_based --name=benchmark --size=256M --runtime=60 --randrepeat=1 --iodepth=32 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randread --blocksize=4k --group_reporting
benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=737: Sun Apr 30 13:21:00 2017
  read : io=361817MB, bw=6030.2MB/s, iops=1543.8K, runt= 60001msec
    clat (usec): min=0, max=99866, avg= 4.23, stdev=182.92
     lat (usec): min=0, max=99866, avg= 4.29, stdev=183.51
    clat percentiles (usec):
     |  1.00th=[    0],  5.00th=[    0], 10.00th=[    1], 20.00th=[    1],
     | 30.00th=[    1], 40.00th=[    1], 50.00th=[    1], 60.00th=[    1],
     | 70.00th=[    1], 80.00th=[    1], 90.00th=[    2], 95.00th=[    2],
     | 99.00th=[    2], 99.50th=[  165], 99.90th=[  326], 99.95th=[ 1012],
     | 99.99th=[ 3088]
    bw (KB  /s): min= 4056, max=3029456, per=12.52%, avg=773392.23, stdev=753105.49
    lat (usec) : 2=89.09%, 4=10.25%, 10=0.04%, 20=0.01%, 50=0.01%
    lat (usec) : 100=0.01%, 250=0.44%, 500=0.07%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.04%, 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%
    lat (msec) : 100=0.01%
  cpu          : usr=8.88%, sys=22.55%, ctx=597486, majf=0, minf=295
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=92625051/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=361817MB, aggrb=6030.2MB/s, minb=6030.2MB/s, maxb=6030.2MB/s, mint=60001msec, maxt=60001msec
Hard drive
FIO random direct read
Performance
6739.9 MB/s
IOPS
1766809
./fio --time_based --name=benchmark --size=256M --runtime=60 --randrepeat=1 --iodepth=32 --direct=1 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randread --blocksize=4k --group_reporting
benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes

benchmark: (groupid=0, jobs=8): err= 0: pid=774: Sun Apr 30 13:22:00 2017
  read : io=404409MB, bw=6739.9MB/s, iops=1725.4K, runt= 60003msec
    clat (usec): min=0, max=130019, avg= 3.67, stdev=146.51
     lat (usec): min=0, max=130019, avg= 3.73, stdev=147.02
    clat percentiles (usec):
     |  1.00th=[    0],  5.00th=[    0], 10.00th=[    1], 20.00th=[    1],
     | 30.00th=[    1], 40.00th=[    1], 50.00th=[    1], 60.00th=[    1],
     | 70.00th=[    1], 80.00th=[    1], 90.00th=[    2], 95.00th=[    2],
     | 99.00th=[    2], 99.50th=[  157], 99.90th=[  298], 99.95th=[ 1012],
     | 99.99th=[ 2024]
    bw (KB  /s): min= 4600, max=3063688, per=12.51%, avg=863409.00, stdev=798366.84
    lat (usec) : 2=89.59%, 4=9.80%, 10=0.04%, 20=0.01%, 50=0.01%
    lat (usec) : 100=0.01%, 250=0.41%, 500=0.05%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.05%, 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%
    lat (msec) : 100=0.01%, 250=0.01%
  cpu          : usr=9.96%, sys=24.71%, ctx=635202, majf=0, minf=274
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=103528793/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=404409MB, aggrb=6739.9MB/s, minb=6739.9MB/s, maxb=6739.9MB/s, mint=60003msec, maxt=60003msec
Hard drive
FIO random write
Performance
1437.3 MB/s
IOPS
367922
./fio --time_based --name=benchmark --size=256M --runtime=60 --filename=benchmark --randrepeat=1 --iodepth=32 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randwrite --blocksize=4k --group_reporting
benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes

benchmark: (groupid=0, jobs=8): err= 0: pid=838: Sun Apr 30 13:24:00 2017
  write: io=86233MB, bw=1437.3MB/s, iops=367922, runt= 60001msec
    clat (usec): min=1, max=493832, avg= 8.67, stdev=328.91
     lat (usec): min=1, max=493832, avg= 8.74, stdev=329.13
    clat percentiles (usec):
     |  1.00th=[    1],  5.00th=[    2], 10.00th=[    2], 20.00th=[    2],
     | 30.00th=[    3], 40.00th=[    3], 50.00th=[    3], 60.00th=[    4],
     | 70.00th=[    5], 80.00th=[    5], 90.00th=[    6], 95.00th=[    7],
     | 99.00th=[    9], 99.50th=[   10], 99.90th=[   48], 99.95th=[ 3664],
     | 99.99th=[10944]
    bw (KB  /s): min=    1, max=276341, per=13.16%, avg=193670.64, stdev=47786.26
    lat (usec) : 2=1.43%, 4=50.02%, 10=47.79%, 20=0.60%, 50=0.07%
    lat (usec) : 100=0.02%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.01%, 4=0.01%, 10=0.03%, 20=0.01%, 50=0.01%
    lat (msec) : 100=0.01%, 250=0.01%, 500=0.01%
  cpu          : usr=2.45%, sys=29.22%, ctx=407497, majf=0, minf=260
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=22075720/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=86233MB, aggrb=1437.3MB/s, minb=1437.3MB/s, maxb=1437.3MB/s, mint=60001msec, maxt=60001msec
Hard drive
FIO random direct write
Performance
1016.9 MB/s
IOPS
260313
./fio --time_based --name=benchmark --size=256M --runtime=60 --filename=benchmark --randrepeat=1 --iodepth=32 --direct=1 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randwrite --blocksize=4k --group_reporting
benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=808: Sun Apr 30 13:23:00 2017
  write: io=61012MB, bw=1016.9MB/s, iops=260313, runt= 60001msec
    clat (usec): min=1, max=2109.2K, avg= 9.10, stdev=1008.90
     lat (usec): min=1, max=2109.2K, avg= 9.16, stdev=1008.95
    clat percentiles (usec):
     |  1.00th=[    1],  5.00th=[    2], 10.00th=[    2], 20.00th=[    2],
     | 30.00th=[    2], 40.00th=[    3], 50.00th=[    3], 60.00th=[    4],
     | 70.00th=[    4], 80.00th=[    5], 90.00th=[    5], 95.00th=[    7],
     | 99.00th=[    9], 99.50th=[   10], 99.90th=[   45], 99.95th=[ 2008],
     | 99.99th=[10944]
    bw (KB  /s): min=    0, max=692328, per=19.29%, avg=200806.09, stdev=96035.56
    lat (usec) : 2=1.49%, 4=57.49%, 10=40.45%, 20=0.41%, 50=0.06%
    lat (usec) : 100=0.02%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.01%, 4=0.01%, 10=0.03%, 20=0.01%, 50=0.01%
    lat (msec) : 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
    lat (msec) : 2000=0.01%, >=2000=0.01%
  cpu          : usr=1.81%, sys=19.36%, ctx=517032, majf=0, minf=278
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=15619050/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=61012MB, aggrb=1016.9MB/s, minb=1016.9MB/s, maxb=1016.9MB/s, mint=60001msec, maxt=60001msec
Download
Download benchmark results
Download speed
615.57 Mbit/s
Downloaded 104857600 bytes in 3.196 sec
Downloaded 104857600 bytes in 0.871 sec
Downloaded 104857600 bytes in 0.765 sec
Downloaded 104857600 bytes in 0.755 sec
Downloaded 104857600 bytes in 0.911 sec
Finished! Average download speed is 615.57 Mbit/s
Upload
Speedtest results
Upload speed
125.54 Mbit/s
Retrieving speedtest.net configuration...
Retrieving speedtest.net server list...
Testing from SSD Nodes ...
Selecting 15 servers that are not too close:
  1. Ultimate Internet Access (Ontario, CA) [38.83 km]: 54.621 ms
  2. T-Mobile (Riverside, CA) [45.65 km]: 76.879 ms
  3. AT&T (Los Angeles, CA) [51.71 km]: 47.889 ms
  4. Atlantic Metro (Los Angeles, CA) [51.71 km]: 58.354 ms
  5. Time Warner Cable (Los Angeles, CA) [51.71 km]: 76.733 ms
  6. Race Communications (Los Angeles, CA) [51.71 km]: 250.479 ms
  7. SingTel (Los Angeles, CA) [51.71 km]: 135.665 ms
  8. Phyber Communications (Los Angeles, CA) [51.71 km]: 49.452 ms
  9. QuadraNet, Inc (Los Angeles, CA) [51.71 km]: 49.078 ms
  10. WebNX (Los Angeles, CA) [51.71 km]: 86.955 ms
  11. Speedtest.net (Los Angeles, CA) [51.71 km]: 1800000.0 ms
  12. California Internet Solutions (Los Angeles, CA) [51.71 km]: 44.527 ms
  13. Host Duplex (Los Angeles, CA) [51.71 km]: 51.332 ms
  14. HugeServer Networks, LLC (Los Angeles, CA) [51.71 km]: 76.56 ms
  15. psychz.net (Los Angeles, CA) [51.71 km]: 56.142 ms
Testing upload speeds
  1. Ultimate Internet Access (Ontario, CA):      ......................... 65.35 Mbit/s
  2. T-Mobile (Riverside, CA):                    ......................... 72.08 Mbit/s
  3. AT&T (Los Angeles, CA):                      ......................... 132.18 Mbit/s
  4. Atlantic Metro (Los Angeles, CA):            ......................... 146.49 Mbit/s
  5. Time Warner Cable (Los Angeles, CA):         ......................... 79.30 Mbit/s
  6. Race Communications (Los Angeles, CA):       ......................... 153.63 Mbit/s
  7. SingTel (Los Angeles, CA):                   ......................... 138.52 Mbit/s
  8. Phyber Communications (Los Angeles, CA):     ......................... 90.19 Mbit/s
  9. QuadraNet, Inc (Los Angeles, CA):            ......................... 68.73 Mbit/s
  10. WebNX (Los Angeles, CA):                    ......................... 149.68 Mbit/s
  11. Speedtest.net (Los Angeles, CA):            ......................... 113.43 Mbit/s
  12. California Internet Solutions (Los Angeles, CA):......................... 168.16 Mbit/s
  13. Host Duplex (Los Angeles, CA):              ......................... 123.82 Mbit/s
  14. HugeServer Networks, LLC (Los Angeles, CA): ......................... 138.96 Mbit/s
  15. psychz.net (Los Angeles, CA):               ......................... 18.40 Mbit/s
Average upload speed is 110.59 Mbit/s