dd if=/dev/zero of=benchmark bs=64k count=120k conv=fdatasync 122880+0 records in 122880+0 records out 8053063680 bytes (8.1 GB) copied, 38.4866 s, 209 MB/s dd if=/dev/zero of=benchmark bs=1M count=7686 conv=fdatasync 7686+0 records in 7686+0 records out 8059355136 bytes (8.1 GB) copied, 38.8996 s, 207 MB/s
./fio --time_based --name=benchmark --size=960M --runtime=60 --ioengine=libaio --randrepeat=1 --iodepth=32 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randread --blocksize=4k --group_reporting
benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 960MB)
benchmark: Laying out IO file(s) (1 file(s) / 960MB)
benchmark: Laying out IO file(s) (1 file(s) / 960MB)
benchmark: Laying out IO file(s) (1 file(s) / 960MB)
benchmark: Laying out IO file(s) (1 file(s) / 960MB)
benchmark: Laying out IO file(s) (1 file(s) / 960MB)
benchmark: Laying out IO file(s) (1 file(s) / 960MB)
benchmark: Laying out IO file(s) (1 file(s) / 960MB)
benchmark: (groupid=0, jobs=8): err= 0: pid=48084: Sun Jun 12 23:20:42 2016
  read : io=1058.1MB, bw=18072KB/s, iops=4518, runt= 60002msec
    slat (usec): min=278, max=33556, avg=1768.90, stdev=724.11
    clat (usec): min=1, max=128677, avg=54846.72, stdev=7483.21
     lat (msec): min=1, max=130, avg=56.62, stdev= 7.64
    clat percentiles (msec):
     |  1.00th=[   50],  5.00th=[   50], 10.00th=[   51], 20.00th=[   51],
     | 30.00th=[   51], 40.00th=[   52], 50.00th=[   53], 60.00th=[   54],
     | 70.00th=[   56], 80.00th=[   58], 90.00th=[   62], 95.00th=[   68],
     | 99.00th=[   89], 99.50th=[   97], 99.90th=[  119], 99.95th=[  127],
     | 99.99th=[  129]
    bw (KB  /s): min= 1596, max= 2483, per=12.50%, avg=2258.33, stdev=151.17
    lat (usec) : 2=0.01%, 4=0.01%
    lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.02%, 50=6.45%
    lat (msec) : 100=93.12%, 250=0.39%
  cpu          : usr=0.12%, sys=0.27%, ctx=271130, majf=0, minf=530
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=99.9%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
     issued    : total=r=271096/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
   READ: io=1058.1MB, aggrb=18072KB/s, minb=18072KB/s, maxb=18072KB/s, mint=60002msec, maxt=60002msec
Disk stats (read/write):
  dasdb: ios=270475/13, merge=0/10, ticks=476120/0, in_queue=476140, util=99.90%
./fio --time_based --name=benchmark --size=960M --runtime=60 --ioengine=libaio --randrepeat=1 --iodepth=32 --direct=1 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randread --blocksize=4k --group_reporting
benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: (groupid=0, jobs=8): err= 0: pid=48163: Sun Jun 12 23:21:42 2016
  read : io=1046.3MB, bw=17842KB/s, iops=4460, runt= 60047msec
    slat (usec): min=0, max=101790, avg=933.63, stdev=5418.72
    clat (usec): min=87, max=536158, avg=56401.04, stdev=28200.55
     lat (usec): min=364, max=536159, avg=57334.75, stdev=28706.09
    clat percentiles (msec):
     |  1.00th=[    3],  5.00th=[   25], 10.00th=[   31], 20.00th=[   44],
     | 30.00th=[   50], 40.00th=[   54], 50.00th=[   56], 60.00th=[   58],
     | 70.00th=[   60], 80.00th=[   63], 90.00th=[   76], 95.00th=[   89],
     | 99.00th=[  182], 99.50th=[  233], 99.90th=[  318], 99.95th=[  371],
     | 99.99th=[  449]
    bw (KB  /s): min=  589, max= 3360, per=12.52%, avg=2232.97, stdev=375.60
    lat (usec) : 100=0.01%, 250=0.01%, 500=0.01%
    lat (msec) : 2=0.54%, 4=1.27%, 10=0.80%, 20=0.92%, 50=26.81%
    lat (msec) : 100=66.40%, 250=2.90%, 500=0.36%, 750=0.01%
  cpu          : usr=0.05%, sys=0.13%, ctx=46083, majf=0, minf=570
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=99.9%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
     issued    : total=r=267843/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
   READ: io=1046.3MB, aggrb=17842KB/s, minb=17842KB/s, maxb=17842KB/s, mint=60047msec, maxt=60047msec
Disk stats (read/write):
  dasdb: ios=267149/0, merge=53/0, ticks=8648850/0, in_queue=8652020, util=99.82%
./fio --time_based --name=benchmark --size=960M --runtime=60 --filename=benchmark --ioengine=libaio --randrepeat=1 --iodepth=32 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randwrite --blocksize=4k --group_reporting
benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: (groupid=0, jobs=8): err= 0: pid=48925: Sun Jun 12 23:23:43 2016
  write: io=83024MB, bw=1383.8MB/s, iops=354229, runt= 60001msec
    slat (usec): min=0, max=3181.9K, avg=21.54, stdev=3168.41
    clat (usec): min=1, max=3350.2K, avg=699.59, stdev=17986.58
     lat (usec): min=4, max=3350.2K, avg=721.21, stdev=18274.86
    clat percentiles (usec):
     |  1.00th=[   70],  5.00th=[   73], 10.00th=[   75], 20.00th=[   78],
     | 30.00th=[   84], 40.00th=[   97], 50.00th=[  104], 60.00th=[  112],
     | 70.00th=[  121], 80.00th=[  133], 90.00th=[  153], 95.00th=[  207],
     | 99.00th=[14912], 99.50th=[21120], 99.90th=[59648], 99.95th=[79360],
     | 99.99th=[156672]
    bw (KB  /s): min=    1, max=381336, per=14.21%, avg=201381.36, stdev=57458.87
    lat (usec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%
    lat (usec) : 100=43.06%, 250=52.57%, 500=0.62%, 750=0.10%, 1000=0.05%
    lat (msec) : 2=0.13%, 4=0.44%, 10=1.31%, 20=1.12%, 50=0.45%
    lat (msec) : 100=0.11%, 250=0.02%, 500=0.01%, >=2000=0.01%
  cpu          : usr=2.69%, sys=12.20%, ctx=176941, majf=0, minf=310
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=21254132/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
  WRITE: io=83024MB, aggrb=1383.8MB/s, minb=1383.8MB/s, maxb=1383.8MB/s, mint=60001msec, maxt=60001msec
Disk stats (read/write):
  dasdb: ios=0/136882, merge=0/3234, ticks=0/3171700, in_queue=3198860, util=96.25%
./fio --time_based --name=benchmark --size=960M --runtime=60 --filename=benchmark --ioengine=libaio --randrepeat=1 --iodepth=32 --direct=1 --invalidate=1 --verify=0 --verify_fatal=0 --numjobs=8 --rw=randwrite --blocksize=4k --group_reporting
benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 960MB)
benchmark: (groupid=0, jobs=8): err= 0: pid=48851: Sun Jun 12 23:22:42 2016
  write: io=561456KB, bw=9328.2KB/s, iops=2332, runt= 60184msec
    slat (usec): min=1, max=1180.1K, avg=3301.40, stdev=24699.82
    clat (usec): min=819, max=2261.9K, avg=106428.10, stdev=134056.83
     lat (usec): min=870, max=2261.9K, avg=109729.60, stdev=136810.37
    clat percentiles (msec):
     |  1.00th=[    5],  5.00th=[   29], 10.00th=[   36], 20.00th=[   45],
     | 30.00th=[   51], 40.00th=[   57], 50.00th=[   64], 60.00th=[   78],
     | 70.00th=[   95], 80.00th=[  123], 90.00th=[  215], 95.00th=[  334],
     | 99.00th=[  799], 99.50th=[ 1012], 99.90th=[ 1237], 99.95th=[ 1303],
     | 99.99th=[ 1450]
    bw (KB  /s): min=    3, max= 2582, per=13.47%, avg=1256.85, stdev=603.00
    lat (usec) : 1000=0.01%
    lat (msec) : 2=0.29%, 4=0.59%, 10=0.34%, 20=0.94%, 50=25.68%
    lat (msec) : 100=44.58%, 250=19.80%, 500=5.70%, 750=1.00%, 1000=0.57%
    lat (msec) : 2000=0.51%, >=2000=0.01%
  cpu          : usr=0.04%, sys=0.20%, ctx=27799, majf=0, minf=274
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=99.8%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=140364/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
  WRITE: io=561456KB, aggrb=9328KB/s, minb=9328KB/s, maxb=9328KB/s, mint=60184msec, maxt=60184msec
Disk stats (read/write):
  dasdb: ios=0/140186, merge=0/6841, ticks=0/8353870, in_queue=8367460, util=99.90%
Retrieving speedtest.net configuration... Retrieving speedtest.net server list... Testing from Marist College ... Selecting 10 servers based on location: Skipping the closest server hosted by Mid-Hudson Data Corp (Hudson, NY) [59.89 km] 1. T-Mobile (Wayne, NJ) [89.06 km]: 5.6 ms 2. Interserver, inc (Secaucus, NJ) [102.30 km]: 20.742 ms 3. Connecticut Education Network (Hartford, CT) [102.79 km]: 17.584 ms 4. T-Mobile (Syosset, NY) [105.14 km]: 5.637 ms 5. INOC, LLC (Albany, NY) [106.36 km]: 255.696 ms 6. Towerstream (New York City, NY) [110.43 km]: 14.907 ms 7. Atlantic Metro (New York City, NY) [110.43 km]: 58.121 ms 8. Optimum Online (New York City, NY) [110.43 km]: 16.858 ms 9. fdcservers.net (New York City, NY) [110.43 km]: 11.763 ms 10. T-Mobile (New York City, NY) [110.43 km]: 4.596 ms Testing upload speeds 1. T-Mobile (Wayne, NJ): ......................... 452.82 Mbit/s 2. Interserver, inc (Secaucus, NJ): ......................... 21.65 Mbit/s 3. Connecticut Education Network (Hartford, CT):......................... 71.91 Mbit/s 4. T-Mobile (Syosset, NY): ......................... 414.66 Mbit/s 5. INOC, LLC (Albany, NY): ......................... 27.99 Mbit/s 6. Towerstream (New York City, NY): ......................... 0.00 Mbit/s 7. Atlantic Metro (New York City, NY): ......................... 159.50 Mbit/s 8. Optimum Online (New York City, NY): ......................... 180.31 Mbit/s 9. fdcservers.net (New York City, NY): ......................... 191.62 Mbit/s 10. T-Mobile (New York City, NY): ......................... 440.91 Mbit/s Average upload speed is 196.14 Mbit/s