1. 09 Mar, 2018 12 commits
    • Kirill Smelkov's avatar
      X tcpenalty: My draft program to show C-state related penalty · b190e483
      Kirill Smelkov authored
      The penalty turned out to be actually depending on the predictor logic
      inside OS kernel, so this program was canceled. Saving anyway as this
      in some form might become useful in the future.
      b190e483
    • Kirill Smelkov's avatar
      . · 115b25d2
      Kirill Smelkov authored
      115b25d2
    • Kirill Smelkov's avatar
      X rio: localhost timings, C > C1 disabled, zwrk@1s · 26ad577f
      Kirill Smelkov authored
      Compared to C-states enabled it is not clear what is going on - it helps
      a bit to serial cases, but that is close to noise:
      
      ---- 8< ----
      cluster:rio dataset:wczblk1-8
      zeo/py/fs1-zhash.py                                         398µs ± 1%               375µs ± 2%   -5.82%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.py                                      264µs ± 1%               252µs ± 1%   -4.51%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  36.9µs ± 6%              33.4µs ± 3%   -9.47%  (p=0.008 n=5+5)
      
      cluster:rio dataset:prod1-1024
      neo/py(!log)/sqlite-zhash.py                                326µs ± 8%               291µs ± 0%  -10.77%  (p=0.008 n=5+5)
      ---- 8< ----
      
      and neo/py/sql timing is _not_ denoised:
      
      ---- 8< ----
      cluster:rio dataset:wczblk1-8
      neo/py(!log)/sql-zhash.py                                   406µs ±39%               376µs ±41%     ~     (p=0.246 n=5+5)
      
      cluster:rio dataset:prod1-1024
      neo/py(!log)/sql-zhash.py                                   342µs ± 4%               374µs ±41%     ~     (p=0.905 n=4+5)
      ---- 8< ----
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset  20180308-rio-ffixed-c-zwrk10s.txt 20180308-rio-ffixed-noc_C1\(1µs\)-zwrk1s.txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:rio
      pystone                                                      140k ±12%                142k ± 3%     ~     (p=1.000 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:rio
      crc32/py/4K                                                4.79µs ± 1%              4.77µs ± 1%     ~     (p=0.341 n=5+5)
      crc32/go/4K                                                1.49µs ± 0%              1.49µs ± 0%     ~     (p=1.000 n=4+5)
      sha1/py/4K                                                 8.02µs ± 2%              8.07µs ± 4%     ~     (p=1.000 n=5+5)
      sha1/go/4K                                                 8.93µs ± 0%              8.93µs ± 0%     ~     (p=0.400 n=4+4)
      unzlib/py/wczdata                                          25.2µs ± 1%              25.1µs ± 1%     ~     (p=0.421 n=5+5)
      unzlib/go/wczdata                                          23.0µs ± 0%              22.9µs ± 0%   -0.58%  (p=0.008 n=5+5)
      unzlib/py/prod1-avg                                        7.27µs ± 1%              6.85µs ±25%     ~     (p=0.690 n=5+5)
      unzlib/go/prod1-avg                                        5.07µs ± 2%              5.02µs ± 1%     ~     (p=0.095 n=5+5)
      disk/randread/direct/4K-min                                93.1µs ± 1%              93.4µs ± 0%     ~     (p=0.460 n=5+5)
      disk/randread/direct/4K-avg                                 116µs ± 0%               116µs ± 0%     ~     (p=0.238 n=5+5)
      disk/randread/pagecache/4K-min                              570ns ± 1%               570ns ± 1%     ~     (p=0.984 n=5+5)
      disk/randread/pagecache/4K-avg                             1.00µs ± 1%              1.00µs ± 1%     ~     (p=0.357 n=5+5)
      
      name                                           old time/object          new time/object          delta
      cluster:rio dataset:wczblk1-8
      fs1-zhash.py                                               29.0µs ± 5%              29.0µs ± 2%     ~     (p=0.730 n=5+5)
      fs1-zhash.go                                               4.60µs ± 0%              4.60µs ± 0%     ~     (all equal)
      fs1-zhash.go+prefetch128                                   4.74µs ± 3%              4.62µs ± 5%     ~     (p=0.111 n=5+5)
      zeo/py/fs1-zhash.py                                         398µs ± 1%               375µs ± 2%   -5.82%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go                                         138µs ± 1%               135µs ± 1%   -2.25%  (p=0.024 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            74.5µs ± 2%              73.6µs ± 3%     ~     (p=0.238 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                321µs ± 4%               315µs ± 6%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                155µs ± 2%               155µs ± 5%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    122µs ± 1%               126µs ± 1%   +3.38%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                   406µs ±39%               376µs ±41%     ~     (p=0.246 n=5+5)
      neo/py(!log)/sql-zhash.go                                   181µs ± 6%               183µs ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       160µs ± 2%               161µs ± 3%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zhash.py                                         223µs ± 6%               216µs ± 1%     ~     (p=0.087 n=5+5)
      neo/go/fs1-zhash.go                                        67.2µs ± 1%              67.9µs ± 1%   +1.04%  (p=0.032 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            28.8µs ± 3%              28.4µs ± 5%     ~     (p=0.651 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          43.9µs ± 2%              44.1µs ± 4%     ~     (p=0.627 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              18.7µs ± 4%              19.1µs ± 6%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zhash.py                                      264µs ± 1%               252µs ± 1%   -4.51%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      105µs ± 1%               103µs ± 3%     ~     (p=0.159 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         37.9µs ± 9%              38.0µs ± 9%     ~     (p=0.897 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              94.4µs ± 3%              93.0µs ± 2%     ~     (p=0.206 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  36.9µs ± 6%              33.4µs ± 3%   -9.47%  (p=0.008 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zhash.py                                               24.1µs ± 1%              23.8µs ± 2%     ~     (p=0.325 n=5+5)
      fs1-zhash.go                                               3.40µs ± 0%              3.40µs ± 0%     ~     (all equal)
      fs1-zhash.go+prefetch128                                   3.00µs ± 0%              3.16µs ± 8%     ~     (p=0.556 n=4+5)
      zeo/py/fs1-zhash.py                                         352µs ± 1%               346µs ± 2%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zhash.go                                         116µs ± 2%               114µs ± 1%     ~     (p=0.063 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            65.9µs ± 1%              64.4µs ± 2%   -2.34%  (p=0.024 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                326µs ± 8%               291µs ± 0%  -10.77%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                142µs ± 2%               142µs ± 2%     ~     (p=0.952 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    116µs ± 1%               117µs ± 1%     ~     (p=0.357 n=5+5)
      neo/py(!log)/sql-zhash.py                                   342µs ± 4%               374µs ±41%     ~     (p=0.905 n=4+5)
      neo/py(!log)/sql-zhash.go                                   173µs ± 3%               173µs ± 8%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       148µs ± 2%               148µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zhash.py                                         220µs ± 4%               210µs ± 3%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zhash.go                                        49.7µs ± 1%              50.2µs ± 2%     ~     (p=0.286 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            18.9µs ± 3%              19.4µs ± 2%     ~     (p=0.103 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          40.7µs ± 1%              40.6µs ± 2%     ~     (p=0.746 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              16.2µs ± 2%              15.8µs ± 2%     ~     (p=0.079 n=5+5)
      neo/go/sqlite-zhash.py                                      261µs ± 2%               262µs ± 4%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zhash.go                                     93.3µs ± 1%              93.8µs ± 1%     ~     (p=0.357 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         33.3µs ± 3%              33.4µs ± 6%     ~     (p=0.500 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              89.9µs ± 1%              90.9µs ± 4%     ~     (p=0.341 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  33.0µs ± 1%              33.2µs ± 2%     ~     (p=0.952 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:rio dataset:wczblk1-8
      fs1-zwrk.go·1                                                300k ± 0%                301k ± 1%     ~     (p=0.151 n=5+5)
      fs1-zwrk.go·2                                                550k ± 0%                551k ± 0%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·3                                                816k ± 0%                814k ± 0%     ~     (p=0.222 n=5+5)
      fs1-zwrk.go·4                                               1.08M ± 0%               1.08M ± 1%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·8                                               1.43M ± 0%               1.43M ± 0%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                              1.55M ± 0%               1.55M ± 0%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·16                                              1.55M ± 1%               1.54M ± 0%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        7.40k ± 0%               7.50k ± 1%   +1.32%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        8.89k ± 0%               8.89k ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        9.62k ± 1%               9.61k ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        9.91k ± 0%               9.92k ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        10.3k ± 0%               10.2k ± 2%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       10.4k ± 1%               10.6k ± 1%   +1.95%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       10.5k ± 1%               10.5k ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               6.82k ± 1%               6.70k ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.63k ± 1%               8.54k ± 0%     ~     (p=0.111 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·3                               8.56k ± 2%               8.43k ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.54k ± 1%               8.37k ± 4%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.53k ± 1%               8.44k ± 0%   -1.04%  (p=0.016 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·12                              8.56k ± 0%               8.23k ± 5%   -3.82%  (p=0.016 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.53k ± 1%               8.46k ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.57k ± 2%               5.66k ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.64k ± 2%               6.75k ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.60k ± 1%               6.68k ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.54k ± 2%               6.70k ± 2%   +2.49%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.64k ± 1%               6.50k ± 5%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.64k ± 2%               6.67k ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.62k ± 2%               6.72k ± 3%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·1                                        15.6k ± 0%               15.7k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·2                                        30.0k ± 0%               30.2k ± 0%   +0.78%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                        39.6k ± 0%               39.8k ± 0%   +0.47%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                        49.5k ± 0%               49.7k ± 0%   +0.30%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        69.0k ± 0%               68.8k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·12                                       73.3k ± 0%               73.0k ± 0%   -0.44%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·16                                       74.2k ± 0%               73.7k ± 0%   -0.61%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          25.6k ± 1%               25.5k ± 3%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          47.3k ± 0%               47.9k ± 0%   +1.21%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          59.5k ± 0%               59.7k ± 0%   +0.36%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          72.2k ± 0%               72.7k ± 0%   +0.66%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          96.6k ± 0%               97.0k ± 0%   +0.37%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          110k ± 0%                110k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                          114k ± 0%                113k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     9.89k ± 0%               9.95k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     18.1k ± 0%               18.4k ± 0%   +1.93%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     25.0k ± 0%               25.5k ± 0%   +1.90%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     29.7k ± 0%               30.4k ± 0%   +2.23%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     38.1k ± 0%               39.4k ± 1%   +3.56%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go·12                                    40.5k ± 2%               40.7k ± 2%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    41.3k ± 1%               40.8k ± 2%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.0k ± 0%               11.1k ± 0%   +1.11%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              19.6k ± 0%               20.1k ± 0%   +2.36%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              27.2k ± 0%               27.9k ± 0%   +2.43%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              33.1k ± 0%               34.2k ± 0%   +3.31%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              42.4k ± 2%               44.0k ± 1%   +3.60%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             42.8k ± 1%               43.4k ± 2%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             42.8k ± 3%               41.4k ± 2%   -3.25%  (p=0.016 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zwrk.go·1                                                460k ± 1%                461k ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·2                                                901k ± 2%                906k ± 1%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·3                                               1.34M ± 1%               1.35M ± 0%     ~     (p=0.151 n=5+5)
      fs1-zwrk.go·4                                               1.78M ± 0%               1.78M ± 1%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·8                                               2.37M ± 1%               2.33M ± 1%   -1.46%  (p=0.032 n=5+5)
      fs1-zwrk.go·12                                              2.40M ± 0%               2.40M ± 0%     ~     (p=0.222 n=5+5)
      fs1-zwrk.go·16                                              2.40M ± 0%               2.40M ± 0%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        8.87k ± 0%               9.06k ± 1%   +2.15%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        11.4k ± 1%               11.7k ± 2%   +2.18%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        12.6k ± 1%               12.9k ± 1%   +2.32%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        13.1k ± 1%               13.4k ± 3%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        13.7k ± 0%               13.9k ± 2%   +1.50%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       13.8k ± 1%               14.2k ± 2%   +2.85%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       13.9k ± 1%               14.4k ± 1%   +3.31%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.23k ± 0%               7.28k ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.71k ± 1%               8.70k ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.71k ± 1%               8.73k ± 3%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.69k ± 1%               8.69k ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.75k ± 1%               8.77k ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.66k ± 2%               8.59k ± 7%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.67k ± 2%               8.67k ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.83k ± 1%               5.98k ± 1%   +2.55%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.83k ± 1%               6.86k ± 4%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.80k ± 1%               6.86k ± 3%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.76k ± 2%               6.90k ± 1%   +2.02%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.68k ± 2%               6.62k ± 6%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.84k ± 2%               6.78k ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.81k ± 1%               6.78k ± 3%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·1                                        21.8k ± 0%               21.6k ± 0%   -1.08%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                        39.2k ± 0%               39.0k ± 0%   -0.42%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·3                                        51.4k ± 0%               51.0k ± 1%   -0.66%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·4                                        62.9k ± 0%               62.3k ± 0%   -0.97%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        82.9k ± 2%               79.7k ± 1%   -3.87%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       88.0k ± 2%               81.8k ± 2%   -7.00%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·16                                       89.6k ± 3%               80.8k ± 3%   -9.89%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.6k ± 0%               26.9k ± 1%   +1.27%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          48.7k ± 0%               49.3k ± 0%   +1.10%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          62.0k ± 0%               62.3k ± 0%   +0.53%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          74.4k ± 0%               74.7k ± 0%   +0.39%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          94.2k ± 0%               93.5k ± 2%   -0.76%  (p=0.016 n=4+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          104k ± 5%                 97k ± 2%   -6.48%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                          107k ± 2%                 95k ± 3%  -11.82%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.1k ± 1%               11.0k ± 0%   -0.58%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     19.4k ± 0%               19.3k ± 0%   -0.84%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     26.7k ± 0%               26.4k ± 0%   -0.93%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     32.1k ± 0%               31.8k ± 0%   -1.04%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     37.4k ± 2%               38.6k ± 1%   +3.25%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    35.8k ± 3%               36.5k ± 2%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    35.0k ± 3%               36.0k ± 1%   +2.79%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.5k ± 0%               11.4k ± 0%   -1.34%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              19.9k ± 1%               19.9k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              27.3k ± 1%               27.4k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              33.1k ± 0%               33.3k ± 0%   +0.70%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              37.6k ± 2%               38.8k ± 2%   +3.32%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             36.3k ± 4%               36.0k ± 2%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             35.2k ± 3%               35.4k ± 1%     ~     (p=1.000 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:rio dataset:wczblk1-8
      fs1-zwrk.go·1                                              3.33µs ± 0%              3.32µs ± 1%     ~     (p=0.151 n=5+5)
      fs1-zwrk.go·2                                              3.63µs ± 0%              3.63µs ± 0%     ~     (p=0.500 n=5+5)
      fs1-zwrk.go·3                                              3.68µs ± 0%              3.69µs ± 0%     ~     (p=0.230 n=5+5)
      fs1-zwrk.go·4                                              3.70µs ± 0%              3.70µs ± 1%     ~     (p=0.643 n=5+5)
      fs1-zwrk.go·8                                              5.60µs ± 0%              5.61µs ± 0%     ~     (p=0.595 n=5+5)
      fs1-zwrk.go·12                                             7.75µs ± 0%              7.76µs ± 0%     ~     (p=0.286 n=5+5)
      fs1-zwrk.go·16                                             10.3µs ± 1%              10.4µs ± 0%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        135µs ± 0%               133µs ± 1%   -1.30%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        225µs ± 0%               225µs ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        312µs ± 1%               312µs ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        403µs ± 0%               403µs ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        778µs ± 0%               781µs ± 2%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.15ms ± 1%              1.13ms ± 1%   -1.91%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.53ms ± 1%              1.52ms ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               147µs ± 1%               149µs ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               232µs ± 1%               234µs ± 0%     ~     (p=0.111 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·3                               350µs ± 2%               356µs ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               469µs ± 1%               478µs ± 4%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               938µs ± 1%               948µs ± 0%   +1.06%  (p=0.016 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·12                             1.40ms ± 0%              1.46ms ± 5%   +4.10%  (p=0.016 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.88ms ± 1%              1.89ms ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  180µs ± 2%               177µs ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  301µs ± 2%               297µs ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  454µs ± 1%               449µs ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  612µs ± 2%               597µs ± 2%   -2.43%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.20ms ± 1%              1.23ms ± 5%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.81ms ± 2%              1.80ms ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.42ms ± 2%              2.38ms ± 3%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·1                                       64.1µs ± 0%              63.9µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·2                                       66.7µs ± 0%              66.2µs ± 0%   -0.77%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                       75.8µs ± 0%              75.5µs ± 0%   -0.47%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                       80.8µs ± 0%              80.6µs ± 0%   -0.30%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        116µs ± 0%               116µs ± 0%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·12                                       164µs ± 0%               164µs ± 0%   +0.45%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·16                                       216µs ± 0%               217µs ± 0%   +0.62%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         39.1µs ± 1%              39.3µs ± 3%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         42.2µs ± 0%              41.7µs ± 0%   -1.20%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         50.4µs ± 0%              50.3µs ± 0%   -0.36%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         55.4µs ± 0%              55.0µs ± 0%   -0.65%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         82.8µs ± 0%              82.5µs ± 0%   -0.36%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         109µs ± 0%               109µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         141µs ± 0%               141µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     101µs ± 0%               100µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     110µs ± 0%               108µs ± 0%   -1.89%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     120µs ± 0%               118µs ± 0%   -1.86%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     135µs ± 0%               132µs ± 0%   -2.19%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     210µs ± 0%               203µs ± 1%   -3.44%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go·12                                    297µs ± 2%               295µs ± 2%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    388µs ± 1%               393µs ± 2%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             90.9µs ± 0%              89.9µs ± 0%   -1.10%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              102µs ± 0%               100µs ± 0%   -2.31%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              110µs ± 0%               108µs ± 0%   -2.38%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              121µs ± 0%               117µs ± 0%   -3.20%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              188µs ± 2%               182µs ± 1%   -3.48%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             280µs ± 2%               277µs ± 2%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             374µs ± 3%               386µs ± 2%   +3.35%  (p=0.016 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zwrk.go·1                                              2.17µs ± 1%              2.17µs ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·2                                              2.22µs ± 1%              2.21µs ± 1%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·3                                              2.24µs ± 1%              2.23µs ± 0%     ~     (p=0.135 n=5+5)
      fs1-zwrk.go·4                                              2.25µs ± 0%              2.24µs ± 1%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·8                                              3.38µs ± 1%              3.43µs ± 1%   +1.48%  (p=0.032 n=5+5)
      fs1-zwrk.go·12                                             5.00µs ± 0%              4.99µs ± 0%     ~     (p=0.270 n=5+5)
      fs1-zwrk.go·16                                             6.67µs ± 0%              6.65µs ± 0%     ~     (p=0.286 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        113µs ± 0%               110µs ± 1%   -2.10%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        175µs ± 1%               171µs ± 2%   -2.13%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        238µs ± 1%               233µs ± 1%   -2.26%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        306µs ± 1%               300µs ± 3%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        582µs ± 0%               574µs ± 2%   -1.47%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       868µs ± 1%               844µs ± 2%   -2.77%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.15ms ± 1%              1.11ms ± 1%   -3.20%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               138µs ± 0%               137µs ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               230µs ± 1%               230µs ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               344µs ± 1%               344µs ± 3%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               461µs ± 1%               461µs ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               914µs ± 1%               912µs ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.39ms ± 2%              1.40ms ± 7%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.85ms ± 2%              1.85ms ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  172µs ± 1%               167µs ± 1%   -2.49%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  293µs ± 1%               292µs ± 5%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  441µs ± 1%               437µs ± 3%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  592µs ± 2%               580µs ± 1%   -1.99%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.20ms ± 3%              1.21ms ± 6%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.75ms ± 2%              1.77ms ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.35ms ± 1%              2.36ms ± 3%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·1                                       45.9µs ± 0%              46.4µs ± 0%   +1.09%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                       51.0µs ± 0%              51.3µs ± 0%   +0.43%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·3                                       58.4µs ± 0%              58.8µs ± 1%   +0.67%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·4                                       63.6µs ± 0%              64.3µs ± 0%   +0.98%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                       96.5µs ± 2%             100.4µs ± 1%   +4.03%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       136µs ± 2%               147µs ± 2%   +7.53%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·16                                       179µs ± 3%               198µs ± 3%  +10.98%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         37.6µs ± 0%              37.2µs ± 1%   -1.25%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         41.0µs ± 0%              40.6µs ± 0%   -1.09%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         48.4µs ± 0%              48.1µs ± 0%   -0.53%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         53.8µs ± 0%              53.6µs ± 0%   -0.39%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         84.9µs ± 0%              85.6µs ± 2%   +0.78%  (p=0.016 n=4+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         116µs ± 5%               124µs ± 2%   +6.87%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         149µs ± 2%               169µs ± 3%  +13.44%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    90.5µs ± 1%              91.0µs ± 0%   +0.58%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     103µs ± 0%               104µs ± 0%   +0.85%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     112µs ± 0%               114µs ± 0%   +0.94%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     124µs ± 0%               126µs ± 0%   +1.05%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     214µs ± 3%               207µs ± 1%   -3.16%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    336µs ± 3%               329µs ± 2%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    458µs ± 3%               445µs ± 1%   -2.73%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             86.6µs ± 0%              87.8µs ± 0%   +1.36%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              100µs ± 1%               101µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              110µs ± 1%               109µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              121µs ± 0%               120µs ± 0%   -0.69%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              213µs ± 2%               206µs ± 2%   -3.22%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             331µs ± 4%               333µs ± 3%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             454µs ± 3%               452µs ± 1%     ~     (p=1.000 n=5+5)
      26ad577f
    • Kirill Smelkov's avatar
      X rio: localhost timings, Cenabled, zwrk@10s · 9282fca1
      Kirill Smelkov authored
      Compared to zwrk@1s it helps but only a very tiny tiny bit: Besides
      everything else that might be noise the improvements are:
      
      ---- 8< ----
      cluster:rio dataset:prod1-1024
      neo/go/fs1-zwrk.go·16                                       200µs ± 3%               179µs ± 3%  -10.62%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         128µs ± 2%               116µs ± 5%   -9.16%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         178µs ± 3%               149µs ± 2%  -16.06%  (p=0.008 n=5+5)
      ---- 8< ----
      
      and noise on neo/py/sql is back:
      
      ---- 8< ----
      cluster:rio dataset:wczblk1-8
      neo/py(!log)/sql-zhash.py                                   342µs ± 2%               406µs ±39%     ~     (p=0.063 n=4+5)
      ---- 8< ----
      
      The next commit will add measurements with C-states disabled.
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset  20180308-rio-ffixed-c-zwrk1s.txt 20180308-rio-ffixed-c-zwrk10s.txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:rio
      pystone                                                      144k ± 3%                140k ±12%     ~     (p=0.690 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:rio
      crc32/py/4K                                                4.79µs ± 1%              4.79µs ± 1%     ~     (p=0.889 n=5+5)
      crc32/go/4K                                                1.49µs ± 0%              1.49µs ± 0%     ~     (p=0.873 n=5+4)
      sha1/py/4K                                                 7.98µs ± 1%              8.02µs ± 2%     ~     (p=0.548 n=5+5)
      sha1/go/4K                                                 9.29µs ±12%              8.93µs ± 0%     ~     (p=0.111 n=5+4)
      unzlib/py/wczdata                                          25.2µs ± 1%              25.2µs ± 1%     ~     (p=0.690 n=5+5)
      unzlib/go/wczdata                                          23.0µs ± 0%              23.0µs ± 0%   +0.17%  (p=0.016 n=5+5)
      unzlib/py/prod1-avg                                        7.26µs ± 3%              7.27µs ± 1%     ~     (p=1.000 n=5+5)
      unzlib/go/prod1-avg                                        5.06µs ± 1%              5.07µs ± 2%     ~     (p=0.690 n=5+5)
      disk/randread/direct/4K-min                                93.0µs ± 0%              93.1µs ± 1%     ~     (p=0.690 n=5+5)
      disk/randread/direct/4K-avg                                 116µs ± 1%               116µs ± 0%     ~     (p=0.373 n=5+5)
      disk/randread/pagecache/4K-min                              570ns ± 1%               570ns ± 1%     ~     (p=1.000 n=5+5)
      disk/randread/pagecache/4K-avg                              995ns ± 0%               999ns ± 1%     ~     (p=0.135 n=5+5)
      
      name                                           old time/object          new time/object          delta
      cluster:rio dataset:wczblk1-8
      fs1-zhash.py                                               28.9µs ± 1%              29.0µs ± 5%     ~     (p=0.730 n=4+5)
      fs1-zhash.go                                               4.60µs ± 0%              4.60µs ± 0%     ~     (all equal)
      fs1-zhash.go+prefetch128                                   4.62µs ± 3%              4.74µs ± 3%     ~     (p=0.119 n=5+5)
      zeo/py/fs1-zhash.py                                         412µs ± 4%               398µs ± 1%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zhash.go                                         139µs ± 3%               138µs ± 1%     ~     (p=0.889 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            75.2µs ± 5%              74.5µs ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                315µs ± 3%               321µs ± 4%     ~     (p=0.246 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                156µs ± 6%               155µs ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    125µs ± 2%               122µs ± 1%   -2.28%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zhash.py                                   342µs ± 2%               406µs ±39%     ~     (p=0.063 n=4+5)
      neo/py(!log)/sql-zhash.go                                   178µs ± 2%               181µs ± 6%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       159µs ± 2%               160µs ± 2%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.py                                         224µs ± 4%               223µs ± 6%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zhash.go                                        67.0µs ± 1%              67.2µs ± 1%     ~     (p=0.810 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            28.3µs ± 1%              28.8µs ± 3%     ~     (p=0.175 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          45.0µs ± 6%              43.9µs ± 2%     ~     (p=0.516 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              19.0µs ± 3%              18.7µs ± 4%     ~     (p=0.365 n=5+5)
      neo/go/sqlite-zhash.py                                      266µs ± 2%               264µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zhash.go                                      103µs ± 2%               105µs ± 1%     ~     (p=0.143 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         37.6µs ± 2%              37.9µs ± 9%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              94.7µs ± 1%              94.4µs ± 3%     ~     (p=0.500 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  35.1µs ± 6%              36.9µs ± 6%     ~     (p=0.230 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zhash.py                                               24.2µs ± 1%              24.1µs ± 1%     ~     (p=0.540 n=4+5)
      fs1-zhash.go                                               3.40µs ± 0%              3.40µs ± 0%     ~     (all equal)
      fs1-zhash.go+prefetch128                                   3.06µs ± 2%              3.00µs ± 0%     ~     (p=0.095 n=5+4)
      zeo/py/fs1-zhash.py                                         368µs ± 1%               352µs ± 1%   -4.55%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go                                         115µs ± 2%               116µs ± 2%     ~     (p=0.730 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            65.6µs ± 1%              65.9µs ± 1%     ~     (p=0.508 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                316µs ± 6%               326µs ± 8%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                142µs ± 5%               142µs ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    116µs ± 1%               116µs ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zhash.py                                   339µs ± 5%               342µs ± 4%     ~     (p=1.000 n=4+4)
      neo/py(!log)/sql-zhash.go                                   172µs ± 1%               173µs ± 3%     ~     (p=0.579 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       150µs ± 1%               148µs ± 2%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zhash.py                                         219µs ± 2%               220µs ± 4%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.go                                        49.9µs ± 1%              49.7µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            19.1µs ± 3%              18.9µs ± 3%     ~     (p=0.540 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          41.1µs ± 2%              40.7µs ± 1%     ~     (p=0.333 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              16.2µs ± 5%              16.2µs ± 2%     ~     (p=0.873 n=5+5)
      neo/go/sqlite-zhash.py                                      261µs ± 5%               261µs ± 2%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zhash.go                                     94.3µs ± 1%              93.3µs ± 1%     ~     (p=0.087 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         33.6µs ± 5%              33.3µs ± 3%     ~     (p=0.810 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              90.3µs ± 2%              89.9µs ± 1%     ~     (p=0.738 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  33.0µs ± 4%              33.0µs ± 1%     ~     (p=0.952 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:rio dataset:wczblk1-8
      fs1-zwrk.go·1                                                301k ± 0%                300k ± 0%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·2                                                550k ± 3%                550k ± 0%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·3                                                817k ± 1%                816k ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·4                                               1.08M ± 0%               1.08M ± 0%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·8                                               1.42M ± 0%               1.43M ± 0%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·12                                              1.55M ± 0%               1.55M ± 0%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·16                                              1.55M ± 0%               1.55M ± 1%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        7.38k ± 1%               7.40k ± 0%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        8.96k ± 2%               8.89k ± 0%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        9.66k ± 3%               9.62k ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        9.87k ± 1%               9.91k ± 0%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        10.3k ± 1%               10.3k ± 0%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       10.4k ± 1%               10.4k ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       10.5k ± 1%               10.5k ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               6.88k ± 2%               6.82k ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.63k ± 3%               8.63k ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.66k ± 0%               8.56k ± 2%     ~     (p=0.111 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.71k ± 1%               8.54k ± 1%   -1.95%  (p=0.016 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.60k ± 2%               8.53k ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.63k ± 2%               8.56k ± 0%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·16                              8.54k ± 3%               8.53k ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.69k ± 1%               5.57k ± 2%   -2.20%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.73k ± 5%               6.64k ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.69k ± 2%               6.60k ± 1%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.60k ±11%               6.54k ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.65k ± 2%               6.64k ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.58k ±11%               6.64k ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.70k ± 1%               6.62k ± 2%     ~     (p=0.413 n=4+5)
      neo/go/fs1-zwrk.go·1                                        15.7k ± 0%               15.6k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·2                                        30.3k ± 0%               30.0k ± 0%   -1.12%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                        39.8k ± 0%               39.6k ± 0%   -0.49%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                        49.7k ± 0%               49.5k ± 0%   -0.41%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        68.7k ± 1%               69.0k ± 0%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·12                                       73.0k ± 0%               73.3k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·16                                       73.9k ± 0%               74.2k ± 0%   +0.38%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          25.6k ± 3%               25.6k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          47.8k ± 0%               47.3k ± 0%   -1.02%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          59.6k ± 0%               59.5k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          72.7k ± 0%               72.2k ± 0%   -0.66%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          97.0k ± 0%               96.6k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          109k ± 1%                110k ± 0%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                          113k ± 1%                114k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     9.88k ± 1%               9.89k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     18.4k ± 0%               18.1k ± 0%   -1.38%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     25.5k ± 0%               25.0k ± 0%   -2.00%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     30.4k ± 0%               29.7k ± 0%   -2.24%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     39.5k ± 0%               38.1k ± 0%   -3.72%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go·12                                    40.9k ± 1%               40.5k ± 2%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    40.4k ± 2%               41.3k ± 1%   +2.15%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.0k ± 1%               11.0k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              19.9k ± 0%               19.6k ± 0%   -1.25%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              27.7k ± 0%               27.2k ± 0%   -1.89%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              34.0k ± 1%               33.1k ± 0%   -2.60%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              43.8k ± 1%               42.4k ± 2%   -3.00%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             42.8k ± 2%               42.8k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             40.9k ± 2%               42.8k ± 3%   +4.65%  (p=0.008 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zwrk.go·1                                                462k ± 1%                460k ± 1%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·2                                                910k ± 1%                901k ± 2%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·3                                               1.35M ± 0%               1.34M ± 1%   -1.12%  (p=0.032 n=5+5)
      fs1-zwrk.go·4                                               1.79M ± 1%               1.78M ± 0%   -0.73%  (p=0.016 n=5+5)
      fs1-zwrk.go·8                                               2.38M ± 1%               2.37M ± 1%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                              2.40M ± 1%               2.40M ± 0%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·16                                              2.40M ± 0%               2.40M ± 0%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        8.91k ± 2%               8.87k ± 0%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        11.7k ± 1%               11.4k ± 1%   -2.04%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        13.0k ± 1%               12.6k ± 1%   -3.20%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        13.4k ± 2%               13.1k ± 1%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        14.2k ± 2%               13.7k ± 0%   -3.44%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       14.1k ± 2%               13.8k ± 1%   -1.88%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       14.4k ± 2%               13.9k ± 1%   -3.29%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.12k ± 2%               7.23k ± 0%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.37k ± 6%               8.71k ± 1%   +4.06%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.60k ± 1%               8.71k ± 1%   +1.25%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.40k ± 8%               8.69k ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.61k ± 3%               8.75k ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.56k ± 2%               8.66k ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.46k ± 5%               8.67k ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.78k ± 5%               5.83k ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.77k ± 4%               6.83k ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.85k ± 1%               6.80k ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.79k ± 2%               6.76k ± 2%     ~     (p=0.794 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.80k ± 5%               6.68k ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.50k ± 5%               6.84k ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.81k ± 1%               6.81k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·1                                        21.6k ± 1%               21.8k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·2                                        39.2k ± 1%               39.2k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·3                                        51.3k ± 0%               51.4k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·4                                        62.7k ± 0%               62.9k ± 0%   +0.30%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·8                                        81.7k ± 1%               82.9k ± 2%   +1.50%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·12                                       82.1k ± 3%               88.0k ± 2%   +7.14%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·16                                       80.1k ± 3%               89.6k ± 3%  +11.90%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.5k ± 1%               26.6k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          49.1k ± 0%               48.7k ± 0%   -0.65%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          62.2k ± 0%               62.0k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          74.2k ± 0%               74.4k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          92.4k ± 1%               94.2k ± 0%   +2.01%  (p=0.016 n=5+4)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         94.1k ± 2%              103.6k ± 5%  +10.13%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         90.0k ± 3%              107.2k ± 2%  +19.10%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     10.9k ± 1%               11.1k ± 1%   +1.37%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     19.3k ± 0%               19.4k ± 0%   +0.80%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     26.4k ± 1%               26.7k ± 0%   +0.86%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     31.8k ± 0%               32.1k ± 0%   +1.02%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     38.1k ± 3%               37.4k ± 2%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    37.1k ± 2%               35.8k ± 3%   -3.52%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    36.3k ± 2%               35.0k ± 3%   -3.60%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.5k ± 1%               11.5k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              20.1k ± 0%               19.9k ± 1%   -0.77%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              27.6k ± 0%               27.3k ± 1%   -1.08%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              33.5k ± 2%               33.1k ± 0%   -1.32%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              40.0k ± 1%               37.6k ± 2%   -5.99%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             37.9k ± 0%               36.3k ± 4%   -4.29%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             36.7k ± 1%               35.2k ± 3%   -3.99%  (p=0.008 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:rio dataset:wczblk1-8
      fs1-zwrk.go·1                                              3.32µs ± 0%              3.33µs ± 0%   +0.42%  (p=0.048 n=5+5)
      fs1-zwrk.go·2                                              3.64µs ± 3%              3.63µs ± 0%     ~     (p=0.500 n=5+5)
      fs1-zwrk.go·3                                              3.67µs ± 1%              3.68µs ± 0%     ~     (p=0.937 n=5+5)
      fs1-zwrk.go·4                                              3.70µs ± 0%              3.70µs ± 0%     ~     (p=0.381 n=5+5)
      fs1-zwrk.go·8                                              5.62µs ± 0%              5.60µs ± 0%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·12                                             7.76µs ± 0%              7.75µs ± 0%     ~     (p=0.516 n=5+5)
      fs1-zwrk.go·16                                             10.3µs ± 0%              10.3µs ± 1%     ~     (p=0.746 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        136µs ± 1%               135µs ± 0%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        223µs ± 2%               225µs ± 0%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        311µs ± 3%               312µs ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        405µs ± 1%               403µs ± 0%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        774µs ± 1%               778µs ± 0%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.15ms ± 1%              1.15ms ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.52ms ± 1%              1.53ms ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               145µs ± 2%               147µs ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               232µs ± 3%               232µs ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               347µs ± 0%               350µs ± 2%     ~     (p=0.111 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·4                               459µs ± 1%               469µs ± 1%   +1.99%  (p=0.016 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·8                               930µs ± 2%               938µs ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.39ms ± 2%              1.40ms ± 0%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·16                             1.87ms ± 3%              1.88ms ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  176µs ± 1%               180µs ± 2%   +2.26%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  298µs ± 5%               301µs ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  449µs ± 2%               454µs ± 1%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  589µs ± 1%               612µs ± 2%   +3.90%  (p=0.016 n=4+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.20ms ± 2%              1.20ms ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.83ms ±12%              1.81ms ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.39ms ± 1%              2.42ms ± 2%     ~     (p=0.413 n=4+5)
      neo/go/fs1-zwrk.go·1                                       63.9µs ± 0%              64.1µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·2                                       66.0µs ± 0%              66.7µs ± 0%   +1.14%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                       75.4µs ± 0%              75.8µs ± 0%   +0.50%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                       80.5µs ± 0%              80.8µs ± 0%   +0.41%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        116µs ± 1%               116µs ± 0%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·12                                       164µs ± 0%               164µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·16                                       217µs ± 0%               216µs ± 0%   -0.37%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         39.0µs ± 3%              39.1µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         41.8µs ± 0%              42.2µs ± 0%   +1.03%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         50.3µs ± 0%              50.4µs ± 0%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         55.0µs ± 0%              55.4µs ± 0%   +0.66%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         82.5µs ± 0%              82.8µs ± 0%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         110µs ± 1%               109µs ± 0%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         142µs ± 1%               141µs ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     101µs ± 1%               101µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     109µs ± 0%               110µs ± 0%   +1.40%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     118µs ± 0%               120µs ± 0%   +2.04%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     132µs ± 0%               135µs ± 0%   +2.29%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     202µs ± 0%               210µs ± 0%   +3.86%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go·12                                    294µs ± 1%               297µs ± 2%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    396µs ± 3%               388µs ± 1%   -2.11%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             91.1µs ± 1%              90.9µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              101µs ± 0%               102µs ± 0%   +1.26%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              108µs ± 0%               110µs ± 0%   +1.92%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              118µs ± 1%               121µs ± 0%   +2.67%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              183µs ± 1%               188µs ± 2%   +3.10%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             280µs ± 2%               280µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             391µs ± 2%               374µs ± 3%   -4.44%  (p=0.008 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zwrk.go·1                                              2.17µs ± 1%              2.17µs ± 1%     ~     (p=0.738 n=5+5)
      fs1-zwrk.go·2                                              2.20µs ± 0%              2.22µs ± 1%     ~     (p=0.103 n=5+5)
      fs1-zwrk.go·3                                              2.21µs ± 0%              2.24µs ± 1%   +1.15%  (p=0.024 n=5+5)
      fs1-zwrk.go·4                                              2.23µs ± 1%              2.25µs ± 0%   +0.73%  (p=0.024 n=5+5)
      fs1-zwrk.go·8                                              3.37µs ± 1%              3.38µs ± 1%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                             5.00µs ± 1%              5.00µs ± 0%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·16                                             6.67µs ± 0%              6.67µs ± 0%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        112µs ± 2%               113µs ± 0%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        171µs ± 1%               175µs ± 1%   +2.08%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        230µs ± 1%               238µs ± 1%   +3.31%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        298µs ± 2%               306µs ± 1%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        562µs ± 2%               582µs ± 0%   +3.55%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       852µs ± 2%               868µs ± 1%   +1.91%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.11ms ± 2%              1.15ms ± 1%   +3.39%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               141µs ± 2%               138µs ± 0%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               239µs ± 6%               230µs ± 1%   -3.99%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               349µs ± 1%               344µs ± 1%   -1.24%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               477µs ± 9%               461µs ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               929µs ± 3%               914µs ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.40ms ± 2%              1.39ms ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.89ms ± 5%              1.85ms ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  173µs ± 6%               172µs ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  295µs ± 4%               293µs ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  438µs ± 1%               441µs ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  589µs ± 2%               592µs ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.18ms ± 6%              1.20ms ± 3%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.85ms ± 5%              1.75ms ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.35ms ± 1%              2.35ms ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·1                                       46.3µs ± 1%              45.9µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·2                                       51.0µs ± 1%              51.0µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·3                                       58.4µs ± 0%              58.4µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·4                                       63.8µs ± 0%              63.6µs ± 0%   -0.30%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·8                                       97.9µs ± 1%              96.5µs ± 2%   -1.48%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·12                                       146µs ± 3%               136µs ± 2%   -6.67%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·16                                       200µs ± 3%               179µs ± 3%  -10.62%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         37.7µs ± 1%              37.6µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         40.8µs ± 0%              41.0µs ± 0%   +0.66%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         48.3µs ± 0%              48.4µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         53.9µs ± 0%              53.8µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         86.6µs ± 1%              84.9µs ± 0%   -1.98%  (p=0.016 n=5+4)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         128µs ± 2%               116µs ± 5%   -9.16%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         178µs ± 3%               149µs ± 2%  -16.06%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    91.7µs ± 1%              90.5µs ± 1%   -1.35%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     104µs ± 0%               103µs ± 0%   -0.80%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     113µs ± 1%               112µs ± 0%   -0.86%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     126µs ± 0%               124µs ± 0%   -1.01%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     210µs ± 3%               214µs ± 3%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    324µs ± 2%               336µs ± 3%   +3.66%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    441µs ± 2%               458µs ± 3%   +3.75%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             87.2µs ± 1%              86.6µs ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              100µs ± 0%               100µs ± 1%   +0.77%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              109µs ± 0%               110µs ± 1%   +1.09%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              119µs ± 2%               121µs ± 0%   +1.33%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              200µs ± 1%               213µs ± 2%   +6.39%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             316µs ± 0%               331µs ± 4%   +4.54%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             436µs ± 1%               454µs ± 3%   +4.17%  (p=0.008 n=5+5)
      9282fca1
    • Kirill Smelkov's avatar
      X rio: localhost timings, Cenabled, zwrk@1s · 31d87ace
      Kirill Smelkov authored
      Remeasure with the same sattings as previous rio localhost with C-enabled (31dc070d):
      
      Like on neo1 & z6001 data is moreorless the same.
      
      the pystone/s change is nose as pystone/s for C-enabled case was 146k on
      prev-prev run (see 31dc070d).
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset  20180306-rio-ffixed-c.txt 20180308-rio-ffixed-c-zwrk1s.txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:rio
      pystone                                                      115k ±12%                144k ± 3%  +24.95%  (p=0.008 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:rio
      crc32/py/4K                                                4.77µs ± 0%              4.79µs ± 1%     ~     (p=0.730 n=4+5)
      crc32/go/4K                                                1.49µs ± 0%              1.49µs ± 0%   -0.21%  (p=0.016 n=5+5)
      sha1/py/4K                                                 8.04µs ± 1%              7.98µs ± 1%     ~     (p=0.206 n=5+5)
      sha1/go/4K                                                 8.93µs ± 0%              9.29µs ±12%     ~     (p=0.167 n=5+5)
      unzlib/py/wczdata                                          25.1µs ± 1%              25.2µs ± 1%     ~     (p=0.421 n=5+5)
      unzlib/go/wczdata                                          23.0µs ± 0%              23.0µs ± 0%   -0.20%  (p=0.016 n=5+5)
      unzlib/py/prod1-avg                                        7.16µs ± 1%              7.26µs ± 3%     ~     (p=0.222 n=5+5)
      unzlib/go/prod1-avg                                        5.08µs ± 1%              5.06µs ± 1%     ~     (p=0.095 n=5+5)
      disk/randread/direct/4K-min                                92.4µs ± 0%              93.0µs ± 0%   +0.67%  (p=0.024 n=5+5)
      disk/randread/direct/4K-avg                                 115µs ± 0%               116µs ± 1%   +0.99%  (p=0.008 n=5+5)
      disk/randread/pagecache/4K-min                              565ns ± 2%               570ns ± 1%     ~     (p=0.167 n=5+5)
      disk/randread/pagecache/4K-avg                              992ns ± 0%               995ns ± 0%   +0.26%  (p=0.016 n=4+5)
      
      name                                           old time/object          new time/object          delta
      cluster:rio dataset:wczblk1-8
      fs1-zhash.py                                               29.2µs ± 1%              28.9µs ± 1%     ~     (p=0.086 n=4+4)
      fs1-zhash.go                                               4.68µs ± 5%              4.60µs ± 0%     ~     (p=0.333 n=5+4)
      fs1-zhash.go+prefetch128                                   4.78µs ± 5%              4.62µs ± 3%     ~     (p=0.111 n=5+5)
      zeo/py/fs1-zhash.py                                         400µs ± 0%               412µs ± 4%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zhash.go                                         138µs ± 1%               139µs ± 3%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            74.7µs ± 2%              75.2µs ± 5%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                318µs ± 7%               315µs ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                154µs ± 4%               156µs ± 6%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    125µs ± 3%               125µs ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zhash.py                                   400µs ±57%               342µs ± 2%     ~     (p=0.730 n=5+4)
      neo/py(!log)/sql-zhash.go                                   183µs ±11%               178µs ± 2%     ~     (p=0.889 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       158µs ± 3%               159µs ± 2%     ~     (p=0.968 n=5+5)
      neo/go/fs1-zhash.py                                         222µs ± 4%               224µs ± 4%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.go                                        68.6µs ± 2%              67.0µs ± 1%   -2.30%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            29.0µs ± 6%              28.3µs ± 1%     ~     (p=0.143 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          43.9µs ± 3%              45.0µs ± 6%     ~     (p=0.500 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              18.8µs ± 5%              19.0µs ± 3%     ~     (p=0.810 n=5+5)
      neo/go/sqlite-zhash.py                                      273µs ± 3%               266µs ± 2%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zhash.go                                      104µs ± 1%               103µs ± 2%     ~     (p=0.294 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         36.3µs ± 3%              37.6µs ± 2%   +3.75%  (p=0.016 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              94.2µs ± 3%              94.7µs ± 1%     ~     (p=0.413 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  35.1µs ± 6%              35.1µs ± 6%     ~     (p=1.000 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zhash.py                                               23.9µs ± 1%              24.2µs ± 1%     ~     (p=0.143 n=4+4)
      fs1-zhash.go                                               3.40µs ± 0%              3.40µs ± 0%     ~     (all equal)
      fs1-zhash.go+prefetch128                                   3.02µs ± 9%              3.06µs ± 2%     ~     (p=0.238 n=5+5)
      zeo/py/fs1-zhash.py                                         372µs ±10%               368µs ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zhash.go                                         114µs ± 1%               115µs ± 2%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            64.6µs ± 1%              65.6µs ± 1%   +1.55%  (p=0.040 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                321µs ±11%               316µs ± 6%     ~     (p=0.952 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                142µs ± 3%               142µs ± 5%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    117µs ± 1%               116µs ± 1%     ~     (p=0.111 n=5+5)
      neo/py(!log)/sql-zhash.py                                   330µs ± 1%               339µs ± 5%     ~     (p=0.486 n=4+4)
      neo/py(!log)/sql-zhash.go                                   172µs ± 1%               172µs ± 1%     ~     (p=0.889 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       149µs ± 2%               150µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zhash.py                                         217µs ± 1%               219µs ± 2%     ~     (p=0.389 n=5+5)
      neo/go/fs1-zhash.go                                        49.8µs ± 2%              49.9µs ± 1%     ~     (p=0.786 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            18.8µs ± 1%              19.1µs ± 3%     ~     (p=0.167 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          40.4µs ± 3%              41.1µs ± 2%     ~     (p=0.103 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              16.1µs ± 2%              16.2µs ± 5%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zhash.py                                      263µs ± 4%               261µs ± 5%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zhash.go                                     93.1µs ± 1%              94.3µs ± 1%   +1.29%  (p=0.024 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         32.7µs ± 2%              33.6µs ± 5%     ~     (p=0.381 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              89.6µs ± 1%              90.3µs ± 2%     ~     (p=0.175 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  34.0µs ± 2%              33.0µs ± 4%     ~     (p=0.238 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:rio dataset:wczblk1-8
      fs1-zwrk.go·1                                                300k ± 0%                301k ± 0%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·2                                                546k ± 0%                550k ± 3%     ~     (p=0.151 n=5+5)
      fs1-zwrk.go·3                                                810k ± 0%                817k ± 1%   +0.82%  (p=0.008 n=5+5)
      fs1-zwrk.go·4                                               1.08M ± 0%               1.08M ± 0%   +0.58%  (p=0.008 n=5+5)
      fs1-zwrk.go·8                                               1.42M ± 0%               1.42M ± 0%     ~     (p=0.222 n=5+5)
      fs1-zwrk.go·12                                              1.55M ± 0%               1.55M ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                              1.55M ± 0%               1.55M ± 0%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        7.41k ± 1%               7.38k ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        9.03k ± 1%               8.96k ± 2%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        9.77k ± 1%               9.66k ± 3%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        10.1k ± 3%                9.9k ± 1%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        10.5k ± 0%               10.3k ± 1%   -1.89%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       10.6k ± 1%               10.4k ± 1%   -1.61%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       10.6k ± 1%               10.5k ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               6.80k ± 2%               6.88k ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.31k ± 7%               8.63k ± 3%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.60k ± 1%               8.66k ± 0%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·4                               8.60k ± 1%               8.71k ± 1%   +1.17%  (p=0.029 n=4+4)
      neo/py(!log)/sqlite-zwrk.go·8                               8.61k ± 1%               8.60k ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.56k ± 1%               8.63k ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.49k ± 3%               8.54k ± 3%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.62k ± 6%               5.69k ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.75k ± 4%               6.73k ± 5%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.77k ± 2%               6.69k ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.51k ± 7%               6.60k ±11%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.56k ± 4%               6.65k ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.84k ± 1%               6.58k ±11%     ~     (p=0.063 n=4+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.73k ± 3%               6.70k ± 1%     ~     (p=0.413 n=5+4)
      neo/go/fs1-zwrk.go·1                                        15.5k ± 0%               15.7k ± 0%   +0.83%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                        29.9k ± 1%               30.3k ± 0%   +1.32%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                        39.4k ± 0%               39.8k ± 0%   +0.83%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                        49.4k ± 0%               49.7k ± 0%   +0.72%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        68.4k ± 0%               68.7k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·12                                       72.5k ± 0%               73.0k ± 0%   +0.68%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·16                                       73.2k ± 0%               73.9k ± 0%   +0.99%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.2k ± 1%               25.6k ± 3%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          47.6k ± 0%               47.8k ± 0%   +0.49%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          59.4k ± 0%               59.6k ± 0%   +0.37%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          72.2k ± 0%               72.7k ± 0%   +0.68%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          96.7k ± 0%               97.0k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          109k ± 0%                109k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                          113k ± 1%                113k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     9.82k ± 0%               9.88k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     18.3k ± 0%               18.4k ± 0%   +0.51%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     25.3k ± 0%               25.5k ± 0%   +0.67%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     30.3k ± 0%               30.4k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     39.5k ± 0%               39.5k ± 0%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    40.8k ± 2%               40.9k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    40.5k ± 2%               40.4k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.0k ± 1%               11.0k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              20.0k ± 0%               19.9k ± 0%   -0.65%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              27.9k ± 0%               27.7k ± 0%   -0.55%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              34.1k ± 0%               34.0k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              44.1k ± 1%               43.8k ± 1%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             43.1k ± 1%               42.8k ± 2%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             41.2k ± 2%               40.9k ± 2%     ~     (p=0.421 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zwrk.go·1                                                465k ± 1%                462k ± 1%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·2                                                920k ± 0%                910k ± 1%   -1.07%  (p=0.016 n=4+5)
      fs1-zwrk.go·3                                               1.36M ± 1%               1.35M ± 0%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·4                                               1.81M ± 0%               1.79M ± 1%   -1.07%  (p=0.008 n=5+5)
      fs1-zwrk.go·8                                               2.37M ± 1%               2.38M ± 1%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·12                                              2.41M ± 0%               2.40M ± 1%   -0.61%  (p=0.008 n=5+5)
      fs1-zwrk.go·16                                              2.42M ± 0%               2.40M ± 0%   -1.00%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        8.98k ± 1%               8.91k ± 2%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        11.7k ± 1%               11.7k ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        12.9k ± 2%               13.0k ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        13.4k ± 4%               13.4k ± 2%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        14.0k ± 2%               14.2k ± 2%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       14.2k ± 2%               14.1k ± 2%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       14.2k ± 3%               14.4k ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.16k ± 4%               7.12k ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.75k ± 1%               8.37k ± 6%   -4.30%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.65k ± 4%               8.60k ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.53k ± 6%               8.40k ± 8%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.61k ± 3%               8.61k ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.64k ± 0%               8.56k ± 2%     ~     (p=0.556 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.64k ± 1%               8.46k ± 5%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.88k ± 1%               5.78k ± 5%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.79k ± 2%               6.77k ± 4%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.58k ± 4%               6.85k ± 1%   +4.08%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.68k ± 4%               6.79k ± 2%     ~     (p=0.643 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.83k ± 1%               6.80k ± 5%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.66k ± 4%               6.50k ± 5%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.65k ± 5%               6.81k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·1                                        21.8k ± 1%               21.6k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·2                                        39.2k ± 1%               39.2k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·3                                        51.4k ± 0%               51.3k ± 0%   -0.22%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·4                                        62.8k ± 0%               62.7k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·8                                        80.7k ± 1%               81.7k ± 1%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·12                                       80.0k ± 2%               82.1k ± 3%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·16                                       78.3k ± 2%               80.1k ± 3%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.5k ± 1%               26.5k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          48.8k ± 0%               49.1k ± 0%   +0.55%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          61.8k ± 0%               62.2k ± 0%   +0.57%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          74.0k ± 0%               74.2k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          91.3k ± 0%               92.4k ± 1%     ~     (p=0.111 n=4+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         93.1k ± 2%               94.1k ± 2%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         89.7k ± 2%               90.0k ± 3%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.0k ± 1%               10.9k ± 1%   -1.12%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     19.4k ± 1%               19.3k ± 0%   -0.67%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     26.6k ± 0%               26.4k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     31.9k ± 0%               31.8k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     37.4k ± 2%               38.1k ± 3%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    35.2k ± 3%               37.1k ± 2%   +5.41%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    34.6k ± 2%               36.3k ± 2%   +4.86%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.5k ± 1%               11.5k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              20.1k ± 0%               20.1k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              27.6k ± 0%               27.6k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              33.4k ± 0%               33.5k ± 2%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              38.8k ± 2%               40.0k ± 1%   +2.97%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             36.4k ± 1%               37.9k ± 0%   +4.32%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             35.2k ± 2%               36.7k ± 1%   +4.28%  (p=0.008 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:rio dataset:wczblk1-8
      fs1-zwrk.go·1                                              3.33µs ± 0%              3.32µs ± 0%   -0.44%  (p=0.048 n=5+5)
      fs1-zwrk.go·2                                              3.67µs ± 0%              3.64µs ± 3%     ~     (p=0.143 n=5+5)
      fs1-zwrk.go·3                                              3.70µs ± 0%              3.67µs ± 1%   -0.80%  (p=0.008 n=5+5)
      fs1-zwrk.go·4                                              3.72µs ± 0%              3.70µs ± 0%   -0.58%  (p=0.008 n=5+5)
      fs1-zwrk.go·8                                              5.62µs ± 0%              5.62µs ± 0%     ~     (p=0.206 n=5+5)
      fs1-zwrk.go·12                                             7.76µs ± 0%              7.76µs ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                             10.3µs ± 0%              10.3µs ± 0%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        135µs ± 1%               136µs ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        222µs ± 1%               223µs ± 2%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        307µs ± 1%               311µs ± 3%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        398µs ± 3%               405µs ± 1%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        759µs ± 0%               774µs ± 1%   +1.93%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.13ms ± 1%              1.15ms ± 1%   +1.64%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.50ms ± 1%              1.52ms ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               147µs ± 2%               145µs ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               241µs ± 8%               232µs ± 3%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               349µs ± 1%               347µs ± 0%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·4                               465µs ± 1%               459µs ± 1%   -1.16%  (p=0.029 n=4+4)
      neo/py(!log)/sqlite-zwrk.go·8                               930µs ± 1%               930µs ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.40ms ± 1%              1.39ms ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.88ms ± 3%              1.87ms ± 3%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  178µs ± 6%               176µs ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  297µs ± 4%               298µs ± 5%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  443µs ± 2%               449µs ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  616µs ± 8%               589µs ± 1%     ~     (p=0.063 n=5+4)
      neo/py(!log)/sql-zwrk.go·8                                 1.22ms ± 5%              1.20ms ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.75ms ± 1%              1.83ms ±12%     ~     (p=0.063 n=4+5)
      neo/py(!log)/sql-zwrk.go·16                                2.38ms ± 3%              2.39ms ± 1%     ~     (p=0.413 n=5+4)
      neo/go/fs1-zwrk.go·1                                       64.4µs ± 0%              63.9µs ± 0%   -0.82%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                       66.8µs ± 1%              66.0µs ± 0%   -1.30%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                       76.1µs ± 0%              75.4µs ± 0%   -0.82%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                       81.0µs ± 0%              80.5µs ± 0%   -0.72%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        117µs ± 0%               116µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·12                                       165µs ± 0%               164µs ± 0%   -0.68%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·16                                       219µs ± 0%               217µs ± 0%   -0.98%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         38.2µs ± 1%              39.0µs ± 3%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         42.0µs ± 0%              41.8µs ± 0%   -0.49%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         50.5µs ± 0%              50.3µs ± 0%   -0.37%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         55.4µs ± 0%              55.0µs ± 0%   -0.67%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         82.8µs ± 0%              82.5µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         110µs ± 0%               110µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         142µs ± 1%               142µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     102µs ± 0%               101µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     110µs ± 0%               109µs ± 0%   -0.50%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     119µs ± 0%               118µs ± 0%   -0.66%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     132µs ± 0%               132µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     203µs ± 0%               202µs ± 0%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    294µs ± 2%               294µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    395µs ± 2%               396µs ± 3%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             91.1µs ± 1%              91.1µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              100µs ± 0%               101µs ± 0%   +0.66%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              108µs ± 0%               108µs ± 0%   +0.56%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              117µs ± 0%               118µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              182µs ± 1%               183µs ± 1%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             279µs ± 1%               280µs ± 2%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             388µs ± 2%               391µs ± 2%     ~     (p=0.421 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zwrk.go·1                                              2.15µs ± 1%              2.17µs ± 1%     ~     (p=0.079 n=5+5)
      fs1-zwrk.go·2                                              2.17µs ± 0%              2.20µs ± 0%   +1.09%  (p=0.016 n=4+5)
      fs1-zwrk.go·3                                              2.20µs ± 1%              2.21µs ± 0%     ~     (p=0.063 n=5+5)
      fs1-zwrk.go·4                                              2.21µs ± 0%              2.23µs ± 1%   +1.09%  (p=0.008 n=5+5)
      fs1-zwrk.go·8                                              3.37µs ± 1%              3.37µs ± 1%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·12                                             4.97µs ± 0%              5.00µs ± 1%   +0.62%  (p=0.008 n=5+5)
      fs1-zwrk.go·16                                             6.61µs ± 0%              6.67µs ± 0%   +1.01%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        111µs ± 1%               112µs ± 2%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        171µs ± 1%               171µs ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        233µs ± 2%               230µs ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        298µs ± 4%               298µs ± 2%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        572µs ± 2%               562µs ± 2%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       844µs ± 2%               852µs ± 2%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.12ms ± 3%              1.11ms ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               140µs ± 4%               141µs ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               229µs ± 1%               239µs ± 6%   +4.59%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               347µs ± 5%               349µs ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               470µs ± 7%               477µs ± 9%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               929µs ± 3%               929µs ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.39ms ± 0%              1.40ms ± 2%     ~     (p=0.556 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.85ms ± 1%              1.89ms ± 5%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  170µs ± 1%               173µs ± 6%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  294µs ± 2%               295µs ± 4%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  456µs ± 4%               438µs ± 1%   -3.97%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  599µs ± 4%               589µs ± 2%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.17ms ± 1%              1.18ms ± 6%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.80ms ± 4%              1.85ms ± 5%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.41ms ± 5%              2.35ms ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·1                                       45.9µs ± 1%              46.3µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·2                                       51.0µs ± 1%              51.0µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·3                                       58.3µs ± 0%              58.4µs ± 0%   +0.22%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·4                                       63.7µs ± 0%              63.8µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·8                                       99.2µs ± 1%              97.9µs ± 1%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·12                                       150µs ± 2%               146µs ± 3%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·16                                       204µs ± 3%               200µs ± 3%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         37.7µs ± 1%              37.7µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         41.0µs ± 0%              40.8µs ± 0%   -0.55%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         48.5µs ± 0%              48.3µs ± 0%   -0.56%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         54.0µs ± 0%              53.9µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         87.6µs ± 0%              86.6µs ± 1%     ~     (p=0.111 n=4+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         129µs ± 2%               128µs ± 2%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         178µs ± 2%               178µs ± 3%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    90.7µs ± 1%              91.7µs ± 1%   +1.13%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     103µs ± 1%               104µs ± 0%   +0.68%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     113µs ± 0%               113µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     125µs ± 0%               126µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     214µs ± 2%               210µs ± 3%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    341µs ± 3%               324µs ± 2%   -5.15%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    462µs ± 2%               441µs ± 2%   -4.63%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             86.7µs ± 1%              87.2µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              100µs ± 0%               100µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              109µs ± 0%               109µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              120µs ± 0%               119µs ± 2%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              206µs ± 2%               200µs ± 1%   -2.89%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             330µs ± 1%               316µs ± 0%   -4.15%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             455µs ± 2%               436µs ± 1%   -4.11%  (p=0.008 n=5+5)
      31d87ace
    • Kirill Smelkov's avatar
      X z6001: localhost timings, C > C1 disabled, zwrk@1s · 5685f384
      Kirill Smelkov authored
      Like on neo1, comparing to Cenabled run, even when there each zwrk was
      run for 10s, similarly to previous measure with Cstates disabled
      (65de70b8) it shows clear improvment:
      
      ---- 8< ----
      cluster:z6001 dataset:wczblk1-8
      zeo/py/fs1-zwrk.go·1                                        217µs ± 3%               195µs ± 1%  -10.29%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               306µs ± 6%               220µs ± 1%  -27.99%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  395µs ±11%               276µs ± 3%  -30.18%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  514µs ± 5%               470µs ± 4%   -8.50%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  741µs ± 3%               699µs ± 0%   -5.64%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.02ms ± 7%              0.95ms ± 5%   -6.66%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.00ms ± 7%              1.91ms ± 1%   -4.52%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                2.94ms ± 3%              2.87ms ± 3%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.04ms ±11%              3.80ms ± 1%   -5.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     203µs ± 3%               139µs ± 1%  -31.68%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     167µs ± 0%               147µs ± 0%  -12.19%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     158µs ± 0%               150µs ± 1%   -5.38%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     163µs ± 0%               156µs ± 0%   -4.11%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              178µs ± 1%               129µs ± 1%  -27.30%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              153µs ± 1%               136µs ± 1%  -11.08%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              149µs ± 0%               138µs ± 0%   -6.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              149µs ± 0%               142µs ± 0%   -4.85%  (p=0.008 n=5+5)
      
      cluster:z6001 dataset:prod1-1024
      zeo/py/fs1-zwrk.go·1                                        186µs ± 4%               163µs ± 1%  -12.16%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               273µs ± 4%               204µs ± 1%  -25.07%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  365µs ±11%               275µs ± 7%  -24.47%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  524µs ± 5%               460µs ± 0%  -12.15%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zwrk.go·3                                  754µs ±10%               689µs ± 1%   -8.64%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  975µs ±11%               927µs ± 0%   -4.98%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zwrk.go·8                                 1.92ms ± 2%              1.83ms ± 1%   -4.53%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                2.95ms ± 9%              2.73ms ± 1%   -7.65%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.12ms ± 8%              3.69ms ± 1%  -10.36%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     174µs ± 3%               126µs ± 2%  -27.44%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     149µs ± 0%               136µs ± 1%   -9.09%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     147µs ± 0%               141µs ± 0%   -4.28%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              169µs ± 3%               122µs ± 2%  -27.64%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              147µs ± 0%               132µs ± 1%  -10.22%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              144µs ± 1%               136µs ± 0%   -5.05%  (p=0.008 n=5+5)
      ---- 8< ----
      
      not to mention that zhash.{py,go}, for which runtime was not changed,
      are also improved/denoised like it was in 65de70b8, thus confirming
      timings from there:
      
      ---- 8< ----
      cluster:z6001 dataset:wczblk1-8
      fs1-zhash.go+prefetch128                                   8.35µs ± 2%              7.34µs ± 5%  -12.10%  (p=0.016 n=4+5)
      zeo/py/fs1-zhash.py                                         675µs ± 5%               590µs ± 4%  -12.51%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go                                         267µs ± 7%               201µs ± 3%  -24.73%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                673µs ± 8%               482µs ± 4%  -28.32%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                291µs ±11%               222µs ± 1%  -23.78%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                   958µs ±28%               529µs ± 4%  -44.74%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zhash.go                                   441µs ± 6%               275µs ± 1%  -37.68%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.py                                         509µs ±15%               342µs ± 2%  -32.79%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go                                         106µs ± 8%                91µs ± 2%  -14.00%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          76.2µs ± 8%              68.8µs ± 3%   -9.79%  (p=0.016 n=5+5)
      neo/go/sqlite-zhash.py                                      531µs ± 9%               373µs ± 7%  -29.80%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      200µs ±13%               143µs ± 3%  -28.59%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               185µs ±14%               133µs ± 5%  -28.19%  (p=0.008 n=5+5)
      
      cluster:z6001 dataset:prod1-1024
      zeo/py/fs1-zhash.py                                         646µs ± 3%               555µs ± 2%  -14.12%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go                                         233µs ± 3%               169µs ± 1%  -27.63%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                653µs ± 7%               467µs ± 4%  -28.50%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                261µs ± 6%               205µs ± 0%  -21.60%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                   961µs ±38%               518µs ± 2%  -46.11%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zhash.go                                   363µs ±12%               267µs ± 1%  -26.59%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       262µs ±11%               226µs ± 9%  -13.79%  (p=0.016 n=5+5)
      neo/go/fs1-zhash.py                                         490µs ± 8%               320µs ±11%  -34.68%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go                                        81.4µs ± 5%              76.3µs ± 3%   -6.34%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          70.5µs ± 6%              64.8µs ± 2%   -8.03%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              21.0µs ± 2%              20.5µs ± 3%   -2.38%  (p=0.048 n=5+5)
      neo/go/sqlite-zhash.py                                      521µs ± 6%               378µs ± 4%  -27.44%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      168µs ±10%               129µs ± 3%  -23.43%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               167µs ±14%               125µs ± 5%  -25.50%  (p=0.008 n=5+5)
      ---- 8< ----
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset  20180308-z6001-ffixed-c-zwrk10s.txt 20180308-z6001-ffixed-noc_C1\(3µs\)-zwrk1s.txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:z6001
      pystone                                                      114k ± 1%                115k ± 1%     ~     (p=0.310 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:z6001
      crc32/py/4K                                                5.10µs ± 0%              5.12µs ± 2%     ~     (p=0.690 n=5+5)
      crc32/go/4K                                                1.77µs ± 8%              1.72µs ± 0%     ~     (p=0.651 n=5+4)
      sha1/py/4K                                                 14.6µs ± 0%              14.7µs ± 1%   +0.38%  (p=0.016 n=4+5)
      sha1/go/4K                                                 10.3µs ± 0%              10.3µs ± 0%     ~     (p=0.143 n=4+4)
      unzlib/py/wczdata                                          36.4µs ± 1%              36.5µs ± 1%     ~     (p=0.310 n=5+5)
      unzlib/go/wczdata                                          31.5µs ± 0%              31.2µs ± 0%   -0.95%  (p=0.008 n=5+5)
      unzlib/py/prod1-avg                                        18.4µs ± 3%              18.6µs ± 1%     ~     (p=0.413 n=5+4)
      unzlib/go/prod1-avg                                        10.0µs ± 1%               9.9µs ± 1%     ~     (p=0.151 n=5+5)
      disk/randread/direct/4K-min                                 133µs ± 6%               127µs ± 1%     ~     (p=0.460 n=5+5)
      disk/randread/direct/4K-avg                                 201µs ± 6%               168µs ± 0%  -16.39%  (p=0.008 n=5+5)
      disk/randread/pagecache/4K-min                              797ns ± 2%               788ns ± 1%     ~     (p=0.333 n=5+5)
      disk/randread/pagecache/4K-avg                             1.40µs ± 7%              1.50µs ± 3%     ~     (p=0.063 n=5+5)
      
      name                                           old time/object          new time/object          delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zhash.py                                               37.4µs ± 2%              37.6µs ± 1%     ~     (p=0.389 n=5+5)
      fs1-zhash.go                                               6.04µs ± 1%              5.98µs ± 2%     ~     (p=0.397 n=5+5)
      fs1-zhash.go+prefetch128                                   8.35µs ± 2%              7.34µs ± 5%  -12.10%  (p=0.016 n=4+5)
      zeo/py/fs1-zhash.py                                         675µs ± 5%               590µs ± 4%  -12.51%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go                                         267µs ± 7%               201µs ± 3%  -24.73%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                             101µs ± 2%               102µs ± 2%     ~     (p=0.444 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                673µs ± 8%               482µs ± 4%  -28.32%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                291µs ±11%               222µs ± 1%  -23.78%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    176µs ± 1%               179µs ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zhash.py                                   958µs ±28%               529µs ± 4%  -44.74%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zhash.go                                   441µs ± 6%               275µs ± 1%  -37.68%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       269µs ±15%               237µs ± 5%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zhash.py                                         509µs ±15%               342µs ± 2%  -32.79%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go                                         106µs ± 8%                91µs ± 2%  -14.00%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            37.1µs ± 6%              36.6µs ± 2%     ~     (p=0.651 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          76.2µs ± 8%              68.8µs ± 3%   -9.79%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              26.0µs ± 2%              26.5µs ± 3%     ~     (p=0.135 n=5+5)
      neo/go/sqlite-zhash.py                                      531µs ± 9%               373µs ± 7%  -29.80%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      200µs ±13%               143µs ± 3%  -28.59%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         39.9µs ± 2%              39.0µs ± 5%     ~     (p=0.381 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               185µs ±14%               133µs ± 5%  -28.19%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  37.2µs ± 6%              36.6µs ± 5%     ~     (p=0.548 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zhash.py                                               30.2µs ± 2%              30.5µs ± 2%     ~     (p=0.349 n=5+5)
      fs1-zhash.go                                               4.60µs ± 0%              4.60µs ± 0%     ~     (all equal)
      fs1-zhash.go+prefetch128                                   5.70µs ± 7%              5.44µs ± 3%     ~     (p=0.119 n=5+5)
      zeo/py/fs1-zhash.py                                         646µs ± 3%               555µs ± 2%  -14.12%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go                                         233µs ± 3%               169µs ± 1%  -27.63%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            87.5µs ± 3%              88.4µs ± 2%     ~     (p=0.651 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                653µs ± 7%               467µs ± 4%  -28.50%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                261µs ± 6%               205µs ± 0%  -21.60%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    161µs ± 2%               161µs ± 1%     ~     (p=0.952 n=5+5)
      neo/py(!log)/sql-zhash.py                                   961µs ±38%               518µs ± 2%  -46.11%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zhash.go                                   363µs ±12%               267µs ± 1%  -26.59%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       262µs ±11%               226µs ± 9%  -13.79%  (p=0.016 n=5+5)
      neo/go/fs1-zhash.py                                         490µs ± 8%               320µs ±11%  -34.68%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go                                        81.4µs ± 5%              76.3µs ± 3%   -6.34%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            23.9µs ± 2%              23.6µs ± 2%     ~     (p=0.230 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          70.5µs ± 6%              64.8µs ± 2%   -8.03%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              21.0µs ± 2%              20.5µs ± 3%   -2.38%  (p=0.048 n=5+5)
      neo/go/sqlite-zhash.py                                      521µs ± 6%               378µs ± 4%  -27.44%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      168µs ±10%               129µs ± 3%  -23.43%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         35.1µs ± 3%              34.8µs ± 2%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               167µs ±14%               125µs ± 5%  -25.50%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  35.0µs ± 2%              34.5µs ± 1%     ~     (p=0.214 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zwrk.go·1                                                229k ± 2%                231k ± 1%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·2                                                438k ± 0%                446k ± 2%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·3                                                665k ± 1%                659k ± 2%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·4                                                868k ± 1%                876k ± 2%     ~     (p=0.222 n=5+5)
      fs1-zwrk.go·8                                               1.75M ± 1%               1.75M ± 1%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·12                                              2.57M ± 1%               2.53M ± 2%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·16                                              2.90M ± 1%               2.91M ± 1%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        4.61k ± 3%               5.14k ± 1%  +11.45%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        6.31k ± 2%               6.35k ± 0%     ~     (p=0.730 n=5+4)
      zeo/py/fs1-zwrk.go·3                                        6.98k ± 2%               7.08k ± 0%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        7.11k ± 3%               7.19k ± 2%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        7.41k ± 4%               7.54k ± 2%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       7.63k ± 1%               7.57k ± 2%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       7.65k ± 3%               7.66k ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               3.27k ± 6%               4.54k ± 1%  +38.70%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               5.64k ± 2%               5.68k ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               5.57k ± 3%               5.70k ± 2%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               5.59k ± 3%               5.65k ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               5.63k ± 2%               5.64k ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              5.57k ± 3%               5.60k ± 6%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              5.63k ± 2%               5.55k ± 4%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  2.55k ±11%               3.62k ± 3%  +42.42%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  3.89k ± 5%               4.26k ± 4%   +9.26%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  4.05k ± 3%               4.29k ± 0%   +5.95%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  3.93k ± 6%               4.21k ± 4%   +7.06%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  4.02k ± 7%               4.20k ± 1%   +4.56%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 4.08k ± 3%               4.19k ± 3%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.98k ±10%               4.21k ± 1%   +5.85%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                        10.6k ± 2%               11.1k ± 3%   +4.24%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·2                                        22.4k ± 0%               23.0k ± 1%   +2.86%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                        31.8k ± 0%               32.2k ± 0%   +1.23%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                        43.1k ± 0%               43.5k ± 0%   +0.86%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        78.1k ± 0%               78.3k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·12                                       92.4k ± 0%               92.5k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·16                                        102k ± 0%                102k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          15.2k ± 1%               15.0k ± 6%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          31.4k ± 0%               31.8k ± 1%   +1.20%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          43.8k ± 0%               44.1k ± 0%   +0.81%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          57.6k ± 0%               57.9k ± 1%   +0.56%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                           100k ± 0%                100k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          116k ± 0%                116k ± 0%   +0.43%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                          126k ± 0%                126k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     4.92k ± 3%               7.20k ± 1%  +46.31%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     12.0k ± 0%               13.7k ± 0%  +13.89%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     18.9k ± 0%               20.0k ± 1%   +5.69%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     24.6k ± 0%               25.7k ± 0%   +4.29%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     44.3k ± 1%               45.3k ± 0%   +2.21%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    55.5k ± 1%               56.4k ± 0%   +1.60%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    58.0k ± 0%               58.2k ± 1%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              5.62k ± 1%               7.73k ± 1%  +37.54%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              13.1k ± 1%               14.7k ± 1%  +12.47%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              20.2k ± 0%               21.7k ± 0%   +7.27%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              26.9k ± 0%               28.2k ± 0%   +5.09%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              47.7k ± 1%               49.0k ± 0%   +2.68%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             59.7k ± 1%               60.5k ± 0%   +1.26%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             62.8k ± 0%               61.9k ± 0%   -1.48%  (p=0.008 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zwrk.go·1                                                349k ± 0%                349k ± 1%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·2                                                659k ± 2%                672k ± 1%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·3                                                990k ± 3%                982k ± 2%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·4                                               1.31M ± 1%               1.29M ± 7%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·8                                               2.52M ± 1%               2.53M ± 3%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·12                                              2.81M ± 1%               3.05M ± 1%   +8.30%  (p=0.008 n=5+5)
      fs1-zwrk.go·16                                              2.86M ± 0%               3.06M ± 1%   +6.87%  (p=0.016 n=4+5)
      zeo/py/fs1-zwrk.go·1                                        5.39k ± 4%               6.13k ± 1%  +13.78%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        8.20k ± 1%               8.21k ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        8.93k ± 2%               9.03k ± 2%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        9.34k ± 4%               9.37k ± 2%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        9.93k ± 3%               9.85k ± 5%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       9.43k ±16%               9.57k ± 9%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       10.1k ± 4%               10.3k ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               3.67k ± 4%               4.90k ± 1%  +33.35%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               5.82k ± 0%               5.90k ± 0%   +1.38%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               5.78k ± 0%               5.86k ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               5.67k ± 3%               5.75k ± 0%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·8                               5.80k ± 2%               5.84k ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              5.85k ± 2%               5.51k ± 6%   -5.93%  (p=0.024 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              5.78k ± 3%               5.71k ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  2.75k ±10%               3.64k ± 7%  +32.25%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  3.83k ± 5%               4.35k ± 0%  +13.62%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zwrk.go·3                                  3.99k ± 9%               4.36k ± 2%   +9.20%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  4.11k ±10%               4.32k ± 0%   +4.92%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zwrk.go·8                                  4.18k ± 2%               4.37k ± 1%   +4.73%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 4.07k ± 9%               4.40k ± 1%   +7.95%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.90k ± 8%               4.34k ± 1%  +11.34%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                        13.7k ± 0%               14.2k ± 1%   +3.69%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                        28.0k ± 0%               28.5k ± 1%   +1.73%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                        40.3k ± 0%               40.6k ± 0%   +0.85%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                        52.8k ± 0%               53.2k ± 1%   +0.77%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        91.0k ± 0%               90.1k ± 1%   -1.06%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       98.3k ± 1%               96.0k ± 1%   -2.30%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·16                                        101k ± 3%                 91k ± 1%   -9.91%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          16.1k ± 1%               16.4k ± 1%   +1.47%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          32.9k ± 0%               33.4k ± 1%   +1.65%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          46.2k ± 0%               46.7k ± 0%   +1.11%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          60.1k ± 0%               60.4k ± 0%   +0.60%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                           100k ± 0%                 99k ± 1%   -0.70%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          106k ± 1%                103k ± 1%   -3.32%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                          110k ± 1%                 97k ± 1%  -11.30%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     5.74k ± 3%               7.92k ± 2%  +37.81%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     13.4k ± 0%               14.7k ± 1%  +10.00%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     20.4k ± 0%               21.3k ± 0%   +4.48%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.8k ± 1%               27.5k ± 1%   +2.60%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     45.6k ± 1%               44.9k ± 1%   -1.38%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    53.9k ± 1%               52.3k ± 0%   -2.91%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    50.5k ± 1%               48.4k ± 1%   -4.22%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              5.92k ± 3%               8.17k ± 2%  +38.16%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              13.6k ± 0%               15.2k ± 1%  +11.39%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              20.9k ± 1%               22.0k ± 0%   +5.32%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.6k ± 0%               28.2k ± 0%   +2.12%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              46.7k ± 2%               45.3k ± 0%   -2.97%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             55.2k ± 1%               52.0k ± 1%   -5.91%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             51.5k ± 2%               48.4k ± 1%   -5.99%  (p=0.008 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zwrk.go·1                                              4.38µs ± 2%              4.33µs ± 1%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·2                                              4.56µs ± 0%              4.49µs ± 2%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·3                                              4.51µs ± 1%              4.56µs ± 2%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·4                                              4.61µs ± 1%              4.57µs ± 2%     ~     (p=0.222 n=5+5)
      fs1-zwrk.go·8                                              4.56µs ± 1%              4.56µs ± 1%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·12                                             4.67µs ± 1%              4.75µs ± 2%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·16                                             5.52µs ± 1%              5.49µs ± 1%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        217µs ± 3%               195µs ± 1%  -10.29%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        317µs ± 2%               315µs ± 0%     ~     (p=0.730 n=5+4)
      zeo/py/fs1-zwrk.go·3                                        430µs ± 2%               424µs ± 0%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        563µs ± 3%               556µs ± 2%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·8                                       1.08ms ± 4%              1.06ms ± 2%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.57ms ± 1%              1.58ms ± 2%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      2.09ms ± 3%              2.09ms ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               306µs ± 6%               220µs ± 1%  -27.99%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               355µs ± 2%               352µs ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               539µs ± 4%               526µs ± 2%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               715µs ± 3%               708µs ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.42ms ± 2%              1.42ms ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             2.16ms ± 3%              2.15ms ± 6%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.84ms ± 2%              2.89ms ± 4%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  395µs ±11%               276µs ± 3%  -30.18%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  514µs ± 5%               470µs ± 4%   -8.50%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  741µs ± 3%               699µs ± 0%   -5.64%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.02ms ± 7%              0.95ms ± 5%   -6.66%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.00ms ± 7%              1.91ms ± 1%   -4.52%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                2.94ms ± 3%              2.87ms ± 3%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.04ms ±11%              3.80ms ± 1%   -5.78%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                       94.3µs ± 2%              90.5µs ± 3%   -4.03%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·2                                       89.4µs ± 0%              86.9µs ± 1%   -2.78%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                       94.4µs ± 0%              93.2µs ± 0%   -1.21%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                       92.7µs ± 0%              91.9µs ± 0%   -0.85%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        102µs ± 0%               102µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·12                                       130µs ± 0%               130µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·16                                       156µs ± 0%               156µs ± 0%     ~     (p=0.452 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         65.9µs ± 1%              66.6µs ± 6%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         63.6µs ± 0%              62.9µs ± 1%   -1.19%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         68.5µs ± 0%              68.0µs ± 0%   -0.80%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         69.4µs ± 0%              69.0µs ± 1%   -0.55%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         80.1µs ± 0%              79.8µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         104µs ± 0%               103µs ± 0%   -0.42%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         127µs ± 0%               127µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     203µs ± 3%               139µs ± 1%  -31.68%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     167µs ± 0%               147µs ± 0%  -12.19%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     158µs ± 0%               150µs ± 1%   -5.38%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     163µs ± 0%               156µs ± 0%   -4.11%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     181µs ± 1%               177µs ± 0%   -2.17%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    216µs ± 1%               213µs ± 0%   -1.57%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    276µs ± 0%               275µs ± 1%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              178µs ± 1%               129µs ± 1%  -27.30%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              153µs ± 1%               136µs ± 1%  -11.08%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              149µs ± 0%               138µs ± 0%   -6.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              149µs ± 0%               142µs ± 0%   -4.85%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              168µs ± 1%               163µs ± 0%   -2.61%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             201µs ± 1%               198µs ± 0%   -1.25%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             255µs ± 0%               259µs ± 0%   +1.51%  (p=0.008 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zwrk.go·1                                              2.87µs ± 0%              2.87µs ± 1%     ~     (p=0.683 n=5+5)
      fs1-zwrk.go·2                                              3.04µs ± 2%              2.98µs ± 1%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·3                                              3.03µs ± 3%              3.05µs ± 2%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·4                                              3.06µs ± 1%              3.10µs ± 7%     ~     (p=0.651 n=5+5)
      fs1-zwrk.go·8                                              3.18µs ± 1%              3.16µs ± 3%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·12                                             4.26µs ± 1%              3.94µs ± 1%   -7.65%  (p=0.008 n=5+5)
      fs1-zwrk.go·16                                             5.59µs ± 0%              5.23µs ± 1%   -6.43%  (p=0.016 n=4+5)
      zeo/py/fs1-zwrk.go·1                                        186µs ± 4%               163µs ± 1%  -12.16%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        244µs ± 1%               244µs ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        336µs ± 2%               332µs ± 2%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        428µs ± 4%               427µs ± 2%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        806µs ± 3%               813µs ± 5%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.29ms ±17%              1.26ms ± 9%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.59ms ± 4%              1.55ms ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               273µs ± 4%               204µs ± 1%  -25.07%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               344µs ± 0%               339µs ± 0%   -1.36%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               519µs ± 0%               512µs ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               705µs ± 3%               695µs ± 0%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·8                              1.38ms ± 2%              1.37ms ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             2.05ms ± 2%              2.18ms ± 6%   +6.50%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.77ms ± 3%              2.80ms ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  365µs ±11%               275µs ± 7%  -24.47%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  524µs ± 5%               460µs ± 0%  -12.15%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zwrk.go·3                                  754µs ±10%               689µs ± 1%   -8.64%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  975µs ±11%               927µs ± 0%   -4.98%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zwrk.go·8                                 1.92ms ± 2%              1.83ms ± 1%   -4.53%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                2.95ms ± 9%              2.73ms ± 1%   -7.65%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.12ms ± 8%              3.69ms ± 1%  -10.36%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                       72.8µs ± 0%              70.2µs ± 1%   -3.56%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                       71.5µs ± 0%              70.3µs ± 1%   -1.70%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                       74.4µs ± 0%              73.8µs ± 0%   -0.85%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                       75.8µs ± 0%              75.2µs ± 1%   -0.76%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                       87.9µs ± 0%              88.8µs ± 1%   +1.07%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       122µs ± 1%               125µs ± 1%   +2.36%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·16                                       158µs ± 3%               175µs ± 1%  +10.97%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         62.0µs ± 1%              61.1µs ± 1%   -1.45%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         60.8µs ± 0%              59.8µs ± 1%   -1.62%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         64.9µs ± 0%              64.2µs ± 0%   -1.10%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         66.6µs ± 0%              66.2µs ± 0%   -0.60%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         80.3µs ± 0%              80.9µs ± 1%   +0.71%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         113µs ± 1%               117µs ± 1%   +3.44%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         146µs ± 1%               165µs ± 1%  +12.74%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     174µs ± 3%               126µs ± 2%  -27.44%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     149µs ± 0%               136µs ± 1%   -9.09%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     147µs ± 0%               141µs ± 0%   -4.28%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     149µs ± 1%               145µs ± 1%   -2.53%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     176µs ± 1%               178µs ± 1%   +1.40%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    223µs ± 1%               229µs ± 0%   +3.00%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    317µs ± 1%               331µs ± 1%   +4.40%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              169µs ± 3%               122µs ± 2%  -27.64%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              147µs ± 0%               132µs ± 1%  -10.22%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              144µs ± 1%               136µs ± 0%   -5.05%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              145µs ± 0%               142µs ± 0%   -2.07%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              171µs ± 2%               177µs ± 0%   +3.05%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             217µs ± 1%               231µs ± 1%   +6.28%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             311µs ± 2%               331µs ± 1%   +6.37%  (p=0.008 n=5+5)
      5685f384
    • Kirill Smelkov's avatar
      X z6001: localhost timings, Cenabled, zwrk@10s · 20788052
      Kirill Smelkov authored
      Compared to zwrk@1 it helps, but only a tiny bit, and the timings are
      still noisy:
      
      ---- 8< ----
      cluster:z6001 dataset:wczblk1-8
      neo/py(!log)/sql-zwrk.go·8                                 2.21ms ±11%              2.00ms ± 7%   -9.61%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.31ms ± 6%              2.94ms ± 3%  -11.20%  (p=0.008 n=5+5)
      
      cluster:z6001 dataset:prod1-1024
      zeo/py/fs1-zwrk.go·1                                        204µs ± 6%               186µs ± 4%   -9.09%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  818µs ± 8%               754µs ±10%   -7.83%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·16                                       178µs ± 1%               158µs ± 3%  -11.35%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         164µs ± 2%               146µs ± 1%  -11.22%  (p=0.008 n=5+5)
      ---- 8< ----
      
      The help is much less compared to the signidican speedup with Cstates
      disabled (65de70b8).
      
      The next commit will add remeasurements with C-states disabled.
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset  20180308-z6001-ffixed-c-zwrk1s.txt 20180308-z6001-ffixed-c-zwrk10s.txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:z6001
      pystone                                                      114k ± 1%                114k ± 1%     ~     (p=0.690 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:z6001
      crc32/py/4K                                                5.10µs ± 0%              5.10µs ± 0%     ~     (p=0.587 n=5+5)
      crc32/go/4K                                                1.72µs ± 0%              1.77µs ± 8%     ~     (p=0.381 n=4+5)
      sha1/py/4K                                                 14.6µs ± 0%              14.6µs ± 0%     ~     (p=0.556 n=5+4)
      sha1/go/4K                                                 10.3µs ± 0%              10.3µs ± 0%     ~     (p=0.714 n=5+4)
      unzlib/py/wczdata                                          36.2µs ± 1%              36.4µs ± 1%     ~     (p=0.548 n=5+5)
      unzlib/go/wczdata                                          31.5µs ± 0%              31.5µs ± 0%     ~     (p=0.310 n=5+5)
      unzlib/py/prod1-avg                                        18.2µs ± 1%              18.4µs ± 3%     ~     (p=0.222 n=5+5)
      unzlib/go/prod1-avg                                        10.0µs ± 2%              10.0µs ± 1%     ~     (p=0.548 n=5+5)
      disk/randread/direct/4K-min                                 129µs ± 4%               133µs ± 6%     ~     (p=0.841 n=5+5)
      disk/randread/direct/4K-avg                                 201µs ± 7%               201µs ± 6%     ~     (p=0.794 n=5+5)
      disk/randread/pagecache/4K-min                              793ns ± 2%               797ns ± 2%     ~     (p=0.548 n=5+5)
      disk/randread/pagecache/4K-avg                             1.41µs ± 4%              1.40µs ± 7%     ~     (p=0.881 n=5+5)
      
      name                                           old time/object          new time/object          delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zhash.py                                               37.5µs ± 1%              37.4µs ± 2%     ~     (p=0.897 n=5+5)
      fs1-zhash.go                                               5.90µs ± 0%              6.04µs ± 1%   +2.37%  (p=0.008 n=5+5)
      fs1-zhash.go+prefetch128                                   8.10µs ± 5%              8.35µs ± 2%     ~     (p=0.286 n=5+4)
      zeo/py/fs1-zhash.py                                         661µs ± 8%               675µs ± 5%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zhash.go                                         267µs ± 8%               267µs ± 7%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                             102µs ± 1%               101µs ± 2%     ~     (p=0.397 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                692µs ± 4%               673µs ± 8%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                309µs ±15%               291µs ±11%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    176µs ± 1%               176µs ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zhash.py                                   992µs ±31%               958µs ±28%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zhash.go                                   377µs ±16%               441µs ± 6%  +16.96%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       268µs ±12%               269µs ±15%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.py                                         482µs ±20%               509µs ±15%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zhash.go                                         102µs ± 9%               106µs ± 8%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            37.2µs ± 2%              37.1µs ± 6%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          73.1µs ±12%              76.2µs ± 8%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              26.9µs ± 7%              26.0µs ± 2%     ~     (p=0.198 n=5+5)
      neo/go/sqlite-zhash.py                                      525µs ±10%               531µs ± 9%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zhash.go                                      193µs ±16%               200µs ±13%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         39.6µs ± 4%              39.9µs ± 2%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               195µs ±25%               185µs ±14%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  36.7µs ± 3%              37.2µs ± 6%     ~     (p=0.452 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zhash.py                                               30.3µs ± 2%              30.2µs ± 2%     ~     (p=0.738 n=5+5)
      fs1-zhash.go                                               4.56µs ± 1%              4.60µs ± 0%     ~     (p=0.444 n=5+5)
      fs1-zhash.go+prefetch128                                   5.96µs ± 9%              5.70µs ± 7%     ~     (p=0.397 n=5+5)
      zeo/py/fs1-zhash.py                                         615µs ±13%               646µs ± 3%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zhash.go                                         235µs ± 6%               233µs ± 3%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            87.6µs ± 1%              87.5µs ± 3%     ~     (p=0.802 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                658µs ± 5%               653µs ± 7%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                256µs ± 8%               261µs ± 6%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    161µs ± 0%               161µs ± 2%     ~     (p=0.659 n=5+5)
      neo/py(!log)/sql-zhash.py                                  1.02ms ±33%              0.96ms ±38%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zhash.go                                   385µs ± 8%               363µs ±12%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       263µs ±11%               262µs ±11%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zhash.py                                         461µs ±16%               490µs ± 8%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zhash.go                                        82.9µs ± 5%              81.4µs ± 5%     ~     (p=0.341 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            23.9µs ± 3%              23.9µs ± 2%     ~     (p=0.810 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          69.7µs ±11%              70.5µs ± 6%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              21.0µs ± 2%              21.0µs ± 2%     ~     (p=0.762 n=5+5)
      neo/go/sqlite-zhash.py                                      541µs ± 9%               521µs ± 6%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zhash.go                                      181µs ±13%               168µs ±10%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         35.5µs ± 2%              35.1µs ± 3%     ~     (p=0.452 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               162µs ±14%               167µs ±14%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  35.3µs ± 1%              35.0µs ± 2%     ~     (p=0.794 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zwrk.go·1                                                228k ± 3%                229k ± 2%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·2                                                444k ± 1%                438k ± 0%   -1.35%  (p=0.016 n=5+5)
      fs1-zwrk.go·3                                                660k ± 3%                665k ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·4                                                882k ± 1%                868k ± 1%   -1.54%  (p=0.016 n=5+5)
      fs1-zwrk.go·8                                               1.75M ± 2%               1.75M ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·12                                              2.50M ± 3%               2.57M ± 1%   +2.64%  (p=0.032 n=5+5)
      fs1-zwrk.go·16                                              2.88M ± 1%               2.90M ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        4.44k ± 6%               4.61k ± 3%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        6.32k ± 0%               6.31k ± 2%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        6.89k ± 0%               6.98k ± 2%     ~     (p=0.135 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        7.15k ± 1%               7.11k ± 3%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        7.46k ± 2%               7.41k ± 4%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       7.55k ± 1%               7.63k ± 1%     ~     (p=0.063 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       7.55k ± 1%               7.65k ± 3%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               3.74k ±12%               3.27k ± 6%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               5.59k ± 1%               5.64k ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               5.58k ± 1%               5.57k ± 3%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               5.54k ± 1%               5.59k ± 3%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               5.65k ± 0%               5.63k ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              5.59k ± 0%               5.57k ± 3%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              5.58k ± 1%               5.63k ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  2.61k ± 5%               2.55k ±11%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  3.88k ±11%               3.89k ± 5%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  3.80k ±12%               4.05k ± 3%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  3.85k ± 5%               3.93k ± 6%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  3.64k ±12%               4.02k ± 7%  +10.28%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 3.62k ± 6%               4.08k ± 3%  +12.51%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.92k ±13%               3.98k ±10%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                        10.6k ± 5%               10.6k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·2                                        22.4k ± 1%               22.4k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·3                                        31.9k ± 1%               31.8k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·4                                        43.2k ± 0%               43.1k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·8                                        78.2k ± 0%               78.1k ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·12                                       92.3k ± 0%               92.4k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·16                                        102k ± 1%                102k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          15.0k ± 4%               15.2k ± 1%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          31.4k ± 1%               31.4k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          43.9k ± 0%               43.8k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          57.6k ± 0%               57.6k ± 0%     ~     (p=0.635 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                           100k ± 0%                100k ± 0%   -0.33%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          116k ± 0%                116k ± 0%   -0.44%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                          126k ± 0%                126k ± 0%   -0.28%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     5.06k ± 8%               4.92k ± 3%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     11.9k ± 2%               12.0k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     19.0k ± 1%               18.9k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     24.6k ± 1%               24.6k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     44.8k ± 0%               44.3k ± 1%   -1.06%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    56.3k ± 0%               55.5k ± 1%   -1.29%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    58.2k ± 0%               58.0k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              5.71k ± 8%               5.62k ± 1%     ~     (p=0.794 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              13.2k ± 3%               13.1k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              20.4k ± 1%               20.2k ± 0%   -0.96%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.1k ± 1%               26.9k ± 0%   -1.07%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              48.3k ± 0%               47.7k ± 1%   -1.13%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             60.2k ± 0%               59.7k ± 1%   -0.85%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             61.7k ± 0%               62.8k ± 0%   +1.77%  (p=0.008 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zwrk.go·1                                                347k ± 2%                349k ± 0%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·2                                                662k ± 1%                659k ± 2%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·3                                                982k ± 1%                990k ± 3%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·4                                               1.30M ± 2%               1.31M ± 1%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·8                                               2.56M ± 2%               2.52M ± 1%   -1.81%  (p=0.032 n=5+5)
      fs1-zwrk.go·12                                              2.83M ± 1%               2.81M ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                              2.82M ± 1%               2.86M ± 0%   +1.58%  (p=0.016 n=5+4)
      zeo/py/fs1-zwrk.go·1                                        4.90k ± 6%               5.39k ± 4%   +9.97%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        8.11k ± 0%               8.20k ± 1%   +1.11%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        9.07k ± 2%               8.93k ± 2%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        9.36k ± 0%               9.34k ± 4%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        10.0k ± 2%                9.9k ± 3%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       10.2k ± 2%                9.4k ±16%     ~     (p=1.000 n=4+5)
      zeo/py/fs1-zwrk.go·16                                       10.3k ± 2%               10.1k ± 4%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               3.80k ±13%               3.67k ± 4%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               5.80k ± 0%               5.82k ± 0%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               5.57k ± 8%               5.78k ± 0%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               5.80k ± 0%               5.67k ± 3%   -2.26%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               5.78k ± 2%               5.80k ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              5.77k ± 0%               5.85k ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              5.80k ± 0%               5.78k ± 3%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  2.74k ±24%               2.75k ±10%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  3.69k ± 8%               3.83k ± 5%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  3.68k ± 8%               3.99k ± 9%   +8.34%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  3.80k ±10%               4.11k ±10%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  3.94k ±12%               4.18k ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 4.04k ±12%               4.07k ± 9%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.82k ±10%               3.90k ± 8%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·1                                        13.7k ± 4%               13.7k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·2                                        28.0k ± 0%               28.0k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·3                                        40.2k ± 0%               40.3k ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·4                                        52.8k ± 0%               52.8k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·8                                        90.5k ± 0%               91.0k ± 0%   +0.61%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·12                                       95.9k ± 1%               98.3k ± 1%   +2.47%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·16                                       89.9k ± 1%              101.4k ± 3%  +12.84%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          16.2k ± 3%               16.1k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          33.0k ± 0%               32.9k ± 0%   -0.47%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          46.1k ± 1%               46.2k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          60.2k ± 0%               60.1k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          99.2k ± 1%               99.6k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          103k ± 0%                106k ± 1%   +3.11%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         97.3k ± 2%              109.6k ± 1%  +12.63%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     5.79k ± 8%               5.74k ± 3%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     13.3k ± 1%               13.4k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     20.3k ± 1%               20.4k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.4k ± 1%               26.8k ± 1%   +1.42%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     44.7k ± 0%               45.6k ± 1%   +2.04%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go·12                                    52.6k ± 0%               53.9k ± 1%   +2.38%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    48.6k ± 1%               50.5k ± 1%   +3.98%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              5.81k ±12%               5.92k ± 3%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              13.1k ± 3%               13.6k ± 0%   +3.75%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              20.5k ± 1%               20.9k ± 1%   +1.84%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.2k ± 2%               27.6k ± 0%   +1.50%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              45.3k ± 0%               46.7k ± 2%   +3.11%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             53.3k ± 1%               55.2k ± 1%   +3.56%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             49.9k ± 1%               51.5k ± 2%   +3.18%  (p=0.008 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zwrk.go·1                                              4.39µs ± 4%              4.38µs ± 2%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·2                                              4.50µs ± 1%              4.56µs ± 0%   +1.36%  (p=0.016 n=5+5)
      fs1-zwrk.go·3                                              4.55µs ± 3%              4.51µs ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·4                                              4.54µs ± 1%              4.61µs ± 1%   +1.56%  (p=0.016 n=5+5)
      fs1-zwrk.go·8                                              4.57µs ± 2%              4.56µs ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·12                                             4.80µs ± 3%              4.67µs ± 1%   -2.60%  (p=0.024 n=5+5)
      fs1-zwrk.go·16                                             5.56µs ± 1%              5.52µs ± 1%     ~     (p=0.135 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        225µs ± 6%               217µs ± 3%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        317µs ± 0%               317µs ± 2%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        435µs ± 0%               430µs ± 2%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        559µs ± 1%               563µs ± 3%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                       1.07ms ± 2%              1.08ms ± 4%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.59ms ± 1%              1.57ms ± 1%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      2.12ms ± 1%              2.09ms ± 3%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               269µs ±12%               306µs ± 6%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               358µs ± 1%               355µs ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               537µs ± 1%               539µs ± 4%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               721µs ± 1%               715µs ± 3%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.42ms ± 0%              1.42ms ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             2.15ms ± 0%              2.16ms ± 3%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.87ms ± 1%              2.84ms ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  384µs ± 5%               395µs ±11%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  518µs ±11%               514µs ± 5%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  795µs ±13%               741µs ± 3%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.04ms ± 5%              1.02ms ± 7%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.21ms ±11%              2.00ms ± 7%   -9.61%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.31ms ± 6%              2.94ms ± 3%  -11.20%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.10ms ±15%              4.04ms ±11%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                       94.0µs ± 5%              94.3µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·2                                       89.1µs ± 1%              89.4µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·3                                       94.0µs ± 1%              94.4µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·4                                       92.7µs ± 0%              92.7µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·8                                        102µs ± 0%               102µs ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·12                                       130µs ± 0%               130µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·16                                       156µs ± 1%               156µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         66.5µs ± 4%              65.9µs ± 1%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         63.6µs ± 1%              63.6µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         68.4µs ± 0%              68.5µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         69.4µs ± 0%              69.4µs ± 0%     ~     (p=0.635 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         79.8µs ± 0%              80.1µs ± 0%   +0.33%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         103µs ± 0%               104µs ± 0%   +0.45%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         127µs ± 0%               127µs ± 0%   +0.28%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     198µs ± 8%               203µs ± 3%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     169µs ± 2%               167µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     158µs ± 1%               158µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     162µs ± 1%               163µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     179µs ± 0%               181µs ± 1%   +1.07%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    213µs ± 0%               216µs ± 1%   +1.31%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    275µs ± 0%               276µs ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              175µs ± 8%               178µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              152µs ± 3%               153µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              147µs ± 1%               149µs ± 0%   +0.96%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              147µs ± 1%               149µs ± 0%   +1.08%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              166µs ± 0%               168µs ± 1%   +1.14%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             199µs ± 0%               201µs ± 1%   +0.86%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             259µs ± 0%               255µs ± 0%   -1.74%  (p=0.008 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zwrk.go·1                                              2.88µs ± 2%              2.87µs ± 0%     ~     (p=0.651 n=5+5)
      fs1-zwrk.go·2                                              3.02µs ± 1%              3.04µs ± 2%     ~     (p=0.794 n=5+5)
      fs1-zwrk.go·3                                              3.05µs ± 1%              3.03µs ± 3%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·4                                              3.08µs ± 2%              3.06µs ± 1%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·8                                              3.12µs ± 2%              3.18µs ± 1%   +1.83%  (p=0.032 n=5+5)
      fs1-zwrk.go·12                                             4.25µs ± 1%              4.26µs ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                             5.68µs ± 1%              5.59µs ± 0%   -1.57%  (p=0.016 n=5+4)
      zeo/py/fs1-zwrk.go·1                                        204µs ± 6%               186µs ± 4%   -9.09%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        247µs ± 0%               244µs ± 1%   -1.09%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        331µs ± 2%               336µs ± 2%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        427µs ± 0%               428µs ± 4%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        801µs ± 2%               806µs ± 3%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.17ms ± 2%              1.29ms ±17%     ~     (p=1.000 n=4+5)
      zeo/py/fs1-zwrk.go·16                                      1.55ms ± 2%              1.59ms ± 4%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               265µs ±12%               273µs ± 4%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               345µs ± 0%               344µs ± 0%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               540µs ± 8%               519µs ± 0%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               689µs ± 0%               705µs ± 3%   +2.35%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.38ms ± 2%              1.38ms ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             2.08ms ± 0%              2.05ms ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.76ms ± 0%              2.77ms ± 3%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  372µs ±21%               365µs ±11%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  543µs ± 8%               524µs ± 5%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  818µs ± 8%               754µs ±10%   -7.83%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.06ms ±10%              0.98ms ±11%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.05ms ±13%              1.92ms ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                2.98ms ±13%              2.95ms ± 9%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.20ms ±10%              4.12ms ± 8%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·1                                       73.3µs ± 4%              72.8µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·2                                       71.3µs ± 0%              71.5µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·3                                       74.5µs ± 0%              74.4µs ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·4                                       75.8µs ± 0%              75.8µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·8                                       88.4µs ± 0%              87.9µs ± 0%   -0.60%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·12                                       125µs ± 1%               122µs ± 1%   -2.41%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·16                                       178µs ± 1%               158µs ± 3%  -11.35%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         61.6µs ± 3%              62.0µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         60.5µs ± 0%              60.8µs ± 0%   +0.47%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         65.1µs ± 1%              64.9µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         66.5µs ± 0%              66.6µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         80.7µs ± 1%              80.3µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         116µs ± 0%               113µs ± 1%   -3.01%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         164µs ± 2%               146µs ± 1%  -11.22%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     173µs ± 8%               174µs ± 3%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     151µs ± 1%               149µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     148µs ± 1%               147µs ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     151µs ± 1%               149µs ± 1%   -1.41%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     179µs ± 0%               176µs ± 1%   -1.99%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go·12                                    228µs ± 0%               223µs ± 1%   -2.33%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    329µs ± 1%               317µs ± 1%   -3.83%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              173µs ±13%               169µs ± 3%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              153µs ± 3%               147µs ± 0%   -3.67%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              146µs ± 1%               144µs ± 1%   -1.81%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              147µs ± 2%               145µs ± 0%   -1.49%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              177µs ± 0%               171µs ± 2%   -3.01%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             225µs ± 1%               217µs ± 1%   -3.44%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             321µs ± 1%               311µs ± 2%   -3.07%  (p=0.008 n=5+5)
      20788052
    • Kirill Smelkov's avatar
      X z6001: localhost timings, Cenabled, zwrk@1s · 7f785235
      Kirill Smelkov authored
      Remeasure with the same sattings as previous z6001 localhost with C-enabled (850bfb9d):
      
      Like on neo1 the data is more or less the same and in particular timings
      for either sql backend or python client or even neo/go vs go client are noisy.
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset  20180306-z6001-ffixed-c.txt 20180308-z6001-ffixed-c-zwrk1s.txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:z6001
      pystone                                                      109k ± 9%                114k ± 1%     ~     (p=0.421 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:z6001
      crc32/py/4K                                                5.11µs ± 1%              5.10µs ± 0%     ~     (p=0.968 n=5+5)
      crc32/go/4K                                                1.72µs ± 0%              1.72µs ± 0%     ~     (p=1.000 n=4+4)
      sha1/py/4K                                                 14.7µs ± 1%              14.6µs ± 0%   -0.55%  (p=0.032 n=5+5)
      sha1/go/4K                                                 10.3µs ± 0%              10.3µs ± 0%     ~     (p=0.103 n=5+5)
      unzlib/py/wczdata                                          37.1µs ± 8%              36.2µs ± 1%     ~     (p=0.421 n=5+5)
      unzlib/go/wczdata                                          31.5µs ± 0%              31.5µs ± 0%     ~     (p=0.889 n=5+5)
      unzlib/py/prod1-avg                                        18.5µs ± 3%              18.2µs ± 1%     ~     (p=0.222 n=5+5)
      unzlib/go/prod1-avg                                        10.0µs ± 1%              10.0µs ± 2%     ~     (p=0.690 n=5+5)
      disk/randread/direct/4K-min                                 126µs ± 1%               129µs ± 4%   +2.33%  (p=0.048 n=4+5)
      disk/randread/direct/4K-avg                                 199µs ± 9%               201µs ± 7%     ~     (p=1.000 n=5+5)
      disk/randread/pagecache/4K-min                              806ns ± 3%               793ns ± 2%     ~     (p=0.310 n=5+5)
      disk/randread/pagecache/4K-avg                             1.44µs ± 7%              1.41µs ± 4%     ~     (p=0.635 n=5+5)
      
      name                                           old time/object          new time/object          delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zhash.py                                               37.6µs ± 2%              37.5µs ± 1%     ~     (p=0.738 n=5+5)
      fs1-zhash.go                                               6.00µs ± 2%              5.90µs ± 0%   -1.67%  (p=0.048 n=5+5)
      fs1-zhash.go+prefetch128                                   8.00µs ± 5%              8.10µs ± 5%     ~     (p=0.659 n=5+5)
      zeo/py/fs1-zhash.py                                         650µs ± 7%               661µs ± 8%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zhash.go                                         274µs ±13%               267µs ± 8%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                             101µs ± 2%               102µs ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                696µs ± 1%               692µs ± 4%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                338µs ± 7%               309µs ±15%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    177µs ± 1%               176µs ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zhash.py                                  1.00ms ±38%              0.99ms ±31%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zhash.go                                   434µs ± 6%               377µs ±16%  -13.15%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       277µs ± 9%               268µs ±12%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zhash.py                                         526µs ± 8%               482µs ±20%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zhash.go                                         102µs ± 8%               102µs ± 9%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            36.6µs ± 4%              37.2µs ± 2%     ~     (p=0.238 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          76.4µs ± 5%              73.1µs ±12%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              26.5µs ± 2%              26.9µs ± 7%     ~     (p=0.730 n=5+5)
      neo/go/sqlite-zhash.py                                      528µs ±15%               525µs ±10%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zhash.go                                      204µs ±22%               193µs ±16%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         39.9µs ± 4%              39.6µs ± 4%     ~     (p=0.817 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               194µs ± 9%               195µs ±25%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  38.2µs ± 7%              36.7µs ± 3%     ~     (p=0.151 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zhash.py                                               30.3µs ± 1%              30.3µs ± 2%     ~     (p=1.000 n=5+5)
      fs1-zhash.go                                               4.62µs ± 3%              4.56µs ± 1%     ~     (p=0.397 n=5+5)
      fs1-zhash.go+prefetch128                                   5.76µs ± 8%              5.96µs ± 9%     ~     (p=0.413 n=5+5)
      zeo/py/fs1-zhash.py                                         632µs ±15%               615µs ±13%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zhash.go                                         235µs ± 7%               235µs ± 6%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            87.2µs ± 1%              87.6µs ± 1%     ~     (p=0.270 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                664µs ± 2%               658µs ± 5%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                269µs ± 7%               256µs ± 8%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    162µs ± 0%               161µs ± 0%   -0.74%  (p=0.016 n=4+5)
      neo/py(!log)/sql-zhash.py                                  1.03ms ±29%              1.02ms ±33%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zhash.go                                   406µs ± 2%               385µs ± 8%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       268µs ± 5%               263µs ±11%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zhash.py                                         520µs ± 9%               461µs ±16%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zhash.go                                        83.2µs ± 7%              82.9µs ± 5%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            24.0µs ± 5%              23.9µs ± 3%     ~     (p=0.968 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          67.0µs ± 3%              69.7µs ±11%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              21.2µs ± 4%              21.0µs ± 2%     ~     (p=0.619 n=5+5)
      neo/go/sqlite-zhash.py                                      539µs ±11%               541µs ± 9%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zhash.go                                      196µs ± 9%               181µs ±13%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         35.0µs ± 3%              35.5µs ± 2%     ~     (p=0.238 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               168µs ± 8%               162µs ±14%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  35.1µs ± 4%              35.3µs ± 1%     ~     (p=0.500 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zwrk.go·1                                                230k ± 1%                228k ± 3%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·2                                                437k ± 5%                444k ± 1%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·3                                                663k ± 4%                660k ± 3%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·4                                                880k ± 1%                882k ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·8                                               1.75M ± 2%               1.75M ± 2%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·12                                              2.56M ± 0%               2.50M ± 3%   -2.26%  (p=0.016 n=4+5)
      fs1-zwrk.go·16                                              2.89M ± 1%               2.88M ± 1%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        4.30k ± 8%               4.44k ± 6%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        6.33k ± 0%               6.32k ± 0%     ~     (p=0.063 n=4+5)
      zeo/py/fs1-zwrk.go·3                                        6.90k ± 0%               6.89k ± 0%     ~     (p=0.365 n=4+5)
      zeo/py/fs1-zwrk.go·4                                        7.14k ± 1%               7.15k ± 1%     ~     (p=1.000 n=4+5)
      zeo/py/fs1-zwrk.go·8                                        7.53k ± 2%               7.46k ± 2%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       7.65k ± 0%               7.55k ± 1%     ~     (p=0.063 n=4+5)
      zeo/py/fs1-zwrk.go·16                                       7.57k ± 0%               7.55k ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               3.50k ±15%               3.74k ±12%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               5.58k ± 0%               5.59k ± 1%     ~     (p=1.000 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·3                               5.63k ± 2%               5.58k ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               5.56k ± 1%               5.54k ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               5.61k ± 2%               5.65k ± 0%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              5.62k ± 1%               5.59k ± 0%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              5.62k ± 1%               5.58k ± 1%     ~     (p=0.413 n=4+5)
      neo/py(!log)/sql-zwrk.go·1                                  2.53k ±17%               2.61k ± 5%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  3.57k ± 9%               3.88k ±11%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  3.65k ±14%               3.80k ±12%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  3.56k ±16%               3.85k ± 5%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  3.78k ±12%               3.64k ±12%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 3.73k ±13%               3.62k ± 6%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.47k ± 9%               3.92k ±13%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·1                                        10.7k ± 5%               10.6k ± 5%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·2                                        22.3k ± 1%               22.4k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·3                                        31.7k ± 1%               31.9k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·4                                        43.2k ± 1%               43.2k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·8                                        78.3k ± 0%               78.2k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·12                                       92.5k ± 0%               92.3k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·16                                        103k ± 1%                102k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          15.0k ± 5%               15.0k ± 4%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          31.5k ± 1%               31.4k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          43.8k ± 0%               43.9k ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          57.4k ± 0%               57.6k ± 0%     ~     (p=0.087 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                           100k ± 0%                100k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          116k ± 0%                116k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                          126k ± 1%                126k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     4.85k ±15%               5.06k ± 8%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     12.0k ± 2%               11.9k ± 2%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     19.0k ± 1%               19.0k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     24.7k ± 0%               24.6k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     44.8k ± 0%               44.8k ± 0%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    56.3k ± 0%               56.3k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    58.0k ± 0%               58.2k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              5.41k ± 4%               5.71k ± 8%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              12.8k ± 1%               13.2k ± 3%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              20.2k ± 1%               20.4k ± 1%   +1.19%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              26.8k ± 1%               27.1k ± 1%   +1.11%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              48.1k ± 1%               48.3k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             60.3k ± 0%               60.2k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             61.7k ± 1%               61.7k ± 0%     ~     (p=0.548 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zwrk.go·1                                                347k ± 2%                347k ± 2%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·2                                                660k ± 3%                662k ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·3                                                985k ± 4%                982k ± 1%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·4                                               1.31M ± 2%               1.30M ± 2%     ~     (p=0.151 n=5+5)
      fs1-zwrk.go·8                                               2.55M ± 4%               2.56M ± 2%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·12                                              2.81M ± 1%               2.83M ± 1%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·16                                              2.85M ± 2%               2.82M ± 1%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        4.80k ± 5%               4.90k ± 6%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        8.18k ± 1%               8.11k ± 0%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        8.96k ± 1%               9.07k ± 2%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        8.88k ± 9%               9.36k ± 0%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        10.0k ± 2%               10.0k ± 2%     ~     (p=0.286 n=4+5)
      zeo/py/fs1-zwrk.go·12                                       9.80k ± 6%              10.22k ± 2%     ~     (p=0.063 n=5+4)
      zeo/py/fs1-zwrk.go·16                                       10.1k ± 6%               10.3k ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               3.70k ± 6%               3.80k ±13%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               5.77k ± 0%               5.80k ± 0%   +0.52%  (p=0.016 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·3                               5.77k ± 0%               5.57k ± 8%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               5.77k ± 0%               5.80k ± 0%   +0.67%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               5.84k ± 1%               5.78k ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              5.78k ± 2%               5.77k ± 0%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              5.80k ± 1%               5.80k ± 0%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  2.51k ±12%               2.74k ±24%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  3.62k ± 8%               3.69k ± 8%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  3.86k ±11%               3.68k ± 8%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  3.82k ±11%               3.80k ±10%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  3.89k ±10%               3.94k ±12%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 3.98k ± 7%               4.04k ±12%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.72k ±13%               3.82k ±10%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·1                                        13.8k ± 3%               13.7k ± 4%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·2                                        28.1k ± 0%               28.0k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·3                                        40.2k ± 0%               40.2k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·4                                        52.8k ± 1%               52.8k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·8                                        90.6k ± 0%               90.5k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·12                                       95.8k ± 1%               95.9k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       90.9k ± 1%               89.9k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          16.2k ± 2%               16.2k ± 3%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          32.9k ± 1%               33.0k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          46.2k ± 0%               46.1k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          59.8k ± 1%               60.2k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          98.1k ± 0%               99.2k ± 1%   +1.06%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          102k ± 1%                103k ± 0%   +1.27%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         97.0k ± 2%               97.3k ± 2%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     5.67k ± 8%               5.79k ± 8%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     13.3k ± 2%               13.3k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     20.3k ± 1%               20.3k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.5k ± 0%               26.4k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     44.5k ± 1%               44.7k ± 0%     ~     (p=0.111 n=5+4)
      neo/go/sqlite-zwrk.go·12                                    52.3k ± 1%               52.6k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    48.9k ± 1%               48.6k ± 1%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              5.69k ± 4%               5.81k ±12%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              13.2k ± 3%               13.1k ± 3%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              20.5k ± 1%               20.5k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.1k ± 2%               27.2k ± 2%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              45.4k ± 1%               45.3k ± 0%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             53.3k ± 1%               53.3k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             49.8k ± 1%               49.9k ± 1%     ~     (p=0.690 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zwrk.go·1                                              4.34µs ± 1%              4.39µs ± 4%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·2                                              4.58µs ± 5%              4.50µs ± 1%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·3                                              4.52µs ± 4%              4.55µs ± 3%     ~     (p=0.444 n=5+5)
      fs1-zwrk.go·4                                              4.55µs ± 1%              4.54µs ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·8                                              4.58µs ± 2%              4.57µs ± 2%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·12                                             4.69µs ± 0%              4.80µs ± 3%   +2.35%  (p=0.016 n=4+5)
      fs1-zwrk.go·16                                             5.53µs ± 1%              5.56µs ± 1%     ~     (p=0.214 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        233µs ± 8%               225µs ± 6%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        315µs ± 2%               317µs ± 0%   +0.55%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        435µs ± 0%               435µs ± 0%     ~     (p=0.413 n=4+5)
      zeo/py/fs1-zwrk.go·4                                        560µs ± 1%               559µs ± 1%     ~     (p=1.000 n=4+5)
      zeo/py/fs1-zwrk.go·8                                       1.06ms ± 2%              1.07ms ± 2%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.57ms ± 0%              1.59ms ± 1%     ~     (p=0.063 n=4+5)
      zeo/py/fs1-zwrk.go·16                                      2.11ms ± 0%              2.12ms ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               288µs ±14%               269µs ±12%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               358µs ± 0%               358µs ± 1%     ~     (p=1.000 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·3                               533µs ± 2%               537µs ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               720µs ± 1%               721µs ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.43ms ± 2%              1.42ms ± 0%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             2.14ms ± 1%              2.15ms ± 0%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.85ms ± 1%              2.87ms ± 1%     ~     (p=0.413 n=4+5)
      neo/py(!log)/sql-zwrk.go·1                                  400µs ±16%               384µs ± 5%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  562µs ± 8%               518µs ±11%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  827µs ±13%               795µs ±13%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.13ms ±14%              1.04ms ± 5%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.13ms ±13%              2.21ms ±11%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.24ms ±12%              3.31ms ± 6%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.62ms ± 8%              4.10ms ±15%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·1                                       93.9µs ± 4%              94.0µs ± 5%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·2                                       89.6µs ± 1%              89.1µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·3                                       94.6µs ± 1%              94.0µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·4                                       92.6µs ± 1%              92.7µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·8                                        102µs ± 0%               102µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·12                                       130µs ± 0%               130µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·16                                       156µs ± 1%               156µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         66.8µs ± 5%              66.5µs ± 4%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         63.5µs ± 1%              63.6µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         68.5µs ± 0%              68.4µs ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         69.7µs ± 0%              69.4µs ± 0%     ~     (p=0.087 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         79.7µs ± 0%              79.8µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         103µs ± 0%               103µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         127µs ± 1%               127µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     208µs ±14%               198µs ± 8%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     166µs ± 2%               169µs ± 2%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     158µs ± 1%               158µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     162µs ± 0%               162µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     178µs ± 0%               179µs ± 0%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    213µs ± 0%               213µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    276µs ± 0%               275µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              185µs ± 4%               175µs ± 8%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              156µs ± 1%               152µs ± 3%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              149µs ± 1%               147µs ± 1%   -1.17%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              149µs ± 1%               147µs ± 1%   -1.10%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              166µs ± 1%               166µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             199µs ± 0%               199µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             259µs ± 1%               259µs ± 0%     ~     (p=0.548 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zwrk.go·1                                              2.88µs ± 2%              2.88µs ± 2%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·2                                              3.03µs ± 3%              3.02µs ± 1%     ~     (p=0.952 n=5+5)
      fs1-zwrk.go·3                                              3.05µs ± 4%              3.05µs ± 1%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·4                                              3.05µs ± 2%              3.08µs ± 2%     ~     (p=0.167 n=5+5)
      fs1-zwrk.go·8                                              3.14µs ± 4%              3.12µs ± 2%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·12                                             4.28µs ± 1%              4.25µs ± 1%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·16                                             5.63µs ± 2%              5.68µs ± 1%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        208µs ± 5%               204µs ± 6%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        245µs ± 1%               247µs ± 0%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        335µs ± 1%               331µs ± 2%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        453µs ±10%               427µs ± 0%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        803µs ± 2%               801µs ± 2%     ~     (p=0.286 n=4+5)
      zeo/py/fs1-zwrk.go·12                                      1.23ms ± 6%              1.17ms ± 2%     ~     (p=0.063 n=5+4)
      zeo/py/fs1-zwrk.go·16                                      1.59ms ± 6%              1.55ms ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               271µs ± 7%               265µs ±12%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               346µs ± 0%               345µs ± 0%   -0.51%  (p=0.016 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·3                               520µs ± 0%               540µs ± 8%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               694µs ± 0%               689µs ± 0%   -0.67%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.37ms ± 1%              1.38ms ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             2.07ms ± 2%              2.08ms ± 0%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.76ms ± 1%              2.76ms ± 0%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  400µs ±11%               372µs ±21%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  554µs ± 7%               543µs ± 8%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  783µs ±11%               818µs ± 8%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.06ms ±11%              1.06ms ±10%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.07ms ± 9%              2.05ms ±13%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.02ms ± 7%              2.98ms ±13%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.32ms ±12%              4.20ms ±10%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·1                                       72.6µs ± 3%              73.3µs ± 4%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·2                                       71.2µs ± 0%              71.3µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·3                                       74.6µs ± 0%              74.5µs ± 0%     ~     (p=0.881 n=5+5)
      neo/go/fs1-zwrk.go·4                                       75.7µs ± 1%              75.8µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·8                                       88.3µs ± 0%              88.4µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·12                                       125µs ± 1%               125µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       176µs ± 1%               178µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         61.7µs ± 2%              61.6µs ± 3%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         60.7µs ± 1%              60.5µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         64.9µs ± 0%              65.1µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         66.9µs ± 1%              66.5µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         81.5µs ± 0%              80.7µs ± 1%   -1.05%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         118µs ± 1%               116µs ± 0%   -1.26%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         165µs ± 2%               164µs ± 2%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     177µs ± 8%               173µs ± 8%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     151µs ± 2%               151µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     148µs ± 1%               148µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     151µs ± 0%               151µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     180µs ± 1%               179µs ± 0%     ~     (p=0.111 n=5+4)
      neo/go/sqlite-zwrk.go·12                                    229µs ± 1%               228µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    327µs ± 1%               329µs ± 1%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              176µs ± 4%               173µs ±13%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              152µs ± 3%               153µs ± 3%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              147µs ± 1%               146µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              148µs ± 2%               147µs ± 2%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              176µs ± 1%               177µs ± 0%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             225µs ± 1%               225µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             321µs ± 1%               321µs ± 1%     ~     (p=0.690 n=5+5)
      7f785235
    • Kirill Smelkov's avatar
      X neo1: localhost timings, C > C1 disabled, zwrk@1s · 23f8d82e
      Kirill Smelkov authored
      Comparing to Cenalbled run, even when there each zwrk was run for 10s,
      similarly to previous measure with Cstates disabled (f40c8b4b) it shows
      clear improvement:
      
      ---- 8< ----
      cluster:neo1 dataset:wczblk1-8
      zeo/py/fs1-zwrk.go·1                                        195µs ± 1%               172µs ± 1%  -11.98%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               230µs ± 1%               191µs ± 2%  -16.86%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  305µs ± 7%               244µs ± 6%  -19.90%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  491µs ± 2%               412µs ± 3%  -15.94%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  740µs ± 2%               625µs ± 4%  -15.61%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  976µs ± 2%               837µs ± 1%  -14.28%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.98ms ± 2%              1.69ms ± 7%  -14.60%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                2.98ms ± 2%              2.57ms ± 6%  -13.56%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.03ms ± 3%              3.42ms ± 9%  -14.95%  (p=0.008 n=5+5)
      
      cluster:neo1 dataset:prod1-1024
      zeo/py/fs1-zwrk.go·1                                        170µs ± 1%               146µs ± 1%  -13.66%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               209µs ± 3%               180µs ± 3%  -14.26%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  294µs ± 4%               230µs ± 2%  -21.61%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  483µs ± 2%               405µs ± 4%  -16.22%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  728µs ± 1%               640µs ± 5%  -11.98%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  978µs ± 3%               837µs ± 4%  -14.42%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.92ms ± 2%              1.63ms ± 1%  -15.10%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                2.94ms ± 2%              2.52ms ± 3%  -14.18%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                3.87ms ± 3%              3.27ms ± 3%  -15.56%  (p=0.008 n=5+5)
      ---- 8< ----
      
      not to mention that zhash.{py,go}, for which runtime was not changed,
      are also improved like it was in f40c8b4b, thus confirming timings from
      there:
      
      ---- 8< ----
      cluster:neo1 dataset:wczblk1-8
      zeo/py/fs1-zhash.py                                         516µs ± 8%               459µs ± 0%  -11.00%  (p=0.016 n=5+4)
      zeo/py/fs1-zhash.go                                         200µs ± 4%               174µs ± 2%  -12.99%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                692µs ± 5%               390µs ± 1%  -43.67%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                230µs ± 4%               196µs ± 2%  -14.72%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                   938µs ±50%               459µs ± 1%  -51.03%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zhash.go                                   310µs ±10%               249µs ± 3%  -19.61%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       244µs ± 8%               217µs ± 1%  -10.95%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.py                                         368µs ±27%               274µs ± 1%  -25.36%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.py                                      406µs ± 8%               322µs ± 1%  -20.74%  (p=0.008 n=5+5)
      
      cluster:neo1 dataset:prod1-1024
      zeo/py/fs1-zhash.py                                         499µs ± 2%               436µs ± 2%  -12.61%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go                                         171µs ± 4%               150µs ± 2%  -12.19%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                678µs ± 3%               387µs ± 5%  -42.91%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                211µs ± 6%               185µs ± 4%  -12.53%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                   922µs ±53%               477µs ±40%  -48.31%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go                                   289µs ± 5%               236µs ± 2%  -18.35%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       228µs ± 4%               202µs ± 2%  -11.68%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.py                                         359µs ±15%               267µs ±11%  -25.72%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.py                                      396µs ± 4%               312µs ± 1%  -21.16%  (p=0.008 n=5+5)
      ---- 8< ----
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset  20180308-neo1-ffixed-c-zwrk10s.txt 20180308-neo1-ffixed-noc_C1\(3µs\)-zwrk1s.txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:neo1
      pystone                                                      106k ± 1%                105k ± 0%   -1.36%  (p=0.008 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:neo1
      crc32/py/4K                                                5.16µs ± 1%              5.15µs ± 1%     ~     (p=0.690 n=5+5)
      crc32/go/4K                                                2.79µs ± 0%              2.79µs ± 0%   -0.12%  (p=0.029 n=4+4)
      sha1/py/4K                                                 13.5µs ± 1%              13.5µs ± 3%     ~     (p=0.421 n=5+5)
      sha1/go/4K                                                 9.82µs ± 0%              9.81µs ± 0%     ~     (p=0.516 n=5+5)
      unzlib/py/wczdata                                          36.1µs ± 1%              35.5µs ± 7%     ~     (p=0.690 n=5+5)
      unzlib/go/wczdata                                          31.3µs ± 0%              30.9µs ± 1%   -1.22%  (p=0.008 n=5+5)
      unzlib/py/prod1-avg                                        16.4µs ± 1%              16.0µs ± 2%     ~     (p=0.095 n=5+5)
      unzlib/go/prod1-avg                                        9.41µs ± 1%              9.26µs ± 1%   -1.58%  (p=0.008 n=5+5)
      disk/randread/direct/4K-min                                 162µs ± 0%               158µs ± 2%   -1.99%  (p=0.008 n=5+5)
      disk/randread/direct/4K-avg                                 187µs ± 0%               172µs ± 0%   -7.92%  (p=0.008 n=5+5)
      disk/randread/pagecache/4K-min                              386ns ± 1%               392ns ± 2%     ~     (p=0.190 n=4+5)
      disk/randread/pagecache/4K-avg                              804ns ± 0%               904ns ± 1%  +12.46%  (p=0.016 n=4+5)
      
      name                                           old time/object          new time/object          delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zhash.py                                               34.9µs ± 1%              34.7µs ± 2%     ~     (p=0.476 n=5+5)
      fs1-zhash.go                                               6.00µs ± 0%              5.90µs ± 0%   -1.67%  (p=0.029 n=4+4)
      fs1-zhash.go+prefetch128                                   6.58µs ± 2%              6.32µs ± 3%   -3.95%  (p=0.032 n=5+5)
      zeo/py/fs1-zhash.py                                         516µs ± 8%               459µs ± 0%  -11.00%  (p=0.016 n=5+4)
      zeo/py/fs1-zhash.go                                         200µs ± 4%               174µs ± 2%  -12.99%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            98.5µs ± 2%              98.5µs ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                692µs ± 5%               390µs ± 1%  -43.67%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                230µs ± 4%               196µs ± 2%  -14.72%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    165µs ± 3%               164µs ± 2%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zhash.py                                   938µs ±50%               459µs ± 1%  -51.03%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zhash.go                                   310µs ±10%               249µs ± 3%  -19.61%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       244µs ± 8%               217µs ± 1%  -10.95%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.py                                         368µs ±27%               274µs ± 1%  -25.36%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go                                        80.2µs ± 2%              80.4µs ± 4%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            34.8µs ± 5%              35.3µs ± 6%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          56.7µs ± 3%              56.5µs ± 2%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              22.7µs ± 3%              23.2µs ± 7%     ~     (p=0.413 n=5+5)
      neo/go/sqlite-zhash.py                                      406µs ± 8%               322µs ± 1%  -20.74%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      125µs ± 2%               134µs ±12%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         47.9µs ± 5%              49.4µs ± 9%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               115µs ± 1%               114µs ± 2%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  47.2µs ±13%              46.3µs ± 5%     ~     (p=0.841 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zhash.py                                               29.1µs ± 2%              29.3µs ± 0%     ~     (p=0.413 n=5+5)
      fs1-zhash.go                                               3.74µs ± 2%              3.80µs ± 0%     ~     (p=0.238 n=5+4)
      fs1-zhash.go+prefetch128                                   3.88µs ± 3%              3.78µs ± 3%     ~     (p=0.190 n=5+5)
      zeo/py/fs1-zhash.py                                         499µs ± 2%               436µs ± 2%  -12.61%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go                                         171µs ± 4%               150µs ± 2%  -12.19%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            87.9µs ± 1%              88.0µs ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                678µs ± 3%               387µs ± 5%  -42.91%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                211µs ± 6%               185µs ± 4%  -12.53%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    150µs ± 1%               150µs ± 2%     ~     (p=0.881 n=5+5)
      neo/py(!log)/sql-zhash.py                                   922µs ±53%               477µs ±40%  -48.31%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go                                   289µs ± 5%               236µs ± 2%  -18.35%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       228µs ± 4%               202µs ± 2%  -11.68%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.py                                         359µs ±15%               267µs ±11%  -25.72%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go                                        62.1µs ± 0%              60.8µs ± 2%   -2.12%  (p=0.024 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            22.5µs ± 1%              22.2µs ± 1%     ~     (p=0.087 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          51.4µs ± 4%              52.7µs ± 3%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              18.6µs ± 3%              18.4µs ± 5%     ~     (p=0.683 n=5+5)
      neo/go/sqlite-zhash.py                                      396µs ± 4%               312µs ± 1%  -21.16%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      114µs ± 1%               112µs ± 1%   -1.48%  (p=0.016 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         41.5µs ± 6%              41.2µs ± 7%     ~     (p=0.802 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               109µs ± 1%               107µs ± 2%   -1.58%  (p=0.016 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  41.4µs ± 3%              41.5µs ± 4%     ~     (p=0.984 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zwrk.go·1                                                229k ± 1%                230k ± 0%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·2                                                446k ± 1%                425k ± 7%   -4.73%  (p=0.008 n=5+5)
      fs1-zwrk.go·3                                                665k ± 1%                660k ± 1%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·4                                                868k ± 1%                869k ± 1%     ~     (p=0.730 n=5+4)
      fs1-zwrk.go·8                                                988k ± 1%                996k ± 0%   +0.76%  (p=0.016 n=5+5)
      fs1-zwrk.go·12                                              1.01M ± 1%               1.01M ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                              1.01M ± 1%               1.02M ± 0%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        5.13k ± 1%               5.83k ± 1%  +13.62%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        6.93k ± 1%               7.21k ± 1%   +4.08%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        7.54k ± 1%               7.80k ± 3%   +3.49%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        7.75k ± 1%               8.01k ± 1%   +3.29%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        8.09k ± 0%               8.46k ± 1%   +4.57%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       8.46k ± 0%               8.52k ± 2%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       8.52k ± 0%               8.51k ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               4.35k ± 1%               5.23k ± 2%  +20.31%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               6.33k ± 2%               6.30k ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               6.22k ± 4%               6.33k ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               6.25k ± 1%               6.30k ± 3%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               6.25k ± 2%               6.27k ± 3%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              6.26k ± 2%               6.36k ± 2%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              6.24k ± 1%               6.33k ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  3.29k ± 7%               4.10k ± 5%  +24.73%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  4.08k ± 2%               4.85k ± 2%  +18.97%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  4.05k ± 2%               4.80k ± 4%  +18.54%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  4.10k ± 2%               4.78k ± 1%  +16.65%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  4.04k ± 2%               4.73k ± 7%  +17.24%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 4.03k ± 2%               4.67k ± 6%  +15.80%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.97k ± 3%               4.68k ± 9%  +17.82%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                        12.9k ± 0%               13.0k ± 1%   +1.38%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                        24.8k ± 1%               25.0k ± 1%   +1.00%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                        32.3k ± 1%               32.4k ± 0%   +0.51%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·4                                        40.7k ± 1%               40.9k ± 0%     ~     (p=0.087 n=5+5)
      neo/go/fs1-zwrk.go·8                                        54.5k ± 1%               54.8k ± 1%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·12                                       57.2k ± 1%               57.4k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       58.3k ± 1%               55.8k ± 1%   -4.22%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          19.1k ± 1%               19.3k ± 1%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          37.7k ± 1%               38.0k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          47.7k ± 1%               48.2k ± 0%   +1.00%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          58.6k ± 1%               59.3k ± 0%   +1.29%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          77.6k ± 1%               78.4k ± 0%   +1.04%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         83.1k ± 1%               82.7k ± 1%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         84.9k ± 2%               81.3k ± 2%   -4.30%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     8.06k ± 0%               8.23k ± 1%   +2.09%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     14.7k ± 1%               15.0k ± 0%   +1.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     20.3k ± 1%               20.7k ± 0%   +1.91%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     24.1k ± 1%               24.9k ± 0%   +3.24%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     30.4k ± 1%               30.9k ± 8%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    30.8k ± 3%               31.3k ± 1%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    30.1k ± 2%               30.6k ± 3%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              8.84k ± 0%               9.08k ± 0%   +2.62%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              16.1k ± 1%               16.4k ± 0%   +2.16%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              22.1k ± 1%               22.7k ± 0%   +2.80%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go(!sha1)·4                              26.8k ± 1%               27.8k ± 0%   +3.66%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              33.1k ± 2%               34.6k ± 1%   +4.43%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             32.9k ± 2%               33.5k ± 1%   +1.90%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             32.1k ± 2%               32.8k ± 2%     ~     (p=0.095 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zwrk.go·1                                                453k ± 0%                454k ± 0%     ~     (p=0.063 n=5+4)
      fs1-zwrk.go·2                                                891k ± 0%                869k ± 6%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·3                                               1.32M ± 3%               1.33M ± 1%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·4                                               1.77M ± 1%               1.73M ± 2%     ~     (p=0.222 n=5+5)
      fs1-zwrk.go·8                                               2.00M ± 2%               1.99M ± 2%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·12                                              2.04M ± 0%               2.03M ± 0%   -0.47%  (p=0.029 n=4+4)
      fs1-zwrk.go·16                                              2.03M ± 2%               2.04M ± 0%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        5.90k ± 1%               6.83k ± 1%  +15.81%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        8.50k ± 0%               8.72k ± 3%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        9.32k ± 1%               9.26k ± 6%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        9.70k ± 1%               9.78k ± 3%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        10.2k ± 2%               10.4k ± 1%   +2.11%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       10.4k ± 0%               10.6k ± 1%   +1.42%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       10.5k ± 1%               10.5k ± 5%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               4.78k ± 3%               5.57k ± 3%  +16.64%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               6.42k ± 2%               6.51k ± 1%   +1.40%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               6.40k ± 2%               6.39k ± 6%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               6.40k ± 1%               6.43k ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               6.39k ± 1%               6.33k ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              6.44k ± 1%               6.30k ± 3%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              6.38k ± 1%               6.37k ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  3.41k ± 4%               4.34k ± 2%  +27.52%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  4.14k ± 2%               4.94k ± 4%  +19.38%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  4.12k ± 1%               4.69k ± 5%  +13.72%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  4.09k ± 3%               4.78k ± 4%  +16.85%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  4.18k ± 2%               4.92k ± 1%  +17.77%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 4.09k ± 2%               4.76k ± 3%  +16.56%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 4.14k ± 3%               4.90k ± 3%  +18.44%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                        17.2k ± 1%               17.4k ± 1%   +1.23%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·2                                        32.5k ± 1%               32.9k ± 1%   +1.14%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                        43.0k ± 1%               43.5k ± 0%   +0.98%  (p=0.016 n=5+4)
      neo/go/fs1-zwrk.go·4                                        52.7k ± 1%               53.2k ± 0%   +0.94%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        67.3k ± 1%               67.0k ± 2%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·12                                       64.9k ± 2%               62.6k ± 3%   -3.51%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·16                                       57.3k ± 4%               54.3k ±11%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          20.3k ± 2%               20.2k ± 5%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          40.4k ± 1%               40.8k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          51.5k ± 1%               51.9k ± 1%   +0.79%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          62.0k ± 1%               62.7k ± 0%   +1.15%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          77.1k ± 2%               75.1k ± 4%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         75.3k ± 3%               69.5k ± 1%   -7.81%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         63.9k ± 2%               61.0k ± 2%   -4.52%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     8.99k ± 0%               9.16k ± 1%   +1.81%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     15.8k ± 1%               16.0k ± 0%   +1.04%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     21.5k ± 1%               22.1k ± 0%   +2.67%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     25.7k ± 1%               26.7k ± 0%   +4.05%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     28.7k ± 2%               30.9k ± 2%   +7.45%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    27.3k ± 3%               29.5k ± 1%   +8.03%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    27.1k ± 2%               29.6k ± 2%   +9.24%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              9.31k ± 0%               9.51k ± 1%   +2.23%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              16.3k ± 0%               16.5k ± 0%   +0.90%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              22.3k ± 1%               22.7k ± 0%   +1.41%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              26.8k ± 1%               27.4k ± 1%   +2.07%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              30.1k ± 0%               31.2k ± 2%   +3.80%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             28.4k ± 2%               29.5k ± 2%   +3.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             27.9k ± 3%               28.8k ±10%     ~     (p=0.151 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zwrk.go·1                                              4.37µs ± 1%              4.36µs ± 0%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·2                                              4.48µs ± 1%              4.71µs ± 8%   +5.18%  (p=0.008 n=5+5)
      fs1-zwrk.go·3                                              4.51µs ± 1%              4.55µs ± 1%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·4                                              4.61µs ± 1%              4.60µs ± 1%     ~     (p=0.603 n=5+4)
      fs1-zwrk.go·8                                              8.10µs ± 1%              8.03µs ± 0%   -0.75%  (p=0.016 n=5+5)
      fs1-zwrk.go·12                                             11.9µs ± 1%              11.8µs ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                             15.8µs ± 1%              15.7µs ± 0%     ~     (p=0.206 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        195µs ± 1%               172µs ± 1%  -11.98%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        289µs ± 1%               277µs ± 1%   -3.92%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        398µs ± 1%               384µs ± 3%   -3.36%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        516µs ± 1%               500µs ± 1%   -3.18%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        989µs ± 0%               946µs ± 1%   -4.37%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.42ms ± 0%              1.41ms ± 2%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.88ms ± 0%              1.88ms ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               230µs ± 1%               191µs ± 2%  -16.86%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               316µs ± 2%               317µs ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               483µs ± 4%               474µs ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               640µs ± 1%               635µs ± 3%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.28ms ± 2%              1.28ms ± 3%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.92ms ± 2%              1.89ms ± 2%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.57ms ± 1%              2.53ms ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  305µs ± 7%               244µs ± 6%  -19.90%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  491µs ± 2%               412µs ± 3%  -15.94%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  740µs ± 2%               625µs ± 4%  -15.61%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  976µs ± 2%               837µs ± 1%  -14.28%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.98ms ± 2%              1.69ms ± 7%  -14.60%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                2.98ms ± 2%              2.57ms ± 6%  -13.56%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.03ms ± 3%              3.42ms ± 9%  -14.95%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                       77.8µs ± 0%              76.7µs ± 1%   -1.36%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                       80.7µs ± 1%              79.9µs ± 1%   -0.99%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                       93.0µs ± 1%              92.5µs ± 0%   -0.51%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·4                                       98.4µs ± 1%              97.9µs ± 0%     ~     (p=0.087 n=5+5)
      neo/go/fs1-zwrk.go·8                                        147µs ± 1%               146µs ± 1%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·12                                       210µs ± 1%               209µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       274µs ± 1%               287µs ± 1%   +4.40%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         52.3µs ± 1%              51.9µs ± 2%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         53.1µs ± 1%              52.7µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         62.8µs ± 1%              62.2µs ± 0%   -0.99%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         68.3µs ± 1%              67.4µs ± 0%   -1.27%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          103µs ± 1%               102µs ± 0%   -1.03%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         144µs ± 1%               145µs ± 1%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         188µs ± 2%               197µs ± 2%   +4.49%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     124µs ± 0%               122µs ± 1%   -2.04%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     136µs ± 1%               134µs ± 0%   -1.75%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     148µs ± 1%               145µs ± 0%   -1.87%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     166µs ± 1%               161µs ± 0%   -3.14%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     263µs ± 1%               260µs ± 9%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    390µs ± 3%               383µs ± 1%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    532µs ± 2%               524µs ± 3%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              113µs ± 0%               110µs ± 0%   -2.56%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              125µs ± 1%               122µs ± 0%   -2.11%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              136µs ± 1%               132µs ± 0%   -2.73%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go(!sha1)·4                              149µs ± 1%               144µs ± 0%   -3.53%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              242µs ± 2%               231µs ± 1%   -4.25%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             365µs ± 2%               358µs ± 1%   -1.87%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             499µs ± 2%               487µs ± 2%     ~     (p=0.095 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zwrk.go·1                                              2.21µs ± 0%              2.20µs ± 0%     ~     (p=0.063 n=5+4)
      fs1-zwrk.go·2                                              2.24µs ± 0%              2.31µs ± 6%     ~     (p=0.635 n=5+5)
      fs1-zwrk.go·3                                              2.27µs ± 3%              2.25µs ± 1%     ~     (p=0.476 n=5+5)
      fs1-zwrk.go·4                                              2.27µs ± 1%              2.31µs ± 2%     ~     (p=0.167 n=5+5)
      fs1-zwrk.go·8                                              4.00µs ± 2%              4.02µs ± 2%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·12                                             5.88µs ± 0%              5.91µs ± 0%   +0.47%  (p=0.029 n=4+4)
      fs1-zwrk.go·16                                             7.83µs ± 0%              7.86µs ± 0%     ~     (p=0.127 n=4+5)
      zeo/py/fs1-zwrk.go·1                                        170µs ± 1%               146µs ± 1%  -13.66%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        235µs ± 0%               229µs ± 3%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        322µs ± 1%               324µs ± 6%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        412µs ± 1%               409µs ± 3%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        782µs ± 2%               766µs ± 1%   -2.08%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.15ms ± 0%              1.13ms ± 1%   -1.39%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.52ms ± 1%              1.53ms ± 5%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               209µs ± 3%               180µs ± 3%  -14.26%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               312µs ± 2%               307µs ± 1%   -1.39%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               469µs ± 2%               470µs ± 6%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               625µs ± 1%               622µs ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.25ms ± 1%              1.26ms ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.86ms ± 1%              1.91ms ± 3%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.51ms ± 1%              2.51ms ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  294µs ± 4%               230µs ± 2%  -21.61%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  483µs ± 2%               405µs ± 4%  -16.22%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  728µs ± 1%               640µs ± 5%  -11.98%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  978µs ± 3%               837µs ± 4%  -14.42%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.92ms ± 2%              1.63ms ± 1%  -15.10%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                2.94ms ± 2%              2.52ms ± 3%  -14.18%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                3.87ms ± 3%              3.27ms ± 3%  -15.56%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                       58.1µs ± 1%              57.4µs ± 1%   -1.21%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·2                                       61.5µs ± 1%              60.8µs ± 1%   -1.13%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                       69.7µs ± 1%              69.0µs ± 0%   -0.97%  (p=0.016 n=5+4)
      neo/go/fs1-zwrk.go·4                                       75.8µs ± 1%              75.1µs ± 0%   -0.94%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        119µs ± 2%               119µs ± 2%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·12                                       185µs ± 2%               192µs ± 3%   +3.65%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·16                                       280µs ± 4%               296µs ±12%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         49.4µs ± 2%              49.5µs ± 5%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         49.5µs ± 1%              49.0µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         58.2µs ± 1%              57.8µs ± 1%   -0.78%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         64.5µs ± 1%              63.7µs ± 0%   -1.14%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          104µs ± 2%               107µs ± 5%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         159µs ± 3%               173µs ± 1%   +8.44%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         250µs ± 2%               262µs ± 2%   +4.74%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     111µs ± 0%               109µs ± 1%   -1.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     127µs ± 1%               125µs ± 0%   -1.03%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     140µs ± 1%               136µs ± 0%   -2.60%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     156µs ± 1%               150µs ± 0%   -3.89%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     279µs ± 2%               259µs ± 2%   -6.95%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    440µs ± 3%               407µs ± 1%   -7.45%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    591µs ± 2%               541µs ± 2%   -8.47%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              107µs ± 0%               105µs ± 1%   -2.18%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              122µs ± 0%               121µs ± 0%   -0.89%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              134µs ± 1%               132µs ± 0%   -1.39%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              149µs ± 1%               146µs ± 1%   -2.03%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              266µs ± 0%               256µs ± 2%   -3.65%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             423µs ± 2%               407µs ± 2%   -3.65%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             574µs ± 3%               557µs ±10%     ~     (p=0.151 n=5+5)
      23f8d82e
    • Kirill Smelkov's avatar
      X neo1: localhost timings, Cenabled, zwrk was running for 10s at each iteration · 5db60f7e
      Kirill Smelkov authored
      Compared to zwrk@1s (previous commit) the changes are in within, or
      close to be in within, noise and in particular it does not help for
      -zwrk.go timings like it did with Cstates disabled (f40c8b4b).
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset  20180308-neo1-ffixed-c-zwrk1s.txt 20180308-neo1-ffixed-c-zwrk10s.txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:neo1
      pystone                                                      106k ± 1%                106k ± 1%     ~     (p=1.000 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:neo1
      crc32/py/4K                                                5.13µs ± 1%              5.16µs ± 1%     ~     (p=0.310 n=5+5)
      crc32/go/4K                                                2.79µs ± 0%              2.79µs ± 0%     ~     (p=0.238 n=5+4)
      sha1/py/4K                                                 13.5µs ± 1%              13.5µs ± 1%     ~     (p=0.905 n=4+5)
      sha1/go/4K                                                 9.82µs ± 0%              9.82µs ± 0%     ~     (p=0.444 n=5+5)
      unzlib/py/wczdata                                          35.9µs ± 1%              36.1µs ± 1%     ~     (p=0.548 n=5+5)
      unzlib/go/wczdata                                          31.2µs ± 0%              31.3µs ± 0%     ~     (p=0.548 n=5+5)
      unzlib/py/prod1-avg                                        16.1µs ± 3%              16.4µs ± 1%     ~     (p=0.095 n=5+5)
      unzlib/go/prod1-avg                                        9.38µs ± 1%              9.41µs ± 1%     ~     (p=0.548 n=5+5)
      disk/randread/direct/4K-min                                 162µs ± 0%               162µs ± 0%     ~     (p=0.460 n=4+5)
      disk/randread/direct/4K-avg                                 187µs ± 1%               187µs ± 0%     ~     (p=1.000 n=5+5)
      disk/randread/pagecache/4K-min                              392ns ± 1%               386ns ± 1%   -1.35%  (p=0.032 n=5+4)
      disk/randread/pagecache/4K-avg                              808ns ± 0%               804ns ± 0%   -0.56%  (p=0.016 n=5+4)
      
      name                                           old time/object          new time/object          delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zhash.py                                               34.8µs ± 1%              34.9µs ± 1%     ~     (p=0.762 n=5+5)
      fs1-zhash.go                                               5.96µs ± 1%              6.00µs ± 0%     ~     (p=0.556 n=5+4)
      fs1-zhash.go+prefetch128                                   6.60µs ± 0%              6.58µs ± 2%     ~     (p=0.762 n=4+5)
      zeo/py/fs1-zhash.py                                         524µs ± 2%               516µs ± 8%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zhash.go                                         197µs ± 6%               200µs ± 4%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                             100µs ± 2%                98µs ± 2%     ~     (p=0.135 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                625µs ±20%               692µs ± 5%  +10.75%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                231µs ± 5%               230µs ± 4%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    164µs ± 1%               165µs ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zhash.py                                   992µs ±44%               938µs ±50%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zhash.go                                   329µs ±14%               310µs ±10%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       242µs ± 5%               244µs ± 8%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zhash.py                                         373µs ±19%               368µs ±27%     ~     (p=0.802 n=5+5)
      neo/go/fs1-zhash.go                                        80.0µs ± 2%              80.2µs ± 2%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            34.8µs ± 5%              34.8µs ± 5%     ~     (p=0.889 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          57.5µs ± 3%              56.7µs ± 3%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              23.8µs ± 7%              22.7µs ± 3%     ~     (p=0.063 n=5+5)
      neo/go/sqlite-zhash.py                                      415µs ± 3%               406µs ± 8%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zhash.go                                      126µs ± 1%               125µs ± 2%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         45.6µs ± 6%              47.9µs ± 5%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               117µs ± 3%               115µs ± 1%     ~     (p=0.135 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  45.8µs ± 4%              47.2µs ±13%     ~     (p=0.841 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zhash.py                                               29.1µs ± 1%              29.1µs ± 2%     ~     (p=1.000 n=5+5)
      fs1-zhash.go                                               3.76µs ± 2%              3.74µs ± 2%     ~     (p=1.000 n=5+5)
      fs1-zhash.go+prefetch128                                   3.82µs ± 3%              3.88µs ± 3%     ~     (p=0.484 n=5+5)
      zeo/py/fs1-zhash.py                                         490µs ± 1%               499µs ± 2%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zhash.go                                         173µs ±12%               171µs ± 4%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            86.6µs ± 1%              87.9µs ± 1%   +1.50%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                639µs ±23%               678µs ± 3%     ~     (p=0.651 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                216µs ± 3%               211µs ± 6%     ~     (p=0.500 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    150µs ± 2%               150µs ± 1%     ~     (p=0.984 n=5+5)
      neo/py(!log)/sql-zhash.py                                   912µs ±50%               922µs ±53%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zhash.go                                   307µs ±10%               289µs ± 5%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       227µs ± 3%               228µs ± 4%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zhash.py                                         336µs ±11%               359µs ±15%     ~     (p=0.786 n=5+5)
      neo/go/fs1-zhash.go                                        61.5µs ± 3%              62.1µs ± 0%     ~     (p=0.389 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            22.6µs ± 3%              22.5µs ± 1%     ~     (p=0.556 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          52.5µs ± 4%              51.4µs ± 4%     ~     (p=0.175 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              18.2µs ± 4%              18.6µs ± 3%     ~     (p=0.206 n=5+5)
      neo/go/sqlite-zhash.py                                      387µs ± 4%               396µs ± 4%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zhash.go                                      113µs ± 1%               114µs ± 1%     ~     (p=0.722 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         41.7µs ± 3%              41.5µs ± 6%     ~     (p=0.889 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               110µs ± 2%               109µs ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  40.9µs ± 5%              41.4µs ± 3%     ~     (p=0.595 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zwrk.go·1                                                230k ± 0%                229k ± 1%     ~     (p=0.151 n=5+5)
      fs1-zwrk.go·2                                                447k ± 1%                446k ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·3                                                666k ± 0%                665k ± 1%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·4                                                870k ± 0%                868k ± 1%     ~     (p=0.730 n=4+5)
      fs1-zwrk.go·8                                                991k ± 0%                988k ± 1%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·12                                              1.02M ± 0%               1.01M ± 1%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·16                                              1.02M ± 0%               1.01M ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        5.06k ± 1%               5.13k ± 1%   +1.45%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        6.93k ± 2%               6.93k ± 1%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        7.48k ± 1%               7.54k ± 1%   +0.84%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        7.69k ± 2%               7.75k ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        8.02k ± 1%               8.09k ± 0%   +0.83%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       8.40k ± 2%               8.46k ± 0%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       8.46k ± 1%               8.52k ± 0%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               4.22k ± 2%               4.35k ± 1%   +2.92%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               6.29k ± 3%               6.33k ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               6.29k ± 2%               6.22k ± 4%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               6.26k ± 3%               6.25k ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               6.18k ± 3%               6.25k ± 2%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              6.04k ± 5%               6.26k ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              6.21k ± 5%               6.24k ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  3.27k ±13%               3.29k ± 7%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  3.98k ± 3%               4.08k ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  3.97k ± 4%               4.05k ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  3.95k ± 5%               4.10k ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  4.07k ± 4%               4.04k ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 4.11k ± 6%               4.03k ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 4.03k ± 9%               3.97k ± 3%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·1                                        12.9k ± 1%               12.9k ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·2                                        24.9k ± 0%               24.8k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·3                                        32.3k ± 0%               32.3k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·4                                        40.9k ± 0%               40.7k ± 1%   -0.55%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        54.7k ± 1%               54.5k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·12                                       56.5k ± 1%               57.2k ± 1%   +1.18%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·16                                       54.5k ± 1%               58.3k ± 1%   +6.99%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          19.0k ± 2%               19.1k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          37.5k ± 2%               37.7k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          48.0k ± 0%               47.7k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          59.0k ± 0%               58.6k ± 1%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          78.1k ± 0%               77.6k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         80.7k ± 7%               83.1k ± 1%   +3.04%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         80.7k ± 1%               84.9k ± 2%   +5.23%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     8.12k ± 0%               8.06k ± 0%   -0.75%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     14.9k ± 0%               14.7k ± 1%   -1.31%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     20.9k ± 0%               20.3k ± 1%   -2.48%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     25.0k ± 0%               24.1k ± 1%   -3.69%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go·8                                     32.1k ± 1%               30.4k ± 1%   -5.40%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    32.3k ± 1%               30.8k ± 3%   -4.56%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    30.6k ±10%               30.1k ± 2%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              8.84k ± 1%               8.84k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              16.2k ± 0%               16.1k ± 1%   -0.67%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              22.5k ± 0%               22.1k ± 1%   -1.73%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.5k ± 0%               26.8k ± 1%   -2.68%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              34.2k ± 1%               33.1k ± 2%   -3.21%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             33.4k ± 2%               32.9k ± 2%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             32.8k ± 2%               32.1k ± 2%     ~     (p=0.056 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zwrk.go·1                                                454k ± 0%                453k ± 0%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·2                                                899k ± 0%                891k ± 0%   -0.83%  (p=0.008 n=5+5)
      fs1-zwrk.go·3                                               1.31M ± 8%               1.32M ± 3%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·4                                               1.77M ± 1%               1.77M ± 1%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·8                                               2.02M ± 2%               2.00M ± 2%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·12                                              2.04M ± 0%               2.04M ± 0%     ~     (p=0.063 n=5+4)
      fs1-zwrk.go·16                                              2.04M ± 0%               2.03M ± 2%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        5.84k ± 4%               5.90k ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        8.59k ± 2%               8.50k ± 0%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        9.37k ± 2%               9.32k ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        9.75k ± 3%               9.70k ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        10.2k ± 3%               10.2k ± 2%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       10.5k ± 1%               10.4k ± 0%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       10.5k ± 1%               10.5k ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               4.79k ± 5%               4.78k ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               6.49k ± 0%               6.42k ± 2%     ~     (p=0.063 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·3                               6.37k ± 6%               6.40k ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               6.41k ± 1%               6.40k ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               6.36k ± 5%               6.39k ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              6.43k ± 0%               6.44k ± 1%     ~     (p=0.556 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·16                              6.37k ± 1%               6.38k ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  3.32k ±13%               3.41k ± 4%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  4.08k ± 7%               4.14k ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  4.11k ± 3%               4.12k ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  4.08k ± 4%               4.09k ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  3.98k ± 3%               4.18k ± 2%   +4.87%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 4.11k ± 5%               4.09k ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 4.22k ± 4%               4.14k ± 3%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·1                                        17.3k ± 1%               17.2k ± 1%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·2                                        32.8k ± 1%               32.5k ± 1%     ~     (p=0.111 n=4+5)
      neo/go/fs1-zwrk.go·3                                        43.3k ± 0%               43.0k ± 1%   -0.61%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                        53.0k ± 0%               52.7k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·8                                        66.5k ± 1%               67.3k ± 1%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·12                                       60.7k ± 2%               64.9k ± 2%   +6.81%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·16                                       55.5k ± 2%               57.3k ± 4%   +3.28%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          20.1k ± 2%               20.3k ± 2%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          40.2k ± 1%               40.4k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          51.5k ± 0%               51.5k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          62.1k ± 0%               62.0k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          74.3k ± 2%               77.1k ± 2%   +3.66%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         67.1k ± 3%               75.3k ± 3%  +12.21%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         59.5k ± 2%               63.9k ± 2%   +7.44%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     8.89k ± 4%               8.99k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     15.9k ± 0%               15.8k ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     21.8k ± 1%               21.5k ± 1%   -1.24%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.2k ± 0%               25.7k ± 1%   -2.11%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     29.9k ± 1%               28.7k ± 2%   -4.03%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    28.7k ± 0%               27.3k ± 3%   -4.85%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go·16                                    28.8k ± 1%               27.1k ± 2%   -5.85%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              9.33k ± 1%               9.31k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              16.4k ± 0%               16.3k ± 0%     ~     (p=0.190 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              22.7k ± 0%               22.3k ± 1%   -1.53%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.4k ± 0%               26.8k ± 1%   -2.06%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              31.4k ± 1%               30.1k ± 0%   -4.24%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go(!sha1)·12                             29.8k ± 1%               28.4k ± 2%   -4.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             29.6k ± 2%               27.9k ± 3%   -5.82%  (p=0.008 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zwrk.go·1                                              4.35µs ± 0%              4.37µs ± 1%     ~     (p=0.135 n=5+5)
      fs1-zwrk.go·2                                              4.47µs ± 1%              4.48µs ± 1%     ~     (p=0.968 n=5+5)
      fs1-zwrk.go·3                                              4.51µs ± 0%              4.51µs ± 1%     ~     (p=0.651 n=5+5)
      fs1-zwrk.go·4                                              4.60µs ± 0%              4.61µs ± 1%     ~     (p=0.730 n=4+5)
      fs1-zwrk.go·8                                              8.07µs ± 0%              8.10µs ± 1%     ~     (p=0.571 n=5+5)
      fs1-zwrk.go·12                                             11.8µs ± 0%              11.9µs ± 1%     ~     (p=0.341 n=5+5)
      fs1-zwrk.go·16                                             15.7µs ± 0%              15.8µs ± 1%     ~     (p=0.516 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        198µs ± 1%               195µs ± 1%   -1.43%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        289µs ± 2%               289µs ± 1%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        401µs ± 1%               398µs ± 1%   -0.84%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        520µs ± 2%               516µs ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·8                                       1.00ms ± 1%              0.99ms ± 0%   -0.82%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.43ms ± 2%              1.42ms ± 0%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.89ms ± 1%              1.88ms ± 0%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               237µs ± 2%               230µs ± 1%   -2.86%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               318µs ± 3%               316µs ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               477µs ± 2%               483µs ± 4%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               639µs ± 3%               640µs ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.30ms ± 3%              1.28ms ± 2%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.99ms ± 5%              1.92ms ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.58ms ± 5%              2.57ms ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  308µs ±13%               305µs ± 7%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  503µs ± 3%               491µs ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  756µs ± 4%               740µs ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.01ms ± 5%              0.98ms ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.97ms ± 4%              1.98ms ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                2.92ms ± 6%              2.98ms ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                3.98ms ± 8%              4.03ms ± 3%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·1                                       77.3µs ± 1%              77.8µs ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·2                                       80.4µs ± 0%              80.7µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·3                                       92.8µs ± 0%              93.0µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·4                                       97.8µs ± 0%              98.4µs ± 1%   +0.56%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        146µs ± 1%               147µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·12                                       212µs ± 1%               210µs ± 1%   -1.16%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·16                                       294µs ± 1%               274µs ± 1%   -6.53%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         52.6µs ± 2%              52.3µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         53.3µs ± 2%              53.1µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         62.5µs ± 0%              62.8µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         67.8µs ± 0%              68.3µs ± 1%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          102µs ± 0%               103µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         149µs ± 7%               144µs ± 1%   -3.07%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         198µs ± 1%               188µs ± 2%   -4.97%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     123µs ± 0%               124µs ± 0%   +0.76%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     134µs ± 0%               136µs ± 1%   +1.33%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     144µs ± 0%               148µs ± 1%   +2.55%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     160µs ± 0%               166µs ± 1%   +3.84%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go·8                                     249µs ± 1%               263µs ± 1%   +5.71%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    372µs ± 1%               390µs ± 3%   +4.80%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    524µs ±11%               532µs ± 2%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              113µs ± 1%               113µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              124µs ± 0%               125µs ± 1%   +0.67%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              133µs ± 0%               136µs ± 1%   +1.76%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              145µs ± 0%               149µs ± 1%   +2.75%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              234µs ± 1%               242µs ± 2%   +3.33%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             360µs ± 2%               365µs ± 2%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             487µs ± 2%               499µs ± 2%     ~     (p=0.056 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zwrk.go·1                                              2.21µs ± 0%              2.21µs ± 0%     ~     (p=0.286 n=5+5)
      fs1-zwrk.go·2                                              2.23µs ± 0%              2.24µs ± 0%   +0.84%  (p=0.008 n=5+5)
      fs1-zwrk.go·3                                              2.30µs ± 9%              2.27µs ± 3%     ~     (p=0.849 n=5+5)
      fs1-zwrk.go·4                                              2.26µs ± 1%              2.27µs ± 1%     ~     (p=0.794 n=5+5)
      fs1-zwrk.go·8                                              3.97µs ± 2%              4.00µs ± 2%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·12                                             5.90µs ± 0%              5.88µs ± 0%   -0.28%  (p=0.032 n=5+4)
      fs1-zwrk.go·16                                             7.86µs ± 0%              7.83µs ± 0%     ~     (p=0.111 n=5+4)
      zeo/py/fs1-zwrk.go·1                                        171µs ± 4%               170µs ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        233µs ± 2%               235µs ± 0%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        320µs ± 2%               322µs ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        410µs ± 3%               412µs ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        783µs ± 3%               782µs ± 2%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.14ms ± 1%              1.15ms ± 0%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.53ms ± 1%              1.52ms ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               209µs ± 5%               209µs ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               308µs ± 0%               312µs ± 2%     ~     (p=0.063 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·3                               472µs ± 6%               469µs ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               624µs ± 1%               625µs ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.26ms ± 6%              1.25ms ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.87ms ± 0%              1.86ms ± 1%     ~     (p=0.556 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.51ms ± 1%              2.51ms ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  304µs ±13%               294µs ± 4%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  491µs ± 7%               483µs ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  730µs ± 3%               728µs ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  982µs ± 4%               978µs ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.01ms ± 3%              1.92ms ± 2%   -4.68%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                2.92ms ± 5%              2.94ms ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                3.79ms ± 4%              3.87ms ± 3%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·1                                       57.8µs ± 1%              58.1µs ± 1%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·2                                       61.1µs ± 1%              61.5µs ± 1%     ~     (p=0.111 n=4+5)
      neo/go/fs1-zwrk.go·3                                       69.3µs ± 0%              69.7µs ± 1%   +0.62%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                       75.5µs ± 0%              75.8µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·8                                        120µs ± 1%               119µs ± 2%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·12                                       198µs ± 2%               185µs ± 2%   -6.38%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·16                                       289µs ± 2%               280µs ± 4%   -3.14%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         49.9µs ± 2%              49.4µs ± 2%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         49.8µs ± 1%              49.5µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         58.3µs ± 0%              58.2µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         64.4µs ± 0%              64.5µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          108µs ± 2%               104µs ± 2%   -3.52%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         179µs ± 3%               159µs ± 3%  -10.88%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         269µs ± 2%               250µs ± 2%   -6.92%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     113µs ± 4%               111µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     126µs ± 0%               127µs ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     138µs ± 1%               140µs ± 1%   +1.26%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     152µs ± 0%               156µs ± 1%   +2.16%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     267µs ± 1%               279µs ± 2%   +4.21%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    418µs ± 0%               440µs ± 3%   +5.13%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go·16                                    556µs ± 1%               591µs ± 2%   +6.23%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              107µs ± 1%               107µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              122µs ± 0%               122µs ± 0%     ~     (p=0.190 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              132µs ± 0%               134µs ± 1%   +1.56%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              146µs ± 0%               149µs ± 1%   +2.10%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              255µs ± 1%               266µs ± 0%   +4.43%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go(!sha1)·12                             403µs ± 1%               423µs ± 2%   +5.03%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             541µs ± 2%               574µs ± 3%   +6.20%  (p=0.008 n=5+5)
      5db60f7e
    • Kirill Smelkov's avatar
      X neo1: localhost timings, Cenabled, zwrk was running for 1s at each iteration · 4cbd62f7
      Kirill Smelkov authored
      Remeasure with same settings as previous neo1 localhost with C-enabled (9644774a):
      
      The data is more or less the same and in particular timings for either
      sql backend or python client are noisy.
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset 20180306-neo1-ffixed-c.txt 20180308-neo1-ffixed-c-zwrk1s.txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:neo1
      pystone                                                      106k ± 1%                106k ± 1%    ~     (p=0.690 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:neo1
      crc32/py/4K                                                5.13µs ± 1%              5.13µs ± 1%    ~     (p=1.000 n=5+5)
      crc32/go/4K                                                2.79µs ± 0%              2.79µs ± 0%    ~     (p=1.000 n=5+5)
      sha1/py/4K                                                 13.4µs ± 1%              13.5µs ± 1%    ~     (p=0.730 n=5+4)
      sha1/go/4K                                                 9.83µs ± 0%              9.82µs ± 0%    ~     (p=0.810 n=5+5)
      unzlib/py/wczdata                                          36.1µs ± 0%              35.9µs ± 1%    ~     (p=0.421 n=5+5)
      unzlib/go/wczdata                                          31.1µs ± 1%              31.2µs ± 0%    ~     (p=0.421 n=5+5)
      unzlib/py/prod1-avg                                        16.3µs ± 2%              16.1µs ± 3%    ~     (p=0.310 n=5+5)
      unzlib/go/prod1-avg                                        9.42µs ± 0%              9.38µs ± 1%    ~     (p=0.222 n=5+5)
      disk/randread/direct/4K-min                                 162µs ± 0%               162µs ± 0%    ~     (p=0.619 n=5+4)
      disk/randread/direct/4K-avg                                 187µs ± 2%               187µs ± 1%    ~     (p=0.952 n=5+5)
      disk/randread/pagecache/4K-min                              389ns ± 1%               392ns ± 1%    ~     (p=0.167 n=5+5)
      disk/randread/pagecache/4K-avg                              804ns ± 0%               808ns ± 0%  +0.53%  (p=0.016 n=4+5)
      
      name                                           old time/object          new time/object          delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zhash.py                                               34.7µs ± 2%              34.8µs ± 1%    ~     (p=0.770 n=5+5)
      fs1-zhash.go                                               6.00µs ± 2%              5.96µs ± 1%    ~     (p=0.683 n=5+5)
      fs1-zhash.go+prefetch128                                   6.52µs ± 4%              6.60µs ± 0%    ~     (p=0.397 n=5+4)
      zeo/py/fs1-zhash.py                                         523µs ± 1%               524µs ± 2%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zhash.go                                         194µs ± 4%               197µs ± 6%    ~     (p=0.421 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            98.6µs ± 3%             100.1µs ± 2%    ~     (p=0.135 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                684µs ± 3%               625µs ±20%    ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                236µs ± 2%               231µs ± 5%    ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    162µs ± 2%               164µs ± 1%    ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zhash.py                                   942µs ±47%               992µs ±44%    ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zhash.go                                   300µs ±17%               329µs ±14%    ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       240µs ± 6%               242µs ± 5%    ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.py                                         383µs ±20%               373µs ±19%    ~     (p=0.802 n=5+5)
      neo/go/fs1-zhash.go                                        81.3µs ± 1%              80.0µs ± 2%  -1.62%  (p=0.040 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            33.8µs ± 5%              34.8µs ± 5%    ~     (p=0.389 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          57.6µs ± 3%              57.5µs ± 3%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              22.9µs ± 6%              23.8µs ± 7%    ~     (p=0.103 n=5+5)
      neo/go/sqlite-zhash.py                                      402µs ± 6%               415µs ± 3%    ~     (p=0.421 n=5+5)
      neo/go/sqlite-zhash.go                                      125µs ± 1%               126µs ± 1%    ~     (p=0.421 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         48.4µs ± 8%              45.6µs ± 6%    ~     (p=0.310 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               116µs ± 2%               117µs ± 3%    ~     (p=0.413 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  45.9µs ± 5%              45.8µs ± 4%    ~     (p=0.841 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zhash.py                                               28.9µs ± 1%              29.1µs ± 1%    ~     (p=0.167 n=5+5)
      fs1-zhash.go                                               3.76µs ± 4%              3.76µs ± 2%    ~     (p=1.000 n=5+5)
      fs1-zhash.go+prefetch128                                   3.86µs ± 2%              3.82µs ± 3%    ~     (p=0.683 n=5+5)
      zeo/py/fs1-zhash.py                                         474µs ± 2%               490µs ± 1%  +3.34%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go                                         170µs ± 3%               173µs ±12%    ~     (p=0.690 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            87.8µs ± 1%              86.6µs ± 1%  -1.32%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                665µs ± 2%               639µs ±23%    ~     (p=0.651 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                219µs ± 2%               216µs ± 3%    ~     (p=0.206 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    151µs ± 1%               150µs ± 2%    ~     (p=0.611 n=5+5)
      neo/py(!log)/sql-zhash.py                                   886µs ±56%               912µs ±50%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zhash.go                                   298µs ± 9%               307µs ±10%    ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       230µs ± 3%               227µs ± 3%    ~     (p=0.421 n=5+5)
      neo/go/fs1-zhash.py                                         319µs ±11%               336µs ±11%    ~     (p=0.389 n=5+5)
      neo/go/fs1-zhash.go                                        61.3µs ± 3%              61.5µs ± 3%    ~     (p=0.968 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            22.5µs ± 3%              22.6µs ± 3%    ~     (p=0.857 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          52.0µs ± 3%              52.5µs ± 4%    ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              18.3µs ± 2%              18.2µs ± 4%    ~     (p=0.968 n=5+5)
      neo/go/sqlite-zhash.py                                      382µs ± 6%               387µs ± 4%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go                                      113µs ± 1%               113µs ± 1%    ~     (p=0.524 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         40.9µs ± 4%              41.7µs ± 3%    ~     (p=0.341 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               108µs ± 1%               110µs ± 2%    ~     (p=0.063 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  41.1µs ± 5%              40.9µs ± 5%    ~     (p=0.841 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zwrk.go·1                                                229k ± 0%                230k ± 0%  +0.37%  (p=0.016 n=5+5)
      fs1-zwrk.go·2                                                443k ± 1%                447k ± 1%  +1.08%  (p=0.032 n=5+5)
      fs1-zwrk.go·3                                                662k ± 1%                666k ± 0%  +0.61%  (p=0.032 n=5+5)
      fs1-zwrk.go·4                                                867k ± 1%                870k ± 0%    ~     (p=0.413 n=5+4)
      fs1-zwrk.go·8                                                988k ± 0%                991k ± 0%    ~     (p=0.095 n=5+5)
      fs1-zwrk.go·12                                              1.02M ± 0%               1.02M ± 0%    ~     (p=0.841 n=5+5)
      fs1-zwrk.go·16                                               976k ±12%               1016k ± 0%    ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        5.15k ± 1%               5.06k ± 1%  -1.78%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        7.08k ± 1%               6.93k ± 2%  -2.23%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        7.73k ± 1%               7.48k ± 1%  -3.20%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        7.97k ± 4%               7.69k ± 2%    ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        8.30k ± 2%               8.02k ± 1%  -3.33%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       8.15k ± 1%               8.40k ± 2%  +3.06%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       8.25k ± 1%               8.46k ± 1%  +2.60%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               4.31k ± 4%               4.22k ± 2%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               6.28k ± 5%               6.29k ± 3%    ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               6.38k ± 0%               6.29k ± 2%  -1.48%  (p=0.016 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·4                               6.15k ± 5%               6.26k ± 3%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               6.27k ± 4%               6.18k ± 3%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              6.33k ± 2%               6.04k ± 5%  -4.50%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              6.25k ± 4%               6.21k ± 5%    ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  3.10k ± 6%               3.27k ±13%    ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  3.98k ± 1%               3.98k ± 3%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  4.04k ± 3%               3.97k ± 4%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  4.06k ± 4%               3.95k ± 5%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  3.79k ± 7%               4.07k ± 4%  +7.21%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 3.98k ± 3%               4.11k ± 6%    ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.94k ± 1%               4.03k ± 9%    ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                        12.8k ± 0%               12.9k ± 1%    ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·2                                        24.8k ± 0%               24.9k ± 0%    ~     (p=0.556 n=4+5)
      neo/go/fs1-zwrk.go·3                                        32.3k ± 0%               32.3k ± 0%    ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·4                                        40.7k ± 0%               40.9k ± 0%  +0.37%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        54.5k ± 1%               54.7k ± 1%    ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·12                                       56.5k ± 1%               56.5k ± 1%    ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·16                                       53.2k ±10%               54.5k ± 1%    ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          19.0k ± 2%               19.0k ± 2%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          37.8k ± 0%               37.5k ± 2%    ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          48.0k ± 1%               48.0k ± 0%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          59.0k ± 0%               59.0k ± 0%    ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          78.0k ± 1%               78.1k ± 0%    ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         82.2k ± 2%               80.7k ± 7%    ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         80.4k ± 1%               80.7k ± 1%    ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     8.06k ± 4%               8.12k ± 0%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     14.9k ± 0%               14.9k ± 0%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     20.7k ± 0%               20.9k ± 0%  +0.59%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     24.8k ± 0%               25.0k ± 0%  +0.78%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go·8                                     31.7k ± 1%               32.1k ± 1%  +1.34%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    30.8k ± 5%               32.3k ± 1%  +4.85%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    30.4k ± 2%               30.6k ±10%    ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              8.95k ± 1%               8.84k ± 1%  -1.25%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              16.2k ± 1%               16.2k ± 0%    ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              22.6k ± 0%               22.5k ± 0%  -0.34%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.9k ± 0%               27.5k ± 0%  -1.27%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              35.0k ± 1%               34.2k ± 1%  -2.32%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go(!sha1)·12                             34.7k ± 1%               33.4k ± 2%  -3.75%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             33.0k ±11%               32.8k ± 2%    ~     (p=0.222 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zwrk.go·1                                                451k ± 0%                454k ± 0%    ~     (p=0.056 n=5+5)
      fs1-zwrk.go·2                                                893k ± 0%                899k ± 0%  +0.68%  (p=0.008 n=5+5)
      fs1-zwrk.go·3                                               1.34M ± 1%               1.31M ± 8%    ~     (p=0.841 n=5+5)
      fs1-zwrk.go·4                                               1.77M ± 0%               1.77M ± 1%    ~     (p=0.841 n=5+5)
      fs1-zwrk.go·8                                               1.99M ± 1%               2.02M ± 2%    ~     (p=0.151 n=5+5)
      fs1-zwrk.go·12                                              2.03M ± 1%               2.04M ± 0%    ~     (p=0.190 n=4+5)
      fs1-zwrk.go·16                                              2.03M ± 0%               2.04M ± 0%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        5.79k ± 3%               5.84k ± 4%    ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        8.55k ± 1%               8.59k ± 2%    ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        9.28k ± 7%               9.37k ± 2%    ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        9.72k ± 1%               9.75k ± 3%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        10.4k ± 1%               10.2k ± 3%  -1.89%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       10.5k ± 1%               10.5k ± 1%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       10.4k ± 4%               10.5k ± 1%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               4.90k ± 7%               4.79k ± 5%    ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               6.28k ± 4%               6.49k ± 0%    ~     (p=0.190 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·3                               6.32k ± 5%               6.37k ± 6%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               6.45k ± 2%               6.41k ± 1%    ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               6.45k ± 2%               6.36k ± 5%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              6.31k ± 3%               6.43k ± 0%    ~     (p=0.556 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·16                              6.36k ± 5%               6.37k ± 1%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  3.50k ± 9%               3.32k ±13%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  4.05k ± 6%               4.08k ± 7%    ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  4.06k ± 7%               4.11k ± 3%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  3.98k ± 4%               4.08k ± 4%    ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  4.15k ± 3%               3.98k ± 3%    ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 4.00k ± 5%               4.11k ± 5%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.96k ±11%               4.22k ± 4%    ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·1                                        17.1k ± 1%               17.3k ± 1%  +1.36%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                        32.6k ± 0%               32.8k ± 1%    ~     (p=0.111 n=5+4)
      neo/go/fs1-zwrk.go·3                                        43.3k ± 0%               43.3k ± 0%    ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·4                                        52.9k ± 0%               53.0k ± 0%    ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·8                                        66.3k ± 1%               66.5k ± 1%    ~     (p=0.905 n=4+5)
      neo/go/fs1-zwrk.go·12                                       61.6k ± 1%               60.7k ± 2%    ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·16                                       55.6k ± 4%               55.5k ± 2%    ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          19.6k ± 5%               20.1k ± 2%    ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          40.3k ± 0%               40.2k ± 1%    ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          51.6k ± 0%               51.5k ± 0%    ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          62.0k ± 0%               62.1k ± 0%    ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          74.2k ± 4%               74.3k ± 2%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         64.8k ± 7%               67.1k ± 3%    ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         59.5k ± 4%               59.5k ± 2%    ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     9.02k ± 1%               8.89k ± 4%    ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     16.0k ± 0%               15.9k ± 0%  -0.66%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     21.8k ± 1%               21.8k ± 1%    ~     (p=0.286 n=4+5)
      neo/go/sqlite-zwrk.go·4                                     26.2k ± 0%               26.2k ± 0%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     30.0k ± 2%               29.9k ± 1%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    28.6k ± 2%               28.7k ± 0%    ~     (p=0.556 n=5+4)
      neo/go/sqlite-zwrk.go·16                                    28.7k ± 1%               28.8k ± 1%    ~     (p=0.905 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              9.45k ± 1%               9.33k ± 1%  -1.20%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              16.6k ± 1%               16.4k ± 0%  -1.24%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go(!sha1)·3                              23.0k ± 0%               22.7k ± 0%  -1.44%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              28.0k ± 1%               27.4k ± 0%  -2.10%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              32.3k ± 0%               31.4k ± 1%  -2.83%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             30.6k ± 2%               29.8k ± 1%  -2.48%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             30.3k ± 2%               29.6k ± 2%  -2.37%  (p=0.032 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zwrk.go·1                                              4.36µs ± 0%              4.35µs ± 0%  -0.37%  (p=0.016 n=5+5)
      fs1-zwrk.go·2                                              4.52µs ± 1%              4.47µs ± 1%  -1.07%  (p=0.032 n=5+5)
      fs1-zwrk.go·3                                              4.53µs ± 1%              4.51µs ± 0%  -0.61%  (p=0.040 n=5+5)
      fs1-zwrk.go·4                                              4.61µs ± 1%              4.60µs ± 0%    ~     (p=0.413 n=5+4)
      fs1-zwrk.go·8                                              8.10µs ± 0%              8.07µs ± 0%    ~     (p=0.095 n=5+5)
      fs1-zwrk.go·12                                             11.8µs ± 0%              11.8µs ± 0%    ~     (p=0.841 n=5+5)
      fs1-zwrk.go·16                                             16.5µs ±13%              15.7µs ± 0%    ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        194µs ± 1%               198µs ± 1%  +1.81%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        282µs ± 1%               289µs ± 2%  +2.29%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        388µs ± 1%               401µs ± 1%  +3.30%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        502µs ± 5%               520µs ± 2%    ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        964µs ± 2%               997µs ± 1%  +3.43%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.47ms ± 1%              1.43ms ± 2%  -2.97%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.94ms ± 1%              1.89ms ± 1%  -2.54%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               232µs ± 4%               237µs ± 2%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               319µs ± 5%               318µs ± 3%    ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               470µs ± 0%               477µs ± 2%  +1.52%  (p=0.016 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·4                               651µs ± 5%               639µs ± 3%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.28ms ± 4%              1.30ms ± 3%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.90ms ± 2%              1.99ms ± 5%  +4.85%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.56ms ± 4%              2.58ms ± 5%    ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  323µs ± 6%               308µs ±13%    ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  503µs ± 2%               503µs ± 3%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  742µs ± 3%               756µs ± 4%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  986µs ± 4%              1014µs ± 5%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.11ms ± 8%              1.97ms ± 4%  -6.85%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.02ms ± 3%              2.92ms ± 6%    ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.06ms ± 1%              3.98ms ± 8%    ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                       77.8µs ± 0%              77.3µs ± 1%    ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·2                                       80.6µs ± 0%              80.4µs ± 0%    ~     (p=0.556 n=4+5)
      neo/go/fs1-zwrk.go·3                                       92.8µs ± 0%              92.8µs ± 0%    ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·4                                       98.2µs ± 0%              97.8µs ± 0%  -0.36%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        147µs ± 1%               146µs ± 1%    ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·12                                       212µs ± 1%               212µs ± 1%    ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·16                                       293µs ± 1%               294µs ± 1%    ~     (p=0.905 n=4+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         52.7µs ± 2%              52.6µs ± 2%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         53.0µs ± 0%              53.3µs ± 2%    ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         62.5µs ± 1%              62.5µs ± 0%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         67.8µs ± 0%              67.8µs ± 0%    ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          103µs ± 1%               102µs ± 0%    ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         146µs ± 2%               149µs ± 7%    ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         199µs ± 1%               198µs ± 1%    ~     (p=0.802 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     124µs ± 4%               123µs ± 0%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     134µs ± 0%               134µs ± 0%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     145µs ± 0%               144µs ± 0%  -0.59%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     161µs ± 0%               160µs ± 0%  -0.77%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go·8                                     252µs ± 1%               249µs ± 1%  -1.32%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    390µs ± 5%               372µs ± 1%  -4.68%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    526µs ± 2%               524µs ±11%    ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              112µs ± 1%               113µs ± 1%  +1.26%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              124µs ± 1%               124µs ± 0%    ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              133µs ± 0%               133µs ± 0%  +0.34%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              143µs ± 0%               145µs ± 0%  +1.29%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              228µs ± 1%               234µs ± 1%  +2.37%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go(!sha1)·12                             346µs ± 1%               360µs ± 2%  +3.91%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             486µs ±11%               487µs ± 2%    ~     (p=0.222 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zwrk.go·1                                              2.22µs ± 1%              2.21µs ± 0%    ~     (p=0.056 n=5+5)
      fs1-zwrk.go·2                                              2.24µs ± 0%              2.23µs ± 0%  -0.69%  (p=0.008 n=5+5)
      fs1-zwrk.go·3                                              2.25µs ± 1%              2.30µs ± 9%    ~     (p=0.841 n=5+5)
      fs1-zwrk.go·4                                              2.26µs ± 0%              2.26µs ± 1%    ~     (p=0.714 n=5+5)
      fs1-zwrk.go·8                                              4.02µs ± 1%              3.97µs ± 2%    ~     (p=0.111 n=5+5)
      fs1-zwrk.go·12                                             5.92µs ± 1%              5.90µs ± 0%    ~     (p=0.190 n=4+5)
      fs1-zwrk.go·16                                             7.87µs ± 0%              7.86µs ± 0%    ~     (p=0.738 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        173µs ± 3%               171µs ± 4%    ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        234µs ± 1%               233µs ± 2%    ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        324µs ± 7%               320µs ± 2%    ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        412µs ± 1%               410µs ± 3%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        768µs ± 1%               783µs ± 3%  +1.95%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.14ms ± 1%              1.14ms ± 1%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.54ms ± 4%              1.53ms ± 1%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               204µs ± 8%               209µs ± 5%    ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               319µs ± 4%               308µs ± 0%    ~     (p=0.190 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·3                               475µs ± 5%               472µs ± 6%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               620µs ± 2%               624µs ± 1%    ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.24ms ± 2%              1.26ms ± 6%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.90ms ± 3%              1.87ms ± 0%    ~     (p=0.556 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·16                             2.52ms ± 5%              2.51ms ± 1%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  287µs ± 8%               304µs ±13%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  495µs ± 6%               491µs ± 7%    ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  740µs ± 8%               730µs ± 3%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.01ms ± 4%              0.98ms ± 4%    ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.93ms ± 3%              2.01ms ± 3%    ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.01ms ± 4%              2.92ms ± 5%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.05ms ±10%              3.79ms ± 4%    ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·1                                       58.5µs ± 1%              57.8µs ± 1%  -1.34%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                       61.4µs ± 0%              61.1µs ± 1%    ~     (p=0.111 n=5+4)
      neo/go/fs1-zwrk.go·3                                       69.3µs ± 0%              69.3µs ± 0%    ~     (p=0.651 n=5+5)
      neo/go/fs1-zwrk.go·4                                       75.6µs ± 0%              75.5µs ± 0%    ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·8                                        121µs ± 1%               120µs ± 1%    ~     (p=0.905 n=4+5)
      neo/go/fs1-zwrk.go·12                                       195µs ± 1%               198µs ± 2%    ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·16                                       288µs ± 4%               289µs ± 2%    ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         50.9µs ± 5%              49.9µs ± 2%    ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         49.7µs ± 0%              49.8µs ± 1%    ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         58.2µs ± 0%              58.3µs ± 0%    ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         64.5µs ± 0%              64.4µs ± 0%    ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          108µs ± 4%               108µs ± 2%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         185µs ± 8%               179µs ± 3%    ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         269µs ± 4%               269µs ± 2%    ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     111µs ± 1%               113µs ± 4%    ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     125µs ± 0%               126µs ± 0%  +0.66%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     137µs ± 1%               138µs ± 1%    ~     (p=0.286 n=4+5)
      neo/go/sqlite-zwrk.go·4                                     153µs ± 0%               152µs ± 0%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     267µs ± 1%               267µs ± 1%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    420µs ± 2%               418µs ± 0%    ~     (p=0.556 n=5+4)
      neo/go/sqlite-zwrk.go·16                                    558µs ± 1%               556µs ± 1%    ~     (p=0.905 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              106µs ± 1%               107µs ± 1%  +1.21%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              121µs ± 1%               122µs ± 0%  +1.25%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go(!sha1)·3                              130µs ± 0%               132µs ± 0%  +1.47%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              143µs ± 1%               146µs ± 0%  +2.14%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              248µs ± 0%               255µs ± 1%  +2.92%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             393µs ± 2%               403µs ± 1%  +2.53%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             528µs ± 2%               541µs ± 2%  +2.42%  (p=0.032 n=5+5)
      4cbd62f7
    • Kirill Smelkov's avatar
      1e438610
  2. 08 Mar, 2018 3 commits
  3. 06 Mar, 2018 11 commits
    • Kirill Smelkov's avatar
      X deco: localhost timings, C > C1 disabled (remeasure) · 620b723c
      Kirill Smelkov authored
      As it was promised in 0867c981 here comes remeasurement of deco timings
      with C-states disabled. And the results are the same, thus confirming
      zeo/py/fs-<go-client> both speedup and slowdown:
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset "20180306-deco-ffixed-c.txt" "20180306-deco-ffixed-noc_C1(2µs).txt.2"
      
      name                                           old pystone/s            new pystone/s            delta
      node:deco
      pystone                                                      217k ± 4%                217k ± 2%     ~     (p=1.000 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:deco
      crc32/py/4K                                                5.73µs ± 0%              5.73µs ± 0%     ~     (p=0.841 n=5+5)
      crc32/go/4K                                                 279ns ± 0%               279ns ± 0%     ~     (all equal)
      sha1/py/4K                                                 6.74µs ± 1%              6.71µs ± 1%     ~     (p=0.310 n=5+5)
      sha1/go/4K                                                 5.60µs ± 0%              5.59µs ± 0%   -0.18%  (p=0.024 n=5+5)
      unzlib/py/wczdata                                          27.2µs ± 1%              27.1µs ± 1%     ~     (p=0.452 n=5+5)
      unzlib/go/wczdata                                          27.0µs ± 0%              26.8µs ± 0%   -0.62%  (p=0.008 n=5+5)
      unzlib/py/prod1-avg                                        5.14µs ± 3%              5.13µs ± 1%     ~     (p=1.000 n=5+5)
      unzlib/go/prod1-avg                                        5.30µs ± 1%              5.28µs ± 0%   -0.47%  (p=0.016 n=5+5)
      disk/randread/direct/4K-min                                 104µs ± 2%               105µs ± 0%   +1.48%  (p=0.016 n=5+4)
      disk/randread/direct/4K-avg                                 141µs ± 0%               142µs ± 0%   +0.95%  (p=0.008 n=5+5)
      disk/randread/pagecache/4K-min                              579ns ± 2%               584ns ± 2%     ~     (p=0.310 n=5+5)
      disk/randread/pagecache/4K-avg                              993ns ± 0%               986ns ± 0%   -0.70%  (p=0.008 n=5+5)
      
      name                                           old time/object          new time/object          delta
      cluster:deco dataset:wczblk1-8
      fs1-zhash.py                                               20.3µs ± 1%              20.3µs ± 2%     ~     (p=0.524 n=4+5)
      fs1-zhash.go                                               3.26µs ± 4%              3.20µs ± 0%     ~     (p=0.333 n=5+4)
      fs1-zhash.go+prefetch128                                   4.04µs ± 1%              4.00µs ± 7%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zhash.py                                         383µs ± 5%               364µs ± 5%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zhash.go                                         126µs ± 1%               113µs ± 1%  -10.03%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            63.1µs ± 1%              64.0µs ± 2%     ~     (p=0.254 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                344µs ± 6%               318µs ± 2%   -7.43%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                140µs ± 1%               142µs ± 3%     ~     (p=0.286 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    119µs ± 2%               119µs ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zhash.py                                   386µs ± 1%               382µs ± 3%     ~     (p=0.686 n=4+4)
      neo/py(!log)/sql-zhash.go                                   183µs ± 3%               189µs ± 4%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       164µs ± 3%               164µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zhash.py                                         226µs ± 3%               222µs ± 2%     ~     (p=0.167 n=5+5)
      neo/go/fs1-zhash.go                                        57.1µs ± 0%              56.7µs ± 0%   -0.84%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            24.7µs ± 5%              24.5µs ± 5%     ~     (p=0.643 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          40.2µs ± 1%              40.3µs ± 2%     ~     (p=0.849 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              17.1µs ± 6%              17.3µs ± 7%     ~     (p=0.881 n=5+5)
      neo/go/sqlite-zhash.py                                      272µs ± 3%               254µs ± 2%   -6.63%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                     92.8µs ± 0%              94.8µs ± 0%   +2.20%  (p=0.016 n=4+5)
      neo/go/sqlite-zhash.go+prefetch128                         40.5µs ± 5%              41.6µs ±13%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              86.5µs ± 2%              87.0µs ± 2%     ~     (p=0.175 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  38.8µs ± 9%              37.9µs ± 9%     ~     (p=0.421 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zhash.py                                               15.8µs ± 3%              15.8µs ± 1%     ~     (p=0.619 n=4+5)
      fs1-zhash.go                                               2.80µs ± 0%              2.80µs ± 0%     ~     (all equal)
      fs1-zhash.go+prefetch128                                   3.42µs ± 8%              3.50µs ±17%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zhash.py                                         361µs ± 5%               355µs ± 4%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zhash.go                                         105µs ± 0%               105µs ± 1%     ~     (p=0.595 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            58.9µs ± 1%              58.5µs ± 2%     ~     (p=0.302 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                344µs ± 7%               315µs ± 5%   -8.63%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                137µs ± 2%               135µs ± 1%     ~     (p=0.103 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    114µs ± 1%               112µs ± 0%   -1.67%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                   380µs ± 4%               376µs ± 2%     ~     (p=0.886 n=4+4)
      neo/py(!log)/sql-zhash.go                                   180µs ± 1%               183µs ± 2%   +2.06%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       159µs ± 1%               158µs ± 1%   -0.79%  (p=0.048 n=5+5)
      neo/go/fs1-zhash.py                                         221µs ± 1%               223µs ± 2%     ~     (p=0.524 n=5+5)
      neo/go/fs1-zhash.go                                        45.2µs ± 2%              44.3µs ± 1%   -1.99%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            17.6µs ± 2%              17.4µs ± 6%     ~     (p=0.246 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          39.1µs ± 2%              39.0µs ± 1%     ~     (p=0.643 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              14.6µs ± 4%              14.5µs ± 3%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zhash.py                                      271µs ± 2%               252µs ± 1%   -7.10%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                     86.4µs ± 0%              86.6µs ± 1%     ~     (p=0.444 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         35.8µs ± 2%              37.6µs ± 2%   +5.02%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              84.0µs ± 1%              83.5µs ± 1%     ~     (p=0.230 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  36.5µs ± 5%              35.7µs ± 7%     ~     (p=0.381 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:deco dataset:wczblk1-8
      fs1-zwrk.go·1                                                436k ± 0%                437k ± 1%     ~     (p=0.222 n=5+5)
      fs1-zwrk.go·2                                                744k ± 1%                750k ± 3%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·3                                               1.09M ± 0%               1.08M ± 0%   -0.42%  (p=0.016 n=5+5)
      fs1-zwrk.go·4                                               1.16M ± 1%               1.16M ± 1%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·8                                               1.27M ± 1%               1.27M ± 1%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·12                                              1.27M ± 1%               1.28M ± 0%     ~     (p=0.190 n=5+4)
      fs1-zwrk.go·16                                              1.27M ± 1%               1.28M ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        9.12k ± 0%               8.14k ± 0%  -10.75%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        11.6k ± 1%                9.5k ± 1%  -17.53%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        13.4k ± 1%               10.5k ± 1%  -21.27%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        14.0k ± 1%               10.9k ± 1%  -22.08%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        14.7k ± 1%               11.5k ± 1%  -21.84%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       15.0k ± 1%               11.6k ± 2%  -22.49%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       15.1k ± 0%               11.8k ± 1%  -22.02%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.09k ± 1%               7.08k ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.48k ± 1%               8.52k ± 0%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.48k ± 1%               8.48k ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.47k ± 1%               8.45k ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.43k ± 1%               8.52k ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.46k ± 1%               8.57k ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.46k ± 1%               8.57k ± 0%   +1.32%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.51k ± 1%               5.36k ± 2%   -2.78%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.32k ± 1%               6.21k ± 1%   -1.66%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.29k ± 1%               6.24k ± 0%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sql-zwrk.go·4                                  6.27k ± 1%               6.17k ± 2%   -1.63%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.27k ± 1%               6.12k ± 0%   -2.39%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.29k ± 0%               6.15k ± 1%   -2.22%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zwrk.go·16                                 6.22k ± 1%               6.14k ± 3%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·1                                        18.4k ± 1%               18.4k ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·2                                        38.1k ± 1%               38.3k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·3                                        46.0k ± 1%               46.1k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·4                                        50.2k ± 1%               50.3k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·8                                        61.0k ± 0%               60.8k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·12                                       62.1k ± 1%               62.5k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·16                                       62.5k ± 1%               62.1k ± 2%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.3k ± 1%               26.3k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          55.3k ± 1%               55.1k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          62.7k ± 1%               62.6k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          69.3k ± 1%               69.0k ± 1%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          88.2k ± 0%               87.7k ± 0%   -0.47%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         93.4k ± 0%               92.4k ± 1%   -1.02%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         93.5k ± 2%               93.5k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.0k ± 1%               10.9k ± 0%   -1.25%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     18.4k ± 1%               18.2k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     24.4k ± 1%               24.2k ± 1%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.8k ± 0%               26.8k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     30.4k ± 2%               30.0k ± 2%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    30.5k ± 1%               29.5k ± 1%   -3.47%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    29.9k ± 2%               28.5k ± 1%   -4.81%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.9k ± 1%               11.9k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              19.7k ± 0%               19.6k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              26.5k ± 1%               26.7k ± 0%   +0.84%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              30.0k ± 0%               30.4k ± 1%   +1.43%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              31.2k ± 2%               32.1k ± 0%   +2.82%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             28.9k ± 1%               30.2k ± 2%   +4.46%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             28.4k ± 2%               29.7k ± 2%   +4.60%  (p=0.008 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zwrk.go·1                                                555k ± 0%                558k ± 1%     ~     (p=0.222 n=5+5)
      fs1-zwrk.go·2                                               1.01M ± 3%               1.01M ± 8%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·3                                               1.32M ± 1%               1.33M ± 0%   +0.69%  (p=0.032 n=5+5)
      fs1-zwrk.go·4                                               1.55M ± 2%               1.54M ± 3%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·8                                               1.59M ± 0%               1.59M ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·12                                              1.59M ± 0%               1.59M ± 0%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·16                                              1.59M ± 0%               1.59M ± 0%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        9.70k ± 0%               9.66k ± 0%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        12.4k ± 1%               12.3k ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        14.2k ± 1%               14.2k ± 1%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        14.9k ± 0%               14.9k ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        15.6k ± 0%               15.7k ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       15.2k ±11%               16.0k ± 1%   +5.04%  (p=0.032 n=5+4)
      zeo/py/fs1-zwrk.go·16                                       16.1k ± 1%               16.1k ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.44k ± 1%               7.46k ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.59k ± 1%               8.67k ± 1%   +0.91%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.61k ± 1%               8.71k ± 1%   +1.16%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.57k ± 1%               8.68k ± 0%   +1.33%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.56k ± 1%               8.73k ± 1%   +2.01%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.51k ± 1%               8.66k ± 1%   +1.69%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.54k ± 1%               8.62k ± 1%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.55k ± 2%               5.47k ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.36k ± 1%               6.37k ± 0%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.31k ± 0%               6.30k ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.28k ± 0%               6.33k ± 0%   +0.78%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.34k ± 1%               6.36k ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.35k ± 1%               6.36k ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.36k ± 0%               6.35k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·1                                        23.7k ± 0%               24.0k ± 0%   +1.23%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                        45.4k ± 0%               45.6k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·3                                        55.2k ± 1%               55.5k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·4                                        60.7k ± 2%               60.7k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·8                                        70.9k ± 2%               69.3k ± 3%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·12                                       71.1k ± 3%               69.5k ± 7%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·16                                       71.0k ± 3%               67.8k ± 2%   -4.43%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          27.3k ± 0%               27.1k ± 0%   -0.92%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          55.4k ± 1%               55.4k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          64.0k ± 1%               62.9k ± 1%   -1.62%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          69.0k ± 1%               68.4k ± 1%   -0.87%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          80.9k ± 2%               79.9k ± 3%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         78.3k ± 5%               77.6k ± 4%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         75.4k ± 3%               77.7k ± 7%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.7k ± 1%               11.7k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     19.0k ± 0%               19.1k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     24.5k ± 1%               24.3k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.3k ± 1%               26.3k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     24.9k ± 3%               24.8k ± 3%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    24.0k ± 5%               23.6k ± 2%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    25.4k ± 1%               24.3k ± 1%   -4.16%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              12.2k ± 0%               12.2k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              19.8k ± 0%               19.6k ± 0%   -0.97%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              26.2k ± 1%               26.2k ± 2%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              28.7k ± 1%               29.1k ± 1%   +1.21%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              27.2k ± 3%               27.3k ± 2%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             25.3k ± 2%               25.5k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             25.3k ± 1%               25.5k ± 1%     ~     (p=0.095 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:deco dataset:wczblk1-8
      fs1-zwrk.go·1                                              2.29µs ± 0%              2.29µs ± 1%     ~     (p=0.198 n=5+5)
      fs1-zwrk.go·2                                              2.69µs ± 1%              2.67µs ± 3%     ~     (p=0.738 n=5+5)
      fs1-zwrk.go·3                                              2.76µs ± 0%              2.77µs ± 0%   +0.42%  (p=0.016 n=5+5)
      fs1-zwrk.go·4                                              3.44µs ± 1%              3.44µs ± 1%     ~     (p=0.730 n=5+5)
      fs1-zwrk.go·8                                              6.28µs ± 1%              6.29µs ± 1%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·12                                             9.46µs ± 1%              9.35µs ± 0%     ~     (p=0.159 n=5+4)
      fs1-zwrk.go·16                                             12.6µs ± 1%              12.5µs ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        110µs ± 0%               123µs ± 0%  +12.04%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        173µs ± 1%               210µs ± 1%  +21.26%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        224µs ± 1%               285µs ± 1%  +27.02%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        286µs ± 1%               366µs ± 1%  +28.34%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        545µs ± 1%               698µs ± 1%  +27.94%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       802µs ± 1%              1034µs ± 2%  +29.03%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.06ms ± 0%              1.36ms ± 1%  +28.25%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               141µs ± 1%               141µs ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               236µs ± 1%               235µs ± 0%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               354µs ± 1%               354µs ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               472µs ± 1%               474µs ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               949µs ± 1%               939µs ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.42ms ± 1%              1.40ms ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.89ms ± 1%              1.87ms ± 0%   -1.30%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  181µs ± 1%               187µs ± 2%   +2.87%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  317µs ± 1%               322µs ± 1%   +1.68%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  477µs ± 1%               481µs ± 0%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sql-zwrk.go·4                                  638µs ± 1%               648µs ± 2%   +1.66%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.28ms ± 1%              1.31ms ± 0%   +2.44%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.91ms ± 0%              1.95ms ± 1%   +2.28%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zwrk.go·16                                2.57ms ± 1%              2.61ms ± 3%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·1                                       54.2µs ± 1%              54.2µs ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·2                                       52.5µs ± 1%              52.2µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·3                                       65.3µs ± 1%              65.1µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·4                                       79.6µs ± 1%              79.5µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·8                                        131µs ± 0%               132µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·12                                       193µs ± 1%               192µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·16                                       256µs ± 1%               258µs ± 2%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         38.0µs ± 1%              38.0µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         36.1µs ± 1%              36.3µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         47.8µs ± 1%              47.9µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         57.7µs ± 1%              58.0µs ± 1%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         90.7µs ± 0%              91.2µs ± 0%   +0.47%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         129µs ± 0%               130µs ± 1%   +1.04%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         171µs ± 2%               171µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    90.7µs ± 1%              91.8µs ± 0%   +1.26%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     109µs ± 1%               110µs ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     123µs ± 1%               124µs ± 1%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     149µs ± 0%               149µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     263µs ± 2%               267µs ± 2%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    393µs ± 1%               407µs ± 1%   +3.60%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    534µs ± 2%               561µs ± 1%   +5.04%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             84.0µs ± 1%              84.1µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              102µs ± 0%               102µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              113µs ± 1%               112µs ± 0%   -0.83%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              133µs ± 0%               132µs ± 1%   -1.41%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              257µs ± 2%               250µs ± 0%   -2.76%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             415µs ± 1%               397µs ± 2%   -4.26%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             563µs ± 2%               538µs ± 2%   -4.40%  (p=0.008 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zwrk.go·1                                              1.80µs ± 0%              1.79µs ± 1%     ~     (p=0.222 n=5+5)
      fs1-zwrk.go·2                                              1.98µs ± 3%              1.98µs ± 8%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·3                                              2.27µs ± 1%              2.25µs ± 0%   -0.68%  (p=0.032 n=5+5)
      fs1-zwrk.go·4                                              2.58µs ± 2%              2.59µs ± 3%     ~     (p=0.952 n=5+5)
      fs1-zwrk.go·8                                              5.04µs ± 0%              5.04µs ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·12                                             7.55µs ± 0%              7.53µs ± 0%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·16                                             10.0µs ± 0%              10.0µs ± 0%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        103µs ± 0%               104µs ± 0%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        162µs ± 1%               162µs ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        212µs ± 1%               211µs ± 1%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        269µs ± 0%               268µs ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        512µs ± 0%               510µs ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       793µs ±12%               752µs ± 1%   -5.18%  (p=0.032 n=5+4)
      zeo/py/fs1-zwrk.go·16                                       991µs ± 1%               992µs ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               134µs ± 1%               134µs ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               233µs ± 1%               231µs ± 1%   -0.91%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               348µs ± 1%               344µs ± 1%   -1.15%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               467µs ± 1%               461µs ± 0%   -1.32%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               935µs ± 1%               916µs ± 1%   -1.97%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.41ms ± 1%              1.39ms ± 1%   -1.66%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.87ms ± 1%              1.86ms ± 1%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  180µs ± 2%               183µs ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  315µs ± 1%               314µs ± 0%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  475µs ± 0%               476µs ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  637µs ± 0%               632µs ± 0%   -0.78%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.26ms ± 1%              1.26ms ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.89ms ± 1%              1.89ms ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.52ms ± 0%              2.52ms ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·1                                       42.2µs ± 0%              41.7µs ± 0%   -1.21%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                       44.1µs ± 0%              43.8µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·3                                       54.4µs ± 1%              54.1µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·4                                       65.9µs ± 2%              65.9µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·8                                        113µs ± 2%               115µs ± 3%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·12                                       169µs ± 4%               173µs ± 7%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·16                                       225µs ± 3%               236µs ± 2%   +4.62%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         36.6µs ± 0%              36.9µs ± 0%   +0.93%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         36.1µs ± 1%              36.1µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         46.9µs ± 1%              47.7µs ± 1%   +1.64%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         57.9µs ± 1%              58.4µs ± 1%   +0.88%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         98.9µs ± 2%             100.2µs ± 3%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         153µs ± 5%               155µs ± 4%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         212µs ± 3%               206µs ± 7%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    85.1µs ± 1%              85.3µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     105µs ± 0%               105µs ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     123µs ± 1%               123µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     152µs ± 1%               152µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     321µs ± 3%               323µs ± 3%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    500µs ± 5%               508µs ± 2%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    630µs ± 1%               657µs ± 1%   +4.34%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             82.0µs ± 0%              82.3µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              101µs ± 0%               102µs ± 0%   +0.98%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              115µs ± 1%               115µs ± 3%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              139µs ± 1%               138µs ± 1%   -1.19%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              295µs ± 3%               293µs ± 2%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             474µs ± 2%               470µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             632µs ± 1%               627µs ± 1%     ~     (p=0.095 n=5+5)
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset "20180306-deco-ffixed-noc_C1(2µs).txt" "20180306-deco-ffixed-noc_C1(2µs).txt.2"
      
      name                                           old pystone/s            new pystone/s            delta
      node:deco
      pystone                                                      218k ± 2%                217k ± 2%    ~     (p=1.000 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:deco
      crc32/py/4K                                                5.72µs ± 0%              5.73µs ± 0%    ~     (p=0.151 n=5+5)
      crc32/go/4K                                                 280ns ± 1%               279ns ± 0%    ~     (p=0.333 n=5+4)
      sha1/py/4K                                                 6.72µs ± 1%              6.71µs ± 1%    ~     (p=1.000 n=5+5)
      sha1/go/4K                                                 5.59µs ± 0%              5.59µs ± 0%    ~     (p=1.000 n=4+5)
      unzlib/py/wczdata                                          27.2µs ± 1%              27.1µs ± 1%    ~     (p=0.421 n=5+5)
      unzlib/go/wczdata                                          26.8µs ± 0%              26.8µs ± 0%    ~     (p=0.548 n=5+5)
      unzlib/py/prod1-avg                                        5.08µs ± 1%              5.13µs ± 1%    ~     (p=0.095 n=5+5)
      unzlib/go/prod1-avg                                        5.29µs ± 1%              5.28µs ± 0%    ~     (p=0.333 n=5+5)
      disk/randread/direct/4K-min                                 105µs ± 0%               105µs ± 0%    ~     (p=0.111 n=5+4)
      disk/randread/direct/4K-avg                                 142µs ± 0%               142µs ± 0%  +0.35%  (p=0.040 n=5+5)
      disk/randread/pagecache/4K-min                              582ns ± 0%               584ns ± 2%    ~     (p=0.286 n=5+5)
      disk/randread/pagecache/4K-avg                              987ns ± 0%               986ns ± 0%    ~     (p=0.460 n=5+5)
      
      name                                           old time/object          new time/object          delta
      cluster:deco dataset:wczblk1-8
      fs1-zhash.py                                               20.2µs ± 1%              20.3µs ± 2%    ~     (p=1.000 n=5+5)
      fs1-zhash.go                                               3.20µs ± 0%              3.20µs ± 0%    ~     (all equal)
      fs1-zhash.go+prefetch128                                   4.14µs ± 1%              4.00µs ± 7%    ~     (p=0.159 n=5+5)
      zeo/py/fs1-zhash.py                                         361µs ± 3%               364µs ± 5%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zhash.go                                         112µs ± 1%               113µs ± 1%  +0.93%  (p=0.024 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            63.9µs ± 1%              64.0µs ± 2%    ~     (p=0.952 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                321µs ± 8%               318µs ± 2%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                141µs ± 3%               142µs ± 3%    ~     (p=0.595 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    119µs ± 1%               119µs ± 2%    ~     (p=0.794 n=5+5)
      neo/py(!log)/sql-zhash.py                                   376µs ± 2%               382µs ± 3%    ~     (p=0.486 n=4+4)
      neo/py(!log)/sql-zhash.go                                   187µs ± 5%               189µs ± 4%    ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       164µs ± 2%               164µs ± 2%    ~     (p=0.841 n=5+5)
      neo/go/fs1-zhash.py                                         226µs ± 2%               222µs ± 2%    ~     (p=0.222 n=5+5)
      neo/go/fs1-zhash.go                                        57.1µs ± 1%              56.7µs ± 0%  -0.81%  (p=0.016 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            24.0µs ± 4%              24.5µs ± 5%    ~     (p=0.460 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          40.3µs ± 1%              40.3µs ± 2%    ~     (p=0.833 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              17.2µs ± 4%              17.3µs ± 7%    ~     (p=0.730 n=5+5)
      neo/go/sqlite-zhash.py                                      253µs ± 1%               254µs ± 2%    ~     (p=0.952 n=5+5)
      neo/go/sqlite-zhash.go                                     93.7µs ± 1%              94.8µs ± 0%  +1.20%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         39.5µs ± 6%              41.6µs ±13%    ~     (p=0.310 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              86.4µs ± 3%              87.0µs ± 2%    ~     (p=0.079 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  39.4µs ± 7%              37.9µs ± 9%    ~     (p=0.690 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zhash.py                                               15.9µs ± 2%              15.8µs ± 1%    ~     (p=0.571 n=5+5)
      fs1-zhash.go                                               2.80µs ± 0%              2.80µs ± 0%    ~     (all equal)
      fs1-zhash.go+prefetch128                                   3.34µs ± 2%              3.50µs ±17%    ~     (p=0.683 n=5+5)
      zeo/py/fs1-zhash.py                                         347µs ± 3%               355µs ± 4%    ~     (p=0.222 n=5+5)
      zeo/py/fs1-zhash.go                                         105µs ± 0%               105µs ± 1%  +0.52%  (p=0.040 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            58.9µs ± 1%              58.5µs ± 2%    ~     (p=0.198 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                317µs ± 5%               315µs ± 5%    ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                138µs ± 1%               135µs ± 1%  -1.86%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    112µs ± 1%               112µs ± 0%    ~     (p=0.508 n=5+5)
      neo/py(!log)/sql-zhash.py                                   377µs ± 2%               376µs ± 2%    ~     (p=0.686 n=4+4)
      neo/py(!log)/sql-zhash.go                                   184µs ± 2%               183µs ± 2%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       160µs ± 2%               158µs ± 1%  -1.18%  (p=0.024 n=5+5)
      neo/go/fs1-zhash.py                                         225µs ± 1%               223µs ± 2%    ~     (p=0.278 n=5+5)
      neo/go/fs1-zhash.go                                        44.6µs ± 0%              44.3µs ± 1%  -0.63%  (p=0.048 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            17.2µs ± 3%              17.4µs ± 6%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          39.1µs ± 3%              39.0µs ± 1%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              15.2µs ± 3%              14.5µs ± 3%  -4.47%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.py                                      254µs ± 1%               252µs ± 1%    ~     (p=0.111 n=5+5)
      neo/go/sqlite-zhash.go                                     86.3µs ± 0%              86.6µs ± 1%  +0.42%  (p=0.040 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         36.6µs ± 5%              37.6µs ± 2%    ~     (p=0.310 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              83.8µs ± 2%              83.5µs ± 1%    ~     (p=0.548 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  36.9µs ± 8%              35.7µs ± 7%    ~     (p=0.310 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:deco dataset:wczblk1-8
      fs1-zwrk.go·1                                                431k ± 1%                437k ± 1%  +1.51%  (p=0.008 n=5+5)
      fs1-zwrk.go·2                                                760k ± 3%                750k ± 3%    ~     (p=0.310 n=5+5)
      fs1-zwrk.go·3                                               1.08M ± 2%               1.08M ± 0%    ~     (p=0.841 n=5+5)
      fs1-zwrk.go·4                                               1.16M ± 1%               1.16M ± 1%    ~     (p=1.000 n=5+5)
      fs1-zwrk.go·8                                               1.27M ± 1%               1.27M ± 1%    ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                              1.28M ± 1%               1.28M ± 0%    ~     (p=0.190 n=5+4)
      fs1-zwrk.go·16                                              1.28M ± 1%               1.28M ± 1%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        8.04k ± 4%               8.14k ± 0%    ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        9.54k ± 1%               9.54k ± 1%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        10.5k ± 0%               10.5k ± 1%    ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        11.0k ± 1%               10.9k ± 1%    ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        11.4k ± 1%               11.5k ± 1%    ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       11.7k ± 0%               11.6k ± 2%    ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       11.8k ± 2%               11.8k ± 1%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.04k ± 1%               7.08k ± 1%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.52k ± 1%               8.52k ± 0%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.51k ± 1%               8.48k ± 1%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.50k ± 1%               8.45k ± 1%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.53k ± 1%               8.52k ± 1%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.48k ± 2%               8.57k ± 1%    ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.48k ± 1%               8.57k ± 0%  +1.08%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.37k ± 3%               5.36k ± 2%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.34k ± 0%               6.21k ± 1%  -2.02%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.28k ± 1%               6.24k ± 0%    ~     (p=0.190 n=5+4)
      neo/py(!log)/sql-zwrk.go·4                                  6.29k ± 1%               6.17k ± 2%  -1.87%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.29k ± 1%               6.12k ± 0%  -2.68%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.25k ± 1%               6.15k ± 1%  -1.54%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zwrk.go·16                                 6.23k ± 2%               6.14k ± 3%    ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·1                                        18.4k ± 0%               18.4k ± 0%    ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·2                                        38.3k ± 1%               38.3k ± 0%    ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·3                                        45.9k ± 0%               46.1k ± 1%    ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·4                                        50.0k ± 0%               50.3k ± 1%    ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·8                                        60.3k ± 1%               60.8k ± 1%    ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·12                                       62.1k ± 1%               62.5k ± 1%  +0.67%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·16                                       61.6k ± 1%               62.1k ± 2%    ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.3k ± 0%               26.3k ± 0%    ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          55.7k ± 1%               55.1k ± 0%  -1.12%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          62.8k ± 1%               62.6k ± 1%    ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          69.4k ± 1%               69.0k ± 1%    ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          88.3k ± 1%               87.7k ± 0%    ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         93.5k ± 1%               92.4k ± 1%  -1.17%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         93.8k ± 0%               93.5k ± 1%    ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.0k ± 0%               10.9k ± 0%  -0.70%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     18.3k ± 1%               18.2k ± 0%    ~     (p=0.111 n=4+5)
      neo/go/sqlite-zwrk.go·3                                     24.2k ± 0%               24.2k ± 1%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.8k ± 1%               26.8k ± 1%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     29.6k ± 2%               30.0k ± 2%    ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    29.3k ± 2%               29.5k ± 1%    ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    28.6k ± 1%               28.5k ± 1%    ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.9k ± 1%               11.9k ± 0%    ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              19.6k ± 1%               19.6k ± 1%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              26.4k ± 0%               26.7k ± 0%  +1.08%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              30.0k ± 0%               30.4k ± 1%  +1.43%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              31.2k ± 2%               32.1k ± 0%  +2.86%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             28.8k ± 3%               30.2k ± 2%  +4.93%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             28.4k ± 1%               29.7k ± 2%  +4.69%  (p=0.008 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zwrk.go·1                                                556k ± 0%                558k ± 1%    ~     (p=0.690 n=5+5)
      fs1-zwrk.go·2                                                994k ± 6%               1011k ± 8%    ~     (p=0.310 n=5+5)
      fs1-zwrk.go·3                                               1.33M ± 2%               1.33M ± 0%    ~     (p=0.690 n=5+5)
      fs1-zwrk.go·4                                               1.53M ± 0%               1.54M ± 3%    ~     (p=0.222 n=5+5)
      fs1-zwrk.go·8                                               1.59M ± 1%               1.59M ± 0%    ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                              1.60M ± 1%               1.59M ± 0%    ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                              1.59M ± 0%               1.59M ± 0%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        9.75k ± 1%               9.66k ± 0%  -0.94%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        12.4k ± 1%               12.3k ± 1%    ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        14.2k ± 1%               14.2k ± 1%    ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        14.9k ± 1%               14.9k ± 1%    ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        15.6k ± 1%               15.7k ± 1%    ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       16.0k ± 1%               16.0k ± 1%    ~     (p=1.000 n=5+4)
      zeo/py/fs1-zwrk.go·16                                       16.0k ± 6%               16.1k ± 1%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.45k ± 2%               7.46k ± 1%    ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.71k ± 1%               8.67k ± 1%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.69k ± 1%               8.71k ± 1%    ~     (p=0.802 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.61k ± 1%               8.68k ± 0%  +0.88%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.61k ± 1%               8.73k ± 1%  +1.42%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.59k ± 1%               8.66k ± 1%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.60k ± 1%               8.62k ± 1%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.45k ± 2%               5.47k ± 2%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.25k ± 1%               6.37k ± 0%  +1.89%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.24k ± 1%               6.30k ± 1%  +0.96%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.27k ± 1%               6.33k ± 0%  +0.97%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.28k ± 1%               6.36k ± 1%    ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.33k ± 0%               6.36k ± 1%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.30k ± 1%               6.35k ± 0%  +0.81%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·1                                        23.9k ± 0%               24.0k ± 0%  +0.52%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                        45.5k ± 1%               45.6k ± 1%    ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·3                                        55.1k ± 0%               55.5k ± 1%  +0.75%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·4                                        60.4k ± 0%               60.7k ± 0%    ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·8                                        69.2k ± 2%               69.3k ± 3%    ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·12                                       68.0k ± 5%               69.5k ± 7%    ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·16                                       68.1k ± 3%               67.8k ± 2%    ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          27.2k ± 1%               27.1k ± 0%    ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          55.5k ± 1%               55.4k ± 1%    ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          64.0k ± 1%               62.9k ± 1%  -1.69%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          69.1k ± 1%               68.4k ± 1%    ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          81.1k ± 4%               79.9k ± 3%    ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         77.8k ± 8%               77.6k ± 4%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         76.8k ± 5%               77.7k ± 7%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.7k ± 1%               11.7k ± 0%    ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     18.9k ± 1%               19.1k ± 0%    ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     24.4k ± 2%               24.3k ± 1%    ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.0k ± 3%               26.3k ± 1%    ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     24.6k ± 5%               24.8k ± 3%    ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    23.7k ± 3%               23.6k ± 2%    ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    24.1k ± 3%               24.3k ± 1%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              12.2k ± 1%               12.2k ± 0%    ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              19.6k ± 1%               19.6k ± 0%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              25.5k ± 1%               26.2k ± 2%  +2.75%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.5k ± 2%               29.1k ± 1%  +5.64%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              25.6k ± 2%               27.3k ± 2%  +6.33%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             24.0k ± 2%               25.5k ± 1%  +6.19%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             24.2k ± 1%               25.5k ± 1%  +5.65%  (p=0.008 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:deco dataset:wczblk1-8
      fs1-zwrk.go·1                                              2.32µs ± 1%              2.29µs ± 1%  -1.48%  (p=0.016 n=5+5)
      fs1-zwrk.go·2                                              2.63µs ± 3%              2.67µs ± 3%    ~     (p=0.310 n=5+5)
      fs1-zwrk.go·3                                              2.78µs ± 2%              2.77µs ± 0%    ~     (p=0.841 n=5+5)
      fs1-zwrk.go·4                                              3.44µs ± 1%              3.44µs ± 1%    ~     (p=1.000 n=5+5)
      fs1-zwrk.go·8                                              6.28µs ± 1%              6.29µs ± 1%    ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                             9.40µs ± 1%              9.35µs ± 0%    ~     (p=0.159 n=5+4)
      fs1-zwrk.go·16                                             12.5µs ± 1%              12.5µs ± 1%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        125µs ± 4%               123µs ± 0%    ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        210µs ± 1%               210µs ± 1%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        286µs ± 0%               285µs ± 1%    ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        365µs ± 1%               366µs ± 1%    ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        699µs ± 1%               698µs ± 1%    ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.03ms ± 0%              1.03ms ± 2%    ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.36ms ± 2%              1.36ms ± 1%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               142µs ± 1%               141µs ± 1%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               235µs ± 1%               235µs ± 0%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               353µs ± 1%               354µs ± 1%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               470µs ± 1%               474µs ± 1%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               938µs ± 1%               939µs ± 1%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.41ms ± 2%              1.40ms ± 1%    ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.89ms ± 1%              1.87ms ± 0%  -1.07%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  186µs ± 3%               187µs ± 2%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  315µs ± 0%               322µs ± 1%  +2.07%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  478µs ± 1%               481µs ± 0%    ~     (p=0.190 n=5+4)
      neo/py(!log)/sql-zwrk.go·4                                  636µs ± 1%               648µs ± 2%  +1.91%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.27ms ± 1%              1.31ms ± 0%  +2.75%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.92ms ± 1%              1.95ms ± 1%  +1.57%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zwrk.go·16                                2.57ms ± 2%              2.61ms ± 3%    ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·1                                       54.4µs ± 0%              54.2µs ± 0%    ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·2                                       52.2µs ± 1%              52.2µs ± 0%    ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·3                                       65.3µs ± 0%              65.1µs ± 1%    ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·4                                       80.0µs ± 0%              79.5µs ± 1%    ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·8                                        133µs ± 1%               132µs ± 1%    ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·12                                       193µs ± 1%               192µs ± 1%  -0.67%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·16                                       260µs ± 1%               258µs ± 2%    ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         38.0µs ± 0%              38.0µs ± 0%    ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         35.9µs ± 1%              36.3µs ± 0%  +1.13%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         47.7µs ± 1%              47.9µs ± 1%    ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         57.7µs ± 1%              58.0µs ± 1%    ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         90.6µs ± 1%              91.2µs ± 0%    ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         128µs ± 1%               130µs ± 1%  +1.18%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         171µs ± 0%               171µs ± 1%    ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    91.2µs ± 0%              91.8µs ± 0%  +0.71%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     109µs ± 1%               110µs ± 0%    ~     (p=0.111 n=4+5)
      neo/go/sqlite-zwrk.go·3                                     124µs ± 0%               124µs ± 1%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     149µs ± 1%               149µs ± 1%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     270µs ± 2%               267µs ± 2%    ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    410µs ± 2%               407µs ± 1%    ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    560µs ± 1%               561µs ± 1%    ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             84.0µs ± 1%              84.1µs ± 0%    ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              102µs ± 1%               102µs ± 1%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              113µs ± 0%               112µs ± 0%  -1.07%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              133µs ± 0%               132µs ± 1%  -1.41%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              257µs ± 2%               250µs ± 0%  -2.80%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             417µs ± 3%               397µs ± 2%  -4.72%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             563µs ± 1%               538µs ± 2%  -4.47%  (p=0.008 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zwrk.go·1                                              1.80µs ± 0%              1.79µs ± 1%    ~     (p=0.524 n=5+5)
      fs1-zwrk.go·2                                              2.01µs ± 6%              1.98µs ± 8%    ~     (p=0.310 n=5+5)
      fs1-zwrk.go·3                                              2.26µs ± 2%              2.25µs ± 0%    ~     (p=0.690 n=5+5)
      fs1-zwrk.go·4                                              2.61µs ± 0%              2.59µs ± 3%    ~     (p=0.198 n=5+5)
      fs1-zwrk.go·8                                              5.04µs ± 1%              5.04µs ± 0%    ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                             7.52µs ± 1%              7.53µs ± 0%    ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                             10.0µs ± 0%              10.0µs ± 0%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        103µs ± 1%               104µs ± 0%  +0.95%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        161µs ± 1%               162µs ± 1%    ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        212µs ± 1%               211µs ± 1%    ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        268µs ± 1%               268µs ± 1%    ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        512µs ± 1%               510µs ± 1%    ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       752µs ± 1%               752µs ± 1%    ~     (p=1.000 n=5+4)
      zeo/py/fs1-zwrk.go·16                                      1.00ms ± 6%              0.99ms ± 1%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               134µs ± 1%               134µs ± 1%    ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               230µs ± 1%               231µs ± 1%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               345µs ± 1%               344µs ± 1%    ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               465µs ± 1%               461µs ± 0%  -0.88%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               929µs ± 1%               916µs ± 1%  -1.41%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.40ms ± 1%              1.39ms ± 1%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.86ms ± 1%              1.86ms ± 1%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  184µs ± 2%               183µs ± 2%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  320µs ± 1%               314µs ± 0%  -1.86%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  481µs ± 1%               476µs ± 1%  -0.95%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  638µs ± 1%               632µs ± 0%  -0.96%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.27ms ± 1%              1.26ms ± 1%    ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.89ms ± 0%              1.89ms ± 1%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.54ms ± 1%              2.52ms ± 0%  -0.80%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·1                                       41.9µs ± 0%              41.7µs ± 0%  -0.51%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                       44.0µs ± 1%              43.8µs ± 1%    ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·3                                       54.5µs ± 0%              54.1µs ± 1%  -0.74%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·4                                       66.2µs ± 0%              65.9µs ± 0%    ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·8                                        116µs ± 2%               115µs ± 3%    ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·12                                       177µs ± 5%               173µs ± 7%    ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·16                                       235µs ± 3%               236µs ± 2%    ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         36.8µs ± 1%              36.9µs ± 0%    ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         36.0µs ± 1%              36.1µs ± 1%    ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         46.9µs ± 1%              47.7µs ± 1%  +1.72%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         57.9µs ± 1%              58.4µs ± 1%    ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         98.6µs ± 4%             100.2µs ± 3%    ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         155µs ± 8%               155µs ± 4%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         208µs ± 5%               206µs ± 7%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    85.5µs ± 1%              85.3µs ± 0%    ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     106µs ± 1%               105µs ± 0%    ~     (p=0.063 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     123µs ± 2%               123µs ± 1%    ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     154µs ± 3%               152µs ± 1%    ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     325µs ± 5%               323µs ± 3%    ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    507µs ± 3%               508µs ± 2%    ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    665µs ± 3%               657µs ± 1%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             82.3µs ± 1%              82.3µs ± 0%    ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              102µs ± 1%               102µs ± 0%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              118µs ± 1%               115µs ± 3%  -2.66%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              145µs ± 2%               138µs ± 1%  -5.36%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              312µs ± 2%               293µs ± 2%  -5.95%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             500µs ± 2%               470µs ± 1%  -5.84%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             662µs ± 1%               627µs ± 1%  -5.35%  (p=0.008 n=5+5)
      620b723c
    • Kirill Smelkov's avatar
      X rio: localhost timings, C > C1 disabled · 3695ff12
      Kirill Smelkov authored
      Disabling C-states on rio tendto help serial cases, like it was on neo1
      and z6001, but it is closer to noise.
      
      ---- 8< ----
      cluster:rio dataset:wczblk1-8
      zeo/py/fs1-zhash.py                                         400µs ± 0%               370µs ± 1%   -7.32%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                318µs ± 7%               295µs ± 0%   -7.16%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       158µs ± 3%               158µs ± 2%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.py                                         222µs ± 4%               214µs ± 2%   -3.73%  (p=0.040 n=5+5)
      neo/go/sqlite-zhash.py                                      273µs ± 3%               256µs ± 4%   -6.45%  (p=0.008 n=5+5)
      
      cluster:rio dataset:prod1-1024
      zeo/py/fs1-zhash.py                                         372µs ±10%               347µs ± 5%   -6.84%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                321µs ±11%               298µs ± 5%   -7.13%  (p=0.048 n=5+5)
      ---- 8< ----
      
      the pystone/s change is nose as pystone/s for C-enabled case was 146k on
      prev-prev run (see 31dc070d).
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset 20180306-rio-ffixed-c.txt 20180306-rio-ffixed-noc_C1\(1µs\).txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:rio
      pystone                                                      115k ±12%                144k ± 1%  +25.53%  (p=0.008 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:rio
      crc32/py/4K                                                4.77µs ± 0%              4.78µs ± 1%     ~     (p=0.825 n=4+5)
      crc32/go/4K                                                1.49µs ± 0%              1.49µs ± 0%     ~     (p=0.484 n=5+5)
      sha1/py/4K                                                 8.04µs ± 1%              8.00µs ± 1%     ~     (p=0.206 n=5+5)
      sha1/go/4K                                                 8.93µs ± 0%              8.93µs ± 0%     ~     (p=0.389 n=5+5)
      unzlib/py/wczdata                                          25.1µs ± 1%              25.1µs ± 1%     ~     (p=1.000 n=5+5)
      unzlib/go/wczdata                                          23.0µs ± 0%              22.9µs ± 0%   -0.45%  (p=0.016 n=5+5)
      unzlib/py/prod1-avg                                        7.16µs ± 1%              7.08µs ± 1%     ~     (p=0.056 n=5+5)
      unzlib/go/prod1-avg                                        5.08µs ± 1%              5.04µs ± 0%   -0.82%  (p=0.008 n=5+5)
      disk/randread/direct/4K-min                                92.4µs ± 0%              92.7µs ± 0%     ~     (p=0.198 n=5+5)
      disk/randread/direct/4K-avg                                 115µs ± 0%               115µs ± 0%   +0.37%  (p=0.008 n=5+5)
      disk/randread/pagecache/4K-min                              565ns ± 2%               562ns ± 1%     ~     (p=0.444 n=5+5)
      disk/randread/pagecache/4K-avg                              992ns ± 0%               992ns ± 0%     ~     (p=1.032 n=4+5)
      
      name                                           old time/object          new time/object          delta
      cluster:rio dataset:wczblk1-8
      fs1-zhash.py                                               29.2µs ± 1%              28.8µs ± 2%     ~     (p=0.111 n=4+5)
      fs1-zhash.go                                               4.68µs ± 5%              4.60µs ± 0%     ~     (p=0.444 n=5+5)
      fs1-zhash.go+prefetch128                                   4.78µs ± 5%              4.62µs ±15%     ~     (p=0.159 n=5+5)
      zeo/py/fs1-zhash.py                                         400µs ± 0%               370µs ± 1%   -7.32%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go                                         138µs ± 1%               136µs ± 2%     ~     (p=0.087 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            74.7µs ± 2%              74.9µs ± 2%     ~     (p=0.730 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                318µs ± 7%               295µs ± 0%   -7.16%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                154µs ± 4%               151µs ± 6%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    125µs ± 3%               126µs ± 2%     ~     (p=0.746 n=5+5)
      neo/py(!log)/sql-zhash.py                                   400µs ±57%               325µs ± 2%     ~     (p=0.063 n=5+4)
      neo/py(!log)/sql-zhash.go                                   183µs ±11%               178µs ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       158µs ± 3%               158µs ± 2%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.py                                         222µs ± 4%               214µs ± 2%   -3.73%  (p=0.040 n=5+5)
      neo/go/fs1-zhash.go                                        68.6µs ± 2%              68.9µs ± 3%     ~     (p=0.722 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            29.0µs ± 6%              28.3µs ± 4%     ~     (p=0.135 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          43.9µs ± 3%              43.7µs ± 2%     ~     (p=0.881 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              18.8µs ± 5%              18.6µs ± 4%     ~     (p=0.516 n=5+5)
      neo/go/sqlite-zhash.py                                      273µs ± 3%               256µs ± 4%   -6.45%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      104µs ± 1%               104µs ± 2%     ~     (p=0.651 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         36.3µs ± 3%              37.0µs ± 8%     ~     (p=0.595 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              94.2µs ± 3%              93.1µs ± 3%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  35.1µs ± 6%              35.7µs ±13%     ~     (p=1.000 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zhash.py                                               23.9µs ± 1%              24.0µs ± 2%     ~     (p=0.937 n=4+5)
      fs1-zhash.go                                               3.40µs ± 0%              3.40µs ± 0%     ~     (all equal)
      fs1-zhash.go+prefetch128                                   3.02µs ± 9%              3.04µs ± 2%     ~     (p=0.397 n=5+5)
      zeo/py/fs1-zhash.py                                         372µs ±10%               347µs ± 5%   -6.84%  (p=0.032 n=5+5)
      zeo/py/fs1-zhash.go                                         114µs ± 1%               114µs ± 2%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            64.6µs ± 1%              66.6µs ± 1%   +3.07%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                321µs ±11%               298µs ± 5%   -7.13%  (p=0.048 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                142µs ± 3%               142µs ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    117µs ± 1%               115µs ± 1%     ~     (p=0.087 n=5+5)
      neo/py(!log)/sql-zhash.py                                   330µs ± 1%               380µs ±34%  +15.42%  (p=0.016 n=4+5)
      neo/py(!log)/sql-zhash.go                                   172µs ± 1%               170µs ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       149µs ± 2%               148µs ± 1%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zhash.py                                         217µs ± 1%               214µs ± 5%     ~     (p=0.643 n=5+5)
      neo/go/fs1-zhash.go                                        49.8µs ± 2%              49.5µs ± 1%     ~     (p=0.246 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            18.8µs ± 1%              19.1µs ± 2%   +2.03%  (p=0.048 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          40.4µs ± 3%              40.5µs ± 2%     ~     (p=0.587 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              16.1µs ± 2%              15.8µs ± 3%     ~     (p=0.238 n=5+5)
      neo/go/sqlite-zhash.py                                      263µs ± 4%               253µs ± 3%   -3.90%  (p=0.024 n=5+5)
      neo/go/sqlite-zhash.go                                     93.1µs ± 1%              92.7µs ± 1%     ~     (p=0.595 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         32.7µs ± 2%              32.6µs ± 4%     ~     (p=0.659 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              89.6µs ± 1%              91.2µs ± 1%   +1.79%  (p=0.024 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  34.0µs ± 2%              32.7µs ± 2%   -3.82%  (p=0.008 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:rio dataset:wczblk1-8
      fs1-zwrk.go·1                                                300k ± 0%                299k ± 1%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·2                                                546k ± 0%                547k ± 1%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·3                                                810k ± 0%                812k ± 0%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·4                                               1.08M ± 0%               1.08M ± 0%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·8                                               1.42M ± 0%               1.42M ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·12                                              1.55M ± 0%               1.55M ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                              1.55M ± 0%               1.54M ± 0%   -0.34%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        7.41k ± 1%               7.42k ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        9.03k ± 1%               8.95k ± 1%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        9.77k ± 1%               9.86k ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        10.1k ± 3%               10.1k ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        10.5k ± 0%               10.4k ± 2%   -1.37%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       10.6k ± 1%               10.6k ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       10.6k ± 1%               10.6k ± 1%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               6.80k ± 2%               6.78k ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.31k ± 7%               8.25k ± 8%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.60k ± 1%               8.48k ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.60k ± 1%               8.52k ± 0%     ~     (p=0.114 n=4+4)
      neo/py(!log)/sqlite-zwrk.go·8                               8.61k ± 1%               8.51k ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.56k ± 1%               8.46k ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.49k ± 3%               8.51k ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.62k ± 6%               5.59k ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.75k ± 4%               6.83k ± 1%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sql-zwrk.go·3                                  6.77k ± 2%               6.71k ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.51k ± 7%               6.56k ± 4%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.56k ± 4%               6.68k ± 4%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.84k ± 1%               6.73k ± 6%     ~     (p=0.730 n=4+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.73k ± 3%               6.71k ± 3%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                        15.5k ± 0%               15.6k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·2                                        29.9k ± 1%               30.2k ± 1%   +0.84%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·3                                        39.4k ± 0%               39.7k ± 0%   +0.70%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                        49.4k ± 0%               49.6k ± 0%   +0.54%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        68.4k ± 0%               68.8k ± 0%   +0.62%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       72.5k ± 0%               73.0k ± 0%   +0.66%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·16                                       73.2k ± 0%               73.7k ± 1%   +0.79%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.2k ± 1%               25.3k ± 2%   -3.17%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          47.6k ± 0%               47.8k ± 0%   +0.46%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          59.4k ± 0%               59.6k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          72.2k ± 0%               72.4k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          96.7k ± 0%               96.8k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          109k ± 0%                110k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                          113k ± 1%                113k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     9.82k ± 0%               9.91k ± 0%   +0.88%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     18.3k ± 0%               18.4k ± 0%   +0.56%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     25.3k ± 0%               25.5k ± 0%   +0.91%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     30.3k ± 0%               30.6k ± 0%   +0.80%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     39.5k ± 0%               40.1k ± 0%   +1.54%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    40.8k ± 2%               41.8k ± 1%   +2.31%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    40.5k ± 2%               41.8k ± 2%   +3.20%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.0k ± 1%               11.1k ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              20.0k ± 0%               20.1k ± 0%   +0.35%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              27.9k ± 0%               28.0k ± 0%   +0.27%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              34.1k ± 0%               34.3k ± 0%   +0.62%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              44.1k ± 1%               44.7k ± 1%   +1.53%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             43.1k ± 1%               44.5k ± 1%   +3.33%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             41.2k ± 2%               43.0k ± 2%   +4.21%  (p=0.008 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zwrk.go·1                                                465k ± 1%                461k ± 1%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·2                                                920k ± 0%                918k ± 0%     ~     (p=0.730 n=4+5)
      fs1-zwrk.go·3                                               1.36M ± 1%               1.37M ± 1%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·4                                               1.81M ± 0%               1.80M ± 3%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·8                                               2.37M ± 1%               2.38M ± 2%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·12                                              2.41M ± 0%               2.42M ± 0%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·16                                              2.42M ± 0%               2.41M ± 0%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        8.98k ± 1%               8.88k ± 1%   -1.08%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        11.7k ± 1%               11.6k ± 2%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        12.9k ± 2%               12.5k ± 2%   -2.84%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        13.4k ± 4%               13.1k ± 2%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        14.0k ± 2%               13.6k ± 1%   -2.77%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       14.2k ± 2%               13.9k ± 1%   -2.05%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       14.2k ± 3%               13.8k ± 1%   -2.84%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.16k ± 4%               7.12k ± 3%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.75k ± 1%               8.64k ± 7%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.65k ± 4%               8.79k ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.53k ± 6%               8.73k ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.61k ± 3%               8.60k ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.64k ± 0%               8.78k ± 1%   +1.63%  (p=0.016 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.64k ± 1%               8.58k ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.88k ± 1%               5.91k ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.79k ± 2%               6.71k ± 9%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.58k ± 4%               6.85k ± 2%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.68k ± 4%               6.82k ± 1%     ~     (p=0.730 n=5+4)
      neo/py(!log)/sql-zwrk.go·8                                  6.83k ± 1%               6.80k ± 6%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.66k ± 4%               6.87k ± 2%   +3.10%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.65k ± 5%               6.90k ± 2%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·1                                        21.8k ± 1%               21.9k ± 2%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·2                                        39.2k ± 1%               39.6k ± 1%   +0.94%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·3                                        51.4k ± 0%               51.5k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·4                                        62.8k ± 0%               62.8k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·8                                        80.7k ± 1%               80.2k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·12                                       80.0k ± 2%               79.6k ± 3%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       78.3k ± 2%               77.1k ± 5%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.5k ± 1%               26.9k ± 1%   +1.52%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          48.8k ± 0%               49.2k ± 0%   +0.89%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          61.8k ± 0%               62.1k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          74.0k ± 0%               74.2k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          91.3k ± 0%               91.9k ± 2%     ~     (p=0.190 n=4+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         93.1k ± 2%               92.9k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         89.7k ± 2%               90.1k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.0k ± 1%               11.1k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     19.4k ± 1%               19.4k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     26.6k ± 0%               26.5k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     31.9k ± 0%               31.7k ± 0%   -0.47%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     37.4k ± 2%               37.3k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    35.2k ± 3%               35.4k ± 2%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    34.6k ± 2%               34.8k ± 2%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.5k ± 1%               11.4k ± 1%   -1.34%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              20.1k ± 0%               19.8k ± 0%   -1.52%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              27.6k ± 0%               27.3k ± 1%   -0.93%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              33.4k ± 0%               33.1k ± 1%   -0.81%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              38.8k ± 2%               38.8k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             36.4k ± 1%               36.0k ± 2%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             35.2k ± 2%               35.1k ± 2%     ~     (p=0.690 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:rio dataset:wczblk1-8
      fs1-zwrk.go·1                                              3.33µs ± 0%              3.34µs ± 1%     ~     (p=0.286 n=5+5)
      fs1-zwrk.go·2                                              3.67µs ± 0%              3.65µs ± 1%     ~     (p=0.667 n=5+5)
      fs1-zwrk.go·3                                              3.70µs ± 0%              3.69µs ± 0%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·4                                              3.72µs ± 0%              3.72µs ± 0%     ~     (p=0.984 n=5+5)
      fs1-zwrk.go·8                                              5.62µs ± 0%              5.62µs ± 0%     ~     (p=0.889 n=5+5)
      fs1-zwrk.go·12                                             7.76µs ± 0%              7.76µs ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                             10.3µs ± 0%              10.4µs ± 0%   +0.34%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        135µs ± 1%               135µs ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        222µs ± 1%               223µs ± 1%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        307µs ± 1%               304µs ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        398µs ± 3%               397µs ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        759µs ± 0%               770µs ± 2%   +1.41%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.13ms ± 1%              1.14ms ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.50ms ± 1%              1.51ms ± 1%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               147µs ± 2%               147µs ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               241µs ± 8%               243µs ± 8%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               349µs ± 1%               354µs ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               465µs ± 1%               470µs ± 0%     ~     (p=0.114 n=4+4)
      neo/py(!log)/sqlite-zwrk.go·8                               930µs ± 1%               940µs ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.40ms ± 1%              1.42ms ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.88ms ± 3%              1.88ms ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  178µs ± 6%               179µs ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  297µs ± 4%               293µs ± 1%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sql-zwrk.go·3                                  443µs ± 2%               447µs ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  616µs ± 8%               610µs ± 4%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.22ms ± 5%              1.20ms ± 4%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.75ms ± 1%              1.79ms ± 6%     ~     (p=0.730 n=4+5)
      neo/py(!log)/sql-zwrk.go·16                                2.38ms ± 3%              2.38ms ± 3%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                       64.4µs ± 0%              64.1µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·2                                       66.8µs ± 1%              66.3µs ± 1%   -0.83%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·3                                       76.1µs ± 0%              75.5µs ± 0%   -0.69%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                       81.0µs ± 0%              80.6µs ± 0%   -0.53%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        117µs ± 0%               116µs ± 0%   -0.62%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       165µs ± 0%               164µs ± 0%   -0.65%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·16                                       219µs ± 0%               217µs ± 1%   -0.78%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         38.2µs ± 1%              39.5µs ± 2%   +3.29%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         42.0µs ± 0%              41.8µs ± 0%   -0.45%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         50.5µs ± 0%              50.4µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         55.4µs ± 0%              55.3µs ± 0%     ~     (p=0.063 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         82.8µs ± 0%              82.7µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         110µs ± 0%               110µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         142µs ± 1%               142µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     102µs ± 0%               101µs ± 0%   -0.87%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     110µs ± 0%               109µs ± 0%   -0.55%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     119µs ± 0%               117µs ± 0%   -0.90%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     132µs ± 0%               131µs ± 0%   -0.79%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     203µs ± 0%               200µs ± 0%   -1.52%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    294µs ± 2%               287µs ± 1%   -2.26%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    395µs ± 2%               383µs ± 2%   -3.11%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             91.1µs ± 1%              90.4µs ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              100µs ± 0%               100µs ± 0%   -0.35%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              108µs ± 0%               107µs ± 0%   -0.27%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              117µs ± 0%               117µs ± 0%   -0.62%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              182µs ± 1%               179µs ± 1%   -1.51%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             279µs ± 1%               270µs ± 1%   -3.22%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             388µs ± 2%               372µs ± 2%   -4.03%  (p=0.008 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zwrk.go·1                                              2.15µs ± 1%              2.17µs ± 1%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·2                                              2.17µs ± 0%              2.18µs ± 0%     ~     (p=0.603 n=4+5)
      fs1-zwrk.go·3                                              2.20µs ± 1%              2.20µs ± 1%     ~     (p=0.460 n=5+5)
      fs1-zwrk.go·4                                              2.21µs ± 0%              2.23µs ± 3%     ~     (p=0.278 n=5+5)
      fs1-zwrk.go·8                                              3.37µs ± 1%              3.36µs ± 2%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·12                                             4.97µs ± 0%              4.97µs ± 0%     ~     (p=0.675 n=5+5)
      fs1-zwrk.go·16                                             6.61µs ± 0%              6.63µs ± 0%     ~     (p=0.063 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        111µs ± 1%               113µs ± 1%   +1.09%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        171µs ± 1%               173µs ± 2%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        233µs ± 2%               240µs ± 2%   +2.94%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        298µs ± 4%               306µs ± 2%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        572µs ± 2%               588µs ± 1%   +2.84%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       844µs ± 2%               861µs ± 1%   +2.07%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.12ms ± 3%              1.16ms ± 1%   +2.90%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               140µs ± 4%               140µs ± 3%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               229µs ± 1%               232µs ± 7%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               347µs ± 5%               341µs ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               470µs ± 7%               458µs ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               929µs ± 3%               930µs ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.39ms ± 0%              1.37ms ± 1%   -1.60%  (p=0.016 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.85ms ± 1%              1.86ms ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  170µs ± 1%               169µs ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  294µs ± 2%               299µs ±10%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  456µs ± 4%               438µs ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  599µs ± 4%               587µs ± 1%     ~     (p=0.730 n=5+4)
      neo/py(!log)/sql-zwrk.go·8                                 1.17ms ± 1%              1.18ms ± 6%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.80ms ± 4%              1.75ms ± 2%   -3.05%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.41ms ± 5%              2.32ms ± 2%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·1                                       45.9µs ± 1%              45.6µs ± 2%     ~     (p=0.167 n=5+5)
      neo/go/fs1-zwrk.go·2                                       51.0µs ± 1%              50.6µs ± 1%   -0.94%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·3                                       58.3µs ± 0%              58.3µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·4                                       63.7µs ± 0%              63.7µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·8                                       99.2µs ± 1%              99.8µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·12                                       150µs ± 2%               151µs ± 3%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       204µs ± 3%               208µs ± 5%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         37.7µs ± 1%              37.2µs ± 1%   -1.50%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         41.0µs ± 0%              40.6µs ± 0%   -0.88%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         48.5µs ± 0%              48.3µs ± 0%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         54.0µs ± 0%              53.9µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         87.6µs ± 0%              87.1µs ± 2%     ~     (p=0.190 n=4+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         129µs ± 2%               129µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         178µs ± 2%               178µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    90.7µs ± 1%              90.4µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     103µs ± 1%               103µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     113µs ± 0%               113µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     125µs ± 0%               126µs ± 0%   +0.47%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     214µs ± 2%               215µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    341µs ± 3%               339µs ± 2%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    462µs ± 2%               460µs ± 2%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             86.7µs ± 1%              87.9µs ± 1%   +1.36%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              100µs ± 0%               101µs ± 0%   +1.54%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              109µs ± 0%               110µs ± 1%   +0.94%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              120µs ± 0%               121µs ± 1%   +0.82%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              206µs ± 2%               206µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             330µs ± 1%               333µs ± 2%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             455µs ± 2%               456µs ± 2%     ~     (p=0.690 n=5+5)
      3695ff12
    • Kirill Smelkov's avatar
      X z6001: localhost timings, C > C1 disabled · 65de70b8
      Kirill Smelkov authored
      Like for neo1 disabling C-states helps serial cases for zeo/py and
      neo/py/sqlite and serial and parallel cases for neo/py/sql. For
      neo/py/sql it also tends to make timings less noisy:
      
      ---- 8< ----
      cluster:z6001 dataset:wczblk1-8
      zeo/py/fs1-zhash.py                                         650µs ± 7%               583µs ± 9%  -10.33%  (p=0.032 n=5+5)
      zeo/py/fs1-zhash.go                                         274µs ±13%               202µs ± 1%  -26.34%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                696µs ± 1%               476µs ± 4%  -31.64%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                338µs ± 7%               225µs ± 6%  -33.47%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                  1.00ms ±38%              0.59ms ±36%  -41.17%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zhash.go                                   434µs ± 6%               282µs ± 3%  -35.10%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       277µs ± 9%               237µs ± 2%  -14.37%  (p=0.008 n=5+5)
      
      zeo/py/fs1-zwrk.go·1                                        233µs ± 8%               195µs ± 2%  -16.41%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               288µs ±14%               220µs ± 2%  -23.74%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  400µs ±16%               278µs ± 1%  -30.47%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  562µs ± 8%               470µs ± 0%  -16.47%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  827µs ±13%               699µs ± 1%  -15.44%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.13ms ±14%              0.96ms ±10%  -15.10%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.13ms ±13%              1.90ms ± 1%  -10.78%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.24ms ±12%              2.82ms ± 2%  -12.82%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.62ms ± 8%              3.76ms ± 1%  -18.69%  (p=0.016 n=5+4)
      
      cluster:z6001 dataset:prod1-1024
      zeo/py/fs1-zhash.go                                         235µs ± 7%               167µs ± 1%  -28.85%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                664µs ± 2%               452µs ±10%  -31.89%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                269µs ± 7%               208µs ± 1%  -22.79%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                  1.03ms ±29%              0.57ms ±38%  -44.81%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go                                   406µs ± 2%               267µs ± 3%  -34.15%  (p=0.008 n=5+5)
      
      zeo/py/fs1-zwrk.go·1                                        208µs ± 5%               163µs ± 1%  -21.69%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               271µs ± 7%               210µs ± 6%  -22.43%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  400µs ±11%               261µs ± 1%  -34.78%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  554µs ± 7%               463µs ± 1%  -16.42%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  783µs ±11%               692µs ± 0%  -11.57%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.06ms ±11%              0.92ms ± 1%  -12.52%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.07ms ± 9%              1.83ms ± 2%  -11.28%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.02ms ± 7%              2.80ms ± 3%   -7.52%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.32ms ±12%              3.67ms ± 2%  -15.10%  (p=0.008 n=5+5)
      ---- 8< ----
      
      Like on neo1 it also seems to be helping neo/go/* with slower python
      client, but for neo/go/sqlite with go client too:
      
      ---- 8< ----
      cluster:z6001 dataset:wczblk1-8
      neo/go/fs1-zhash.py                                         526µs ± 8%               333µs ±10%  -36.81%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.py                                      528µs ±15%               385µs ± 6%  -27.15%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      204µs ±22%               142µs ± 1%  -30.26%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               194µs ± 9%               132µs ± 3%  -31.76%  (p=0.008 n=5+5)
      
      neo/go/sqlite-zwrk.go·1                                     208µs ±14%               139µs ± 1%  -32.89%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     166µs ± 2%               147µs ± 1%  -11.70%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     158µs ± 1%               150µs ± 0%   -4.60%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     162µs ± 0%               157µs ± 0%   -3.12%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              185µs ± 4%               130µs ± 1%  -29.53%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              156µs ± 1%               136µs ± 1%  -12.98%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              149µs ± 1%               139µs ± 0%   -6.76%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              149µs ± 1%               142µs ± 0%   -4.81%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              166µs ± 1%               163µs ± 0%   -2.04%  (p=0.008 n=5+5)
      
      cluster:z6001 dataset:prod1-1024
      neo/go/fs1-zhash.py                                         520µs ± 9%               321µs ±11%  -38.25%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go                                        83.2µs ± 7%              74.8µs ± 3%  -10.14%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.py                                      539µs ±11%               361µs ± 6%  -32.97%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      196µs ± 9%               128µs ± 2%  -34.66%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               168µs ± 8%               125µs ± 4%  -25.63%  (p=0.008 n=5+5)
      
      neo/go/sqlite-zwrk.go·1                                     177µs ± 8%               126µs ± 1%  -29.04%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     151µs ± 2%               136µs ± 1%   -9.65%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     148µs ± 1%               140µs ± 0%   -5.57%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     151µs ± 0%               145µs ± 0%   -3.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     180µs ± 1%               177µs ± 1%   -1.31%  (p=0.016 n=5+5)
      
      neo/go/sqlite-zwrk.go(!sha1)·1                              176µs ± 4%               120µs ± 2%  -31.54%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              152µs ± 3%               131µs ± 1%  -13.38%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              147µs ± 1%               135µs ± 0%   -7.68%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              148µs ± 2%               140µs ± 1%   -5.20%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              176µs ± 1%               173µs ± 1%   -1.65%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             225µs ± 1%               224µs ± 0%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             321µs ± 1%               321µs ± 1%     ~     (p=1.000 n=5+5)
      ---- 8< ----
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset 20180306-z6001-ffixed-c.txt 20180306-z6001-ffixed-noc_C1\(3µs\).txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:z6001
      pystone                                                      109k ± 9%                114k ± 1%     ~     (p=0.421 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:z6001
      crc32/py/4K                                                5.11µs ± 1%              5.15µs ± 4%     ~     (p=0.738 n=5+5)
      crc32/go/4K                                                1.72µs ± 0%              1.72µs ± 0%     ~     (p=1.000 n=4+4)
      sha1/py/4K                                                 14.7µs ± 1%              14.7µs ± 1%     ~     (p=0.841 n=5+5)
      sha1/go/4K                                                 10.3µs ± 0%              10.3µs ± 0%     ~     (p=0.103 n=5+5)
      unzlib/py/wczdata                                          37.1µs ± 8%              36.3µs ± 1%     ~     (p=0.310 n=5+5)
      unzlib/go/wczdata                                          31.5µs ± 0%              31.2µs ± 0%   -1.12%  (p=0.008 n=5+5)
      unzlib/py/prod1-avg                                        18.5µs ± 3%              18.6µs ± 3%     ~     (p=0.841 n=5+5)
      unzlib/go/prod1-avg                                        10.0µs ± 1%               9.9µs ± 1%     ~     (p=0.095 n=5+5)
      disk/randread/direct/4K-min                                 126µs ± 1%               127µs ± 1%     ~     (p=1.000 n=4+5)
      disk/randread/direct/4K-avg                                 199µs ± 9%               168µs ± 0%  -15.84%  (p=0.008 n=5+5)
      disk/randread/pagecache/4K-min                              806ns ± 3%               799ns ± 1%     ~     (p=0.746 n=5+5)
      disk/randread/pagecache/4K-avg                             1.44µs ± 7%              1.52µs ± 3%     ~     (p=0.079 n=5+5)
      
      name                                           old time/object          new time/object          delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zhash.py                                               37.6µs ± 2%              37.4µs ± 2%     ~     (p=0.571 n=5+5)
      fs1-zhash.go                                               6.00µs ± 2%              5.96µs ± 1%     ~     (p=0.643 n=5+5)
      fs1-zhash.go+prefetch128                                   8.00µs ± 5%              7.24µs ± 6%   -9.50%  (p=0.016 n=5+5)
      zeo/py/fs1-zhash.py                                         650µs ± 7%               583µs ± 9%  -10.33%  (p=0.032 n=5+5)
      zeo/py/fs1-zhash.go                                         274µs ±13%               202µs ± 1%  -26.34%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                             101µs ± 2%               102µs ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                696µs ± 1%               476µs ± 4%  -31.64%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                338µs ± 7%               225µs ± 6%  -33.47%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    177µs ± 1%               179µs ± 1%     ~     (p=0.143 n=5+5)
      neo/py(!log)/sql-zhash.py                                  1.00ms ±38%              0.59ms ±36%  -41.17%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zhash.go                                   434µs ± 6%               282µs ± 3%  -35.10%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       277µs ± 9%               237µs ± 2%  -14.37%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.py                                         526µs ± 8%               333µs ±10%  -36.81%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go                                         102µs ± 8%                94µs ± 6%   -8.17%  (p=0.032 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            36.6µs ± 4%              36.6µs ± 3%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          76.4µs ± 5%              69.7µs ± 8%   -8.75%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              26.5µs ± 2%              26.4µs ± 5%     ~     (p=0.730 n=5+5)
      neo/go/sqlite-zhash.py                                      528µs ±15%               385µs ± 6%  -27.15%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      204µs ±22%               142µs ± 1%  -30.26%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         39.9µs ± 4%              41.4µs ± 5%     ~     (p=0.111 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               194µs ± 9%               132µs ± 3%  -31.76%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  38.2µs ± 7%              36.7µs ± 5%     ~     (p=0.151 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zhash.py                                               30.3µs ± 1%              30.0µs ± 1%     ~     (p=0.373 n=5+5)
      fs1-zhash.go                                               4.62µs ± 3%              4.60µs ± 0%     ~     (p=0.968 n=5+4)
      fs1-zhash.go+prefetch128                                   5.76µs ± 8%              5.48µs ± 4%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zhash.py                                         632µs ±15%               560µs ± 3%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zhash.go                                         235µs ± 7%               167µs ± 1%  -28.85%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            87.2µs ± 1%              88.5µs ± 1%   +1.49%  (p=0.048 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                664µs ± 2%               452µs ±10%  -31.89%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                269µs ± 7%               208µs ± 1%  -22.79%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    162µs ± 0%               163µs ± 0%     ~     (p=0.397 n=4+5)
      neo/py(!log)/sql-zhash.py                                  1.03ms ±29%              0.57ms ±38%  -44.81%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go                                   406µs ± 2%               267µs ± 3%  -34.15%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       268µs ± 5%               228µs ±10%  -14.87%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.py                                         520µs ± 9%               321µs ±11%  -38.25%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go                                        83.2µs ± 7%              74.8µs ± 3%  -10.14%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            24.0µs ± 5%              24.1µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          67.0µs ± 3%              65.2µs ± 5%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              21.2µs ± 4%              21.1µs ± 2%     ~     (p=0.952 n=5+5)
      neo/go/sqlite-zhash.py                                      539µs ±11%               361µs ± 6%  -32.97%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      196µs ± 9%               128µs ± 2%  -34.66%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         35.0µs ± 3%              34.6µs ± 2%     ~     (p=0.302 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               168µs ± 8%               125µs ± 4%  -25.63%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  35.1µs ± 4%              34.9µs ± 2%     ~     (p=1.000 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zwrk.go·1                                                230k ± 1%                231k ± 1%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·2                                                437k ± 5%                444k ± 1%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·3                                                663k ± 4%                661k ± 4%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·4                                                880k ± 1%                878k ± 3%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·8                                               1.75M ± 2%               1.76M ± 2%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                              2.56M ± 0%               2.51M ± 3%     ~     (p=0.063 n=4+5)
      fs1-zwrk.go·16                                              2.89M ± 1%               2.90M ± 1%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        4.30k ± 8%               5.14k ± 2%  +19.34%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        6.33k ± 0%               6.38k ± 2%   +0.85%  (p=0.016 n=4+5)
      zeo/py/fs1-zwrk.go·3                                        6.90k ± 0%               7.05k ± 1%   +2.13%  (p=0.016 n=4+5)
      zeo/py/fs1-zwrk.go·4                                        7.14k ± 1%               7.22k ± 2%     ~     (p=0.111 n=4+5)
      zeo/py/fs1-zwrk.go·8                                        7.53k ± 2%               7.50k ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       7.65k ± 0%               7.53k ± 0%   -1.59%  (p=0.016 n=4+5)
      zeo/py/fs1-zwrk.go·16                                       7.57k ± 0%               7.66k ± 1%   +1.17%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               3.50k ±15%               4.55k ± 2%  +30.01%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               5.58k ± 0%               5.59k ± 1%     ~     (p=0.730 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·3                               5.63k ± 2%               5.56k ± 0%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·4                               5.56k ± 1%               5.54k ± 0%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               5.61k ± 2%               5.59k ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              5.62k ± 1%               5.57k ± 0%   -0.82%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              5.62k ± 1%               5.58k ± 0%     ~     (p=0.413 n=4+5)
      neo/py(!log)/sql-zwrk.go·1                                  2.53k ±17%               3.59k ± 1%  +41.99%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  3.57k ± 9%               4.26k ± 0%  +19.25%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  3.65k ±14%               4.29k ± 1%  +17.53%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  3.56k ±16%               4.17k ± 9%  +17.25%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  3.78k ±12%               4.20k ± 1%  +11.12%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 3.73k ±13%               4.25k ± 2%  +13.97%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.47k ± 9%               4.26k ± 1%  +22.71%  (p=0.016 n=5+4)
      neo/go/fs1-zwrk.go·1                                        10.7k ± 5%               11.1k ± 7%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·2                                        22.3k ± 1%               23.1k ± 2%   +3.68%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                        31.7k ± 1%               32.1k ± 1%   +1.34%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                        43.2k ± 1%               43.5k ± 0%   +0.72%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·8                                        78.3k ± 0%               78.1k ± 0%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·12                                       92.5k ± 0%               92.4k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·16                                        103k ± 1%                102k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          15.0k ± 5%               15.1k ± 3%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          31.5k ± 1%               31.8k ± 1%   +0.91%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          43.8k ± 0%               44.1k ± 0%   +0.82%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          57.4k ± 0%               57.9k ± 0%   +0.92%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                           100k ± 0%                100k ± 0%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          116k ± 0%                116k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                          126k ± 1%                126k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     4.85k ±15%               7.17k ± 1%  +47.73%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     12.0k ± 2%               13.6k ± 1%  +13.23%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     19.0k ± 1%               19.9k ± 0%   +4.82%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     24.7k ± 0%               25.5k ± 0%   +3.22%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     44.8k ± 0%               44.9k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    56.3k ± 0%               55.7k ± 0%   -0.92%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    58.0k ± 0%               57.4k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              5.41k ± 4%               7.67k ± 1%  +41.83%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              12.8k ± 1%               14.7k ± 1%  +14.92%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              20.2k ± 1%               21.6k ± 0%   +7.25%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              26.8k ± 1%               28.2k ± 0%   +5.05%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              48.1k ± 1%               49.1k ± 0%   +2.08%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             60.3k ± 0%               60.4k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             61.7k ± 1%               61.9k ± 1%     ~     (p=0.690 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zwrk.go·1                                                347k ± 2%                347k ± 2%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·2                                                660k ± 3%                659k ± 2%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·3                                                985k ± 4%                978k ± 4%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·4                                               1.31M ± 2%               1.30M ± 4%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·8                                               2.55M ± 4%               2.52M ± 6%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·12                                              2.81M ± 1%               3.02M ± 1%   +7.78%  (p=0.008 n=5+5)
      fs1-zwrk.go·16                                              2.85M ± 2%               3.06M ± 1%   +7.51%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        4.80k ± 5%               6.13k ± 1%  +27.58%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        8.18k ± 1%               8.16k ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        8.96k ± 1%               8.99k ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        8.88k ± 9%               9.37k ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        10.0k ± 2%                9.8k ± 5%     ~     (p=0.905 n=4+5)
      zeo/py/fs1-zwrk.go·12                                       9.80k ± 6%               9.19k ± 8%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       10.1k ± 6%                8.9k ±15%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               3.70k ± 6%               4.77k ± 6%  +29.01%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               5.77k ± 0%               5.92k ± 0%   +2.58%  (p=0.029 n=4+4)
      neo/py(!log)/sqlite-zwrk.go·3                               5.77k ± 0%               5.76k ± 0%   -0.25%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               5.77k ± 0%               5.82k ± 2%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               5.84k ± 1%               5.75k ± 0%   -1.67%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              5.78k ± 2%               5.71k ± 0%   -1.27%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              5.80k ± 1%               5.71k ± 0%   -1.63%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  2.51k ±12%               3.83k ± 1%  +52.68%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  3.62k ± 8%               4.32k ± 1%  +19.32%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  3.86k ±11%               4.33k ± 0%  +12.15%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  3.82k ±11%               4.33k ± 1%  +13.35%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  3.89k ±10%               4.36k ± 2%  +12.29%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 3.98k ± 7%               4.29k ± 3%   +7.85%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.72k ±13%               4.36k ± 2%  +17.09%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                        13.8k ± 3%               14.0k ± 3%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·2                                        28.1k ± 0%               28.4k ± 1%   +1.29%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                        40.2k ± 0%               40.5k ± 0%   +0.60%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                        52.8k ± 1%               53.1k ± 0%   +0.54%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·8                                        90.6k ± 0%               90.2k ± 0%   -0.48%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·12                                       95.8k ± 1%               95.0k ± 2%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·16                                       90.9k ± 1%               90.4k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          16.2k ± 2%               16.3k ± 2%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          32.9k ± 1%               33.4k ± 0%   +1.52%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          46.2k ± 0%               46.5k ± 0%   +0.68%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          59.8k ± 1%               60.4k ± 0%   +0.91%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          98.1k ± 0%               98.7k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          102k ± 1%                103k ± 1%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         97.0k ± 2%               98.4k ± 2%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     5.67k ± 8%               7.97k ± 1%  +40.55%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     13.3k ± 2%               14.7k ± 1%  +10.67%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     20.3k ± 1%               21.5k ± 0%   +5.90%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.5k ± 0%               27.6k ± 0%   +3.93%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     44.5k ± 1%               45.1k ± 1%   +1.33%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    52.3k ± 1%               52.6k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    48.9k ± 1%               48.8k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              5.69k ± 4%               8.31k ± 2%  +45.99%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              13.2k ± 3%               15.2k ± 1%  +15.42%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              20.5k ± 1%               22.2k ± 0%   +8.31%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.1k ± 2%               28.6k ± 1%   +5.47%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              45.4k ± 1%               46.2k ± 1%   +1.67%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             53.3k ± 1%               53.5k ± 0%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             49.8k ± 1%               49.8k ± 1%     ~     (p=1.000 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zwrk.go·1                                              4.34µs ± 1%              4.33µs ± 1%     ~     (p=0.540 n=5+5)
      fs1-zwrk.go·2                                              4.58µs ± 5%              4.51µs ± 1%     ~     (p=0.381 n=5+5)
      fs1-zwrk.go·3                                              4.52µs ± 4%              4.54µs ± 4%     ~     (p=0.952 n=5+5)
      fs1-zwrk.go·4                                              4.55µs ± 1%              4.56µs ± 3%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·8                                              4.58µs ± 2%              4.56µs ± 2%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                             4.69µs ± 0%              4.77µs ± 3%     ~     (p=0.063 n=4+5)
      fs1-zwrk.go·16                                             5.53µs ± 1%              5.51µs ± 1%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        233µs ± 8%               195µs ± 2%  -16.41%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        315µs ± 2%               314µs ± 2%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        435µs ± 0%               426µs ± 1%   -2.08%  (p=0.016 n=4+5)
      zeo/py/fs1-zwrk.go·4                                        560µs ± 1%               554µs ± 2%     ~     (p=0.111 n=4+5)
      zeo/py/fs1-zwrk.go·8                                       1.06ms ± 2%              1.07ms ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.57ms ± 0%              1.59ms ± 0%   +1.62%  (p=0.016 n=4+5)
      zeo/py/fs1-zwrk.go·16                                      2.11ms ± 0%              2.09ms ± 1%   -1.15%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               288µs ±14%               220µs ± 2%  -23.74%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               358µs ± 0%               358µs ± 1%     ~     (p=0.730 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·3                               533µs ± 2%               539µs ± 0%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·4                               720µs ± 1%               723µs ± 0%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.43ms ± 2%              1.43ms ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             2.14ms ± 1%              2.15ms ± 0%   +0.82%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.85ms ± 1%              2.87ms ± 0%     ~     (p=0.413 n=4+5)
      neo/py(!log)/sql-zwrk.go·1                                  400µs ±16%               278µs ± 1%  -30.47%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  562µs ± 8%               470µs ± 0%  -16.47%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  827µs ±13%               699µs ± 1%  -15.44%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.13ms ±14%              0.96ms ±10%  -15.10%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.13ms ±13%              1.90ms ± 1%  -10.78%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.24ms ±12%              2.82ms ± 2%  -12.82%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.62ms ± 8%              3.76ms ± 1%  -18.69%  (p=0.016 n=5+4)
      neo/go/fs1-zwrk.go·1                                       93.9µs ± 4%              90.4µs ± 7%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·2                                       89.6µs ± 1%              86.5µs ± 2%   -3.55%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                       94.6µs ± 1%              93.3µs ± 1%   -1.33%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                       92.6µs ± 1%              91.9µs ± 0%   -0.71%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·8                                        102µs ± 0%               102µs ± 0%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·12                                       130µs ± 0%               130µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·16                                       156µs ± 1%               157µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         66.8µs ± 5%              66.1µs ± 3%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         63.5µs ± 1%              62.9µs ± 1%   -0.90%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         68.5µs ± 0%              68.0µs ± 0%   -0.81%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         69.7µs ± 0%              69.0µs ± 0%   -0.91%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         79.7µs ± 0%              79.9µs ± 0%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         103µs ± 0%               103µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         127µs ± 1%               127µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     208µs ±14%               139µs ± 1%  -32.89%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     166µs ± 2%               147µs ± 1%  -11.70%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     158µs ± 1%               150µs ± 0%   -4.60%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     162µs ± 0%               157µs ± 0%   -3.12%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     178µs ± 0%               178µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    213µs ± 0%               215µs ± 0%   +0.93%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    276µs ± 0%               279µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              185µs ± 4%               130µs ± 1%  -29.53%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              156µs ± 1%               136µs ± 1%  -12.98%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              149µs ± 1%               139µs ± 0%   -6.76%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              149µs ± 1%               142µs ± 0%   -4.81%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              166µs ± 1%               163µs ± 0%   -2.04%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             199µs ± 0%               199µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             259µs ± 1%               259µs ± 1%     ~     (p=0.690 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zwrk.go·1                                              2.88µs ± 2%              2.88µs ± 2%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·2                                              3.03µs ± 3%              3.03µs ± 3%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·3                                              3.05µs ± 4%              3.07µs ± 4%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·4                                              3.05µs ± 2%              3.09µs ± 4%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·8                                              3.14µs ± 4%              3.18µs ± 6%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·12                                             4.28µs ± 1%              3.97µs ± 1%   -7.22%  (p=0.008 n=5+5)
      fs1-zwrk.go·16                                             5.63µs ± 2%              5.23µs ± 1%   -7.01%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        208µs ± 5%               163µs ± 1%  -21.69%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        245µs ± 1%               245µs ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        335µs ± 1%               334µs ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        453µs ±10%               427µs ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        803µs ± 2%               815µs ± 5%     ~     (p=0.905 n=4+5)
      zeo/py/fs1-zwrk.go·12                                      1.23ms ± 6%              1.31ms ± 8%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.59ms ± 6%              1.82ms ±14%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               271µs ± 7%               210µs ± 6%  -22.43%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               346µs ± 0%               338µs ± 0%   -2.52%  (p=0.029 n=4+4)
      neo/py(!log)/sqlite-zwrk.go·3                               520µs ± 0%               521µs ± 0%   +0.25%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               694µs ± 0%               688µs ± 2%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.37ms ± 1%              1.39ms ± 0%   +1.68%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             2.07ms ± 2%              2.10ms ± 0%   +1.28%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.76ms ± 1%              2.80ms ± 0%   +1.65%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  400µs ±11%               261µs ± 1%  -34.78%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  554µs ± 7%               463µs ± 1%  -16.42%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  783µs ±11%               692µs ± 0%  -11.57%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.06ms ±11%              0.92ms ± 1%  -12.52%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.07ms ± 9%              1.83ms ± 2%  -11.28%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.02ms ± 7%              2.80ms ± 3%   -7.52%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.32ms ±12%              3.67ms ± 2%  -15.10%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                       72.6µs ± 3%              71.5µs ± 3%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·2                                       71.2µs ± 0%              70.3µs ± 1%   -1.27%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                       74.6µs ± 0%              74.1µs ± 0%   -0.59%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                       75.7µs ± 1%              75.3µs ± 0%   -0.54%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·8                                       88.3µs ± 0%              88.7µs ± 0%   +0.48%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·12                                       125µs ± 1%               126µs ± 2%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·16                                       176µs ± 1%               177µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         61.7µs ± 2%              61.3µs ± 2%     ~     (p=0.651 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         60.7µs ± 1%              59.8µs ± 0%   -1.50%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         64.9µs ± 0%              64.5µs ± 0%   -0.68%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         66.9µs ± 1%              66.3µs ± 0%   -0.90%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         81.5µs ± 0%              81.0µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         118µs ± 1%               116µs ± 1%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         165µs ± 2%               163µs ± 2%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     177µs ± 8%               126µs ± 1%  -29.04%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     151µs ± 2%               136µs ± 1%   -9.65%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     148µs ± 1%               140µs ± 0%   -5.57%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     151µs ± 0%               145µs ± 0%   -3.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     180µs ± 1%               177µs ± 1%   -1.31%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    229µs ± 1%               228µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    327µs ± 1%               328µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              176µs ± 4%               120µs ± 2%  -31.54%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              152µs ± 3%               131µs ± 1%  -13.38%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              147µs ± 1%               135µs ± 0%   -7.68%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              148µs ± 2%               140µs ± 1%   -5.20%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              176µs ± 1%               173µs ± 1%   -1.65%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             225µs ± 1%               224µs ± 0%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             321µs ± 1%               321µs ± 1%     ~     (p=1.000 n=5+5)
      65de70b8
    • Kirill Smelkov's avatar
      X neo1: localhost timings, C > C1 disabled · f40c8b4b
      Kirill Smelkov authored
      $ benchstat -split node,cluster,dataset 20180306-neo1-ffixed-c.txt 20180306-neo1-ffixed-noc_C1\(3µs\).txt
      
      Disabling C states helps serial cases for zeo/py and neo/py/sqlite and
      both serial and parallel cases for neo/py/sql. For neo/py/sql it also
      denoises the timing.
      
      ---- 8< ----
      cluster:neo1 dataset:wczblk1-8
      zeo/py/fs1-zhash.py                                         523µs ± 1%               465µs ± 4%  -11.04%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go                                         194µs ± 4%               173µs ± 2%  -10.70%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                684µs ± 3%               389µs ± 1%  -43.08%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                236µs ± 2%               198µs ± 5%  -16.19%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                   942µs ±47%               448µs ± 3%  -52.47%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zhash.go                                   300µs ±17%               251µs ± 2%  -16.37%  (p=0.008 n=5+5)
      
      zeo/py/fs1-zwrk.go·1                                        194µs ± 1%               171µs ± 1%  -11.93%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               232µs ± 4%               198µs ± 3%  -14.97%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  323µs ± 6%               242µs ± 1%  -24.90%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  503µs ± 2%               421µs ± 5%  -16.28%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  742µs ± 3%               639µs ± 4%  -13.97%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  986µs ± 4%               838µs ± 2%  -15.02%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.11ms ± 8%              1.71ms ± 4%  -18.91%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.02ms ± 3%              2.57ms ± 3%  -14.83%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.06ms ± 1%              3.39ms ± 3%  -16.33%  (p=0.008 n=5+5)
      
      cluster:neo1 dataset:prod1-1024
      zeo/py/fs1-zhash.go                                         170µs ± 3%               148µs ± 3%  -13.05%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                665µs ± 2%               382µs ± 3%  -42.60%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                219µs ± 2%               181µs ± 1%  -17.27%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                   886µs ±56%               426µs ± 1%  -51.90%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zhash.go                                   298µs ± 9%               234µs ± 2%  -21.22%  (p=0.008 n=5+5)
      
      zeo/py/fs1-zwrk.go·1                                        173µs ± 3%               146µs ± 2%  -15.31%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               204µs ± 8%               182µs ± 3%  -11.14%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  287µs ± 8%               236µs ± 8%  -17.73%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  495µs ± 6%               406µs ± 1%  -17.95%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  740µs ± 8%               618µs ± 3%  -16.50%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.01ms ± 4%              0.82ms ± 2%  -18.75%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.93ms ± 3%              1.64ms ± 1%  -15.14%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.01ms ± 4%              2.45ms ± 3%  -18.53%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.05ms ±10%              3.33ms ± 8%  -17.74%  (p=0.008 n=5+5)
      ---- 8< ----
      
      It looks to be also helping to neo/go/* with python (thus slower)
      client:
      
      ---- 8< ----
      cluster:neo1 dataset:wczblk1-8
      neo/go/fs1-zhash.py                                         383µs ±20%               270µs ± 2%  -29.62%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.py                                      402µs ± 6%               323µs ± 1%  -19.66%  (p=0.008 n=5+5)
      
      cluster:neo1 dataset:prod1-1024
      neo/go/fs1-zhash.py                                         319µs ±11%               260µs ± 2%  -18.46%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.py                                      382µs ± 6%               310µs ± 2%  -19.04%  (p=0.008 n=5+5)
      ---- 8< ----
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset 20180306-neo1-ffixed-c.txt 20180306-neo1-ffixed-noc_C1\(3µs\).txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:neo1
      pystone                                                      106k ± 1%                106k ± 1%     ~     (p=0.548 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:neo1
      crc32/py/4K                                                5.13µs ± 1%              5.13µs ± 1%     ~     (p=1.000 n=5+5)
      crc32/go/4K                                                2.79µs ± 0%              2.79µs ± 0%   -0.06%  (p=0.032 n=5+5)
      sha1/py/4K                                                 13.4µs ± 1%              13.5µs ± 1%     ~     (p=0.548 n=5+5)
      sha1/go/4K                                                 9.83µs ± 0%              9.85µs ± 1%     ~     (p=0.905 n=5+4)
      unzlib/py/wczdata                                          36.1µs ± 0%              36.1µs ± 1%     ~     (p=0.841 n=5+5)
      unzlib/go/wczdata                                          31.1µs ± 1%              30.9µs ± 1%     ~     (p=0.111 n=5+5)
      unzlib/py/prod1-avg                                        16.3µs ± 2%              16.8µs ±10%     ~     (p=0.548 n=5+5)
      unzlib/go/prod1-avg                                        9.42µs ± 0%              9.27µs ± 1%   -1.58%  (p=0.008 n=5+5)
      disk/randread/direct/4K-min                                 162µs ± 0%               162µs ± 0%     ~     (p=0.270 n=5+4)
      disk/randread/direct/4K-avg                                 187µs ± 2%               172µs ± 0%   -8.20%  (p=0.008 n=5+5)
      disk/randread/pagecache/4K-min                              389ns ± 1%               390ns ± 1%     ~     (p=0.548 n=5+5)
      disk/randread/pagecache/4K-avg                              804ns ± 0%               894ns ± 0%  +11.28%  (p=0.016 n=4+5)
      
      name                                           old time/object          new time/object          delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zhash.py                                               34.7µs ± 2%              34.4µs ± 2%     ~     (p=0.119 n=5+5)
      fs1-zhash.go                                               6.00µs ± 2%              5.90µs ± 0%     ~     (p=0.095 n=5+4)
      fs1-zhash.go+prefetch128                                   6.52µs ± 4%              6.26µs ± 3%     ~     (p=0.079 n=5+5)
      zeo/py/fs1-zhash.py                                         523µs ± 1%               465µs ± 4%  -11.04%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go                                         194µs ± 4%               173µs ± 2%  -10.70%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            98.6µs ± 3%              98.8µs ± 1%     ~     (p=0.810 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                684µs ± 3%               389µs ± 1%  -43.08%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                236µs ± 2%               198µs ± 5%  -16.19%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    162µs ± 2%               165µs ± 4%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zhash.py                                   942µs ±47%               448µs ± 3%  -52.47%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zhash.go                                   300µs ±17%               251µs ± 2%  -16.37%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       240µs ± 6%               220µs ± 1%   -8.51%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.py                                         383µs ±20%               270µs ± 2%  -29.62%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go                                        81.3µs ± 1%              81.0µs ± 4%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            33.8µs ± 5%              34.9µs ± 6%     ~     (p=0.381 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          57.6µs ± 3%              56.0µs ± 3%   -2.71%  (p=0.024 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              22.9µs ± 6%              22.7µs ± 7%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zhash.py                                      402µs ± 6%               323µs ± 1%  -19.66%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      125µs ± 1%               124µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         48.4µs ± 8%              46.9µs ± 2%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               116µs ± 2%               113µs ± 2%   -1.96%  (p=0.032 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  45.9µs ± 5%              46.6µs ± 4%     ~     (p=0.341 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zhash.py                                               28.9µs ± 1%              28.9µs ± 1%     ~     (p=0.746 n=5+5)
      fs1-zhash.go                                               3.76µs ± 4%              3.76µs ± 2%     ~     (p=1.000 n=5+5)
      fs1-zhash.go+prefetch128                                   3.86µs ± 2%              3.74µs ± 2%   -3.11%  (p=0.048 n=5+5)
      zeo/py/fs1-zhash.py                                         474µs ± 2%               442µs ± 9%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zhash.go                                         170µs ± 3%               148µs ± 3%  -13.05%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            87.8µs ± 1%              87.9µs ± 2%     ~     (p=0.881 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                665µs ± 2%               382µs ± 3%  -42.60%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                219µs ± 2%               181µs ± 1%  -17.27%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    151µs ± 1%               150µs ± 1%     ~     (p=0.206 n=5+4)
      neo/py(!log)/sql-zhash.py                                   886µs ±56%               426µs ± 1%  -51.90%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zhash.go                                   298µs ± 9%               234µs ± 2%  -21.22%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       230µs ± 3%               210µs ± 6%   -8.71%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.py                                         319µs ±11%               260µs ± 2%  -18.46%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go                                        61.3µs ± 3%              61.4µs ± 2%     ~     (p=0.802 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            22.5µs ± 3%              22.2µs ± 5%     ~     (p=0.595 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          52.0µs ± 3%              51.9µs ± 4%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              18.3µs ± 2%              18.3µs ± 3%     ~     (p=0.667 n=5+5)
      neo/go/sqlite-zhash.py                                      382µs ± 6%               310µs ± 2%  -19.04%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      113µs ± 1%               112µs ± 1%     ~     (p=0.063 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         40.9µs ± 4%              41.9µs ± 4%     ~     (p=0.190 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               108µs ± 1%               107µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  41.1µs ± 5%              41.1µs ± 2%     ~     (p=0.881 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zwrk.go·1                                                229k ± 0%                229k ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·2                                                443k ± 1%                439k ± 0%     ~     (p=0.111 n=5+4)
      fs1-zwrk.go·3                                                662k ± 1%                660k ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·4                                                867k ± 1%                865k ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·8                                                988k ± 0%                959k ±11%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                              1.02M ± 0%               1.02M ± 0%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·16                                               976k ±12%               1015k ± 0%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        5.15k ± 1%               5.84k ± 1%  +13.54%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        7.08k ± 1%               7.05k ± 5%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        7.73k ± 1%               7.82k ± 1%   +1.29%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        7.97k ± 4%               8.07k ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        8.30k ± 2%               8.40k ± 2%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       8.15k ± 1%               8.40k ± 2%   +3.08%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       8.25k ± 1%               8.48k ± 1%   +2.85%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               4.31k ± 4%               5.06k ± 3%  +17.59%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               6.28k ± 5%               6.39k ± 0%     ~     (p=0.730 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·3                               6.38k ± 0%               6.28k ± 8%     ~     (p=0.730 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·4                               6.15k ± 5%               6.10k ± 5%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               6.27k ± 4%               6.22k ± 9%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              6.33k ± 2%               6.28k ± 6%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              6.25k ± 4%               6.17k ± 6%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  3.10k ± 6%               4.12k ± 1%  +33.05%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  3.98k ± 1%               4.76k ± 5%  +19.62%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  4.04k ± 3%               4.70k ± 4%  +16.27%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  4.06k ± 4%               4.78k ± 2%  +17.62%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  3.79k ± 7%               4.67k ± 5%  +23.22%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 3.98k ± 3%               4.67k ± 3%  +17.40%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.94k ± 1%               4.72k ± 3%  +19.55%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                        12.8k ± 0%               12.8k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·2                                        24.8k ± 0%               25.0k ± 1%     ~     (p=0.063 n=4+5)
      neo/go/fs1-zwrk.go·3                                        32.3k ± 0%               32.2k ± 2%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·4                                        40.7k ± 0%               40.9k ± 0%   +0.47%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        54.5k ± 1%               54.9k ± 0%   +0.66%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·12                                       56.5k ± 1%               56.7k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       53.2k ±10%               54.4k ± 2%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          19.0k ± 2%               19.3k ± 2%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          37.8k ± 0%               37.8k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          48.0k ± 1%               48.2k ± 0%   +0.50%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          59.0k ± 0%               59.2k ± 0%   +0.39%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          78.0k ± 1%               78.3k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         82.2k ± 2%               82.5k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         80.4k ± 1%               80.3k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     8.06k ± 4%               8.24k ± 1%   +2.17%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     14.9k ± 0%               15.0k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     20.7k ± 0%               20.8k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     24.8k ± 0%               24.9k ± 0%   +0.39%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     31.7k ± 1%               31.6k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    30.8k ± 5%               31.4k ± 1%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    30.4k ± 2%               30.6k ± 3%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              8.95k ± 1%               9.05k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              16.2k ± 1%               16.3k ± 1%   +0.88%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              22.6k ± 0%               22.6k ± 0%     ~     (p=0.905 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.9k ± 0%               27.7k ± 0%   -0.83%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              35.0k ± 1%               34.4k ± 1%   -1.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             34.7k ± 1%               33.4k ± 2%   -3.68%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             33.0k ±11%               32.9k ± 2%     ~     (p=0.151 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zwrk.go·1                                                451k ± 0%                451k ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·2                                                893k ± 0%                871k ± 9%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·3                                               1.34M ± 1%               1.33M ± 0%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·4                                               1.77M ± 0%               1.76M ± 0%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·8                                               1.99M ± 1%               2.00M ± 2%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·12                                              2.03M ± 1%               2.03M ± 0%     ~     (p=0.556 n=4+5)
      fs1-zwrk.go·16                                              2.03M ± 0%               2.03M ± 0%     ~     (p=0.111 n=5+4)
      zeo/py/fs1-zwrk.go·1                                        5.79k ± 3%               6.83k ± 2%  +18.03%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        8.55k ± 1%               8.70k ± 1%   +1.74%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        9.28k ± 7%               9.54k ± 2%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        9.72k ± 1%               9.77k ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        10.4k ± 1%               10.5k ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       10.5k ± 1%               10.6k ± 1%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       10.4k ± 4%               10.7k ± 1%   +2.75%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               4.90k ± 7%               5.51k ± 3%  +12.34%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               6.28k ± 4%               6.38k ± 3%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               6.32k ± 5%               6.27k ± 5%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               6.45k ± 2%               6.54k ± 0%   +1.35%  (p=0.032 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·8                               6.45k ± 2%               6.48k ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              6.31k ± 3%               6.43k ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              6.36k ± 5%               6.41k ± 3%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  3.50k ± 9%               4.25k ± 7%  +21.25%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  4.05k ± 6%               4.92k ± 1%  +21.64%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  4.06k ± 7%               4.85k ± 3%  +19.49%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  3.98k ± 4%               4.90k ± 2%  +22.98%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  4.15k ± 3%               4.89k ± 1%  +17.81%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 4.00k ± 5%               4.90k ± 3%  +22.72%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.96k ±11%               4.81k ± 7%  +21.32%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                        17.1k ± 1%               17.4k ± 2%   +2.02%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                        32.6k ± 0%               32.8k ± 1%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·3                                        43.3k ± 0%               43.2k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·4                                        52.9k ± 0%               52.9k ± 0%     ~     (p=0.905 n=5+4)
      neo/go/fs1-zwrk.go·8                                        66.3k ± 1%               65.4k ± 1%     ~     (p=0.063 n=4+5)
      neo/go/fs1-zwrk.go·12                                       61.6k ± 1%               59.6k ± 4%   -3.20%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·16                                       55.6k ± 4%               53.9k ± 2%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          19.6k ± 5%               20.1k ± 2%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          40.3k ± 0%               39.9k ± 5%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          51.6k ± 0%               51.7k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          62.0k ± 0%               62.5k ± 0%   +0.78%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          74.2k ± 4%               74.0k ± 3%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         64.8k ± 7%               66.8k ± 3%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         59.5k ± 4%               58.6k ± 2%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     9.02k ± 1%               9.16k ± 1%   +1.58%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     16.0k ± 0%               16.0k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     21.8k ± 1%               21.8k ± 0%     ~     (p=0.730 n=4+5)
      neo/go/sqlite-zwrk.go·4                                     26.2k ± 0%               26.2k ± 1%     ~     (p=0.905 n=5+4)
      neo/go/sqlite-zwrk.go·8                                     30.0k ± 2%               29.9k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    28.6k ± 2%               28.5k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    28.7k ± 1%               28.9k ± 2%     ~     (p=0.730 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              9.45k ± 1%               9.51k ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              16.6k ± 1%               16.5k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              23.0k ± 0%               22.7k ± 0%   -1.37%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              28.0k ± 1%               27.4k ± 0%   -2.02%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              32.3k ± 0%               30.4k ±12%   -5.86%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             30.6k ± 2%               29.6k ± 2%   -3.24%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             30.3k ± 2%               29.5k ± 2%   -2.73%  (p=0.008 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zwrk.go·1                                              4.36µs ± 0%              4.37µs ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·2                                              4.52µs ± 1%              4.56µs ± 0%     ~     (p=0.111 n=5+4)
      fs1-zwrk.go·3                                              4.53µs ± 1%              4.54µs ± 1%     ~     (p=0.881 n=5+5)
      fs1-zwrk.go·4                                              4.61µs ± 1%              4.62µs ± 0%     ~     (p=0.889 n=5+5)
      fs1-zwrk.go·8                                              8.10µs ± 0%              8.37µs ±12%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                             11.8µs ± 0%              11.8µs ± 0%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·16                                             16.5µs ±13%              15.8µs ± 0%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        194µs ± 1%               171µs ± 1%  -11.93%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        282µs ± 1%               284µs ± 5%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        388µs ± 1%               383µs ± 1%   -1.27%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        502µs ± 5%               496µs ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        964µs ± 2%               952µs ± 2%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.47ms ± 1%              1.43ms ± 2%   -2.98%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.94ms ± 1%              1.89ms ± 1%   -2.77%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               232µs ± 4%               198µs ± 3%  -14.97%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               319µs ± 5%               313µs ± 0%     ~     (p=0.730 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·3                               470µs ± 0%               469µs ± 1%     ~     (p=0.343 n=4+4)
      neo/py(!log)/sqlite-zwrk.go·4                               651µs ± 5%               656µs ± 5%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.28ms ± 4%              1.29ms ±10%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.90ms ± 2%              1.91ms ± 6%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.56ms ± 4%              2.60ms ± 6%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  323µs ± 6%               242µs ± 1%  -24.90%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  503µs ± 2%               421µs ± 5%  -16.28%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  742µs ± 3%               639µs ± 4%  -13.97%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  986µs ± 4%               838µs ± 2%  -15.02%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.11ms ± 8%              1.71ms ± 4%  -18.91%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.02ms ± 3%              2.57ms ± 3%  -14.83%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.06ms ± 1%              3.39ms ± 3%  -16.33%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                       77.8µs ± 0%              78.2µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·2                                       80.6µs ± 0%              80.0µs ± 1%     ~     (p=0.063 n=4+5)
      neo/go/fs1-zwrk.go·3                                       92.8µs ± 0%              93.1µs ± 2%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·4                                       98.2µs ± 0%              97.7µs ± 0%   -0.47%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        147µs ± 1%               146µs ± 0%   -0.66%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·12                                       212µs ± 1%               212µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       293µs ± 1%               294µs ± 2%     ~     (p=0.556 n=4+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         52.7µs ± 2%              51.8µs ± 2%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         53.0µs ± 0%              52.9µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         62.5µs ± 1%              62.2µs ± 0%   -0.50%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         67.8µs ± 0%              67.6µs ± 0%   -0.39%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          103µs ± 1%               102µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         146µs ± 2%               145µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         199µs ± 1%               199µs ± 2%     ~     (p=0.794 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     124µs ± 4%               121µs ± 1%   -2.17%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     134µs ± 0%               134µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     145µs ± 0%               144µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     161µs ± 0%               161µs ± 0%   -0.38%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     252µs ± 1%               253µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    390µs ± 5%               382µs ± 1%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    526µs ± 2%               524µs ± 3%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              112µs ± 1%               110µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              124µs ± 1%               123µs ± 1%   -0.87%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              133µs ± 0%               133µs ± 0%     ~     (p=0.905 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              143µs ± 0%               145µs ± 0%   +0.83%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              228µs ± 1%               232µs ± 1%   +1.81%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             346µs ± 1%               359µs ± 2%   +3.82%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             486µs ±11%               486µs ± 2%     ~     (p=0.151 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zwrk.go·1                                              2.22µs ± 1%              2.22µs ± 1%     ~     (p=0.889 n=5+5)
      fs1-zwrk.go·2                                              2.24µs ± 0%              2.30µs ± 9%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·3                                              2.25µs ± 1%              2.25µs ± 0%     ~     (p=0.738 n=5+5)
      fs1-zwrk.go·4                                              2.26µs ± 0%              2.27µs ± 0%     ~     (p=0.286 n=5+5)
      fs1-zwrk.go·8                                              4.02µs ± 1%              4.00µs ± 2%     ~     (p=0.460 n=5+5)
      fs1-zwrk.go·12                                             5.92µs ± 1%              5.91µs ± 0%     ~     (p=0.619 n=4+5)
      fs1-zwrk.go·16                                             7.87µs ± 0%              7.88µs ± 0%     ~     (p=0.127 n=5+4)
      zeo/py/fs1-zwrk.go·1                                        173µs ± 3%               146µs ± 2%  -15.31%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        234µs ± 1%               230µs ± 1%   -1.71%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        324µs ± 7%               315µs ± 2%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        412µs ± 1%               409µs ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        768µs ± 1%               765µs ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.14ms ± 1%              1.13ms ± 1%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.54ms ± 4%              1.49ms ± 1%   -2.71%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               204µs ± 8%               182µs ± 3%  -11.14%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               319µs ± 4%               314µs ± 3%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               475µs ± 5%               479µs ± 5%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               620µs ± 2%               612µs ± 0%   -1.34%  (p=0.032 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·8                              1.24ms ± 2%              1.23ms ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.90ms ± 3%              1.87ms ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.52ms ± 5%              2.49ms ± 3%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  287µs ± 8%               236µs ± 8%  -17.73%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  495µs ± 6%               406µs ± 1%  -17.95%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  740µs ± 8%               618µs ± 3%  -16.50%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.01ms ± 4%              0.82ms ± 2%  -18.75%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.93ms ± 3%              1.64ms ± 1%  -15.14%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.01ms ± 4%              2.45ms ± 3%  -18.53%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.05ms ±10%              3.33ms ± 8%  -17.74%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                       58.5µs ± 1%              57.4µs ± 2%   -1.98%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                       61.4µs ± 0%              61.1µs ± 1%     ~     (p=0.238 n=5+5)
      neo/go/fs1-zwrk.go·3                                       69.3µs ± 0%              69.4µs ± 0%     ~     (p=0.881 n=5+5)
      neo/go/fs1-zwrk.go·4                                       75.6µs ± 0%              75.6µs ± 0%     ~     (p=0.952 n=5+4)
      neo/go/fs1-zwrk.go·8                                        121µs ± 1%               122µs ± 1%     ~     (p=0.063 n=4+5)
      neo/go/fs1-zwrk.go·12                                       195µs ± 1%               201µs ± 4%   +3.35%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·16                                       288µs ± 4%               297µs ± 2%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         50.9µs ± 5%              49.8µs ± 2%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         49.7µs ± 0%              50.1µs ± 5%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         58.2µs ± 0%              58.0µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         64.5µs ± 0%              64.0µs ± 0%   -0.77%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          108µs ± 4%               108µs ± 3%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         185µs ± 8%               180µs ± 3%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         269µs ± 4%               273µs ± 2%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     111µs ± 1%               109µs ± 1%   -1.55%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     125µs ± 0%               125µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     137µs ± 1%               137µs ± 0%     ~     (p=0.730 n=4+5)
      neo/go/sqlite-zwrk.go·4                                     153µs ± 0%               153µs ± 1%     ~     (p=0.905 n=5+4)
      neo/go/sqlite-zwrk.go·8                                     267µs ± 1%               267µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    420µs ± 2%               421µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    558µs ± 1%               554µs ± 2%     ~     (p=0.730 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              106µs ± 1%               105µs ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              121µs ± 1%               121µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              130µs ± 0%               132µs ± 0%   +1.39%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              143µs ± 1%               146µs ± 0%   +2.06%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              248µs ± 0%               264µs ±13%   +6.65%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             393µs ± 2%               406µs ± 2%   +3.34%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             528µs ± 2%               543µs ± 2%   +2.81%  (p=0.008 n=5+5)
      f40c8b4b
    • Kirill Smelkov's avatar
      X deco: localhost timings, C > C1 disabled · 0867c981
      Kirill Smelkov authored
      Probably what is above noise is:
      
      ---- 8< ----
      cluster:deco dataset:wczblk1-8
      zeo/py/fs1-zhash.go                                         126µs ± 1%               112µs ± 1%  -10.86%  (p=0.008 n=5+5)
      
      zeo/py/fs1-zwrk.go·1                                        9.12k ± 0%               8.04k ± 4%  -11.87%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        11.6k ± 1%                9.5k ± 1%  -17.54%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        13.4k ± 1%               10.5k ± 0%  -21.56%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        14.0k ± 1%               11.0k ± 1%  -21.81%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        14.7k ± 1%               11.4k ± 1%  -22.03%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       15.0k ± 1%               11.7k ± 0%  -22.09%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       15.1k ± 0%               11.8k ± 2%  -22.32%  (p=0.008 n=5+5)
      
      zeo/py/fs1-zwrk.go·1                                        110µs ± 0%               125µs ± 4%  +13.55%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        173µs ± 1%               210µs ± 1%  +21.27%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        224µs ± 1%               286µs ± 0%  +27.49%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        286µs ± 1%               365µs ± 1%  +27.90%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        545µs ± 1%               699µs ± 1%  +28.25%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       802µs ± 1%              1029µs ± 0%  +28.35%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.06ms ± 0%              1.36ms ± 2%  +28.74%  (p=0.008 n=5+5)
      ---- 8< ----
      
      however it strangely shows that serial zeo-zhash.go latency improved
      126µs -> 112µs and serial zeo-zwrk.go latency got worse 110µs -> 125µs,
      so probably it is all noise and I will remeasure.
      
      Otherwise no significant change.
      
      $ benchstat -split node,cluster,dataset 20180306-deco-ffixed-c.txt 20180306-deco-ffixed-noc_C1\(2µs\).txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:deco
      pystone                                                      217k ± 4%                218k ± 2%     ~     (p=0.841 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:deco
      crc32/py/4K                                                5.73µs ± 0%              5.72µs ± 0%     ~     (p=0.151 n=5+5)
      crc32/go/4K                                                 279ns ± 0%               280ns ± 1%     ~     (p=0.444 n=5+5)
      sha1/py/4K                                                 6.74µs ± 1%              6.72µs ± 1%     ~     (p=0.310 n=5+5)
      sha1/go/4K                                                 5.60µs ± 0%              5.59µs ± 0%   -0.16%  (p=0.016 n=5+4)
      unzlib/py/wczdata                                          27.2µs ± 1%              27.2µs ± 1%     ~     (p=0.690 n=5+5)
      unzlib/go/wczdata                                          27.0µs ± 0%              26.8µs ± 0%   -0.49%  (p=0.032 n=5+5)
      unzlib/py/prod1-avg                                        5.14µs ± 3%              5.08µs ± 1%     ~     (p=0.690 n=5+5)
      unzlib/go/prod1-avg                                        5.30µs ± 1%              5.29µs ± 1%     ~     (p=0.151 n=5+5)
      disk/randread/direct/4K-min                                 104µs ± 2%               105µs ± 0%   +1.23%  (p=0.016 n=5+5)
      disk/randread/direct/4K-avg                                 141µs ± 0%               142µs ± 0%   +0.60%  (p=0.008 n=5+5)
      disk/randread/pagecache/4K-min                              579ns ± 2%               582ns ± 0%     ~     (p=0.548 n=5+5)
      disk/randread/pagecache/4K-avg                              993ns ± 0%               987ns ± 0%   -0.60%  (p=0.008 n=5+5)
      
      name                                           old time/object          new time/object          delta
      cluster:deco dataset:wczblk1-8
      fs1-zhash.py                                               20.3µs ± 1%              20.2µs ± 1%     ~     (p=0.444 n=4+5)
      fs1-zhash.go                                               3.26µs ± 4%              3.20µs ± 0%     ~     (p=0.444 n=5+5)
      fs1-zhash.go+prefetch128                                   4.04µs ± 1%              4.14µs ± 1%     ~     (p=0.079 n=5+5)
      zeo/py/fs1-zhash.py                                         383µs ± 5%               361µs ± 3%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zhash.go                                         126µs ± 1%               112µs ± 1%  -10.86%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            63.1µs ± 1%              63.9µs ± 1%   +1.14%  (p=0.040 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                344µs ± 6%               321µs ± 8%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                140µs ± 1%               141µs ± 3%     ~     (p=0.286 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    119µs ± 2%               119µs ± 1%     ~     (p=0.897 n=5+5)
      neo/py(!log)/sql-zhash.py                                   386µs ± 1%               376µs ± 2%     ~     (p=0.114 n=4+4)
      neo/py(!log)/sql-zhash.go                                   183µs ± 3%               187µs ± 5%     ~     (p=0.341 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       164µs ± 3%               164µs ± 2%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.py                                         226µs ± 3%               226µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zhash.go                                        57.1µs ± 0%              57.1µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            24.7µs ± 5%              24.0µs ± 4%   -2.91%  (p=0.048 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          40.2µs ± 1%              40.3µs ± 1%     ~     (p=0.952 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              17.1µs ± 6%              17.2µs ± 4%     ~     (p=0.786 n=5+5)
      neo/go/sqlite-zhash.py                                      272µs ± 3%               253µs ± 1%   -6.99%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                     92.8µs ± 0%              93.7µs ± 1%   +0.99%  (p=0.016 n=4+5)
      neo/go/sqlite-zhash.go+prefetch128                         40.5µs ± 5%              39.5µs ± 6%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              86.5µs ± 2%              86.4µs ± 3%     ~     (p=0.571 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  38.8µs ± 9%              39.4µs ± 7%     ~     (p=0.730 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zhash.py                                               15.8µs ± 3%              15.9µs ± 2%     ~     (p=0.413 n=4+5)
      fs1-zhash.go                                               2.80µs ± 0%              2.80µs ± 0%     ~     (all equal)
      fs1-zhash.go+prefetch128                                   3.42µs ± 8%              3.34µs ± 2%     ~     (p=0.683 n=5+5)
      zeo/py/fs1-zhash.py                                         361µs ± 5%               347µs ± 3%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zhash.go                                         105µs ± 0%               105µs ± 0%   -0.42%  (p=0.016 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            58.9µs ± 1%              58.9µs ± 1%     ~     (p=0.508 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                344µs ± 7%               317µs ± 5%   -7.93%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                137µs ± 2%               138µs ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    114µs ± 1%               112µs ± 1%   -1.48%  (p=0.024 n=5+5)
      neo/py(!log)/sql-zhash.py                                   380µs ± 4%               377µs ± 2%     ~     (p=1.000 n=4+4)
      neo/py(!log)/sql-zhash.go                                   180µs ± 1%               184µs ± 2%   +2.44%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       159µs ± 1%               160µs ± 2%     ~     (p=0.889 n=5+5)
      neo/go/fs1-zhash.py                                         221µs ± 1%               225µs ± 1%   +1.59%  (p=0.016 n=5+5)
      neo/go/fs1-zhash.go                                        45.2µs ± 2%              44.6µs ± 0%   -1.37%  (p=0.016 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            17.6µs ± 2%              17.2µs ± 3%     ~     (p=0.087 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          39.1µs ± 2%              39.1µs ± 3%     ~     (p=0.659 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              14.6µs ± 4%              15.2µs ± 3%   +4.25%  (p=0.024 n=5+5)
      neo/go/sqlite-zhash.py                                      271µs ± 2%               254µs ± 1%   -6.14%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                     86.4µs ± 0%              86.3µs ± 0%     ~     (p=0.325 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         35.8µs ± 2%              36.6µs ± 5%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              84.0µs ± 1%              83.8µs ± 2%     ~     (p=0.952 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  36.5µs ± 5%              36.9µs ± 8%     ~     (p=1.000 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:deco dataset:wczblk1-8
      fs1-zwrk.go·1                                                436k ± 0%                431k ± 1%   -1.23%  (p=0.008 n=5+5)
      fs1-zwrk.go·2                                                744k ± 1%                760k ± 3%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·3                                               1.09M ± 0%               1.08M ± 2%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·4                                               1.16M ± 1%               1.16M ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·8                                               1.27M ± 1%               1.27M ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·12                                              1.27M ± 1%               1.28M ± 1%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·16                                              1.27M ± 1%               1.28M ± 1%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        9.12k ± 0%               8.04k ± 4%  -11.87%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        11.6k ± 1%                9.5k ± 1%  -17.54%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        13.4k ± 1%               10.5k ± 0%  -21.56%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        14.0k ± 1%               11.0k ± 1%  -21.81%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        14.7k ± 1%               11.4k ± 1%  -22.03%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       15.0k ± 1%               11.7k ± 0%  -22.09%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       15.1k ± 0%               11.8k ± 2%  -22.32%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.09k ± 1%               7.04k ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.48k ± 1%               8.52k ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.48k ± 1%               8.51k ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.47k ± 1%               8.50k ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.43k ± 1%               8.53k ± 1%   +1.16%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.46k ± 1%               8.48k ± 2%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.46k ± 1%               8.48k ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.51k ± 1%               5.37k ± 3%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.32k ± 1%               6.34k ± 0%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.29k ± 1%               6.28k ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.27k ± 1%               6.29k ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.27k ± 1%               6.29k ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.29k ± 0%               6.25k ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.22k ± 1%               6.23k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                        18.4k ± 1%               18.4k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·2                                        38.1k ± 1%               38.3k ± 1%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·3                                        46.0k ± 1%               45.9k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·4                                        50.2k ± 1%               50.0k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·8                                        61.0k ± 0%               60.3k ± 1%   -1.09%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       62.1k ± 1%               62.1k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       62.5k ± 1%               61.6k ± 1%   -1.37%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.3k ± 1%               26.3k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          55.3k ± 1%               55.7k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          62.7k ± 1%               62.8k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          69.3k ± 1%               69.4k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          88.2k ± 0%               88.3k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         93.4k ± 0%               93.5k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         93.5k ± 2%               93.8k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.0k ± 1%               11.0k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     18.4k ± 1%               18.3k ± 1%     ~     (p=0.556 n=5+4)
      neo/go/sqlite-zwrk.go·3                                     24.4k ± 1%               24.2k ± 0%   -0.73%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.8k ± 0%               26.8k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     30.4k ± 2%               29.6k ± 2%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    30.5k ± 1%               29.3k ± 2%   -4.15%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    29.9k ± 2%               28.6k ± 1%   -4.50%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.9k ± 1%               11.9k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              19.7k ± 0%               19.6k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              26.5k ± 1%               26.4k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              30.0k ± 0%               30.0k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              31.2k ± 2%               31.2k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             28.9k ± 1%               28.8k ± 3%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             28.4k ± 2%               28.4k ± 1%     ~     (p=0.841 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zwrk.go·1                                                555k ± 0%                556k ± 0%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·2                                               1.01M ± 3%               0.99M ± 6%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·3                                               1.32M ± 1%               1.33M ± 2%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·4                                               1.55M ± 2%               1.53M ± 0%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·8                                               1.59M ± 0%               1.59M ± 1%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·12                                              1.59M ± 0%               1.60M ± 1%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·16                                              1.59M ± 0%               1.59M ± 0%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        9.70k ± 0%               9.75k ± 1%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        12.4k ± 1%               12.4k ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        14.2k ± 1%               14.2k ± 1%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        14.9k ± 0%               14.9k ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        15.6k ± 0%               15.6k ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       15.2k ±11%               16.0k ± 1%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       16.1k ± 1%               16.0k ± 6%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.44k ± 1%               7.45k ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.59k ± 1%               8.71k ± 1%   +1.33%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.61k ± 1%               8.69k ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.57k ± 1%               8.61k ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.56k ± 1%               8.61k ± 1%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.51k ± 1%               8.59k ± 1%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.54k ± 1%               8.60k ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.55k ± 2%               5.45k ± 2%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.36k ± 1%               6.25k ± 1%   -1.67%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.31k ± 0%               6.24k ± 1%   -1.09%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.28k ± 0%               6.27k ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.34k ± 1%               6.28k ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.35k ± 1%               6.33k ± 0%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.36k ± 0%               6.30k ± 1%   -0.95%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                        23.7k ± 0%               23.9k ± 0%   +0.71%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                        45.4k ± 0%               45.5k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·3                                        55.2k ± 1%               55.1k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·4                                        60.7k ± 2%               60.4k ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·8                                        70.9k ± 2%               69.2k ± 2%   -2.41%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·12                                       71.1k ± 3%               68.0k ± 5%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·16                                       71.0k ± 3%               68.1k ± 3%   -4.07%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          27.3k ± 0%               27.2k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          55.4k ± 1%               55.5k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          64.0k ± 1%               64.0k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          69.0k ± 1%               69.1k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          80.9k ± 2%               81.1k ± 4%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         78.3k ± 5%               77.8k ± 8%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         75.4k ± 3%               76.8k ± 5%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.7k ± 1%               11.7k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     19.0k ± 0%               18.9k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     24.5k ± 1%               24.4k ± 2%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.3k ± 1%               26.0k ± 3%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     24.9k ± 3%               24.6k ± 5%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    24.0k ± 5%               23.7k ± 3%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    25.4k ± 1%               24.1k ± 3%   -5.14%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              12.2k ± 0%               12.2k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              19.8k ± 0%               19.6k ± 1%   -0.81%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              26.2k ± 1%               25.5k ± 1%   -2.65%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              28.7k ± 1%               27.5k ± 2%   -4.20%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              27.2k ± 3%               25.6k ± 2%   -5.54%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             25.3k ± 2%               24.0k ± 2%   -5.13%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             25.3k ± 1%               24.2k ± 1%   -4.63%  (p=0.008 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:deco dataset:wczblk1-8
      fs1-zwrk.go·1                                              2.29µs ± 0%              2.32µs ± 1%   +1.24%  (p=0.008 n=5+5)
      fs1-zwrk.go·2                                              2.69µs ± 1%              2.63µs ± 3%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·3                                              2.76µs ± 0%              2.78µs ± 2%     ~     (p=0.079 n=5+5)
      fs1-zwrk.go·4                                              3.44µs ± 1%              3.44µs ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·8                                              6.28µs ± 1%              6.28µs ± 1%     ~     (p=0.984 n=5+5)
      fs1-zwrk.go·12                                             9.46µs ± 1%              9.40µs ± 1%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·16                                             12.6µs ± 1%              12.5µs ± 1%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        110µs ± 0%               125µs ± 4%  +13.55%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        173µs ± 1%               210µs ± 1%  +21.27%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        224µs ± 1%               286µs ± 0%  +27.49%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        286µs ± 1%               365µs ± 1%  +27.90%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        545µs ± 1%               699µs ± 1%  +28.25%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       802µs ± 1%              1029µs ± 0%  +28.35%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.06ms ± 0%              1.36ms ± 2%  +28.74%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               141µs ± 1%               142µs ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               236µs ± 1%               235µs ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               354µs ± 1%               353µs ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               472µs ± 1%               470µs ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               949µs ± 1%               938µs ± 1%   -1.15%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.42ms ± 1%              1.41ms ± 2%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.89ms ± 1%              1.89ms ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  181µs ± 1%               186µs ± 3%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  317µs ± 1%               315µs ± 0%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  477µs ± 1%               478µs ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  638µs ± 1%               636µs ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.28ms ± 1%              1.27ms ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.91ms ± 0%              1.92ms ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.57ms ± 1%              2.57ms ± 2%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                       54.2µs ± 1%              54.4µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·2                                       52.5µs ± 1%              52.2µs ± 1%     ~     (p=0.333 n=5+5)
      neo/go/fs1-zwrk.go·3                                       65.3µs ± 1%              65.3µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·4                                       79.6µs ± 1%              80.0µs ± 0%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·8                                        131µs ± 0%               133µs ± 1%   +1.10%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       193µs ± 1%               193µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       256µs ± 1%               260µs ± 1%   +1.38%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         38.0µs ± 1%              38.0µs ± 0%     ~     (p=0.889 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         36.1µs ± 1%              35.9µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         47.8µs ± 1%              47.7µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         57.7µs ± 1%              57.7µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         90.7µs ± 0%              90.6µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         129µs ± 0%               128µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         171µs ± 2%               171µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    90.7µs ± 1%              91.2µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     109µs ± 1%               109µs ± 1%     ~     (p=0.556 n=5+4)
      neo/go/sqlite-zwrk.go·3                                     123µs ± 1%               124µs ± 0%   +0.74%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     149µs ± 0%               149µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     263µs ± 2%               270µs ± 2%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    393µs ± 1%               410µs ± 2%   +4.33%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    534µs ± 2%               560µs ± 1%   +4.70%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             84.0µs ± 1%              84.0µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              102µs ± 0%               102µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              113µs ± 1%               113µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              133µs ± 0%               133µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              257µs ± 2%               257µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             415µs ± 1%               417µs ± 3%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             563µs ± 2%               563µs ± 1%     ~     (p=0.841 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zwrk.go·1                                              1.80µs ± 0%              1.80µs ± 0%     ~     (p=0.413 n=5+5)
      fs1-zwrk.go·2                                              1.98µs ± 3%              2.01µs ± 6%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·3                                              2.27µs ± 1%              2.26µs ± 2%     ~     (p=0.889 n=5+5)
      fs1-zwrk.go·4                                              2.58µs ± 2%              2.61µs ± 0%     ~     (p=0.492 n=5+5)
      fs1-zwrk.go·8                                              5.04µs ± 0%              5.04µs ± 1%     ~     (p=0.730 n=5+5)
      fs1-zwrk.go·12                                             7.55µs ± 0%              7.52µs ± 1%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·16                                             10.0µs ± 0%              10.0µs ± 0%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        103µs ± 0%               103µs ± 1%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        162µs ± 1%               161µs ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        212µs ± 1%               212µs ± 1%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        269µs ± 0%               268µs ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        512µs ± 0%               512µs ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       793µs ±12%               752µs ± 1%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       991µs ± 1%              1001µs ± 6%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               134µs ± 1%               134µs ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               233µs ± 1%               230µs ± 1%   -1.31%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               348µs ± 1%               345µs ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               467µs ± 1%               465µs ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               935µs ± 1%               929µs ± 1%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.41ms ± 1%              1.40ms ± 1%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.87ms ± 1%              1.86ms ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  180µs ± 2%               184µs ± 2%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  315µs ± 1%               320µs ± 1%   +1.69%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  475µs ± 0%               481µs ± 1%   +1.11%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  637µs ± 0%               638µs ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.26ms ± 1%              1.27ms ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.89ms ± 1%              1.89ms ± 0%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.52ms ± 0%              2.54ms ± 1%   +0.96%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                       42.2µs ± 0%              41.9µs ± 0%   -0.70%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                       44.1µs ± 0%              44.0µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·3                                       54.4µs ± 1%              54.5µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·4                                       65.9µs ± 2%              66.2µs ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·8                                        113µs ± 2%               116µs ± 2%   +2.48%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·12                                       169µs ± 4%               177µs ± 5%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·16                                       225µs ± 3%               235µs ± 3%   +4.24%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         36.6µs ± 0%              36.8µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         36.1µs ± 1%              36.0µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         46.9µs ± 1%              46.9µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         57.9µs ± 1%              57.9µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         98.9µs ± 2%              98.6µs ± 4%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         153µs ± 5%               155µs ± 8%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         212µs ± 3%               208µs ± 5%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    85.1µs ± 1%              85.5µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     105µs ± 0%               106µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     123µs ± 1%               123µs ± 2%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     152µs ± 1%               154µs ± 3%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     321µs ± 3%               325µs ± 5%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    500µs ± 5%               507µs ± 3%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    630µs ± 1%               665µs ± 3%   +5.46%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             82.0µs ± 0%              82.3µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              101µs ± 0%               102µs ± 1%   +0.82%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              115µs ± 1%               118µs ± 1%   +2.73%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              139µs ± 1%               145µs ± 2%   +4.40%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              295µs ± 3%               312µs ± 2%   +5.87%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             474µs ± 2%               500µs ± 2%   +5.41%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             632µs ± 1%               662µs ± 1%   +4.85%  (p=0.008 n=5+5)
      0867c981
    • Kirill Smelkov's avatar
      X rio: localhost timings, Cenabled · 31dc070d
      Kirill Smelkov authored
      Compared to yesterday shows relatively no significant change, though
      some benchmarks, like on neo1 & z6001, are itself noisy.
      
      Disk, like on neo1 is not stable from run to run (though it still shows
      a magnitude).
      
      $ benchstat -split node,cluster,dataset 20180305-rio-ffixed-c.txt 20180306-rio-ffixed-c.txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:rio
      pystone                                                      146k ± 1%                115k ±12%   -21.20%  (p=0.008 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:rio
      crc32/py/4K                                                4.76µs ± 0%              4.77µs ± 0%      ~     (p=0.730 n=5+4)
      crc32/go/4K                                                1.49µs ± 0%              1.49µs ± 0%    +0.22%  (p=0.016 n=4+5)
      sha1/py/4K                                                 8.02µs ± 2%              8.04µs ± 1%      ~     (p=0.500 n=5+5)
      sha1/go/4K                                                 8.95µs ± 0%              8.93µs ± 0%      ~     (p=0.397 n=4+5)
      unzlib/py/wczdata                                          25.0µs ± 0%              25.1µs ± 1%      ~     (p=0.778 n=4+5)
      unzlib/go/wczdata                                          23.0µs ± 0%              23.0µs ± 0%      ~     (p=0.548 n=5+5)
      unzlib/py/prod1-avg                                        7.25µs ± 3%              7.16µs ± 1%      ~     (p=0.151 n=5+5)
      unzlib/go/prod1-avg                                        5.07µs ± 0%              5.08µs ± 1%      ~     (p=0.841 n=5+5)
      disk/randread/direct/4K-min                                38.4µs ± 1%              92.4µs ± 0%  +140.70%  (p=0.008 n=5+5)
      disk/randread/direct/4K-avg                                96.9µs ± 0%             115.0µs ± 0%   +18.72%  (p=0.008 n=5+5)
      disk/randread/pagecache/4K-min                              571ns ± 1%               565ns ± 2%      ~     (p=0.167 n=5+5)
      disk/randread/pagecache/4K-avg                             1.01µs ± 0%              0.99µs ± 0%    -1.78%  (p=0.029 n=4+4)
      
      name                                           old time/object          new time/object          delta
      cluster:rio dataset:wczblk1-8
      fs1-zhash.py                                               28.7µs ± 2%              29.2µs ± 1%      ~     (p=0.063 n=5+4)
      fs1-zhash.go                                               4.60µs ± 0%              4.68µs ± 5%      ~     (p=0.444 n=5+5)
      fs1-zhash.go+prefetch128                                   4.72µs ± 6%              4.78µs ± 5%      ~     (p=0.460 n=5+5)
      zeo/py/fs1-zhash.py                                         395µs ± 3%               400µs ± 0%      ~     (p=0.690 n=5+5)
      zeo/py/fs1-zhash.go                                         138µs ± 1%               138µs ± 1%      ~     (p=0.897 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            73.5µs ± 1%              74.7µs ± 2%    +1.66%  (p=0.048 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                330µs ± 6%               318µs ± 7%      ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                157µs ± 4%               154µs ± 4%      ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    126µs ± 3%               125µs ± 3%      ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zhash.py                                   392µs ±45%               400µs ±57%      ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zhash.go                                   181µs ± 2%               183µs ±11%      ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       159µs ± 4%               158µs ± 3%      ~     (p=0.841 n=5+5)
      neo/go/fs1-zhash.py                                         228µs ± 2%               222µs ± 4%      ~     (p=0.079 n=5+5)
      neo/go/fs1-zhash.go                                        68.5µs ± 1%              68.6µs ± 2%      ~     (p=0.714 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            29.4µs ± 5%              29.0µs ± 6%      ~     (p=0.381 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          44.2µs ± 2%              43.9µs ± 3%      ~     (p=0.770 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              19.1µs ± 3%              18.8µs ± 5%      ~     (p=0.643 n=5+5)
      neo/go/sqlite-zhash.py                                      265µs ± 5%               273µs ± 3%      ~     (p=0.095 n=5+5)
      neo/go/sqlite-zhash.go                                      104µs ± 1%               104µs ± 1%      ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         38.6µs ± 6%              36.3µs ± 3%    -6.16%  (p=0.048 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              92.9µs ± 2%              94.2µs ± 3%      ~     (p=0.095 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  35.7µs ± 6%              35.1µs ± 6%      ~     (p=0.413 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zhash.py                                               23.9µs ± 1%              23.9µs ± 1%      ~     (p=1.000 n=5+4)
      fs1-zhash.go                                               3.40µs ± 0%              3.40µs ± 0%      ~     (all equal)
      fs1-zhash.go+prefetch128                                   3.00µs ± 0%              3.02µs ± 9%      ~     (p=0.444 n=5+5)
      zeo/py/fs1-zhash.py                                         367µs ± 5%               372µs ±10%      ~     (p=1.000 n=5+5)
      zeo/py/fs1-zhash.go                                         114µs ± 3%               114µs ± 1%      ~     (p=0.421 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            64.6µs ± 0%              64.6µs ± 1%      ~     (p=0.913 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                314µs ± 8%               321µs ±11%      ~     (p=0.952 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                144µs ± 2%               142µs ± 3%      ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    115µs ± 1%               117µs ± 1%      ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zhash.py                                   378µs ±44%               330µs ± 1%      ~     (p=0.286 n=5+4)
      neo/py(!log)/sql-zhash.go                                   174µs ± 5%               172µs ± 1%      ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       149µs ± 1%               149µs ± 2%      ~     (p=0.952 n=5+5)
      neo/go/fs1-zhash.py                                         218µs ± 1%               217µs ± 1%      ~     (p=0.857 n=4+5)
      neo/go/fs1-zhash.go                                        49.9µs ± 1%              49.8µs ± 2%      ~     (p=0.984 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            19.0µs ± 1%              18.8µs ± 1%      ~     (p=0.143 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          40.4µs ± 3%              40.4µs ± 3%      ~     (p=0.794 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              16.2µs ± 5%              16.1µs ± 2%      ~     (p=1.000 n=5+5)
      neo/go/sqlite-zhash.py                                      266µs ± 3%               263µs ± 4%      ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go                                     94.0µs ± 1%              93.1µs ± 1%    -1.00%  (p=0.040 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         33.0µs ± 4%              32.7µs ± 2%      ~     (p=0.651 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              90.1µs ± 2%              89.6µs ± 1%      ~     (p=0.381 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  32.9µs ± 4%              34.0µs ± 2%      ~     (p=0.063 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:rio dataset:wczblk1-8
      fs1-zwrk.go·1                                                300k ± 0%                300k ± 0%      ~     (p=0.151 n=5+5)
      fs1-zwrk.go·2                                                549k ± 0%                546k ± 0%    -0.53%  (p=0.016 n=4+5)
      fs1-zwrk.go·3                                                811k ± 0%                810k ± 0%      ~     (p=0.421 n=5+5)
      fs1-zwrk.go·4                                               1.07M ± 0%               1.08M ± 0%      ~     (p=0.310 n=5+5)
      fs1-zwrk.go·8                                               1.42M ± 0%               1.42M ± 0%      ~     (p=0.841 n=5+5)
      fs1-zwrk.go·12                                              1.54M ± 0%               1.55M ± 0%      ~     (p=0.310 n=5+5)
      fs1-zwrk.go·16                                              1.55M ± 0%               1.55M ± 0%      ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        7.55k ± 0%               7.41k ± 1%    -1.87%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        9.17k ± 1%               9.03k ± 1%    -1.60%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        9.74k ± 1%               9.77k ± 1%      ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        10.2k ± 2%               10.1k ± 3%      ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        10.6k ± 2%               10.5k ± 0%      ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       10.5k ± 1%               10.6k ± 1%      ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       10.6k ± 1%               10.6k ± 1%      ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               6.69k ± 4%               6.80k ± 2%      ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.31k ± 9%               8.31k ± 7%      ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               7.96k ± 6%               8.60k ± 1%    +8.12%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.27k ± 9%               8.60k ± 1%    +4.05%  (p=0.016 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·8                               8.42k ± 2%               8.61k ± 1%    +2.20%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.46k ± 1%               8.56k ± 1%    +1.19%  (p=0.032 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.34k ± 4%               8.49k ± 3%      ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.63k ± 1%               5.62k ± 6%      ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.80k ± 2%               6.75k ± 4%      ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.68k ± 2%               6.77k ± 2%      ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.63k ± 3%               6.51k ± 7%      ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.73k ± 2%               6.56k ± 4%      ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.71k ± 1%               6.84k ± 1%    +2.00%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zwrk.go·16                                 6.77k ± 2%               6.73k ± 3%      ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                        15.7k ± 1%               15.5k ± 0%    -1.10%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                        30.2k ± 0%               29.9k ± 1%    -1.04%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                        39.8k ± 0%               39.4k ± 0%    -0.82%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                        49.8k ± 0%               49.4k ± 0%    -0.85%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        69.1k ± 1%               68.4k ± 0%    -0.93%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       73.1k ± 1%               72.5k ± 0%    -0.74%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·16                                       73.8k ± 0%               73.2k ± 0%    -0.81%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          25.5k ± 2%               26.2k ± 1%    +2.41%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          47.9k ± 0%               47.6k ± 0%    -0.60%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          59.8k ± 0%               59.4k ± 0%    -0.63%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          72.7k ± 0%               72.2k ± 0%    -0.75%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          97.0k ± 0%               96.7k ± 0%      ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          110k ± 0%                109k ± 0%    -0.64%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                          114k ± 0%                113k ± 1%      ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     9.84k ± 1%               9.82k ± 0%      ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     18.2k ± 0%               18.3k ± 0%      ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     25.4k ± 0%               25.3k ± 0%      ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     30.3k ± 0%               30.3k ± 0%      ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     39.3k ± 1%               39.5k ± 0%      ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    40.6k ± 2%               40.8k ± 2%      ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    40.5k ± 1%               40.5k ± 2%      ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.1k ± 1%               11.0k ± 1%      ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              20.1k ± 0%               20.0k ± 0%    -0.49%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              27.9k ± 0%               27.9k ± 0%      ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              34.1k ± 1%               34.1k ± 0%      ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              44.2k ± 1%               44.1k ± 1%      ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             43.2k ± 1%               43.1k ± 1%      ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             41.3k ± 2%               41.2k ± 2%      ~     (p=1.000 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zwrk.go·1                                                463k ± 1%                465k ± 1%      ~     (p=0.095 n=5+5)
      fs1-zwrk.go·2                                                882k ± 7%                920k ± 0%    +4.29%  (p=0.016 n=5+4)
      fs1-zwrk.go·3                                               1.36M ± 1%               1.36M ± 1%      ~     (p=0.056 n=5+5)
      fs1-zwrk.go·4                                               1.79M ± 1%               1.81M ± 0%      ~     (p=0.095 n=5+5)
      fs1-zwrk.go·8                                               2.34M ± 2%               2.37M ± 1%      ~     (p=0.151 n=5+5)
      fs1-zwrk.go·12                                              2.40M ± 0%               2.41M ± 0%      ~     (p=0.056 n=5+5)
      fs1-zwrk.go·16                                              2.41M ± 0%               2.42M ± 0%    +0.61%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        8.99k ± 1%               8.98k ± 1%      ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        11.8k ± 1%               11.7k ± 1%    -1.10%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        12.9k ± 1%               12.9k ± 2%      ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        13.4k ± 3%               13.4k ± 4%      ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        14.1k ± 1%               14.0k ± 2%      ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       14.4k ± 2%               14.2k ± 2%      ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       14.4k ± 1%               14.2k ± 3%      ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.18k ± 2%               7.16k ± 4%      ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.65k ± 3%               8.75k ± 1%      ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.63k ± 1%               8.65k ± 4%      ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.67k ± 1%               8.53k ± 6%      ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.47k ± 6%               8.61k ± 3%      ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.45k ± 5%               8.64k ± 0%      ~     (p=0.286 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·16                              8.37k ± 3%               8.64k ± 1%    +3.14%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.91k ± 3%               5.88k ± 1%      ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.86k ± 3%               6.79k ± 2%      ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.91k ± 4%               6.58k ± 4%    -4.75%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.84k ± 2%               6.68k ± 4%      ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.98k ± 1%               6.83k ± 1%    -2.17%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.84k ± 6%               6.66k ± 4%      ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.92k ± 4%               6.65k ± 5%      ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·1                                        21.8k ± 0%               21.8k ± 1%      ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·2                                        39.4k ± 1%               39.2k ± 1%      ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·3                                        51.6k ± 0%               51.4k ± 0%    -0.37%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                        62.9k ± 0%               62.8k ± 0%      ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·8                                        80.3k ± 2%               80.7k ± 1%      ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·12                                       79.7k ± 2%               80.0k ± 2%      ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·16                                       78.1k ± 4%               78.3k ± 2%      ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.5k ± 2%               26.5k ± 1%      ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          49.2k ± 0%               48.8k ± 0%    -0.90%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          62.4k ± 0%               61.8k ± 0%    -0.97%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          74.5k ± 0%               74.0k ± 0%    -0.63%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          92.3k ± 2%               91.3k ± 0%      ~     (p=0.190 n=5+4)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         93.6k ± 4%               93.1k ± 2%      ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         90.7k ± 5%               89.7k ± 2%      ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.0k ± 0%               11.0k ± 1%    +0.63%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     19.4k ± 0%               19.4k ± 1%      ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     26.5k ± 0%               26.6k ± 0%      ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     31.8k ± 1%               31.9k ± 0%      ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     37.5k ± 1%               37.4k ± 2%      ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    36.4k ± 5%               35.2k ± 3%      ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    36.5k ± 3%               34.6k ± 2%    -5.21%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.5k ± 1%               11.5k ± 1%      ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              20.1k ± 1%               20.1k ± 0%      ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              28.0k ± 0%               27.6k ± 0%    -1.43%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              34.0k ± 0%               33.4k ± 0%    -1.74%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              40.2k ± 1%               38.8k ± 2%    -3.35%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             38.1k ± 1%               36.4k ± 1%    -4.51%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             36.8k ± 1%               35.2k ± 2%    -4.47%  (p=0.008 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:rio dataset:wczblk1-8
      fs1-zwrk.go·1                                              3.34µs ± 0%              3.33µs ± 0%      ~     (p=0.222 n=5+5)
      fs1-zwrk.go·2                                              3.65µs ± 0%              3.67µs ± 0%    +0.53%  (p=0.016 n=4+5)
      fs1-zwrk.go·3                                              3.70µs ± 0%              3.70µs ± 0%      ~     (p=0.421 n=5+5)
      fs1-zwrk.go·4                                              3.72µs ± 0%              3.72µs ± 0%      ~     (p=0.341 n=5+5)
      fs1-zwrk.go·8                                              5.62µs ± 0%              5.62µs ± 0%      ~     (p=0.889 n=5+5)
      fs1-zwrk.go·12                                             7.77µs ± 0%              7.76µs ± 0%      ~     (p=0.333 n=5+5)
      fs1-zwrk.go·16                                             10.4µs ± 0%              10.3µs ± 0%      ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        132µs ± 0%               135µs ± 1%    +1.91%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        218µs ± 1%               222µs ± 1%    +1.62%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        308µs ± 1%               307µs ± 1%      ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        392µs ± 2%               398µs ± 3%      ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        754µs ± 2%               759µs ± 0%      ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.15ms ± 1%              1.13ms ± 1%      ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.51ms ± 1%              1.50ms ± 1%      ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               150µs ± 4%               147µs ± 2%      ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               235µs ± 1%               241µs ± 8%      ~     (p=0.556 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·3                               378µs ± 6%               349µs ± 1%    -7.74%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               485µs ± 9%               465µs ± 1%    -4.08%  (p=0.016 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·8                               950µs ± 2%               930µs ± 1%    -2.15%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.42ms ± 1%              1.40ms ± 1%    -1.18%  (p=0.032 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.92ms ± 4%              1.88ms ± 3%      ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  178µs ± 1%               178µs ± 6%      ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  294µs ± 2%               297µs ± 4%      ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  449µs ± 2%               443µs ± 2%      ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  603µs ± 3%               616µs ± 8%      ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.19ms ± 2%              1.22ms ± 5%      ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.79ms ± 1%              1.75ms ± 1%    -1.96%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zwrk.go·16                                2.36ms ± 2%              2.38ms ± 3%      ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                       63.7µs ± 1%              64.4µs ± 0%    +1.11%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                       66.2µs ± 0%              66.8µs ± 1%    +1.05%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                       75.4µs ± 0%              76.1µs ± 0%    +0.82%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                       80.4µs ± 0%              81.0µs ± 0%    +0.85%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        116µs ± 1%               117µs ± 0%    +0.94%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       164µs ± 1%               165µs ± 0%    +0.74%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·16                                       217µs ± 0%               219µs ± 0%    +0.82%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         39.2µs ± 2%              38.2µs ± 1%    -2.37%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         41.8µs ± 0%              42.0µs ± 0%    +0.60%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         50.2µs ± 0%              50.5µs ± 0%    +0.64%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         55.0µs ± 0%              55.4µs ± 0%    +0.76%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         82.5µs ± 0%              82.8µs ± 0%      ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         109µs ± 0%               110µs ± 0%    +0.65%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         141µs ± 0%               142µs ± 1%      ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     102µs ± 1%               102µs ± 0%      ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     110µs ± 0%               110µs ± 0%      ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     118µs ± 0%               119µs ± 0%      ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     132µs ± 0%               132µs ± 0%      ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     204µs ± 1%               203µs ± 0%      ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    296µs ± 2%               294µs ± 2%      ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    395µs ± 1%               395µs ± 2%      ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             90.2µs ± 1%              91.1µs ± 1%      ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              100µs ± 0%               100µs ± 0%    +0.49%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              107µs ± 0%               108µs ± 0%      ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              117µs ± 1%               117µs ± 0%      ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              181µs ± 1%               182µs ± 1%      ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             278µs ± 1%               279µs ± 1%      ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             388µs ± 2%               388µs ± 2%      ~     (p=1.000 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zwrk.go·1                                              2.16µs ± 1%              2.15µs ± 1%      ~     (p=0.079 n=5+5)
      fs1-zwrk.go·2                                              2.27µs ± 7%              2.17µs ± 0%    -4.29%  (p=0.016 n=5+4)
      fs1-zwrk.go·3                                              2.21µs ± 1%              2.20µs ± 1%      ~     (p=0.056 n=5+5)
      fs1-zwrk.go·4                                              2.23µs ± 1%              2.21µs ± 0%      ~     (p=0.087 n=5+5)
      fs1-zwrk.go·8                                              3.42µs ± 2%              3.37µs ± 1%      ~     (p=0.151 n=5+5)
      fs1-zwrk.go·12                                             4.99µs ± 0%              4.97µs ± 0%      ~     (p=0.056 n=5+5)
      fs1-zwrk.go·16                                             6.65µs ± 0%              6.61µs ± 0%    -0.60%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        111µs ± 1%               111µs ± 1%      ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        169µs ± 1%               171µs ± 1%    +1.12%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        233µs ± 1%               233µs ± 2%      ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        298µs ± 3%               298µs ± 4%      ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        567µs ± 1%               572µs ± 2%      ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       835µs ± 2%               844µs ± 2%      ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.11ms ± 1%              1.12ms ± 3%      ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               139µs ± 2%               140µs ± 4%      ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               231µs ± 3%               229µs ± 1%      ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               348µs ± 1%               347µs ± 5%      ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               462µs ± 1%               470µs ± 7%      ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               945µs ± 6%               929µs ± 3%      ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.42ms ± 5%              1.39ms ± 0%      ~     (p=0.286 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·16                             1.91ms ± 3%              1.85ms ± 1%    -3.07%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  169µs ± 3%               170µs ± 1%      ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  292µs ± 3%               294µs ± 2%      ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  434µs ± 4%               456µs ± 4%    +4.99%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  585µs ± 2%               599µs ± 4%      ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.15ms ± 1%              1.17ms ± 1%    +2.21%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.76ms ± 7%              1.80ms ± 4%      ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.31ms ± 4%              2.41ms ± 5%      ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·1                                       45.8µs ± 0%              45.9µs ± 1%      ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·2                                       50.7µs ± 1%              51.0µs ± 1%      ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·3                                       58.1µs ± 0%              58.3µs ± 0%    +0.37%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                       63.6µs ± 0%              63.7µs ± 0%      ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·8                                        100µs ± 1%                99µs ± 1%      ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·12                                       151µs ± 2%               150µs ± 2%      ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·16                                       205µs ± 4%               204µs ± 3%      ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         37.7µs ± 2%              37.7µs ± 1%      ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         40.6µs ± 0%              41.0µs ± 0%    +0.91%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         48.1µs ± 0%              48.5µs ± 0%    +0.98%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         53.7µs ± 0%              54.0µs ± 0%    +0.63%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         86.7µs ± 2%              87.6µs ± 0%      ~     (p=0.190 n=5+4)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         128µs ± 4%               129µs ± 2%      ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         177µs ± 5%               178µs ± 2%      ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    91.3µs ± 0%              90.7µs ± 1%    -0.63%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     103µs ± 0%               103µs ± 1%      ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     113µs ± 0%               113µs ± 0%      ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     126µs ± 1%               125µs ± 0%      ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     214µs ± 1%               214µs ± 2%      ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    330µs ± 5%               341µs ± 3%      ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    438µs ± 3%               462µs ± 2%    +5.47%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             87.2µs ± 1%              86.7µs ± 1%      ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                             99.3µs ± 1%              99.7µs ± 0%      ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              107µs ± 0%               109µs ± 0%    +1.45%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              118µs ± 0%               120µs ± 0%    +1.77%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              199µs ± 1%               206µs ± 2%    +3.47%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             315µs ± 1%               330µs ± 1%    +4.73%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             434µs ± 1%               455µs ± 2%    +4.69%  (p=0.008 n=5+5)
      31dc070d
    • Kirill Smelkov's avatar
      X z6001: localhost timings, Cenabled · 850bfb9d
      Kirill Smelkov authored
      Compared to yesterday shows relatively no significant change, though
      some benchmarks, like on neo1, are itself noisy.
      
      disk/randread/direct/4K-avg changes by 55%, probably showing we should
      be taking into account mdev(=std) ioping gives us, not only averaging
      the average it prints.
      
      $ benchstat -split node,cluster,dataset 20180305-z6001-ffixed-c.txt 20180306-z6001-ffixed-c.txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:z6001
      pystone                                                      112k ± 8%                109k ± 9%     ~     (p=0.548 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:z6001
      crc32/py/4K                                                5.11µs ± 2%              5.11µs ± 1%     ~     (p=0.452 n=5+5)
      crc32/go/4K                                                1.72µs ± 0%              1.72µs ± 0%     ~     (p=1.000 n=4+4)
      sha1/py/4K                                                 17.1µs ±31%              14.7µs ± 1%     ~     (p=0.056 n=5+5)
      sha1/go/4K                                                 10.6µs ± 5%              10.3µs ± 0%     ~     (p=1.000 n=5+5)
      unzlib/py/wczdata                                          36.4µs ± 1%              37.1µs ± 8%     ~     (p=1.000 n=5+5)
      unzlib/go/wczdata                                          31.5µs ± 0%              31.5µs ± 0%     ~     (p=0.151 n=5+5)
      unzlib/py/prod1-avg                                        18.5µs ± 2%              18.5µs ± 3%     ~     (p=0.841 n=5+5)
      unzlib/go/prod1-avg                                        10.0µs ± 0%              10.0µs ± 1%     ~     (p=0.151 n=5+5)
      disk/randread/direct/4K-min                                 125µs ± 1%               126µs ± 1%   +0.92%  (p=0.048 n=5+4)
      disk/randread/direct/4K-avg                                 128µs ± 0%               199µs ± 9%  +55.41%  (p=0.016 n=4+5)
      disk/randread/pagecache/4K-min                              801ns ± 4%               806ns ± 3%     ~     (p=0.452 n=5+5)
      disk/randread/pagecache/4K-avg                             1.39µs ±12%              1.44µs ± 7%     ~     (p=0.643 n=5+5)
      
      name                                           old time/object          new time/object          delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zhash.py                                               37.4µs ± 2%              37.6µs ± 2%     ~     (p=0.579 n=5+5)
      fs1-zhash.go                                               5.94µs ± 1%              6.00µs ± 2%     ~     (p=0.365 n=5+5)
      fs1-zhash.go+prefetch128                                   8.06µs ± 7%              8.00µs ± 5%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zhash.py                                         657µs ±14%               650µs ± 7%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zhash.go                                         273µs ± 4%               274µs ±13%     ~     (p=0.889 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                             101µs ± 2%               101µs ± 2%     ~     (p=0.968 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                694µs ± 1%               696µs ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                326µs ±20%               338µs ± 7%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    174µs ± 2%               177µs ± 1%     ~     (p=0.063 n=5+5)
      neo/py(!log)/sql-zhash.py                                   934µs ± 3%              1000µs ±38%     ~     (p=0.730 n=4+5)
      neo/py(!log)/sql-zhash.go                                   422µs ±11%               434µs ± 6%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       274µs ±10%               277µs ± 9%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.py                                         527µs ±13%               526µs ± 8%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zhash.go                                         103µs ± 6%               102µs ± 8%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            35.7µs ± 3%              36.6µs ± 4%     ~     (p=0.175 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          73.8µs ± 5%              76.4µs ± 5%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              27.2µs ± 6%              26.5µs ± 2%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zhash.py                                      553µs ±14%               528µs ±15%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zhash.go                                      222µs ±17%               204µs ±22%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         39.6µs ± 4%              39.9µs ± 4%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               188µs ±14%               194µs ± 9%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  37.4µs ± 4%              38.2µs ± 7%     ~     (p=0.278 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zhash.py                                               30.3µs ± 3%              30.3µs ± 1%     ~     (p=0.444 n=5+5)
      fs1-zhash.go                                               4.60µs ± 0%              4.62µs ± 3%     ~     (p=0.556 n=4+5)
      fs1-zhash.go+prefetch128                                   5.90µs ± 5%              5.76µs ± 8%     ~     (p=0.476 n=5+5)
      zeo/py/fs1-zhash.py                                         617µs ± 9%               632µs ±15%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zhash.go                                         228µs ± 4%               235µs ± 7%     ~     (p=0.389 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            87.9µs ± 1%              87.2µs ± 1%     ~     (p=0.206 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                665µs ± 3%               664µs ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                285µs ± 4%               269µs ± 7%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    163µs ± 0%               162µs ± 0%   -0.52%  (p=0.029 n=4+4)
      neo/py(!log)/sql-zhash.py                                   970µs ±41%              1029µs ±29%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zhash.go                                   386µs ±11%               406µs ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       261µs ± 3%               268µs ± 5%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zhash.py                                         515µs ±16%               520µs ± 9%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.go                                        82.5µs ± 7%              83.2µs ± 7%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            24.2µs ± 3%              24.0µs ± 5%     ~     (p=0.452 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          70.4µs ± 2%              67.0µs ± 3%   -4.80%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              20.9µs ± 2%              21.2µs ± 4%     ~     (p=0.579 n=5+5)
      neo/go/sqlite-zhash.py                                      527µs ± 9%               539µs ±11%     ~     (p=0.587 n=5+5)
      neo/go/sqlite-zhash.go                                      190µs ±23%               196µs ± 9%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         34.7µs ± 2%              35.0µs ± 3%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               159µs ±21%               168µs ± 8%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  35.4µs ± 1%              35.1µs ± 4%     ~     (p=0.556 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zwrk.go·1                                                231k ± 0%                230k ± 1%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·2                                                444k ± 2%                437k ± 5%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·3                                                667k ± 2%                663k ± 4%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·4                                                877k ± 0%                880k ± 1%     ~     (p=0.286 n=4+5)
      fs1-zwrk.go·8                                               1.74M ± 2%               1.75M ± 2%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·12                                              2.52M ± 3%               2.56M ± 0%     ~     (p=0.190 n=5+4)
      fs1-zwrk.go·16                                              2.88M ± 0%               2.89M ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        4.42k ± 5%               4.30k ± 8%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        6.33k ± 0%               6.33k ± 0%     ~     (p=0.905 n=5+4)
      zeo/py/fs1-zwrk.go·3                                        6.91k ± 0%               6.90k ± 0%     ~     (p=0.730 n=5+4)
      zeo/py/fs1-zwrk.go·4                                        7.12k ± 0%               7.14k ± 1%     ~     (p=0.343 n=4+4)
      zeo/py/fs1-zwrk.go·8                                        7.52k ± 1%               7.53k ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       7.55k ± 2%               7.65k ± 0%     ~     (p=0.111 n=5+4)
      zeo/py/fs1-zwrk.go·16                                       7.67k ± 2%               7.57k ± 0%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               3.41k ±12%               3.50k ±15%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               5.63k ± 0%               5.58k ± 0%   -0.85%  (p=0.016 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·3                               5.54k ± 5%               5.63k ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               5.54k ± 1%               5.56k ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               5.74k ± 1%               5.61k ± 2%   -2.19%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              5.67k ± 1%               5.62k ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              5.64k ± 2%               5.62k ± 1%     ~     (p=0.556 n=5+4)
      neo/py(!log)/sql-zwrk.go·1                                  2.64k ± 8%               2.53k ±17%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  3.63k ± 9%               3.57k ± 9%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  3.91k ± 7%               3.65k ±14%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  3.73k ± 9%               3.56k ±16%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  3.79k ± 5%               3.78k ±12%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 3.65k ±11%               3.73k ±13%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.69k ±14%               3.47k ± 9%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·1                                        10.8k ± 6%               10.7k ± 5%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·2                                        22.5k ± 2%               22.3k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·3                                        31.8k ± 1%               31.7k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·4                                        43.3k ± 0%               43.2k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·8                                        78.1k ± 0%               78.3k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·12                                       92.5k ± 0%               92.5k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                        102k ± 1%                103k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          15.3k ± 5%               15.0k ± 5%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          31.5k ± 1%               31.5k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          43.8k ± 0%               43.8k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          57.6k ± 0%               57.4k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                           100k ± 0%                100k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          116k ± 0%                116k ± 0%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                          126k ± 0%                126k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     5.05k ±10%               4.85k ±15%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     11.8k ± 2%               12.0k ± 2%   +2.47%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     19.0k ± 0%               19.0k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     24.6k ± 1%               24.7k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     44.5k ± 1%               44.8k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    56.3k ± 1%               56.3k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    58.4k ± 0%               58.0k ± 0%   -0.72%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              5.62k ± 7%               5.41k ± 4%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              13.1k ± 3%               12.8k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              20.4k ± 1%               20.2k ± 1%   -1.15%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.1k ± 1%               26.8k ± 1%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              48.4k ± 1%               48.1k ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             60.2k ± 0%               60.3k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             61.6k ± 1%               61.7k ± 1%     ~     (p=0.548 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zwrk.go·1                                                342k ± 4%                347k ± 2%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·2                                                657k ± 6%                660k ± 3%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·3                                                985k ± 4%                985k ± 4%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·4                                               1.29M ± 2%               1.31M ± 2%     ~     (p=0.222 n=5+5)
      fs1-zwrk.go·8                                               2.57M ± 1%               2.55M ± 4%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·12                                              2.81M ± 2%               2.81M ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                              2.85M ± 1%               2.85M ± 2%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        5.07k ± 5%               4.80k ± 5%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        8.17k ± 2%               8.18k ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        8.84k ± 5%               8.96k ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        9.19k ± 1%               8.88k ± 9%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        9.82k ± 1%               9.96k ± 2%     ~     (p=0.111 n=5+4)
      zeo/py/fs1-zwrk.go·12                                       9.67k ± 6%               9.80k ± 6%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       10.0k ± 9%               10.1k ± 6%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               3.69k ± 9%               3.70k ± 6%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               5.76k ± 0%               5.77k ± 0%     ~     (p=0.343 n=4+4)
      neo/py(!log)/sqlite-zwrk.go·3                               5.44k ±11%               5.77k ± 0%   +6.20%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               5.81k ± 1%               5.77k ± 0%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               5.85k ± 0%               5.84k ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              5.67k ± 3%               5.78k ± 2%   +1.96%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              5.84k ± 0%               5.80k ± 1%     ~     (p=0.730 n=4+5)
      neo/py(!log)/sql-zwrk.go·1                                  2.63k ± 6%               2.51k ±12%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  3.83k ±11%               3.62k ± 8%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  3.64k ±13%               3.86k ±11%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  3.73k ±14%               3.82k ±11%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  4.12k ± 6%               3.89k ±10%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 3.89k ± 9%               3.98k ± 7%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.60k ± 9%               3.72k ±13%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                        13.4k ± 3%               13.8k ± 3%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·2                                        28.0k ± 1%               28.1k ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·3                                        40.0k ± 0%               40.2k ± 0%   +0.61%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                        52.8k ± 0%               52.8k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·8                                        90.7k ± 0%               90.6k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·12                                       96.4k ± 1%               95.8k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·16                                       91.2k ± 2%               90.9k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          15.9k ± 2%               16.2k ± 2%   +2.23%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          33.0k ± 0%               32.9k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          46.3k ± 0%               46.2k ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          59.9k ± 0%               59.8k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          98.7k ± 1%               98.1k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          103k ± 1%                102k ± 1%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         96.5k ± 3%               97.0k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     5.66k ±15%               5.67k ± 8%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     13.3k ± 2%               13.3k ± 2%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     20.4k ± 0%               20.3k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.6k ± 1%               26.5k ± 0%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     44.5k ± 0%               44.5k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    52.2k ± 1%               52.3k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    48.8k ± 1%               48.9k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              5.74k ± 8%               5.69k ± 4%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              13.3k ± 2%               13.2k ± 3%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              20.5k ± 1%               20.5k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.0k ± 1%               27.1k ± 2%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              44.8k ± 2%               45.4k ± 1%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             53.1k ± 1%               53.3k ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             49.8k ± 2%               49.8k ± 1%     ~     (p=1.000 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zwrk.go·1                                              4.32µs ± 0%              4.34µs ± 1%   +0.47%  (p=0.040 n=5+5)
      fs1-zwrk.go·2                                              4.51µs ± 2%              4.58µs ± 5%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·3                                              4.50µs ± 2%              4.52µs ± 4%     ~     (p=0.635 n=5+5)
      fs1-zwrk.go·4                                              4.56µs ± 0%              4.55µs ± 1%     ~     (p=0.381 n=4+5)
      fs1-zwrk.go·8                                              4.60µs ± 2%              4.58µs ± 2%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·12                                             4.77µs ± 3%              4.69µs ± 0%     ~     (p=0.190 n=5+4)
      fs1-zwrk.go·16                                             5.56µs ± 0%              5.53µs ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        227µs ± 5%               233µs ± 8%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        316µs ± 0%               315µs ± 2%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        434µs ± 0%               435µs ± 0%     ~     (p=0.730 n=5+4)
      zeo/py/fs1-zwrk.go·4                                        562µs ± 0%               560µs ± 1%     ~     (p=0.343 n=4+4)
      zeo/py/fs1-zwrk.go·8                                       1.06ms ± 1%              1.06ms ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.59ms ± 2%              1.57ms ± 0%     ~     (p=0.111 n=5+4)
      zeo/py/fs1-zwrk.go·16                                      2.09ms ± 2%              2.11ms ± 0%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               295µs ±11%               288µs ±14%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               355µs ± 0%               358µs ± 0%   +0.86%  (p=0.016 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·3                               542µs ± 5%               533µs ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               722µs ± 1%               720µs ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.39ms ± 1%              1.43ms ± 2%   +2.25%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             2.11ms ± 1%              2.14ms ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.84ms ± 2%              2.85ms ± 1%     ~     (p=0.556 n=5+4)
      neo/py(!log)/sql-zwrk.go·1                                  380µs ± 8%               400µs ±16%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  553µs ± 9%               562µs ± 8%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  769µs ± 7%               827µs ±13%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.08ms ± 9%              1.13ms ±14%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.11ms ± 5%              2.13ms ±13%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.31ms ±12%              3.24ms ±12%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.37ms ±15%              4.62ms ± 8%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·1                                       92.9µs ± 6%              93.9µs ± 4%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·2                                       88.7µs ± 2%              89.6µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·3                                       94.4µs ± 1%              94.6µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·4                                       92.5µs ± 0%              92.6µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·8                                        102µs ± 0%               102µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·12                                       130µs ± 0%               130µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       157µs ± 1%               156µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         65.6µs ± 5%              66.8µs ± 5%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         63.4µs ± 1%              63.5µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         68.4µs ± 0%              68.5µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         69.5µs ± 0%              69.7µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         79.9µs ± 0%              79.7µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         103µs ± 0%               103µs ± 0%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         127µs ± 0%               127µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     198µs ± 9%               208µs ±14%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     170µs ± 2%               166µs ± 2%   -2.41%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     157µs ± 0%               158µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     162µs ± 1%               162µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     180µs ± 1%               178µs ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    213µs ± 1%               213µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    274µs ± 0%               276µs ± 0%   +0.72%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              178µs ± 7%               185µs ± 4%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              152µs ± 3%               156µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              147µs ± 1%               149µs ± 1%   +1.17%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              148µs ± 1%               149µs ± 1%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              165µs ± 1%               166µs ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             199µs ± 0%               199µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             260µs ± 1%               259µs ± 1%     ~     (p=0.548 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zwrk.go·1                                              2.93µs ± 4%              2.88µs ± 2%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·2                                              3.05µs ± 6%              3.03µs ± 3%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·3                                              3.05µs ± 5%              3.05µs ± 4%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·4                                              3.10µs ± 2%              3.05µs ± 2%     ~     (p=0.222 n=5+5)
      fs1-zwrk.go·8                                              3.11µs ± 1%              3.14µs ± 4%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·12                                             4.27µs ± 2%              4.28µs ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                             5.62µs ± 1%              5.63µs ± 2%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        198µs ± 6%               208µs ± 5%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        245µs ± 2%               245µs ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        340µs ± 5%               335µs ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        435µs ± 1%               453µs ±10%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        814µs ± 1%               803µs ± 2%     ~     (p=0.111 n=5+4)
      zeo/py/fs1-zwrk.go·12                                      1.24ms ± 7%              1.23ms ± 6%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.61ms ±10%              1.59ms ± 6%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               272µs ± 8%               271µs ± 7%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               347µs ± 0%               346µs ± 0%     ~     (p=0.343 n=4+4)
      neo/py(!log)/sqlite-zwrk.go·3                               555µs ±12%               520µs ± 0%   -6.28%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               688µs ± 1%               694µs ± 0%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.37ms ± 0%              1.37ms ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             2.12ms ± 3%              2.07ms ± 2%   -1.93%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.74ms ± 0%              2.76ms ± 1%     ~     (p=0.730 n=4+5)
      neo/py(!log)/sql-zwrk.go·1                                  380µs ± 6%               400µs ±11%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  524µs ±10%               554µs ± 7%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  832µs ±12%               783µs ±11%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.08ms ±13%              1.06ms ±11%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.95ms ± 7%              2.07ms ± 9%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.09ms ±10%              3.02ms ± 7%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.45ms ± 8%              4.32ms ±12%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                       74.5µs ± 3%              72.6µs ± 3%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·2                                       71.4µs ± 1%              71.2µs ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·3                                       75.0µs ± 0%              74.6µs ± 0%   -0.61%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                       75.8µs ± 0%              75.7µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·8                                       88.2µs ± 0%              88.3µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·12                                       124µs ± 1%               125µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·16                                       175µs ± 2%               176µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         63.1µs ± 2%              61.7µs ± 2%   -2.19%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         60.6µs ± 0%              60.7µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         64.8µs ± 0%              64.9µs ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         66.7µs ± 0%              66.9µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         81.1µs ± 1%              81.5µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         117µs ± 1%               118µs ± 1%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         166µs ± 3%               165µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     178µs ±14%               177µs ± 8%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     150µs ± 2%               151µs ± 2%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     147µs ± 0%               148µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     151µs ± 1%               151µs ± 0%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     180µs ± 0%               180µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    230µs ± 1%               229µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    328µs ± 1%               327µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              175µs ± 8%               176µs ± 4%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              150µs ± 2%               152µs ± 3%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              147µs ± 1%               147µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              148µs ± 1%               148µs ± 2%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              179µs ± 2%               176µs ± 1%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             226µs ± 1%               225µs ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             322µs ± 2%               321µs ± 1%     ~     (p=1.000 n=5+5)
      850bfb9d
    • Kirill Smelkov's avatar
      X neo1: localhost timings, Cenabled · 9644774a
      Kirill Smelkov authored
      Compared to yesterday shows relatively no significant change, though
      some benchmarks, usually related to sql are itself noisy.
      
      $ benchstat -split node,cluster,dataset 20180305-neo1-ffixed-c.txt 20180306-neo1-ffixed-c.txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:neo1
      pystone                                                      106k ± 1%                106k ± 1%     ~     (p=0.690 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:neo1
      crc32/py/4K                                                5.13µs ± 1%              5.13µs ± 1%     ~     (p=0.548 n=5+5)
      crc32/go/4K                                                2.79µs ± 0%              2.79µs ± 0%     ~     (p=0.238 n=5+5)
      sha1/py/4K                                                 13.5µs ± 1%              13.4µs ± 1%     ~     (p=0.548 n=5+5)
      sha1/go/4K                                                 9.83µs ± 0%              9.83µs ± 0%     ~     (p=0.746 n=5+5)
      unzlib/py/wczdata                                          36.2µs ± 1%              36.1µs ± 0%     ~     (p=0.421 n=5+5)
      unzlib/go/wczdata                                          31.2µs ± 1%              31.1µs ± 1%     ~     (p=0.548 n=5+5)
      unzlib/py/prod1-avg                                        16.4µs ± 2%              16.3µs ± 2%     ~     (p=0.690 n=5+5)
      unzlib/go/prod1-avg                                        9.42µs ± 0%              9.42µs ± 0%     ~     (p=0.786 n=5+5)
      disk/randread/direct/4K-min                                 161µs ± 0%               162µs ± 0%   +0.37%  (p=0.008 n=5+5)
      disk/randread/direct/4K-avg                                 187µs ± 1%               187µs ± 2%     ~     (p=0.381 n=5+5)
      disk/randread/pagecache/4K-min                              390ns ± 1%               389ns ± 1%     ~     (p=0.317 n=5+5)
      disk/randread/pagecache/4K-avg                              801ns ± 0%               804ns ± 0%   +0.34%  (p=0.048 n=5+4)
      
      name                                           old time/object          new time/object          delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zhash.py                                               34.9µs ± 1%              34.7µs ± 2%     ~     (p=0.651 n=5+5)
      fs1-zhash.go                                               5.96µs ± 1%              6.00µs ± 2%     ~     (p=0.683 n=5+5)
      fs1-zhash.go+prefetch128                                   6.64µs ± 2%              6.52µs ± 4%     ~     (p=0.317 n=5+5)
      zeo/py/fs1-zhash.py                                         517µs ± 2%               523µs ± 1%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zhash.go                                         200µs ± 3%               194µs ± 4%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            99.3µs ± 4%              98.6µs ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                668µs ±18%               684µs ± 3%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                242µs ± 1%               236µs ± 2%   -2.46%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    166µs ± 1%               162µs ± 2%   -2.30%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                   933µs ±54%               942µs ±47%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zhash.go                                   317µs ± 8%               300µs ±17%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       245µs ± 7%               240µs ± 6%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zhash.py                                         382µs ±22%               383µs ±20%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.go                                        81.3µs ± 3%              81.3µs ± 1%     ~     (p=0.532 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            33.9µs ± 4%              33.8µs ± 5%     ~     (p=0.952 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          57.4µs ± 3%              57.6µs ± 3%     ~     (p=0.746 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              23.2µs ± 4%              22.9µs ± 6%     ~     (p=0.500 n=5+5)
      neo/go/sqlite-zhash.py                                      410µs ± 3%               402µs ± 6%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zhash.go                                      125µs ± 1%               125µs ± 1%     ~     (p=0.333 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         47.4µs ± 3%              48.4µs ± 8%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               114µs ± 2%               116µs ± 2%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  47.0µs ±13%              45.9µs ± 5%     ~     (p=1.000 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zhash.py                                               29.0µs ± 1%              28.9µs ± 1%     ~     (p=0.341 n=5+5)
      fs1-zhash.go                                               3.76µs ± 2%              3.76µs ± 4%     ~     (p=1.000 n=5+5)
      fs1-zhash.go+prefetch128                                   3.80µs ± 0%              3.86µs ± 2%     ~     (p=0.238 n=4+5)
      zeo/py/fs1-zhash.py                                         481µs ± 3%               474µs ± 2%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zhash.go                                         170µs ± 5%               170µs ± 3%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            87.7µs ± 2%              87.8µs ± 1%     ~     (p=0.881 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                657µs ±11%               665µs ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                213µs ± 5%               219µs ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    151µs ± 2%               151µs ± 1%     ~     (p=0.881 n=5+5)
      neo/py(!log)/sql-zhash.py                                   897µs ±54%               886µs ±56%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zhash.go                                   320µs ± 9%               298µs ± 9%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       230µs ± 2%               230µs ± 3%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.py                                         346µs ±35%               319µs ±11%     ~     (p=0.794 n=5+5)
      neo/go/fs1-zhash.go                                        61.2µs ± 1%              61.3µs ± 3%     ~     (p=0.794 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            22.6µs ± 2%              22.5µs ± 3%     ~     (p=0.738 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          51.2µs ± 2%              52.0µs ± 3%     ~     (p=0.135 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              18.5µs ± 5%              18.3µs ± 2%     ~     (p=0.460 n=5+5)
      neo/go/sqlite-zhash.py                                      391µs ± 7%               382µs ± 6%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zhash.go                                      113µs ± 1%               113µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         41.5µs ± 6%              40.9µs ± 4%     ~     (p=0.730 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               109µs ± 1%               108µs ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  41.1µs ± 3%              41.1µs ± 5%     ~     (p=1.000 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zwrk.go·1                                                230k ± 0%                229k ± 0%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·2                                                446k ± 1%                443k ± 1%     ~     (p=0.151 n=5+5)
      fs1-zwrk.go·3                                                663k ± 0%                662k ± 1%     ~     (p=0.730 n=4+5)
      fs1-zwrk.go·4                                                868k ± 0%                867k ± 1%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·8                                                989k ± 1%                988k ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·12                                              1.02M ± 0%               1.02M ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                              1.01M ± 0%               0.98M ±12%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        5.09k ± 2%               5.15k ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        7.08k ± 2%               7.08k ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        7.75k ± 1%               7.73k ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        7.93k ± 2%               7.97k ± 4%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        8.30k ± 2%               8.30k ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       8.43k ± 1%               8.15k ± 1%   -3.31%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       8.41k ± 2%               8.25k ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               4.36k ± 4%               4.31k ± 4%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               6.27k ± 3%               6.28k ± 5%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               6.21k ± 2%               6.38k ± 0%   +2.64%  (p=0.016 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·4                               6.07k ± 6%               6.15k ± 5%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               6.22k ± 3%               6.27k ± 4%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              6.19k ± 4%               6.33k ± 2%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              6.09k ± 6%               6.25k ± 4%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  3.12k ± 7%               3.10k ± 6%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  4.02k ± 7%               3.98k ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  4.08k ± 8%               4.04k ± 3%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  4.03k ± 4%               4.06k ± 4%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  3.95k ± 3%               3.79k ± 7%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 4.04k ± 5%               3.98k ± 3%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.97k ± 5%               3.94k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                        12.9k ± 2%               12.8k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·2                                        24.9k ± 1%               24.8k ± 0%     ~     (p=0.286 n=5+4)
      neo/go/fs1-zwrk.go·3                                        32.4k ± 0%               32.3k ± 0%   -0.29%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·4                                        40.8k ± 1%               40.7k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·8                                        54.8k ± 1%               54.5k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·12                                       56.5k ± 1%               56.5k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       54.4k ± 2%               53.2k ±10%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          18.9k ± 2%               19.0k ± 2%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          37.8k ± 0%               37.8k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          48.1k ± 0%               48.0k ± 1%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          59.2k ± 0%               59.0k ± 0%   -0.45%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          78.4k ± 0%               78.0k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         82.9k ± 1%               82.2k ± 2%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         80.4k ± 2%               80.4k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     8.13k ± 0%               8.06k ± 4%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     14.9k ± 0%               14.9k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     20.8k ± 1%               20.7k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     24.9k ± 0%               24.8k ± 0%   -0.37%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     31.7k ± 1%               31.7k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    31.4k ± 1%               30.8k ± 5%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    30.5k ± 2%               30.4k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              8.96k ± 0%               8.95k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              16.4k ± 0%               16.2k ± 1%   -1.04%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              22.7k ± 0%               22.6k ± 0%   -0.59%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.7k ± 0%               27.9k ± 0%   +0.58%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              34.4k ± 0%               35.0k ± 1%   +1.92%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             33.5k ± 2%               34.7k ± 1%   +3.56%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             33.0k ± 2%               33.0k ±11%     ~     (p=0.222 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zwrk.go·1                                                452k ± 1%                451k ± 0%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·2                                                895k ± 0%                893k ± 0%   -0.30%  (p=0.032 n=5+5)
      fs1-zwrk.go·3                                               1.33M ± 1%               1.34M ± 1%     ~     (p=0.151 n=5+5)
      fs1-zwrk.go·4                                               1.76M ± 1%               1.77M ± 0%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·8                                               1.94M ±12%               1.99M ± 1%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·12                                              2.03M ± 0%               2.03M ± 1%     ~     (p=0.286 n=5+4)
      fs1-zwrk.go·16                                              2.03M ± 0%               2.03M ± 0%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        6.00k ± 2%               5.79k ± 3%   -3.52%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        8.45k ± 7%               8.55k ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        9.33k ± 2%               9.28k ± 7%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        9.80k ± 0%               9.72k ± 1%   -0.89%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        10.4k ± 1%               10.4k ± 1%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       10.5k ± 2%               10.5k ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       10.4k ± 4%               10.4k ± 4%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               4.87k ±11%               4.90k ± 7%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               6.44k ± 1%               6.28k ± 4%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               6.31k ± 6%               6.32k ± 5%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               6.36k ± 7%               6.45k ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               6.47k ± 1%               6.45k ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              6.48k ± 1%               6.31k ± 3%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              6.35k ± 2%               6.36k ± 5%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  3.07k ± 9%               3.50k ± 9%  +14.08%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  4.09k ± 3%               4.05k ± 6%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  3.99k ±11%               4.06k ± 7%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  3.99k ± 2%               3.98k ± 4%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  4.15k ± 4%               4.15k ± 3%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 4.13k ± 5%               4.00k ± 5%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 4.22k ± 7%               3.96k ±11%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·1                                        17.3k ± 1%               17.1k ± 1%     ~     (p=0.063 n=5+5)
      neo/go/fs1-zwrk.go·2                                        32.5k ± 1%               32.6k ± 0%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·3                                        43.3k ± 0%               43.3k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·4                                        52.9k ± 0%               52.9k ± 0%     ~     (p=0.730 n=4+5)
      neo/go/fs1-zwrk.go·8                                        65.3k ± 2%               66.3k ± 1%   +1.57%  (p=0.032 n=5+4)
      neo/go/fs1-zwrk.go·12                                       61.0k ± 6%               61.6k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·16                                       55.9k ± 2%               55.6k ± 4%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          20.0k ± 3%               19.6k ± 5%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          40.5k ± 1%               40.3k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          51.6k ± 0%               51.6k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          62.6k ± 0%               62.0k ± 0%   -0.83%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          74.6k ± 1%               74.2k ± 4%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         66.3k ± 4%               64.8k ± 7%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         58.9k ± 2%               59.5k ± 4%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     9.01k ± 1%               9.02k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     15.9k ± 1%               16.0k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     21.8k ± 0%               21.8k ± 1%     ~     (p=1.000 n=4+4)
      neo/go/sqlite-zwrk.go·4                                     26.3k ± 0%               26.2k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     29.8k ± 1%               30.0k ± 2%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    28.5k ± 1%               28.6k ± 2%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    28.5k ± 8%               28.7k ± 1%     ~     (p=0.730 n=5+4)
      neo/go/sqlite-zwrk.go(!sha1)·1                              9.38k ± 1%               9.45k ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              16.5k ± 0%               16.6k ± 1%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              22.7k ± 0%               23.0k ± 0%   +1.59%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.5k ± 1%               28.0k ± 1%   +1.81%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              32.3k ± 5%               32.3k ± 0%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             30.7k ± 2%               30.6k ± 2%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             30.3k ± 2%               30.3k ± 2%     ~     (p=0.841 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zwrk.go·1                                              4.35µs ± 0%              4.36µs ± 0%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·2                                              4.49µs ± 1%              4.52µs ± 1%     ~     (p=0.151 n=5+5)
      fs1-zwrk.go·3                                              4.53µs ± 0%              4.53µs ± 1%     ~     (p=0.730 n=4+5)
      fs1-zwrk.go·4                                              4.61µs ± 0%              4.61µs ± 1%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·8                                              8.09µs ± 1%              8.10µs ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·12                                             11.8µs ± 0%              11.8µs ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                             15.8µs ± 0%              16.5µs ±13%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        197µs ± 2%               194µs ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        283µs ± 2%               282µs ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        387µs ± 1%               388µs ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        504µs ± 2%               502µs ± 5%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        964µs ± 2%               964µs ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.42ms ± 1%              1.47ms ± 1%   +3.43%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.90ms ± 2%              1.94ms ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               230µs ± 4%               232µs ± 4%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               319µs ± 3%               319µs ± 5%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               483µs ± 2%               470µs ± 0%   -2.59%  (p=0.016 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·4                               661µs ± 6%               651µs ± 5%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.29ms ± 3%              1.28ms ± 4%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.94ms ± 4%              1.90ms ± 2%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.63ms ± 6%              2.56ms ± 4%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  321µs ± 7%               323µs ± 6%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  499µs ± 7%               503µs ± 2%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  737µs ± 8%               742µs ± 3%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  993µs ± 4%               986µs ± 4%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.03ms ± 3%              2.11ms ± 8%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                2.97ms ± 4%              3.02ms ± 3%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.03ms ± 4%              4.06ms ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                       77.7µs ± 2%              77.8µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·2                                       80.2µs ± 1%              80.6µs ± 0%     ~     (p=0.286 n=5+4)
      neo/go/fs1-zwrk.go·3                                       92.5µs ± 0%              92.8µs ± 0%   +0.30%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·4                                       98.1µs ± 1%              98.2µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·8                                        146µs ± 1%               147µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·12                                       212µs ± 1%               212µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       294µs ± 2%               293µs ± 1%     ~     (p=0.905 n=5+4)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         52.8µs ± 2%              52.7µs ± 2%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         53.0µs ± 0%              53.0µs ± 0%     ~     (p=0.889 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         62.3µs ± 0%              62.5µs ± 1%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         67.5µs ± 0%              67.8µs ± 0%   +0.46%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          102µs ± 0%               103µs ± 1%   +0.54%  (p=0.040 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         145µs ± 1%               146µs ± 2%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         199µs ± 2%               199µs ± 1%     ~     (p=0.651 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     123µs ± 0%               124µs ± 4%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     134µs ± 0%               134µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     144µs ± 1%               145µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     161µs ± 0%               161µs ± 0%   +0.38%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     253µs ± 1%               252µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    383µs ± 1%               390µs ± 5%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    524µs ± 2%               526µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              112µs ± 0%               112µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              122µs ± 0%               124µs ± 1%   +1.05%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              132µs ± 0%               133µs ± 0%   +0.60%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go(!sha1)·4                              144µs ± 0%               143µs ± 0%   -0.57%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              233µs ± 0%               228µs ± 1%   -1.88%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             359µs ± 2%               346µs ± 1%   -3.44%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             485µs ± 2%               486µs ±11%     ~     (p=0.222 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zwrk.go·1                                              2.21µs ± 1%              2.22µs ± 1%     ~     (p=0.667 n=5+5)
      fs1-zwrk.go·2                                              2.23µs ± 0%              2.24µs ± 0%   +0.30%  (p=0.040 n=5+5)
      fs1-zwrk.go·3                                              2.25µs ± 1%              2.25µs ± 1%     ~     (p=0.135 n=5+5)
      fs1-zwrk.go·4                                              2.27µs ± 1%              2.26µs ± 0%     ~     (p=0.611 n=5+5)
      fs1-zwrk.go·8                                              4.15µs ±13%              4.02µs ± 1%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·12                                             5.90µs ± 0%              5.92µs ± 1%     ~     (p=0.317 n=5+4)
      fs1-zwrk.go·16                                             7.89µs ± 0%              7.87µs ± 0%     ~     (p=0.087 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        167µs ± 2%               173µs ± 3%   +3.68%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        237µs ± 7%               234µs ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        322µs ± 2%               324µs ± 7%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        408µs ± 0%               412µs ± 1%   +0.91%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        770µs ± 1%               768µs ± 1%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.14ms ± 2%              1.14ms ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.54ms ± 4%              1.54ms ± 4%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               206µs ±11%               204µs ± 8%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               311µs ± 1%               319µs ± 4%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               476µs ± 7%               475µs ± 5%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               629µs ± 7%               620µs ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.24ms ± 1%              1.24ms ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.85ms ± 1%              1.90ms ± 3%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.52ms ± 2%              2.52ms ± 5%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  327µs ± 8%               287µs ± 8%  -12.18%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  489µs ± 3%               495µs ± 6%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  755µs ±10%               740µs ± 8%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.00ms ± 2%              1.01ms ± 4%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.93ms ± 3%              1.93ms ± 3%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                2.91ms ± 5%              3.01ms ± 4%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                3.80ms ± 7%              4.05ms ±10%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·1                                       57.8µs ± 1%              58.5µs ± 1%     ~     (p=0.063 n=5+5)
      neo/go/fs1-zwrk.go·2                                       61.5µs ± 1%              61.4µs ± 0%     ~     (p=0.254 n=5+5)
      neo/go/fs1-zwrk.go·3                                       69.3µs ± 0%              69.3µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·4                                       75.6µs ± 0%              75.6µs ± 0%     ~     (p=0.730 n=4+5)
      neo/go/fs1-zwrk.go·8                                        123µs ± 2%               121µs ± 1%   -1.56%  (p=0.032 n=5+4)
      neo/go/fs1-zwrk.go·12                                       197µs ± 6%               195µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·16                                       286µs ± 2%               288µs ± 4%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         50.0µs ± 3%              50.9µs ± 5%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         49.4µs ± 1%              49.7µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         58.1µs ± 0%              58.2µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         63.9µs ± 0%              64.5µs ± 0%   +0.84%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          107µs ± 1%               108µs ± 4%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         181µs ± 4%               185µs ± 8%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         272µs ± 2%               269µs ± 4%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     111µs ± 1%               111µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     126µs ± 1%               125µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     137µs ± 0%               137µs ± 1%     ~     (p=1.000 n=4+4)
      neo/go/sqlite-zwrk.go·4                                     152µs ± 0%               153µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     268µs ± 1%               267µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    421µs ± 1%               420µs ± 2%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    562µs ± 8%               558µs ± 1%     ~     (p=0.730 n=5+4)
      neo/go/sqlite-zwrk.go(!sha1)·1                              107µs ± 1%               106µs ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              121µs ± 0%               121µs ± 1%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              132µs ± 0%               130µs ± 0%   -1.57%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              146µs ± 1%               143µs ± 1%   -1.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              247µs ± 5%               248µs ± 0%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             391µs ± 2%               393µs ± 2%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             528µs ± 2%               528µs ± 2%     ~     (p=0.841 n=5+5)
      9644774a
    • Kirill Smelkov's avatar
      X deco: localhost timings, Cenabled · dabeb4b8
      Kirill Smelkov authored
      Compared to yesterday shows not significant change, thus meaning
      benchmarking is more or less stable (+/- 5% at ·12 and ·16 is probably
      due to scheduling):
      
      $ benchstat -split node,cluster,dataset 20180305-deco-ffixed-c.txt 20180306-deco-ffixed-c.txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:deco
      pystone                                                      219k ± 3%                217k ± 4%    ~     (p=0.548 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:deco
      crc32/py/4K                                                5.72µs ± 0%              5.73µs ± 0%    ~     (p=0.460 n=5+5)
      crc32/go/4K                                                 279ns ± 0%               279ns ± 0%    ~     (all equal)
      sha1/py/4K                                                 6.69µs ± 0%              6.74µs ± 1%  +0.66%  (p=0.024 n=5+5)
      sha1/go/4K                                                 5.59µs ± 0%              5.60µs ± 0%  +0.19%  (p=0.008 n=5+5)
      unzlib/py/wczdata                                          27.2µs ± 0%              27.2µs ± 1%    ~     (p=0.905 n=4+5)
      unzlib/go/wczdata                                          26.9µs ± 1%              27.0µs ± 0%    ~     (p=0.222 n=5+5)
      unzlib/py/prod1-avg                                        5.06µs ± 0%              5.14µs ± 3%    ~     (p=0.603 n=4+5)
      unzlib/go/prod1-avg                                        5.33µs ± 1%              5.30µs ± 1%    ~     (p=0.087 n=5+5)
      disk/randread/direct/4K-min                                 105µs ± 0%               104µs ± 2%    ~     (p=0.270 n=5+5)
      disk/randread/direct/4K-avg                                 142µs ± 0%               141µs ± 0%  -0.31%  (p=0.032 n=5+5)
      disk/randread/pagecache/4K-min                              583ns ± 1%               579ns ± 2%    ~     (p=0.246 n=5+5)
      disk/randread/pagecache/4K-avg                             1.00µs ± 1%              0.99µs ± 0%  -0.98%  (p=0.024 n=5+5)
      
      name                                           old time/object          new time/object          delta
      cluster:deco dataset:wczblk1-8
      fs1-zhash.py                                               20.2µs ± 1%              20.3µs ± 1%    ~     (p=0.571 n=4+4)
      fs1-zhash.go                                               3.20µs ± 0%              3.26µs ± 4%    ~     (p=0.444 n=5+5)
      fs1-zhash.go+prefetch128                                   4.14µs ± 6%              4.04µs ± 1%    ~     (p=0.444 n=5+5)
      zeo/py/fs1-zhash.py                                         379µs ± 3%               383µs ± 5%    ~     (p=0.730 n=5+5)
      zeo/py/fs1-zhash.go                                         127µs ± 1%               126µs ± 1%    ~     (p=0.317 n=4+5)
      zeo/py/fs1-zhash.go+prefetch128                            64.1µs ± 2%              63.1µs ± 1%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                335µs ± 4%               344µs ± 6%    ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                145µs ± 2%               140µs ± 1%  -3.07%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    118µs ± 1%               119µs ± 2%    ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zhash.py                                   454µs ±61%               386µs ± 1%    ~     (p=1.000 n=5+4)
      neo/py(!log)/sql-zhash.go                                   183µs ± 1%               183µs ± 3%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       164µs ± 2%               164µs ± 3%    ~     (p=0.690 n=5+5)
      neo/go/fs1-zhash.py                                         227µs ± 2%               226µs ± 3%    ~     (p=0.690 n=5+5)
      neo/go/fs1-zhash.go                                        56.9µs ± 1%              57.1µs ± 0%    ~     (p=0.119 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            24.7µs ± 2%              24.7µs ± 5%    ~     (p=0.571 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          40.5µs ± 1%              40.2µs ± 1%    ~     (p=0.254 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              16.8µs ± 5%              17.1µs ± 6%    ~     (p=0.579 n=5+5)
      neo/go/sqlite-zhash.py                                      269µs ± 1%               272µs ± 3%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go                                     92.7µs ± 0%              92.8µs ± 0%    ~     (p=0.397 n=5+4)
      neo/go/sqlite-zhash.go+prefetch128                         39.8µs ± 8%              40.5µs ± 5%    ~     (p=0.548 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              86.4µs ± 2%              86.5µs ± 2%    ~     (p=0.571 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  40.1µs ±11%              38.8µs ± 9%    ~     (p=0.579 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zhash.py                                               15.8µs ± 2%              15.8µs ± 3%    ~     (p=0.629 n=4+4)
      fs1-zhash.go                                               2.80µs ± 0%              2.80µs ± 0%    ~     (all equal)
      fs1-zhash.go+prefetch128                                   3.54µs ± 7%              3.42µs ± 8%    ~     (p=0.381 n=5+5)
      zeo/py/fs1-zhash.py                                         362µs ± 6%               361µs ± 5%    ~     (p=1.000 n=5+5)
      zeo/py/fs1-zhash.go                                         106µs ± 1%               105µs ± 0%    ~     (p=0.214 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            58.9µs ± 1%              58.9µs ± 1%    ~     (p=0.881 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                331µs ± 1%               344µs ± 7%    ~     (p=0.063 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                136µs ± 1%               137µs ± 2%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    112µs ± 1%               114µs ± 1%  +1.73%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                   389µs ± 6%               380µs ± 4%    ~     (p=0.486 n=4+4)
      neo/py(!log)/sql-zhash.go                                   180µs ± 2%               180µs ± 1%    ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       157µs ± 1%               159µs ± 1%    ~     (p=0.095 n=5+5)
      neo/go/fs1-zhash.py                                         223µs ± 0%               221µs ± 1%  -0.79%  (p=0.016 n=5+5)
      neo/go/fs1-zhash.go                                        44.9µs ± 1%              45.2µs ± 2%    ~     (p=0.357 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            17.6µs ± 5%              17.6µs ± 2%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          39.1µs ± 1%              39.1µs ± 2%    ~     (p=0.714 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              14.8µs ± 3%              14.6µs ± 4%    ~     (p=0.302 n=5+5)
      neo/go/sqlite-zhash.py                                      269µs ± 3%               271µs ± 2%    ~     (p=0.548 n=5+5)
      neo/go/sqlite-zhash.go                                     86.0µs ± 1%              86.4µs ± 0%    ~     (p=0.206 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         36.4µs ± 6%              35.8µs ± 2%    ~     (p=0.532 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              83.6µs ± 1%              84.0µs ± 1%    ~     (p=0.516 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  35.9µs ± 5%              36.5µs ± 5%    ~     (p=0.444 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:deco dataset:wczblk1-8
      fs1-zwrk.go·1                                                438k ± 1%                436k ± 0%    ~     (p=0.222 n=5+5)
      fs1-zwrk.go·2                                                745k ± 1%                744k ± 1%    ~     (p=0.548 n=5+5)
      fs1-zwrk.go·3                                               1.09M ± 0%               1.09M ± 0%    ~     (p=0.095 n=5+5)
      fs1-zwrk.go·4                                               1.15M ± 1%               1.16M ± 1%    ~     (p=0.095 n=5+5)
      fs1-zwrk.go·8                                               1.27M ± 1%               1.27M ± 1%    ~     (p=0.841 n=5+5)
      fs1-zwrk.go·12                                              1.27M ± 1%               1.27M ± 1%    ~     (p=0.690 n=5+5)
      fs1-zwrk.go·16                                              1.28M ± 1%               1.27M ± 1%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        9.04k ± 1%               9.12k ± 0%  +0.89%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        11.4k ± 1%               11.6k ± 1%  +1.58%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        13.4k ± 1%               13.4k ± 1%    ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        14.0k ± 1%               14.0k ± 1%    ~     (p=0.595 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        14.6k ± 4%               14.7k ± 1%    ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       14.9k ± 1%               15.0k ± 1%    ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       15.3k ± 1%               15.1k ± 0%  -0.79%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.03k ± 3%               7.09k ± 1%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.52k ± 1%               8.48k ± 1%    ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.48k ± 1%               8.48k ± 1%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.45k ± 1%               8.47k ± 1%    ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.44k ± 1%               8.43k ± 1%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.48k ± 1%               8.46k ± 1%    ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.49k ± 1%               8.46k ± 1%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.51k ± 1%               5.51k ± 1%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.31k ± 1%               6.32k ± 1%    ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.20k ± 1%               6.29k ± 1%  +1.37%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.22k ± 1%               6.27k ± 1%  +0.83%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.25k ± 1%               6.27k ± 1%    ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.26k ± 1%               6.29k ± 0%    ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.26k ± 1%               6.22k ± 1%    ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·1                                        18.4k ± 0%               18.4k ± 1%    ~     (p=0.167 n=5+5)
      neo/go/fs1-zwrk.go·2                                        38.2k ± 1%               38.1k ± 1%    ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·3                                        45.8k ± 1%               46.0k ± 1%    ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·4                                        49.8k ± 0%               50.2k ± 1%  +0.94%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        60.3k ± 1%               61.0k ± 0%  +1.16%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·12                                       61.6k ± 1%               62.1k ± 1%    ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·16                                       61.4k ± 1%               62.5k ± 1%    ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.1k ± 1%               26.3k ± 1%    ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          55.3k ± 1%               55.3k ± 1%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          62.7k ± 1%               62.7k ± 1%    ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          69.1k ± 0%               69.3k ± 1%    ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          87.9k ± 0%               88.2k ± 0%    ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         92.2k ± 1%               93.4k ± 0%  +1.32%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         93.4k ± 1%               93.5k ± 2%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.1k ± 0%               11.0k ± 1%    ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     18.5k ± 0%               18.4k ± 1%  -0.68%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     24.5k ± 0%               24.4k ± 1%    ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.9k ± 1%               26.8k ± 0%    ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     29.9k ± 2%               30.4k ± 2%    ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    29.2k ± 2%               30.5k ± 1%  +4.49%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    28.4k ± 2%               29.9k ± 2%  +5.53%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.8k ± 0%               11.9k ± 1%    ~     (p=0.063 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              19.5k ± 0%               19.7k ± 0%  +0.60%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              26.8k ± 1%               26.5k ± 1%  -1.14%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              30.3k ± 1%               30.0k ± 0%  -1.12%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              32.0k ± 2%               31.2k ± 2%  -2.46%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             30.2k ± 3%               28.9k ± 1%  -4.20%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             29.7k ± 1%               28.4k ± 2%  -4.27%  (p=0.008 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zwrk.go·1                                                555k ± 0%                555k ± 0%    ~     (p=1.000 n=5+5)
      fs1-zwrk.go·2                                                982k ± 2%               1008k ± 3%  +2.66%  (p=0.032 n=5+5)
      fs1-zwrk.go·3                                               1.32M ± 1%               1.32M ± 1%    ~     (p=0.421 n=5+5)
      fs1-zwrk.go·4                                               1.51M ± 1%               1.55M ± 2%  +2.80%  (p=0.032 n=5+5)
      fs1-zwrk.go·8                                               1.58M ± 1%               1.59M ± 0%    ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                              1.59M ± 0%               1.59M ± 0%    ~     (p=0.548 n=5+5)
      fs1-zwrk.go·16                                              1.59M ± 0%               1.59M ± 0%    ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        9.70k ± 1%               9.70k ± 0%    ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        12.2k ± 1%               12.4k ± 1%  +1.67%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        14.2k ± 1%               14.2k ± 1%    ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        14.9k ± 0%               14.9k ± 0%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        15.6k ± 0%               15.6k ± 0%    ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       15.9k ± 1%               15.2k ±11%    ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       16.1k ± 0%               16.1k ± 1%    ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.51k ± 1%               7.44k ± 1%  -0.91%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.72k ± 1%               8.59k ± 1%  -1.45%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.69k ± 1%               8.61k ± 1%    ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.67k ± 1%               8.57k ± 1%    ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.72k ± 0%               8.56k ± 1%  -1.83%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.63k ± 1%               8.51k ± 1%    ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.64k ± 1%               8.54k ± 1%    ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.56k ± 2%               5.55k ± 2%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.42k ± 0%               6.36k ± 1%  -0.97%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.40k ± 0%               6.31k ± 0%  -1.44%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.38k ± 1%               6.28k ± 0%  -1.57%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.39k ± 1%               6.34k ± 1%    ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.42k ± 1%               6.35k ± 1%  -1.11%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.41k ± 2%               6.36k ± 0%    ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·1                                        23.8k ± 0%               23.7k ± 0%  -0.33%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·2                                        45.0k ± 1%               45.4k ± 0%  +0.93%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·3                                        55.1k ± 1%               55.2k ± 1%    ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·4                                        60.1k ± 0%               60.7k ± 2%    ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·8                                        68.3k ± 2%               70.9k ± 2%  +3.72%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·12                                       69.3k ± 5%               71.1k ± 3%    ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·16                                       68.8k ± 6%               71.0k ± 3%    ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          27.3k ± 0%               27.3k ± 0%    ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          54.9k ± 1%               55.4k ± 1%    ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          64.0k ± 0%               64.0k ± 1%    ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          68.7k ± 1%               69.0k ± 1%    ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          79.4k ± 2%               80.9k ± 2%    ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         77.9k ± 2%               78.3k ± 5%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         75.3k ± 6%               75.4k ± 3%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.8k ± 0%               11.7k ± 1%    ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     19.2k ± 0%               19.0k ± 0%  -0.85%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     24.5k ± 1%               24.5k ± 1%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.6k ± 1%               26.3k ± 1%  -1.38%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     25.1k ± 3%               24.9k ± 3%    ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    23.8k ± 2%               24.0k ± 5%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    24.3k ± 2%               25.4k ± 1%  +4.53%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              12.1k ± 1%               12.2k ± 0%    ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              19.6k ± 0%               19.8k ± 0%  +0.98%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              25.3k ± 1%               26.2k ± 1%  +3.40%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.3k ± 1%               28.7k ± 1%  +5.03%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              25.4k ± 3%               27.2k ± 3%  +6.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             23.8k ± 2%               25.3k ± 2%  +6.21%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             23.9k ± 2%               25.3k ± 1%  +6.14%  (p=0.008 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:deco dataset:wczblk1-8
      fs1-zwrk.go·1                                              2.29µs ± 1%              2.29µs ± 0%    ~     (p=0.222 n=5+5)
      fs1-zwrk.go·2                                              2.68µs ± 1%              2.69µs ± 1%    ~     (p=0.524 n=5+5)
      fs1-zwrk.go·3                                              2.76µs ± 0%              2.76µs ± 0%    ~     (p=0.111 n=5+5)
      fs1-zwrk.go·4                                              3.46µs ± 1%              3.44µs ± 1%    ~     (p=0.095 n=5+5)
      fs1-zwrk.go·8                                              6.28µs ± 1%              6.28µs ± 1%    ~     (p=0.889 n=5+5)
      fs1-zwrk.go·12                                             9.42µs ± 1%              9.46µs ± 1%    ~     (p=0.690 n=5+5)
      fs1-zwrk.go·16                                             12.5µs ± 1%              12.6µs ± 1%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        111µs ± 1%               110µs ± 0%  -0.88%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        176µs ± 1%               173µs ± 1%  -1.56%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        224µs ± 1%               224µs ± 1%    ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        285µs ± 1%               286µs ± 1%    ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        549µs ± 4%               545µs ± 1%    ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       805µs ± 1%               802µs ± 1%    ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.05ms ± 1%              1.06ms ± 0%  +0.80%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               142µs ± 3%               141µs ± 1%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               235µs ± 1%               236µs ± 1%    ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               354µs ± 1%               354µs ± 1%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               473µs ± 1%               472µs ± 1%    ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               948µs ± 1%               949µs ± 1%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.42ms ± 1%              1.42ms ± 1%    ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.88ms ± 1%              1.89ms ± 1%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  181µs ± 1%               181µs ± 1%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  317µs ± 1%               317µs ± 1%    ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  484µs ± 1%               477µs ± 1%  -1.36%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  643µs ± 1%               638µs ± 1%  -0.82%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.28ms ± 1%              1.28ms ± 1%    ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.92ms ± 1%              1.91ms ± 0%    ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.56ms ± 1%              2.57ms ± 1%    ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·1                                       54.5µs ± 0%              54.2µs ± 1%    ~     (p=0.167 n=5+5)
      neo/go/fs1-zwrk.go·2                                       52.4µs ± 1%              52.5µs ± 1%    ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·3                                       65.4µs ± 1%              65.3µs ± 1%    ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·4                                       80.4µs ± 0%              79.6µs ± 1%  -0.93%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        133µs ± 1%               131µs ± 0%  -1.15%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·12                                       195µs ± 1%               193µs ± 1%    ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·16                                       261µs ± 1%               256µs ± 1%    ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         38.3µs ± 1%              38.0µs ± 1%    ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         36.2µs ± 1%              36.1µs ± 1%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         47.8µs ± 1%              47.8µs ± 1%    ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         57.9µs ± 0%              57.7µs ± 1%    ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         91.0µs ± 0%              90.7µs ± 0%    ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         130µs ± 1%               129µs ± 0%  -1.31%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         171µs ± 1%               171µs ± 2%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    90.4µs ± 0%              90.7µs ± 1%    ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     108µs ± 0%               109µs ± 1%  +0.69%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     123µs ± 0%               123µs ± 1%    ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     148µs ± 1%               149µs ± 0%    ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     267µs ± 2%               263µs ± 2%    ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    411µs ± 2%               393µs ± 1%  -4.31%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    564µs ± 2%               534µs ± 2%  -5.24%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             84.5µs ± 0%              84.0µs ± 1%    ~     (p=0.063 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              102µs ± 0%               102µs ± 0%  -0.60%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              112µs ± 1%               113µs ± 1%  +1.16%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              132µs ± 1%               133µs ± 0%  +1.13%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              250µs ± 2%               257µs ± 2%  +2.52%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             397µs ± 3%               415µs ± 1%  +4.38%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             539µs ± 1%               563µs ± 2%  +4.47%  (p=0.008 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zwrk.go·1                                              1.80µs ± 0%              1.80µs ± 0%    ~     (p=0.968 n=5+5)
      fs1-zwrk.go·2                                              2.04µs ± 2%              1.98µs ± 3%  -2.55%  (p=0.032 n=5+5)
      fs1-zwrk.go·3                                              2.28µs ± 1%              2.27µs ± 1%    ~     (p=0.389 n=5+5)
      fs1-zwrk.go·4                                              2.65µs ± 1%              2.58µs ± 2%  -2.71%  (p=0.032 n=5+5)
      fs1-zwrk.go·8                                              5.05µs ± 1%              5.04µs ± 0%    ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                             7.54µs ± 0%              7.55µs ± 0%    ~     (p=0.571 n=5+5)
      fs1-zwrk.go·16                                             10.1µs ± 0%              10.0µs ± 0%    ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        103µs ± 1%               103µs ± 0%    ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        164µs ± 1%               162µs ± 1%  -1.64%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        211µs ± 1%               212µs ± 1%    ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        269µs ± 0%               269µs ± 0%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        512µs ± 0%               512µs ± 0%    ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       755µs ± 1%               793µs ±12%    ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       993µs ± 0%               991µs ± 1%    ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               133µs ± 1%               134µs ± 1%  +0.92%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               229µs ± 1%               233µs ± 1%  +1.47%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               345µs ± 1%               348µs ± 1%    ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               461µs ± 1%               467µs ± 1%    ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               917µs ± 0%               935µs ± 1%  +1.87%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.39ms ± 1%              1.41ms ± 1%    ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.85ms ± 1%              1.87ms ± 1%    ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  180µs ± 2%               180µs ± 2%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  311µs ± 0%               315µs ± 1%  +0.99%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  468µs ± 0%               475µs ± 0%  +1.47%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  627µs ± 1%               637µs ± 0%  +1.59%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.25ms ± 1%              1.26ms ± 1%    ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.87ms ± 1%              1.89ms ± 1%  +1.13%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.50ms ± 2%              2.52ms ± 0%    ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·1                                       42.0µs ± 0%              42.2µs ± 0%  +0.33%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·2                                       44.5µs ± 1%              44.1µs ± 0%  -0.92%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·3                                       54.5µs ± 1%              54.4µs ± 1%    ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·4                                       66.5µs ± 0%              65.9µs ± 2%    ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·8                                        117µs ± 2%               113µs ± 2%  -3.59%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·12                                       173µs ± 4%               169µs ± 4%    ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·16                                       233µs ± 6%               225µs ± 3%    ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         36.7µs ± 0%              36.6µs ± 0%    ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         36.4µs ± 1%              36.1µs ± 1%    ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         46.9µs ± 0%              46.9µs ± 1%    ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         58.2µs ± 1%              57.9µs ± 1%    ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          101µs ± 2%                99µs ± 2%    ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         154µs ± 2%               153µs ± 5%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         213µs ± 6%               212µs ± 3%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    84.7µs ± 0%              85.1µs ± 1%    ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     104µs ± 0%               105µs ± 0%  +0.86%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     123µs ± 1%               123µs ± 1%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     150µs ± 1%               152µs ± 1%  +1.40%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     319µs ± 3%               321µs ± 3%    ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    504µs ± 2%               500µs ± 5%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    659µs ± 2%               630µs ± 1%  -4.34%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             82.5µs ± 1%              82.0µs ± 0%    ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              102µs ± 0%               101µs ± 0%  -0.97%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              119µs ± 1%               115µs ± 1%  -3.29%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              146µs ± 1%               139µs ± 1%  -4.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              315µs ± 3%               295µs ± 3%  -6.37%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             503µs ± 2%               474µs ± 2%  -5.86%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             671µs ± 2%               632µs ± 1%  -5.79%  (p=0.008 n=5+5)
      dabeb4b8
    • Kirill Smelkov's avatar
    • Kirill Smelkov's avatar
      X neo1 timings (ffixed, C not disabled) · 8748ba93
      Kirill Smelkov authored
      8748ba93
  4. 05 Mar, 2018 6 commits
    • Kirill Smelkov's avatar
      b655da26
    • Kirill Smelkov's avatar
      X deco-rio timings · a1dde3c9
      Kirill Smelkov authored
      Latency is awful (> 500µs) because RX coalescing is not disabled on rio.
      a1dde3c9
    • Kirill Smelkov's avatar
      X rio localhost timings after switch to zwrk & stabilizing output format · 2d0b54ad
      Kirill Smelkov authored
      Like in previous commit should not be changing compared to 39a77e3b, but
      it was not checked.
      2d0b54ad
    • Kirill Smelkov's avatar
      X noturbo deco timings after switch to zwrk + stabilizing neotest output format · ea5f9d26
      Kirill Smelkov authored
      Compared to 0ed7b1fc there should not be a difference (checked only on
      serial cases with manually ediging 20180221-deco-noturbo-noz.txt-fix to
      use updated output format for wczblk1-8 dataset):
      
      $ benchstat -split node,cluster,dataset 20180221-deco-noturbo-noz.txt-fix 20180305-deco-noturbo-c.txt
      name                                      old pystone/s    new pystone/s    delta
      node:deco
      pystone                                         221k ± 0%        219k ± 3%     ~     (p=0.690 n=5+5)
      
      name                                      old time/op      new time/op      delta
      node:deco
      sha1/py/1K                                    1.85µs ± 2%      1.84µs ± 1%     ~     (p=0.508 n=5+5)
      sha1/go/1K                                    1.53µs ± 0%      1.53µs ± 0%     ~     (p=0.103 n=5+5)
      sha1/py/4K                                    6.68µs ± 1%      6.69µs ± 0%     ~     (p=0.151 n=5+5)
      sha1/go/4K                                    5.59µs ± 0%      5.59µs ± 0%     ~     (p=0.333 n=5+5)
      sha1/py/2M                                    3.18ms ± 0%      3.18ms ± 0%     ~     (p=0.421 n=5+5)
      sha1/go/2M                                    2.78ms ± 0%      2.78ms ± 0%     ~     (p=1.000 n=5+5)
      unzlib/py/null-1K                             2.81µs ± 0%      2.91µs ± 3%   +3.49%  (p=0.008 n=5+5)
      unzlib/go/null-1K                             2.86µs ± 0%      2.88µs ± 1%   +0.93%  (p=0.008 n=5+5)
      unzlib/py/null-4K                             11.3µs ± 1%      11.4µs ± 2%   +0.89%  (p=0.040 n=5+5)
      unzlib/go/null-4K                             11.3µs ± 0%      11.4µs ± 0%   +0.89%  (p=0.008 n=5+5)
      unzlib/py/null-2M                             5.71ms ± 5%      5.66ms ± 3%     ~     (p=1.000 n=5+5)
      unzlib/go/null-2M                             4.79ms ± 0%      4.79ms ± 0%     ~     (p=0.095 n=5+5)
      unzlib/py/prod1-avg                           5.02µs ± 1%      5.06µs ± 0%     ~     (p=0.057 n=4+4)
      unzlib/go/prod1-avg                           5.27µs ± 1%      5.33µs ± 1%     ~     (p=0.087 n=5+5)
      unzlib/py/prod1-max                            512µs ± 2%       438µs ± 5%  -14.45%  (p=0.008 n=5+5)
      unzlib/go/prod1-max                            336µs ± 0%       352µs ± 4%   +4.67%  (p=0.008 n=5+5)
      disk/randread/direct/4K-min                    105µs ± 1%       105µs ± 0%     ~     (p=1.000 n=5+5)
      disk/randread/direct/4K-avg                    144µs ± 0%       142µs ± 0%   -1.54%  (p=0.008 n=5+5)
      disk/randread/direct/2M-min                   5.48ms ± 3%      5.34ms ± 3%     ~     (p=0.135 n=5+5)
      disk/randread/direct/2M-avg                   6.13ms ± 1%      6.04ms ± 2%     ~     (p=0.056 n=5+5)
      disk/randread/pagecache/4K-min                 570ns ± 1%       583ns ± 1%   +2.28%  (p=0.008 n=5+5)
      disk/randread/pagecache/4K-avg                 975ns ± 0%      1003ns ± 1%   +2.91%  (p=0.008 n=5+5)
      disk/randread/pagecache/2M-min                 195µs ± 4%       197µs ± 4%     ~     (p=0.690 n=5+5)
      disk/randread/pagecache/2M-avg                 214µs ± 0%       220µs ± 1%   +2.80%  (p=0.008 n=5+5)
      
      name                                      old time/object  new time/object  delta
      cluster:deco dataset:wczblk1-8
      fs1-zhash.py                                  20.3µs ± 1%      20.2µs ± 1%     ~     (p=0.444 n=5+4)
      fs1-zhash.go                                  3.20µs ± 0%      3.20µs ± 0%     ~     (all equal)
      fs1-zhash.go+prefetch128                      4.16µs ± 4%      4.14µs ± 6%     ~     (p=0.952 n=5+5)
      zeo/py/fs1-zhash.py                            375µs ± 4%       379µs ± 3%     ~     (p=0.690 n=5+5)
      neo/py/sqlite-zhash.py                         355µs ± 6%       362µs ± 6%     ~     (p=0.421 n=5+5)
      neo/py/sqlite-zhash.go                         156µs ± 2%       158µs ± 1%     ~     (p=0.151 n=5+5)
      neo/py/sqlite-zhash.go+prefetch128             134µs ± 2%       135µs ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zhash.py                   326µs ± 3%       335µs ± 4%     ~     (p=0.381 n=5+5)
      neo/py(!log)/sqlite-zhash.go                   143µs ± 3%       145µs ± 2%     ~     (p=0.508 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128       119µs ± 2%       118µs ± 1%     ~     (p=0.421 n=5+5)
      neo/py/sql-zhash.py                            466µs ±45%       392µs ± 5%     ~     (p=0.111 n=5+4)
      neo/py/sql-zhash.go                            201µs ± 2%       197µs ± 1%   -1.63%  (p=0.008 n=5+5)
      neo/py/sql-zhash.go+prefetch128                184µs ± 2%       180µs ± 2%   -1.96%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zhash.py                      375µs ± 2%       454µs ±61%     ~     (p=0.286 n=4+5)
      neo/py(!log)/sql-zhash.go                      182µs ± 2%       183µs ± 1%     ~     (p=0.802 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128          164µs ± 1%       164µs ± 2%     ~     (p=0.881 n=5+5)
      neo/go/fs1-zhash.py                            226µs ± 1%       227µs ± 2%     ~     (p=0.397 n=5+5)
      neo/go/fs1-zhash.go                           56.8µs ± 1%      56.9µs ± 1%     ~     (p=0.889 n=5+5)
      neo/go/fs1-zhash.go+prefetch128               24.8µs ± 3%      24.7µs ± 2%     ~     (p=0.651 n=5+5)
      neo/go/sqlite-zhash.py                         264µs ± 4%       269µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zhash.go                        93.5µs ± 0%      92.7µs ± 0%   -0.83%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128            39.3µs ± 4%      39.8µs ± 8%     ~     (p=0.952 n=5+5)
      
      ( not sure what it was for unzlib/py/prod1-max - probaby some background process
        was also running last time at that test )
      ea5f9d26
    • Kirill Smelkov's avatar
      . · 7c21fb98
      Kirill Smelkov authored
      7c21fb98
    • Kirill Smelkov's avatar
  5. 04 Mar, 2018 8 commits