1. 08 Mar, 2018 2 commits
  2. 06 Mar, 2018 11 commits
    • Kirill Smelkov's avatar
      X deco: localhost timings, C > C1 disabled (remeasure) · 620b723c
      Kirill Smelkov authored
      As it was promised in 0867c981 here comes remeasurement of deco timings
      with C-states disabled. And the results are the same, thus confirming
      zeo/py/fs-<go-client> both speedup and slowdown:
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset "20180306-deco-ffixed-c.txt" "20180306-deco-ffixed-noc_C1(2µs).txt.2"
      
      name                                           old pystone/s            new pystone/s            delta
      node:deco
      pystone                                                      217k ± 4%                217k ± 2%     ~     (p=1.000 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:deco
      crc32/py/4K                                                5.73µs ± 0%              5.73µs ± 0%     ~     (p=0.841 n=5+5)
      crc32/go/4K                                                 279ns ± 0%               279ns ± 0%     ~     (all equal)
      sha1/py/4K                                                 6.74µs ± 1%              6.71µs ± 1%     ~     (p=0.310 n=5+5)
      sha1/go/4K                                                 5.60µs ± 0%              5.59µs ± 0%   -0.18%  (p=0.024 n=5+5)
      unzlib/py/wczdata                                          27.2µs ± 1%              27.1µs ± 1%     ~     (p=0.452 n=5+5)
      unzlib/go/wczdata                                          27.0µs ± 0%              26.8µs ± 0%   -0.62%  (p=0.008 n=5+5)
      unzlib/py/prod1-avg                                        5.14µs ± 3%              5.13µs ± 1%     ~     (p=1.000 n=5+5)
      unzlib/go/prod1-avg                                        5.30µs ± 1%              5.28µs ± 0%   -0.47%  (p=0.016 n=5+5)
      disk/randread/direct/4K-min                                 104µs ± 2%               105µs ± 0%   +1.48%  (p=0.016 n=5+4)
      disk/randread/direct/4K-avg                                 141µs ± 0%               142µs ± 0%   +0.95%  (p=0.008 n=5+5)
      disk/randread/pagecache/4K-min                              579ns ± 2%               584ns ± 2%     ~     (p=0.310 n=5+5)
      disk/randread/pagecache/4K-avg                              993ns ± 0%               986ns ± 0%   -0.70%  (p=0.008 n=5+5)
      
      name                                           old time/object          new time/object          delta
      cluster:deco dataset:wczblk1-8
      fs1-zhash.py                                               20.3µs ± 1%              20.3µs ± 2%     ~     (p=0.524 n=4+5)
      fs1-zhash.go                                               3.26µs ± 4%              3.20µs ± 0%     ~     (p=0.333 n=5+4)
      fs1-zhash.go+prefetch128                                   4.04µs ± 1%              4.00µs ± 7%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zhash.py                                         383µs ± 5%               364µs ± 5%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zhash.go                                         126µs ± 1%               113µs ± 1%  -10.03%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            63.1µs ± 1%              64.0µs ± 2%     ~     (p=0.254 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                344µs ± 6%               318µs ± 2%   -7.43%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                140µs ± 1%               142µs ± 3%     ~     (p=0.286 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    119µs ± 2%               119µs ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zhash.py                                   386µs ± 1%               382µs ± 3%     ~     (p=0.686 n=4+4)
      neo/py(!log)/sql-zhash.go                                   183µs ± 3%               189µs ± 4%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       164µs ± 3%               164µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zhash.py                                         226µs ± 3%               222µs ± 2%     ~     (p=0.167 n=5+5)
      neo/go/fs1-zhash.go                                        57.1µs ± 0%              56.7µs ± 0%   -0.84%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            24.7µs ± 5%              24.5µs ± 5%     ~     (p=0.643 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          40.2µs ± 1%              40.3µs ± 2%     ~     (p=0.849 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              17.1µs ± 6%              17.3µs ± 7%     ~     (p=0.881 n=5+5)
      neo/go/sqlite-zhash.py                                      272µs ± 3%               254µs ± 2%   -6.63%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                     92.8µs ± 0%              94.8µs ± 0%   +2.20%  (p=0.016 n=4+5)
      neo/go/sqlite-zhash.go+prefetch128                         40.5µs ± 5%              41.6µs ±13%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              86.5µs ± 2%              87.0µs ± 2%     ~     (p=0.175 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  38.8µs ± 9%              37.9µs ± 9%     ~     (p=0.421 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zhash.py                                               15.8µs ± 3%              15.8µs ± 1%     ~     (p=0.619 n=4+5)
      fs1-zhash.go                                               2.80µs ± 0%              2.80µs ± 0%     ~     (all equal)
      fs1-zhash.go+prefetch128                                   3.42µs ± 8%              3.50µs ±17%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zhash.py                                         361µs ± 5%               355µs ± 4%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zhash.go                                         105µs ± 0%               105µs ± 1%     ~     (p=0.595 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            58.9µs ± 1%              58.5µs ± 2%     ~     (p=0.302 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                344µs ± 7%               315µs ± 5%   -8.63%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                137µs ± 2%               135µs ± 1%     ~     (p=0.103 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    114µs ± 1%               112µs ± 0%   -1.67%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                   380µs ± 4%               376µs ± 2%     ~     (p=0.886 n=4+4)
      neo/py(!log)/sql-zhash.go                                   180µs ± 1%               183µs ± 2%   +2.06%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       159µs ± 1%               158µs ± 1%   -0.79%  (p=0.048 n=5+5)
      neo/go/fs1-zhash.py                                         221µs ± 1%               223µs ± 2%     ~     (p=0.524 n=5+5)
      neo/go/fs1-zhash.go                                        45.2µs ± 2%              44.3µs ± 1%   -1.99%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            17.6µs ± 2%              17.4µs ± 6%     ~     (p=0.246 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          39.1µs ± 2%              39.0µs ± 1%     ~     (p=0.643 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              14.6µs ± 4%              14.5µs ± 3%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zhash.py                                      271µs ± 2%               252µs ± 1%   -7.10%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                     86.4µs ± 0%              86.6µs ± 1%     ~     (p=0.444 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         35.8µs ± 2%              37.6µs ± 2%   +5.02%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              84.0µs ± 1%              83.5µs ± 1%     ~     (p=0.230 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  36.5µs ± 5%              35.7µs ± 7%     ~     (p=0.381 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:deco dataset:wczblk1-8
      fs1-zwrk.go·1                                                436k ± 0%                437k ± 1%     ~     (p=0.222 n=5+5)
      fs1-zwrk.go·2                                                744k ± 1%                750k ± 3%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·3                                               1.09M ± 0%               1.08M ± 0%   -0.42%  (p=0.016 n=5+5)
      fs1-zwrk.go·4                                               1.16M ± 1%               1.16M ± 1%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·8                                               1.27M ± 1%               1.27M ± 1%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·12                                              1.27M ± 1%               1.28M ± 0%     ~     (p=0.190 n=5+4)
      fs1-zwrk.go·16                                              1.27M ± 1%               1.28M ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        9.12k ± 0%               8.14k ± 0%  -10.75%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        11.6k ± 1%                9.5k ± 1%  -17.53%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        13.4k ± 1%               10.5k ± 1%  -21.27%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        14.0k ± 1%               10.9k ± 1%  -22.08%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        14.7k ± 1%               11.5k ± 1%  -21.84%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       15.0k ± 1%               11.6k ± 2%  -22.49%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       15.1k ± 0%               11.8k ± 1%  -22.02%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.09k ± 1%               7.08k ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.48k ± 1%               8.52k ± 0%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.48k ± 1%               8.48k ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.47k ± 1%               8.45k ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.43k ± 1%               8.52k ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.46k ± 1%               8.57k ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.46k ± 1%               8.57k ± 0%   +1.32%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.51k ± 1%               5.36k ± 2%   -2.78%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.32k ± 1%               6.21k ± 1%   -1.66%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.29k ± 1%               6.24k ± 0%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sql-zwrk.go·4                                  6.27k ± 1%               6.17k ± 2%   -1.63%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.27k ± 1%               6.12k ± 0%   -2.39%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.29k ± 0%               6.15k ± 1%   -2.22%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zwrk.go·16                                 6.22k ± 1%               6.14k ± 3%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·1                                        18.4k ± 1%               18.4k ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·2                                        38.1k ± 1%               38.3k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·3                                        46.0k ± 1%               46.1k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·4                                        50.2k ± 1%               50.3k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·8                                        61.0k ± 0%               60.8k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·12                                       62.1k ± 1%               62.5k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·16                                       62.5k ± 1%               62.1k ± 2%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.3k ± 1%               26.3k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          55.3k ± 1%               55.1k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          62.7k ± 1%               62.6k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          69.3k ± 1%               69.0k ± 1%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          88.2k ± 0%               87.7k ± 0%   -0.47%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         93.4k ± 0%               92.4k ± 1%   -1.02%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         93.5k ± 2%               93.5k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.0k ± 1%               10.9k ± 0%   -1.25%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     18.4k ± 1%               18.2k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     24.4k ± 1%               24.2k ± 1%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.8k ± 0%               26.8k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     30.4k ± 2%               30.0k ± 2%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    30.5k ± 1%               29.5k ± 1%   -3.47%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    29.9k ± 2%               28.5k ± 1%   -4.81%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.9k ± 1%               11.9k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              19.7k ± 0%               19.6k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              26.5k ± 1%               26.7k ± 0%   +0.84%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              30.0k ± 0%               30.4k ± 1%   +1.43%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              31.2k ± 2%               32.1k ± 0%   +2.82%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             28.9k ± 1%               30.2k ± 2%   +4.46%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             28.4k ± 2%               29.7k ± 2%   +4.60%  (p=0.008 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zwrk.go·1                                                555k ± 0%                558k ± 1%     ~     (p=0.222 n=5+5)
      fs1-zwrk.go·2                                               1.01M ± 3%               1.01M ± 8%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·3                                               1.32M ± 1%               1.33M ± 0%   +0.69%  (p=0.032 n=5+5)
      fs1-zwrk.go·4                                               1.55M ± 2%               1.54M ± 3%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·8                                               1.59M ± 0%               1.59M ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·12                                              1.59M ± 0%               1.59M ± 0%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·16                                              1.59M ± 0%               1.59M ± 0%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        9.70k ± 0%               9.66k ± 0%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        12.4k ± 1%               12.3k ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        14.2k ± 1%               14.2k ± 1%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        14.9k ± 0%               14.9k ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        15.6k ± 0%               15.7k ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       15.2k ±11%               16.0k ± 1%   +5.04%  (p=0.032 n=5+4)
      zeo/py/fs1-zwrk.go·16                                       16.1k ± 1%               16.1k ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.44k ± 1%               7.46k ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.59k ± 1%               8.67k ± 1%   +0.91%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.61k ± 1%               8.71k ± 1%   +1.16%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.57k ± 1%               8.68k ± 0%   +1.33%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.56k ± 1%               8.73k ± 1%   +2.01%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.51k ± 1%               8.66k ± 1%   +1.69%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.54k ± 1%               8.62k ± 1%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.55k ± 2%               5.47k ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.36k ± 1%               6.37k ± 0%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.31k ± 0%               6.30k ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.28k ± 0%               6.33k ± 0%   +0.78%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.34k ± 1%               6.36k ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.35k ± 1%               6.36k ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.36k ± 0%               6.35k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·1                                        23.7k ± 0%               24.0k ± 0%   +1.23%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                        45.4k ± 0%               45.6k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·3                                        55.2k ± 1%               55.5k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·4                                        60.7k ± 2%               60.7k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·8                                        70.9k ± 2%               69.3k ± 3%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·12                                       71.1k ± 3%               69.5k ± 7%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·16                                       71.0k ± 3%               67.8k ± 2%   -4.43%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          27.3k ± 0%               27.1k ± 0%   -0.92%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          55.4k ± 1%               55.4k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          64.0k ± 1%               62.9k ± 1%   -1.62%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          69.0k ± 1%               68.4k ± 1%   -0.87%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          80.9k ± 2%               79.9k ± 3%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         78.3k ± 5%               77.6k ± 4%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         75.4k ± 3%               77.7k ± 7%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.7k ± 1%               11.7k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     19.0k ± 0%               19.1k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     24.5k ± 1%               24.3k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.3k ± 1%               26.3k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     24.9k ± 3%               24.8k ± 3%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    24.0k ± 5%               23.6k ± 2%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    25.4k ± 1%               24.3k ± 1%   -4.16%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              12.2k ± 0%               12.2k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              19.8k ± 0%               19.6k ± 0%   -0.97%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              26.2k ± 1%               26.2k ± 2%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              28.7k ± 1%               29.1k ± 1%   +1.21%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              27.2k ± 3%               27.3k ± 2%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             25.3k ± 2%               25.5k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             25.3k ± 1%               25.5k ± 1%     ~     (p=0.095 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:deco dataset:wczblk1-8
      fs1-zwrk.go·1                                              2.29µs ± 0%              2.29µs ± 1%     ~     (p=0.198 n=5+5)
      fs1-zwrk.go·2                                              2.69µs ± 1%              2.67µs ± 3%     ~     (p=0.738 n=5+5)
      fs1-zwrk.go·3                                              2.76µs ± 0%              2.77µs ± 0%   +0.42%  (p=0.016 n=5+5)
      fs1-zwrk.go·4                                              3.44µs ± 1%              3.44µs ± 1%     ~     (p=0.730 n=5+5)
      fs1-zwrk.go·8                                              6.28µs ± 1%              6.29µs ± 1%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·12                                             9.46µs ± 1%              9.35µs ± 0%     ~     (p=0.159 n=5+4)
      fs1-zwrk.go·16                                             12.6µs ± 1%              12.5µs ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        110µs ± 0%               123µs ± 0%  +12.04%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        173µs ± 1%               210µs ± 1%  +21.26%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        224µs ± 1%               285µs ± 1%  +27.02%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        286µs ± 1%               366µs ± 1%  +28.34%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        545µs ± 1%               698µs ± 1%  +27.94%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       802µs ± 1%              1034µs ± 2%  +29.03%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.06ms ± 0%              1.36ms ± 1%  +28.25%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               141µs ± 1%               141µs ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               236µs ± 1%               235µs ± 0%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               354µs ± 1%               354µs ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               472µs ± 1%               474µs ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               949µs ± 1%               939µs ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.42ms ± 1%              1.40ms ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.89ms ± 1%              1.87ms ± 0%   -1.30%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  181µs ± 1%               187µs ± 2%   +2.87%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  317µs ± 1%               322µs ± 1%   +1.68%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  477µs ± 1%               481µs ± 0%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sql-zwrk.go·4                                  638µs ± 1%               648µs ± 2%   +1.66%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.28ms ± 1%              1.31ms ± 0%   +2.44%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.91ms ± 0%              1.95ms ± 1%   +2.28%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zwrk.go·16                                2.57ms ± 1%              2.61ms ± 3%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·1                                       54.2µs ± 1%              54.2µs ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·2                                       52.5µs ± 1%              52.2µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·3                                       65.3µs ± 1%              65.1µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·4                                       79.6µs ± 1%              79.5µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·8                                        131µs ± 0%               132µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·12                                       193µs ± 1%               192µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·16                                       256µs ± 1%               258µs ± 2%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         38.0µs ± 1%              38.0µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         36.1µs ± 1%              36.3µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         47.8µs ± 1%              47.9µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         57.7µs ± 1%              58.0µs ± 1%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         90.7µs ± 0%              91.2µs ± 0%   +0.47%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         129µs ± 0%               130µs ± 1%   +1.04%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         171µs ± 2%               171µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    90.7µs ± 1%              91.8µs ± 0%   +1.26%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     109µs ± 1%               110µs ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     123µs ± 1%               124µs ± 1%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     149µs ± 0%               149µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     263µs ± 2%               267µs ± 2%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    393µs ± 1%               407µs ± 1%   +3.60%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    534µs ± 2%               561µs ± 1%   +5.04%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             84.0µs ± 1%              84.1µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              102µs ± 0%               102µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              113µs ± 1%               112µs ± 0%   -0.83%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              133µs ± 0%               132µs ± 1%   -1.41%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              257µs ± 2%               250µs ± 0%   -2.76%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             415µs ± 1%               397µs ± 2%   -4.26%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             563µs ± 2%               538µs ± 2%   -4.40%  (p=0.008 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zwrk.go·1                                              1.80µs ± 0%              1.79µs ± 1%     ~     (p=0.222 n=5+5)
      fs1-zwrk.go·2                                              1.98µs ± 3%              1.98µs ± 8%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·3                                              2.27µs ± 1%              2.25µs ± 0%   -0.68%  (p=0.032 n=5+5)
      fs1-zwrk.go·4                                              2.58µs ± 2%              2.59µs ± 3%     ~     (p=0.952 n=5+5)
      fs1-zwrk.go·8                                              5.04µs ± 0%              5.04µs ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·12                                             7.55µs ± 0%              7.53µs ± 0%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·16                                             10.0µs ± 0%              10.0µs ± 0%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        103µs ± 0%               104µs ± 0%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        162µs ± 1%               162µs ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        212µs ± 1%               211µs ± 1%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        269µs ± 0%               268µs ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        512µs ± 0%               510µs ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       793µs ±12%               752µs ± 1%   -5.18%  (p=0.032 n=5+4)
      zeo/py/fs1-zwrk.go·16                                       991µs ± 1%               992µs ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               134µs ± 1%               134µs ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               233µs ± 1%               231µs ± 1%   -0.91%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               348µs ± 1%               344µs ± 1%   -1.15%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               467µs ± 1%               461µs ± 0%   -1.32%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               935µs ± 1%               916µs ± 1%   -1.97%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.41ms ± 1%              1.39ms ± 1%   -1.66%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.87ms ± 1%              1.86ms ± 1%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  180µs ± 2%               183µs ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  315µs ± 1%               314µs ± 0%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  475µs ± 0%               476µs ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  637µs ± 0%               632µs ± 0%   -0.78%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.26ms ± 1%              1.26ms ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.89ms ± 1%              1.89ms ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.52ms ± 0%              2.52ms ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·1                                       42.2µs ± 0%              41.7µs ± 0%   -1.21%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                       44.1µs ± 0%              43.8µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·3                                       54.4µs ± 1%              54.1µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·4                                       65.9µs ± 2%              65.9µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·8                                        113µs ± 2%               115µs ± 3%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·12                                       169µs ± 4%               173µs ± 7%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·16                                       225µs ± 3%               236µs ± 2%   +4.62%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         36.6µs ± 0%              36.9µs ± 0%   +0.93%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         36.1µs ± 1%              36.1µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         46.9µs ± 1%              47.7µs ± 1%   +1.64%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         57.9µs ± 1%              58.4µs ± 1%   +0.88%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         98.9µs ± 2%             100.2µs ± 3%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         153µs ± 5%               155µs ± 4%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         212µs ± 3%               206µs ± 7%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    85.1µs ± 1%              85.3µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     105µs ± 0%               105µs ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     123µs ± 1%               123µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     152µs ± 1%               152µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     321µs ± 3%               323µs ± 3%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    500µs ± 5%               508µs ± 2%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    630µs ± 1%               657µs ± 1%   +4.34%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             82.0µs ± 0%              82.3µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              101µs ± 0%               102µs ± 0%   +0.98%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              115µs ± 1%               115µs ± 3%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              139µs ± 1%               138µs ± 1%   -1.19%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              295µs ± 3%               293µs ± 2%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             474µs ± 2%               470µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             632µs ± 1%               627µs ± 1%     ~     (p=0.095 n=5+5)
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset "20180306-deco-ffixed-noc_C1(2µs).txt" "20180306-deco-ffixed-noc_C1(2µs).txt.2"
      
      name                                           old pystone/s            new pystone/s            delta
      node:deco
      pystone                                                      218k ± 2%                217k ± 2%    ~     (p=1.000 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:deco
      crc32/py/4K                                                5.72µs ± 0%              5.73µs ± 0%    ~     (p=0.151 n=5+5)
      crc32/go/4K                                                 280ns ± 1%               279ns ± 0%    ~     (p=0.333 n=5+4)
      sha1/py/4K                                                 6.72µs ± 1%              6.71µs ± 1%    ~     (p=1.000 n=5+5)
      sha1/go/4K                                                 5.59µs ± 0%              5.59µs ± 0%    ~     (p=1.000 n=4+5)
      unzlib/py/wczdata                                          27.2µs ± 1%              27.1µs ± 1%    ~     (p=0.421 n=5+5)
      unzlib/go/wczdata                                          26.8µs ± 0%              26.8µs ± 0%    ~     (p=0.548 n=5+5)
      unzlib/py/prod1-avg                                        5.08µs ± 1%              5.13µs ± 1%    ~     (p=0.095 n=5+5)
      unzlib/go/prod1-avg                                        5.29µs ± 1%              5.28µs ± 0%    ~     (p=0.333 n=5+5)
      disk/randread/direct/4K-min                                 105µs ± 0%               105µs ± 0%    ~     (p=0.111 n=5+4)
      disk/randread/direct/4K-avg                                 142µs ± 0%               142µs ± 0%  +0.35%  (p=0.040 n=5+5)
      disk/randread/pagecache/4K-min                              582ns ± 0%               584ns ± 2%    ~     (p=0.286 n=5+5)
      disk/randread/pagecache/4K-avg                              987ns ± 0%               986ns ± 0%    ~     (p=0.460 n=5+5)
      
      name                                           old time/object          new time/object          delta
      cluster:deco dataset:wczblk1-8
      fs1-zhash.py                                               20.2µs ± 1%              20.3µs ± 2%    ~     (p=1.000 n=5+5)
      fs1-zhash.go                                               3.20µs ± 0%              3.20µs ± 0%    ~     (all equal)
      fs1-zhash.go+prefetch128                                   4.14µs ± 1%              4.00µs ± 7%    ~     (p=0.159 n=5+5)
      zeo/py/fs1-zhash.py                                         361µs ± 3%               364µs ± 5%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zhash.go                                         112µs ± 1%               113µs ± 1%  +0.93%  (p=0.024 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            63.9µs ± 1%              64.0µs ± 2%    ~     (p=0.952 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                321µs ± 8%               318µs ± 2%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                141µs ± 3%               142µs ± 3%    ~     (p=0.595 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    119µs ± 1%               119µs ± 2%    ~     (p=0.794 n=5+5)
      neo/py(!log)/sql-zhash.py                                   376µs ± 2%               382µs ± 3%    ~     (p=0.486 n=4+4)
      neo/py(!log)/sql-zhash.go                                   187µs ± 5%               189µs ± 4%    ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       164µs ± 2%               164µs ± 2%    ~     (p=0.841 n=5+5)
      neo/go/fs1-zhash.py                                         226µs ± 2%               222µs ± 2%    ~     (p=0.222 n=5+5)
      neo/go/fs1-zhash.go                                        57.1µs ± 1%              56.7µs ± 0%  -0.81%  (p=0.016 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            24.0µs ± 4%              24.5µs ± 5%    ~     (p=0.460 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          40.3µs ± 1%              40.3µs ± 2%    ~     (p=0.833 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              17.2µs ± 4%              17.3µs ± 7%    ~     (p=0.730 n=5+5)
      neo/go/sqlite-zhash.py                                      253µs ± 1%               254µs ± 2%    ~     (p=0.952 n=5+5)
      neo/go/sqlite-zhash.go                                     93.7µs ± 1%              94.8µs ± 0%  +1.20%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         39.5µs ± 6%              41.6µs ±13%    ~     (p=0.310 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              86.4µs ± 3%              87.0µs ± 2%    ~     (p=0.079 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  39.4µs ± 7%              37.9µs ± 9%    ~     (p=0.690 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zhash.py                                               15.9µs ± 2%              15.8µs ± 1%    ~     (p=0.571 n=5+5)
      fs1-zhash.go                                               2.80µs ± 0%              2.80µs ± 0%    ~     (all equal)
      fs1-zhash.go+prefetch128                                   3.34µs ± 2%              3.50µs ±17%    ~     (p=0.683 n=5+5)
      zeo/py/fs1-zhash.py                                         347µs ± 3%               355µs ± 4%    ~     (p=0.222 n=5+5)
      zeo/py/fs1-zhash.go                                         105µs ± 0%               105µs ± 1%  +0.52%  (p=0.040 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            58.9µs ± 1%              58.5µs ± 2%    ~     (p=0.198 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                317µs ± 5%               315µs ± 5%    ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                138µs ± 1%               135µs ± 1%  -1.86%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    112µs ± 1%               112µs ± 0%    ~     (p=0.508 n=5+5)
      neo/py(!log)/sql-zhash.py                                   377µs ± 2%               376µs ± 2%    ~     (p=0.686 n=4+4)
      neo/py(!log)/sql-zhash.go                                   184µs ± 2%               183µs ± 2%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       160µs ± 2%               158µs ± 1%  -1.18%  (p=0.024 n=5+5)
      neo/go/fs1-zhash.py                                         225µs ± 1%               223µs ± 2%    ~     (p=0.278 n=5+5)
      neo/go/fs1-zhash.go                                        44.6µs ± 0%              44.3µs ± 1%  -0.63%  (p=0.048 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            17.2µs ± 3%              17.4µs ± 6%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          39.1µs ± 3%              39.0µs ± 1%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              15.2µs ± 3%              14.5µs ± 3%  -4.47%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.py                                      254µs ± 1%               252µs ± 1%    ~     (p=0.111 n=5+5)
      neo/go/sqlite-zhash.go                                     86.3µs ± 0%              86.6µs ± 1%  +0.42%  (p=0.040 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         36.6µs ± 5%              37.6µs ± 2%    ~     (p=0.310 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              83.8µs ± 2%              83.5µs ± 1%    ~     (p=0.548 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  36.9µs ± 8%              35.7µs ± 7%    ~     (p=0.310 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:deco dataset:wczblk1-8
      fs1-zwrk.go·1                                                431k ± 1%                437k ± 1%  +1.51%  (p=0.008 n=5+5)
      fs1-zwrk.go·2                                                760k ± 3%                750k ± 3%    ~     (p=0.310 n=5+5)
      fs1-zwrk.go·3                                               1.08M ± 2%               1.08M ± 0%    ~     (p=0.841 n=5+5)
      fs1-zwrk.go·4                                               1.16M ± 1%               1.16M ± 1%    ~     (p=1.000 n=5+5)
      fs1-zwrk.go·8                                               1.27M ± 1%               1.27M ± 1%    ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                              1.28M ± 1%               1.28M ± 0%    ~     (p=0.190 n=5+4)
      fs1-zwrk.go·16                                              1.28M ± 1%               1.28M ± 1%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        8.04k ± 4%               8.14k ± 0%    ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        9.54k ± 1%               9.54k ± 1%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        10.5k ± 0%               10.5k ± 1%    ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        11.0k ± 1%               10.9k ± 1%    ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        11.4k ± 1%               11.5k ± 1%    ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       11.7k ± 0%               11.6k ± 2%    ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       11.8k ± 2%               11.8k ± 1%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.04k ± 1%               7.08k ± 1%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.52k ± 1%               8.52k ± 0%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.51k ± 1%               8.48k ± 1%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.50k ± 1%               8.45k ± 1%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.53k ± 1%               8.52k ± 1%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.48k ± 2%               8.57k ± 1%    ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.48k ± 1%               8.57k ± 0%  +1.08%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.37k ± 3%               5.36k ± 2%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.34k ± 0%               6.21k ± 1%  -2.02%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.28k ± 1%               6.24k ± 0%    ~     (p=0.190 n=5+4)
      neo/py(!log)/sql-zwrk.go·4                                  6.29k ± 1%               6.17k ± 2%  -1.87%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.29k ± 1%               6.12k ± 0%  -2.68%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.25k ± 1%               6.15k ± 1%  -1.54%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zwrk.go·16                                 6.23k ± 2%               6.14k ± 3%    ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·1                                        18.4k ± 0%               18.4k ± 0%    ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·2                                        38.3k ± 1%               38.3k ± 0%    ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·3                                        45.9k ± 0%               46.1k ± 1%    ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·4                                        50.0k ± 0%               50.3k ± 1%    ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·8                                        60.3k ± 1%               60.8k ± 1%    ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·12                                       62.1k ± 1%               62.5k ± 1%  +0.67%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·16                                       61.6k ± 1%               62.1k ± 2%    ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.3k ± 0%               26.3k ± 0%    ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          55.7k ± 1%               55.1k ± 0%  -1.12%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          62.8k ± 1%               62.6k ± 1%    ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          69.4k ± 1%               69.0k ± 1%    ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          88.3k ± 1%               87.7k ± 0%    ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         93.5k ± 1%               92.4k ± 1%  -1.17%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         93.8k ± 0%               93.5k ± 1%    ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.0k ± 0%               10.9k ± 0%  -0.70%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     18.3k ± 1%               18.2k ± 0%    ~     (p=0.111 n=4+5)
      neo/go/sqlite-zwrk.go·3                                     24.2k ± 0%               24.2k ± 1%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.8k ± 1%               26.8k ± 1%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     29.6k ± 2%               30.0k ± 2%    ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    29.3k ± 2%               29.5k ± 1%    ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    28.6k ± 1%               28.5k ± 1%    ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.9k ± 1%               11.9k ± 0%    ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              19.6k ± 1%               19.6k ± 1%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              26.4k ± 0%               26.7k ± 0%  +1.08%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              30.0k ± 0%               30.4k ± 1%  +1.43%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              31.2k ± 2%               32.1k ± 0%  +2.86%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             28.8k ± 3%               30.2k ± 2%  +4.93%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             28.4k ± 1%               29.7k ± 2%  +4.69%  (p=0.008 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zwrk.go·1                                                556k ± 0%                558k ± 1%    ~     (p=0.690 n=5+5)
      fs1-zwrk.go·2                                                994k ± 6%               1011k ± 8%    ~     (p=0.310 n=5+5)
      fs1-zwrk.go·3                                               1.33M ± 2%               1.33M ± 0%    ~     (p=0.690 n=5+5)
      fs1-zwrk.go·4                                               1.53M ± 0%               1.54M ± 3%    ~     (p=0.222 n=5+5)
      fs1-zwrk.go·8                                               1.59M ± 1%               1.59M ± 0%    ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                              1.60M ± 1%               1.59M ± 0%    ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                              1.59M ± 0%               1.59M ± 0%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        9.75k ± 1%               9.66k ± 0%  -0.94%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        12.4k ± 1%               12.3k ± 1%    ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        14.2k ± 1%               14.2k ± 1%    ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        14.9k ± 1%               14.9k ± 1%    ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        15.6k ± 1%               15.7k ± 1%    ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       16.0k ± 1%               16.0k ± 1%    ~     (p=1.000 n=5+4)
      zeo/py/fs1-zwrk.go·16                                       16.0k ± 6%               16.1k ± 1%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.45k ± 2%               7.46k ± 1%    ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.71k ± 1%               8.67k ± 1%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.69k ± 1%               8.71k ± 1%    ~     (p=0.802 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.61k ± 1%               8.68k ± 0%  +0.88%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.61k ± 1%               8.73k ± 1%  +1.42%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.59k ± 1%               8.66k ± 1%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.60k ± 1%               8.62k ± 1%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.45k ± 2%               5.47k ± 2%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.25k ± 1%               6.37k ± 0%  +1.89%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.24k ± 1%               6.30k ± 1%  +0.96%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.27k ± 1%               6.33k ± 0%  +0.97%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.28k ± 1%               6.36k ± 1%    ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.33k ± 0%               6.36k ± 1%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.30k ± 1%               6.35k ± 0%  +0.81%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·1                                        23.9k ± 0%               24.0k ± 0%  +0.52%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                        45.5k ± 1%               45.6k ± 1%    ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·3                                        55.1k ± 0%               55.5k ± 1%  +0.75%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·4                                        60.4k ± 0%               60.7k ± 0%    ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·8                                        69.2k ± 2%               69.3k ± 3%    ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·12                                       68.0k ± 5%               69.5k ± 7%    ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·16                                       68.1k ± 3%               67.8k ± 2%    ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          27.2k ± 1%               27.1k ± 0%    ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          55.5k ± 1%               55.4k ± 1%    ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          64.0k ± 1%               62.9k ± 1%  -1.69%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          69.1k ± 1%               68.4k ± 1%    ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          81.1k ± 4%               79.9k ± 3%    ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         77.8k ± 8%               77.6k ± 4%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         76.8k ± 5%               77.7k ± 7%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.7k ± 1%               11.7k ± 0%    ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     18.9k ± 1%               19.1k ± 0%    ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     24.4k ± 2%               24.3k ± 1%    ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.0k ± 3%               26.3k ± 1%    ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     24.6k ± 5%               24.8k ± 3%    ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    23.7k ± 3%               23.6k ± 2%    ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    24.1k ± 3%               24.3k ± 1%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              12.2k ± 1%               12.2k ± 0%    ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              19.6k ± 1%               19.6k ± 0%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              25.5k ± 1%               26.2k ± 2%  +2.75%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.5k ± 2%               29.1k ± 1%  +5.64%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              25.6k ± 2%               27.3k ± 2%  +6.33%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             24.0k ± 2%               25.5k ± 1%  +6.19%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             24.2k ± 1%               25.5k ± 1%  +5.65%  (p=0.008 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:deco dataset:wczblk1-8
      fs1-zwrk.go·1                                              2.32µs ± 1%              2.29µs ± 1%  -1.48%  (p=0.016 n=5+5)
      fs1-zwrk.go·2                                              2.63µs ± 3%              2.67µs ± 3%    ~     (p=0.310 n=5+5)
      fs1-zwrk.go·3                                              2.78µs ± 2%              2.77µs ± 0%    ~     (p=0.841 n=5+5)
      fs1-zwrk.go·4                                              3.44µs ± 1%              3.44µs ± 1%    ~     (p=1.000 n=5+5)
      fs1-zwrk.go·8                                              6.28µs ± 1%              6.29µs ± 1%    ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                             9.40µs ± 1%              9.35µs ± 0%    ~     (p=0.159 n=5+4)
      fs1-zwrk.go·16                                             12.5µs ± 1%              12.5µs ± 1%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        125µs ± 4%               123µs ± 0%    ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        210µs ± 1%               210µs ± 1%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        286µs ± 0%               285µs ± 1%    ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        365µs ± 1%               366µs ± 1%    ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        699µs ± 1%               698µs ± 1%    ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.03ms ± 0%              1.03ms ± 2%    ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.36ms ± 2%              1.36ms ± 1%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               142µs ± 1%               141µs ± 1%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               235µs ± 1%               235µs ± 0%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               353µs ± 1%               354µs ± 1%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               470µs ± 1%               474µs ± 1%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               938µs ± 1%               939µs ± 1%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.41ms ± 2%              1.40ms ± 1%    ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.89ms ± 1%              1.87ms ± 0%  -1.07%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  186µs ± 3%               187µs ± 2%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  315µs ± 0%               322µs ± 1%  +2.07%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  478µs ± 1%               481µs ± 0%    ~     (p=0.190 n=5+4)
      neo/py(!log)/sql-zwrk.go·4                                  636µs ± 1%               648µs ± 2%  +1.91%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.27ms ± 1%              1.31ms ± 0%  +2.75%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.92ms ± 1%              1.95ms ± 1%  +1.57%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zwrk.go·16                                2.57ms ± 2%              2.61ms ± 3%    ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·1                                       54.4µs ± 0%              54.2µs ± 0%    ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·2                                       52.2µs ± 1%              52.2µs ± 0%    ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·3                                       65.3µs ± 0%              65.1µs ± 1%    ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·4                                       80.0µs ± 0%              79.5µs ± 1%    ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·8                                        133µs ± 1%               132µs ± 1%    ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·12                                       193µs ± 1%               192µs ± 1%  -0.67%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·16                                       260µs ± 1%               258µs ± 2%    ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         38.0µs ± 0%              38.0µs ± 0%    ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         35.9µs ± 1%              36.3µs ± 0%  +1.13%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         47.7µs ± 1%              47.9µs ± 1%    ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         57.7µs ± 1%              58.0µs ± 1%    ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         90.6µs ± 1%              91.2µs ± 0%    ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         128µs ± 1%               130µs ± 1%  +1.18%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         171µs ± 0%               171µs ± 1%    ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    91.2µs ± 0%              91.8µs ± 0%  +0.71%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     109µs ± 1%               110µs ± 0%    ~     (p=0.111 n=4+5)
      neo/go/sqlite-zwrk.go·3                                     124µs ± 0%               124µs ± 1%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     149µs ± 1%               149µs ± 1%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     270µs ± 2%               267µs ± 2%    ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    410µs ± 2%               407µs ± 1%    ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    560µs ± 1%               561µs ± 1%    ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             84.0µs ± 1%              84.1µs ± 0%    ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              102µs ± 1%               102µs ± 1%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              113µs ± 0%               112µs ± 0%  -1.07%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              133µs ± 0%               132µs ± 1%  -1.41%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              257µs ± 2%               250µs ± 0%  -2.80%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             417µs ± 3%               397µs ± 2%  -4.72%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             563µs ± 1%               538µs ± 2%  -4.47%  (p=0.008 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zwrk.go·1                                              1.80µs ± 0%              1.79µs ± 1%    ~     (p=0.524 n=5+5)
      fs1-zwrk.go·2                                              2.01µs ± 6%              1.98µs ± 8%    ~     (p=0.310 n=5+5)
      fs1-zwrk.go·3                                              2.26µs ± 2%              2.25µs ± 0%    ~     (p=0.690 n=5+5)
      fs1-zwrk.go·4                                              2.61µs ± 0%              2.59µs ± 3%    ~     (p=0.198 n=5+5)
      fs1-zwrk.go·8                                              5.04µs ± 1%              5.04µs ± 0%    ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                             7.52µs ± 1%              7.53µs ± 0%    ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                             10.0µs ± 0%              10.0µs ± 0%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        103µs ± 1%               104µs ± 0%  +0.95%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        161µs ± 1%               162µs ± 1%    ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        212µs ± 1%               211µs ± 1%    ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        268µs ± 1%               268µs ± 1%    ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        512µs ± 1%               510µs ± 1%    ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       752µs ± 1%               752µs ± 1%    ~     (p=1.000 n=5+4)
      zeo/py/fs1-zwrk.go·16                                      1.00ms ± 6%              0.99ms ± 1%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               134µs ± 1%               134µs ± 1%    ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               230µs ± 1%               231µs ± 1%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               345µs ± 1%               344µs ± 1%    ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               465µs ± 1%               461µs ± 0%  -0.88%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               929µs ± 1%               916µs ± 1%  -1.41%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.40ms ± 1%              1.39ms ± 1%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.86ms ± 1%              1.86ms ± 1%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  184µs ± 2%               183µs ± 2%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  320µs ± 1%               314µs ± 0%  -1.86%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  481µs ± 1%               476µs ± 1%  -0.95%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  638µs ± 1%               632µs ± 0%  -0.96%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.27ms ± 1%              1.26ms ± 1%    ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.89ms ± 0%              1.89ms ± 1%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.54ms ± 1%              2.52ms ± 0%  -0.80%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·1                                       41.9µs ± 0%              41.7µs ± 0%  -0.51%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                       44.0µs ± 1%              43.8µs ± 1%    ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·3                                       54.5µs ± 0%              54.1µs ± 1%  -0.74%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·4                                       66.2µs ± 0%              65.9µs ± 0%    ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·8                                        116µs ± 2%               115µs ± 3%    ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·12                                       177µs ± 5%               173µs ± 7%    ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·16                                       235µs ± 3%               236µs ± 2%    ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         36.8µs ± 1%              36.9µs ± 0%    ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         36.0µs ± 1%              36.1µs ± 1%    ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         46.9µs ± 1%              47.7µs ± 1%  +1.72%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         57.9µs ± 1%              58.4µs ± 1%    ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         98.6µs ± 4%             100.2µs ± 3%    ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         155µs ± 8%               155µs ± 4%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         208µs ± 5%               206µs ± 7%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    85.5µs ± 1%              85.3µs ± 0%    ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     106µs ± 1%               105µs ± 0%    ~     (p=0.063 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     123µs ± 2%               123µs ± 1%    ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     154µs ± 3%               152µs ± 1%    ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     325µs ± 5%               323µs ± 3%    ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    507µs ± 3%               508µs ± 2%    ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    665µs ± 3%               657µs ± 1%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             82.3µs ± 1%              82.3µs ± 0%    ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              102µs ± 1%               102µs ± 0%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              118µs ± 1%               115µs ± 3%  -2.66%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              145µs ± 2%               138µs ± 1%  -5.36%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              312µs ± 2%               293µs ± 2%  -5.95%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             500µs ± 2%               470µs ± 1%  -5.84%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             662µs ± 1%               627µs ± 1%  -5.35%  (p=0.008 n=5+5)
      620b723c
    • Kirill Smelkov's avatar
      X rio: localhost timings, C > C1 disabled · 3695ff12
      Kirill Smelkov authored
      Disabling C-states on rio tendto help serial cases, like it was on neo1
      and z6001, but it is closer to noise.
      
      ---- 8< ----
      cluster:rio dataset:wczblk1-8
      zeo/py/fs1-zhash.py                                         400µs ± 0%               370µs ± 1%   -7.32%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                318µs ± 7%               295µs ± 0%   -7.16%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       158µs ± 3%               158µs ± 2%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.py                                         222µs ± 4%               214µs ± 2%   -3.73%  (p=0.040 n=5+5)
      neo/go/sqlite-zhash.py                                      273µs ± 3%               256µs ± 4%   -6.45%  (p=0.008 n=5+5)
      
      cluster:rio dataset:prod1-1024
      zeo/py/fs1-zhash.py                                         372µs ±10%               347µs ± 5%   -6.84%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                321µs ±11%               298µs ± 5%   -7.13%  (p=0.048 n=5+5)
      ---- 8< ----
      
      the pystone/s change is nose as pystone/s for C-enabled case was 146k on
      prev-prev run (see 31dc070d).
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset 20180306-rio-ffixed-c.txt 20180306-rio-ffixed-noc_C1\(1µs\).txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:rio
      pystone                                                      115k ±12%                144k ± 1%  +25.53%  (p=0.008 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:rio
      crc32/py/4K                                                4.77µs ± 0%              4.78µs ± 1%     ~     (p=0.825 n=4+5)
      crc32/go/4K                                                1.49µs ± 0%              1.49µs ± 0%     ~     (p=0.484 n=5+5)
      sha1/py/4K                                                 8.04µs ± 1%              8.00µs ± 1%     ~     (p=0.206 n=5+5)
      sha1/go/4K                                                 8.93µs ± 0%              8.93µs ± 0%     ~     (p=0.389 n=5+5)
      unzlib/py/wczdata                                          25.1µs ± 1%              25.1µs ± 1%     ~     (p=1.000 n=5+5)
      unzlib/go/wczdata                                          23.0µs ± 0%              22.9µs ± 0%   -0.45%  (p=0.016 n=5+5)
      unzlib/py/prod1-avg                                        7.16µs ± 1%              7.08µs ± 1%     ~     (p=0.056 n=5+5)
      unzlib/go/prod1-avg                                        5.08µs ± 1%              5.04µs ± 0%   -0.82%  (p=0.008 n=5+5)
      disk/randread/direct/4K-min                                92.4µs ± 0%              92.7µs ± 0%     ~     (p=0.198 n=5+5)
      disk/randread/direct/4K-avg                                 115µs ± 0%               115µs ± 0%   +0.37%  (p=0.008 n=5+5)
      disk/randread/pagecache/4K-min                              565ns ± 2%               562ns ± 1%     ~     (p=0.444 n=5+5)
      disk/randread/pagecache/4K-avg                              992ns ± 0%               992ns ± 0%     ~     (p=1.032 n=4+5)
      
      name                                           old time/object          new time/object          delta
      cluster:rio dataset:wczblk1-8
      fs1-zhash.py                                               29.2µs ± 1%              28.8µs ± 2%     ~     (p=0.111 n=4+5)
      fs1-zhash.go                                               4.68µs ± 5%              4.60µs ± 0%     ~     (p=0.444 n=5+5)
      fs1-zhash.go+prefetch128                                   4.78µs ± 5%              4.62µs ±15%     ~     (p=0.159 n=5+5)
      zeo/py/fs1-zhash.py                                         400µs ± 0%               370µs ± 1%   -7.32%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go                                         138µs ± 1%               136µs ± 2%     ~     (p=0.087 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            74.7µs ± 2%              74.9µs ± 2%     ~     (p=0.730 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                318µs ± 7%               295µs ± 0%   -7.16%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                154µs ± 4%               151µs ± 6%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    125µs ± 3%               126µs ± 2%     ~     (p=0.746 n=5+5)
      neo/py(!log)/sql-zhash.py                                   400µs ±57%               325µs ± 2%     ~     (p=0.063 n=5+4)
      neo/py(!log)/sql-zhash.go                                   183µs ±11%               178µs ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       158µs ± 3%               158µs ± 2%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.py                                         222µs ± 4%               214µs ± 2%   -3.73%  (p=0.040 n=5+5)
      neo/go/fs1-zhash.go                                        68.6µs ± 2%              68.9µs ± 3%     ~     (p=0.722 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            29.0µs ± 6%              28.3µs ± 4%     ~     (p=0.135 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          43.9µs ± 3%              43.7µs ± 2%     ~     (p=0.881 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              18.8µs ± 5%              18.6µs ± 4%     ~     (p=0.516 n=5+5)
      neo/go/sqlite-zhash.py                                      273µs ± 3%               256µs ± 4%   -6.45%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      104µs ± 1%               104µs ± 2%     ~     (p=0.651 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         36.3µs ± 3%              37.0µs ± 8%     ~     (p=0.595 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              94.2µs ± 3%              93.1µs ± 3%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  35.1µs ± 6%              35.7µs ±13%     ~     (p=1.000 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zhash.py                                               23.9µs ± 1%              24.0µs ± 2%     ~     (p=0.937 n=4+5)
      fs1-zhash.go                                               3.40µs ± 0%              3.40µs ± 0%     ~     (all equal)
      fs1-zhash.go+prefetch128                                   3.02µs ± 9%              3.04µs ± 2%     ~     (p=0.397 n=5+5)
      zeo/py/fs1-zhash.py                                         372µs ±10%               347µs ± 5%   -6.84%  (p=0.032 n=5+5)
      zeo/py/fs1-zhash.go                                         114µs ± 1%               114µs ± 2%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            64.6µs ± 1%              66.6µs ± 1%   +3.07%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                321µs ±11%               298µs ± 5%   -7.13%  (p=0.048 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                142µs ± 3%               142µs ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    117µs ± 1%               115µs ± 1%     ~     (p=0.087 n=5+5)
      neo/py(!log)/sql-zhash.py                                   330µs ± 1%               380µs ±34%  +15.42%  (p=0.016 n=4+5)
      neo/py(!log)/sql-zhash.go                                   172µs ± 1%               170µs ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       149µs ± 2%               148µs ± 1%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zhash.py                                         217µs ± 1%               214µs ± 5%     ~     (p=0.643 n=5+5)
      neo/go/fs1-zhash.go                                        49.8µs ± 2%              49.5µs ± 1%     ~     (p=0.246 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            18.8µs ± 1%              19.1µs ± 2%   +2.03%  (p=0.048 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          40.4µs ± 3%              40.5µs ± 2%     ~     (p=0.587 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              16.1µs ± 2%              15.8µs ± 3%     ~     (p=0.238 n=5+5)
      neo/go/sqlite-zhash.py                                      263µs ± 4%               253µs ± 3%   -3.90%  (p=0.024 n=5+5)
      neo/go/sqlite-zhash.go                                     93.1µs ± 1%              92.7µs ± 1%     ~     (p=0.595 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         32.7µs ± 2%              32.6µs ± 4%     ~     (p=0.659 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              89.6µs ± 1%              91.2µs ± 1%   +1.79%  (p=0.024 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  34.0µs ± 2%              32.7µs ± 2%   -3.82%  (p=0.008 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:rio dataset:wczblk1-8
      fs1-zwrk.go·1                                                300k ± 0%                299k ± 1%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·2                                                546k ± 0%                547k ± 1%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·3                                                810k ± 0%                812k ± 0%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·4                                               1.08M ± 0%               1.08M ± 0%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·8                                               1.42M ± 0%               1.42M ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·12                                              1.55M ± 0%               1.55M ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                              1.55M ± 0%               1.54M ± 0%   -0.34%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        7.41k ± 1%               7.42k ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        9.03k ± 1%               8.95k ± 1%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        9.77k ± 1%               9.86k ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        10.1k ± 3%               10.1k ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        10.5k ± 0%               10.4k ± 2%   -1.37%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       10.6k ± 1%               10.6k ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       10.6k ± 1%               10.6k ± 1%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               6.80k ± 2%               6.78k ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.31k ± 7%               8.25k ± 8%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.60k ± 1%               8.48k ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.60k ± 1%               8.52k ± 0%     ~     (p=0.114 n=4+4)
      neo/py(!log)/sqlite-zwrk.go·8                               8.61k ± 1%               8.51k ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.56k ± 1%               8.46k ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.49k ± 3%               8.51k ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.62k ± 6%               5.59k ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.75k ± 4%               6.83k ± 1%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sql-zwrk.go·3                                  6.77k ± 2%               6.71k ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.51k ± 7%               6.56k ± 4%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.56k ± 4%               6.68k ± 4%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.84k ± 1%               6.73k ± 6%     ~     (p=0.730 n=4+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.73k ± 3%               6.71k ± 3%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                        15.5k ± 0%               15.6k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·2                                        29.9k ± 1%               30.2k ± 1%   +0.84%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·3                                        39.4k ± 0%               39.7k ± 0%   +0.70%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                        49.4k ± 0%               49.6k ± 0%   +0.54%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        68.4k ± 0%               68.8k ± 0%   +0.62%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       72.5k ± 0%               73.0k ± 0%   +0.66%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·16                                       73.2k ± 0%               73.7k ± 1%   +0.79%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.2k ± 1%               25.3k ± 2%   -3.17%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          47.6k ± 0%               47.8k ± 0%   +0.46%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          59.4k ± 0%               59.6k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          72.2k ± 0%               72.4k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          96.7k ± 0%               96.8k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          109k ± 0%                110k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                          113k ± 1%                113k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     9.82k ± 0%               9.91k ± 0%   +0.88%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     18.3k ± 0%               18.4k ± 0%   +0.56%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     25.3k ± 0%               25.5k ± 0%   +0.91%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     30.3k ± 0%               30.6k ± 0%   +0.80%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     39.5k ± 0%               40.1k ± 0%   +1.54%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    40.8k ± 2%               41.8k ± 1%   +2.31%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    40.5k ± 2%               41.8k ± 2%   +3.20%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.0k ± 1%               11.1k ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              20.0k ± 0%               20.1k ± 0%   +0.35%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              27.9k ± 0%               28.0k ± 0%   +0.27%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              34.1k ± 0%               34.3k ± 0%   +0.62%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              44.1k ± 1%               44.7k ± 1%   +1.53%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             43.1k ± 1%               44.5k ± 1%   +3.33%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             41.2k ± 2%               43.0k ± 2%   +4.21%  (p=0.008 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zwrk.go·1                                                465k ± 1%                461k ± 1%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·2                                                920k ± 0%                918k ± 0%     ~     (p=0.730 n=4+5)
      fs1-zwrk.go·3                                               1.36M ± 1%               1.37M ± 1%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·4                                               1.81M ± 0%               1.80M ± 3%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·8                                               2.37M ± 1%               2.38M ± 2%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·12                                              2.41M ± 0%               2.42M ± 0%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·16                                              2.42M ± 0%               2.41M ± 0%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        8.98k ± 1%               8.88k ± 1%   -1.08%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        11.7k ± 1%               11.6k ± 2%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        12.9k ± 2%               12.5k ± 2%   -2.84%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        13.4k ± 4%               13.1k ± 2%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        14.0k ± 2%               13.6k ± 1%   -2.77%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       14.2k ± 2%               13.9k ± 1%   -2.05%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       14.2k ± 3%               13.8k ± 1%   -2.84%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.16k ± 4%               7.12k ± 3%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.75k ± 1%               8.64k ± 7%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.65k ± 4%               8.79k ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.53k ± 6%               8.73k ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.61k ± 3%               8.60k ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.64k ± 0%               8.78k ± 1%   +1.63%  (p=0.016 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.64k ± 1%               8.58k ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.88k ± 1%               5.91k ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.79k ± 2%               6.71k ± 9%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.58k ± 4%               6.85k ± 2%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.68k ± 4%               6.82k ± 1%     ~     (p=0.730 n=5+4)
      neo/py(!log)/sql-zwrk.go·8                                  6.83k ± 1%               6.80k ± 6%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.66k ± 4%               6.87k ± 2%   +3.10%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.65k ± 5%               6.90k ± 2%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·1                                        21.8k ± 1%               21.9k ± 2%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·2                                        39.2k ± 1%               39.6k ± 1%   +0.94%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·3                                        51.4k ± 0%               51.5k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·4                                        62.8k ± 0%               62.8k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·8                                        80.7k ± 1%               80.2k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·12                                       80.0k ± 2%               79.6k ± 3%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       78.3k ± 2%               77.1k ± 5%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.5k ± 1%               26.9k ± 1%   +1.52%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          48.8k ± 0%               49.2k ± 0%   +0.89%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          61.8k ± 0%               62.1k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          74.0k ± 0%               74.2k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          91.3k ± 0%               91.9k ± 2%     ~     (p=0.190 n=4+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         93.1k ± 2%               92.9k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         89.7k ± 2%               90.1k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.0k ± 1%               11.1k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     19.4k ± 1%               19.4k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     26.6k ± 0%               26.5k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     31.9k ± 0%               31.7k ± 0%   -0.47%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     37.4k ± 2%               37.3k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    35.2k ± 3%               35.4k ± 2%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    34.6k ± 2%               34.8k ± 2%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.5k ± 1%               11.4k ± 1%   -1.34%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              20.1k ± 0%               19.8k ± 0%   -1.52%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              27.6k ± 0%               27.3k ± 1%   -0.93%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              33.4k ± 0%               33.1k ± 1%   -0.81%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              38.8k ± 2%               38.8k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             36.4k ± 1%               36.0k ± 2%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             35.2k ± 2%               35.1k ± 2%     ~     (p=0.690 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:rio dataset:wczblk1-8
      fs1-zwrk.go·1                                              3.33µs ± 0%              3.34µs ± 1%     ~     (p=0.286 n=5+5)
      fs1-zwrk.go·2                                              3.67µs ± 0%              3.65µs ± 1%     ~     (p=0.667 n=5+5)
      fs1-zwrk.go·3                                              3.70µs ± 0%              3.69µs ± 0%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·4                                              3.72µs ± 0%              3.72µs ± 0%     ~     (p=0.984 n=5+5)
      fs1-zwrk.go·8                                              5.62µs ± 0%              5.62µs ± 0%     ~     (p=0.889 n=5+5)
      fs1-zwrk.go·12                                             7.76µs ± 0%              7.76µs ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                             10.3µs ± 0%              10.4µs ± 0%   +0.34%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        135µs ± 1%               135µs ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        222µs ± 1%               223µs ± 1%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        307µs ± 1%               304µs ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        398µs ± 3%               397µs ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        759µs ± 0%               770µs ± 2%   +1.41%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.13ms ± 1%              1.14ms ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.50ms ± 1%              1.51ms ± 1%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               147µs ± 2%               147µs ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               241µs ± 8%               243µs ± 8%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               349µs ± 1%               354µs ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               465µs ± 1%               470µs ± 0%     ~     (p=0.114 n=4+4)
      neo/py(!log)/sqlite-zwrk.go·8                               930µs ± 1%               940µs ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.40ms ± 1%              1.42ms ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.88ms ± 3%              1.88ms ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  178µs ± 6%               179µs ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  297µs ± 4%               293µs ± 1%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sql-zwrk.go·3                                  443µs ± 2%               447µs ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  616µs ± 8%               610µs ± 4%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.22ms ± 5%              1.20ms ± 4%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.75ms ± 1%              1.79ms ± 6%     ~     (p=0.730 n=4+5)
      neo/py(!log)/sql-zwrk.go·16                                2.38ms ± 3%              2.38ms ± 3%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                       64.4µs ± 0%              64.1µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·2                                       66.8µs ± 1%              66.3µs ± 1%   -0.83%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·3                                       76.1µs ± 0%              75.5µs ± 0%   -0.69%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                       81.0µs ± 0%              80.6µs ± 0%   -0.53%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        117µs ± 0%               116µs ± 0%   -0.62%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       165µs ± 0%               164µs ± 0%   -0.65%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·16                                       219µs ± 0%               217µs ± 1%   -0.78%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         38.2µs ± 1%              39.5µs ± 2%   +3.29%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         42.0µs ± 0%              41.8µs ± 0%   -0.45%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         50.5µs ± 0%              50.4µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         55.4µs ± 0%              55.3µs ± 0%     ~     (p=0.063 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         82.8µs ± 0%              82.7µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         110µs ± 0%               110µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         142µs ± 1%               142µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     102µs ± 0%               101µs ± 0%   -0.87%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     110µs ± 0%               109µs ± 0%   -0.55%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     119µs ± 0%               117µs ± 0%   -0.90%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     132µs ± 0%               131µs ± 0%   -0.79%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     203µs ± 0%               200µs ± 0%   -1.52%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    294µs ± 2%               287µs ± 1%   -2.26%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    395µs ± 2%               383µs ± 2%   -3.11%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             91.1µs ± 1%              90.4µs ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              100µs ± 0%               100µs ± 0%   -0.35%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              108µs ± 0%               107µs ± 0%   -0.27%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              117µs ± 0%               117µs ± 0%   -0.62%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              182µs ± 1%               179µs ± 1%   -1.51%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             279µs ± 1%               270µs ± 1%   -3.22%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             388µs ± 2%               372µs ± 2%   -4.03%  (p=0.008 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zwrk.go·1                                              2.15µs ± 1%              2.17µs ± 1%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·2                                              2.17µs ± 0%              2.18µs ± 0%     ~     (p=0.603 n=4+5)
      fs1-zwrk.go·3                                              2.20µs ± 1%              2.20µs ± 1%     ~     (p=0.460 n=5+5)
      fs1-zwrk.go·4                                              2.21µs ± 0%              2.23µs ± 3%     ~     (p=0.278 n=5+5)
      fs1-zwrk.go·8                                              3.37µs ± 1%              3.36µs ± 2%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·12                                             4.97µs ± 0%              4.97µs ± 0%     ~     (p=0.675 n=5+5)
      fs1-zwrk.go·16                                             6.61µs ± 0%              6.63µs ± 0%     ~     (p=0.063 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        111µs ± 1%               113µs ± 1%   +1.09%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        171µs ± 1%               173µs ± 2%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        233µs ± 2%               240µs ± 2%   +2.94%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        298µs ± 4%               306µs ± 2%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        572µs ± 2%               588µs ± 1%   +2.84%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       844µs ± 2%               861µs ± 1%   +2.07%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.12ms ± 3%              1.16ms ± 1%   +2.90%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               140µs ± 4%               140µs ± 3%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               229µs ± 1%               232µs ± 7%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               347µs ± 5%               341µs ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               470µs ± 7%               458µs ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               929µs ± 3%               930µs ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.39ms ± 0%              1.37ms ± 1%   -1.60%  (p=0.016 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.85ms ± 1%              1.86ms ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  170µs ± 1%               169µs ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  294µs ± 2%               299µs ±10%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  456µs ± 4%               438µs ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  599µs ± 4%               587µs ± 1%     ~     (p=0.730 n=5+4)
      neo/py(!log)/sql-zwrk.go·8                                 1.17ms ± 1%              1.18ms ± 6%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.80ms ± 4%              1.75ms ± 2%   -3.05%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.41ms ± 5%              2.32ms ± 2%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·1                                       45.9µs ± 1%              45.6µs ± 2%     ~     (p=0.167 n=5+5)
      neo/go/fs1-zwrk.go·2                                       51.0µs ± 1%              50.6µs ± 1%   -0.94%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·3                                       58.3µs ± 0%              58.3µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·4                                       63.7µs ± 0%              63.7µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·8                                       99.2µs ± 1%              99.8µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·12                                       150µs ± 2%               151µs ± 3%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       204µs ± 3%               208µs ± 5%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         37.7µs ± 1%              37.2µs ± 1%   -1.50%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         41.0µs ± 0%              40.6µs ± 0%   -0.88%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         48.5µs ± 0%              48.3µs ± 0%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         54.0µs ± 0%              53.9µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         87.6µs ± 0%              87.1µs ± 2%     ~     (p=0.190 n=4+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         129µs ± 2%               129µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         178µs ± 2%               178µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    90.7µs ± 1%              90.4µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     103µs ± 1%               103µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     113µs ± 0%               113µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     125µs ± 0%               126µs ± 0%   +0.47%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     214µs ± 2%               215µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    341µs ± 3%               339µs ± 2%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    462µs ± 2%               460µs ± 2%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             86.7µs ± 1%              87.9µs ± 1%   +1.36%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              100µs ± 0%               101µs ± 0%   +1.54%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              109µs ± 0%               110µs ± 1%   +0.94%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              120µs ± 0%               121µs ± 1%   +0.82%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              206µs ± 2%               206µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             330µs ± 1%               333µs ± 2%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             455µs ± 2%               456µs ± 2%     ~     (p=0.690 n=5+5)
      3695ff12
    • Kirill Smelkov's avatar
      X z6001: localhost timings, C > C1 disabled · 65de70b8
      Kirill Smelkov authored
      Like for neo1 disabling C-states helps serial cases for zeo/py and
      neo/py/sqlite and serial and parallel cases for neo/py/sql. For
      neo/py/sql it also tends to make timings less noisy:
      
      ---- 8< ----
      cluster:z6001 dataset:wczblk1-8
      zeo/py/fs1-zhash.py                                         650µs ± 7%               583µs ± 9%  -10.33%  (p=0.032 n=5+5)
      zeo/py/fs1-zhash.go                                         274µs ±13%               202µs ± 1%  -26.34%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                696µs ± 1%               476µs ± 4%  -31.64%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                338µs ± 7%               225µs ± 6%  -33.47%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                  1.00ms ±38%              0.59ms ±36%  -41.17%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zhash.go                                   434µs ± 6%               282µs ± 3%  -35.10%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       277µs ± 9%               237µs ± 2%  -14.37%  (p=0.008 n=5+5)
      
      zeo/py/fs1-zwrk.go·1                                        233µs ± 8%               195µs ± 2%  -16.41%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               288µs ±14%               220µs ± 2%  -23.74%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  400µs ±16%               278µs ± 1%  -30.47%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  562µs ± 8%               470µs ± 0%  -16.47%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  827µs ±13%               699µs ± 1%  -15.44%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.13ms ±14%              0.96ms ±10%  -15.10%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.13ms ±13%              1.90ms ± 1%  -10.78%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.24ms ±12%              2.82ms ± 2%  -12.82%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.62ms ± 8%              3.76ms ± 1%  -18.69%  (p=0.016 n=5+4)
      
      cluster:z6001 dataset:prod1-1024
      zeo/py/fs1-zhash.go                                         235µs ± 7%               167µs ± 1%  -28.85%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                664µs ± 2%               452µs ±10%  -31.89%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                269µs ± 7%               208µs ± 1%  -22.79%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                  1.03ms ±29%              0.57ms ±38%  -44.81%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go                                   406µs ± 2%               267µs ± 3%  -34.15%  (p=0.008 n=5+5)
      
      zeo/py/fs1-zwrk.go·1                                        208µs ± 5%               163µs ± 1%  -21.69%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               271µs ± 7%               210µs ± 6%  -22.43%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  400µs ±11%               261µs ± 1%  -34.78%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  554µs ± 7%               463µs ± 1%  -16.42%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  783µs ±11%               692µs ± 0%  -11.57%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.06ms ±11%              0.92ms ± 1%  -12.52%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.07ms ± 9%              1.83ms ± 2%  -11.28%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.02ms ± 7%              2.80ms ± 3%   -7.52%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.32ms ±12%              3.67ms ± 2%  -15.10%  (p=0.008 n=5+5)
      ---- 8< ----
      
      Like on neo1 it also seems to be helping neo/go/* with slower python
      client, but for neo/go/sqlite with go client too:
      
      ---- 8< ----
      cluster:z6001 dataset:wczblk1-8
      neo/go/fs1-zhash.py                                         526µs ± 8%               333µs ±10%  -36.81%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.py                                      528µs ±15%               385µs ± 6%  -27.15%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      204µs ±22%               142µs ± 1%  -30.26%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               194µs ± 9%               132µs ± 3%  -31.76%  (p=0.008 n=5+5)
      
      neo/go/sqlite-zwrk.go·1                                     208µs ±14%               139µs ± 1%  -32.89%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     166µs ± 2%               147µs ± 1%  -11.70%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     158µs ± 1%               150µs ± 0%   -4.60%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     162µs ± 0%               157µs ± 0%   -3.12%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              185µs ± 4%               130µs ± 1%  -29.53%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              156µs ± 1%               136µs ± 1%  -12.98%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              149µs ± 1%               139µs ± 0%   -6.76%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              149µs ± 1%               142µs ± 0%   -4.81%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              166µs ± 1%               163µs ± 0%   -2.04%  (p=0.008 n=5+5)
      
      cluster:z6001 dataset:prod1-1024
      neo/go/fs1-zhash.py                                         520µs ± 9%               321µs ±11%  -38.25%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go                                        83.2µs ± 7%              74.8µs ± 3%  -10.14%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.py                                      539µs ±11%               361µs ± 6%  -32.97%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      196µs ± 9%               128µs ± 2%  -34.66%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               168µs ± 8%               125µs ± 4%  -25.63%  (p=0.008 n=5+5)
      
      neo/go/sqlite-zwrk.go·1                                     177µs ± 8%               126µs ± 1%  -29.04%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     151µs ± 2%               136µs ± 1%   -9.65%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     148µs ± 1%               140µs ± 0%   -5.57%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     151µs ± 0%               145µs ± 0%   -3.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     180µs ± 1%               177µs ± 1%   -1.31%  (p=0.016 n=5+5)
      
      neo/go/sqlite-zwrk.go(!sha1)·1                              176µs ± 4%               120µs ± 2%  -31.54%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              152µs ± 3%               131µs ± 1%  -13.38%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              147µs ± 1%               135µs ± 0%   -7.68%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              148µs ± 2%               140µs ± 1%   -5.20%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              176µs ± 1%               173µs ± 1%   -1.65%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             225µs ± 1%               224µs ± 0%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             321µs ± 1%               321µs ± 1%     ~     (p=1.000 n=5+5)
      ---- 8< ----
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset 20180306-z6001-ffixed-c.txt 20180306-z6001-ffixed-noc_C1\(3µs\).txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:z6001
      pystone                                                      109k ± 9%                114k ± 1%     ~     (p=0.421 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:z6001
      crc32/py/4K                                                5.11µs ± 1%              5.15µs ± 4%     ~     (p=0.738 n=5+5)
      crc32/go/4K                                                1.72µs ± 0%              1.72µs ± 0%     ~     (p=1.000 n=4+4)
      sha1/py/4K                                                 14.7µs ± 1%              14.7µs ± 1%     ~     (p=0.841 n=5+5)
      sha1/go/4K                                                 10.3µs ± 0%              10.3µs ± 0%     ~     (p=0.103 n=5+5)
      unzlib/py/wczdata                                          37.1µs ± 8%              36.3µs ± 1%     ~     (p=0.310 n=5+5)
      unzlib/go/wczdata                                          31.5µs ± 0%              31.2µs ± 0%   -1.12%  (p=0.008 n=5+5)
      unzlib/py/prod1-avg                                        18.5µs ± 3%              18.6µs ± 3%     ~     (p=0.841 n=5+5)
      unzlib/go/prod1-avg                                        10.0µs ± 1%               9.9µs ± 1%     ~     (p=0.095 n=5+5)
      disk/randread/direct/4K-min                                 126µs ± 1%               127µs ± 1%     ~     (p=1.000 n=4+5)
      disk/randread/direct/4K-avg                                 199µs ± 9%               168µs ± 0%  -15.84%  (p=0.008 n=5+5)
      disk/randread/pagecache/4K-min                              806ns ± 3%               799ns ± 1%     ~     (p=0.746 n=5+5)
      disk/randread/pagecache/4K-avg                             1.44µs ± 7%              1.52µs ± 3%     ~     (p=0.079 n=5+5)
      
      name                                           old time/object          new time/object          delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zhash.py                                               37.6µs ± 2%              37.4µs ± 2%     ~     (p=0.571 n=5+5)
      fs1-zhash.go                                               6.00µs ± 2%              5.96µs ± 1%     ~     (p=0.643 n=5+5)
      fs1-zhash.go+prefetch128                                   8.00µs ± 5%              7.24µs ± 6%   -9.50%  (p=0.016 n=5+5)
      zeo/py/fs1-zhash.py                                         650µs ± 7%               583µs ± 9%  -10.33%  (p=0.032 n=5+5)
      zeo/py/fs1-zhash.go                                         274µs ±13%               202µs ± 1%  -26.34%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                             101µs ± 2%               102µs ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                696µs ± 1%               476µs ± 4%  -31.64%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                338µs ± 7%               225µs ± 6%  -33.47%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    177µs ± 1%               179µs ± 1%     ~     (p=0.143 n=5+5)
      neo/py(!log)/sql-zhash.py                                  1.00ms ±38%              0.59ms ±36%  -41.17%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zhash.go                                   434µs ± 6%               282µs ± 3%  -35.10%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       277µs ± 9%               237µs ± 2%  -14.37%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.py                                         526µs ± 8%               333µs ±10%  -36.81%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go                                         102µs ± 8%                94µs ± 6%   -8.17%  (p=0.032 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            36.6µs ± 4%              36.6µs ± 3%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          76.4µs ± 5%              69.7µs ± 8%   -8.75%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              26.5µs ± 2%              26.4µs ± 5%     ~     (p=0.730 n=5+5)
      neo/go/sqlite-zhash.py                                      528µs ±15%               385µs ± 6%  -27.15%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      204µs ±22%               142µs ± 1%  -30.26%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         39.9µs ± 4%              41.4µs ± 5%     ~     (p=0.111 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               194µs ± 9%               132µs ± 3%  -31.76%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  38.2µs ± 7%              36.7µs ± 5%     ~     (p=0.151 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zhash.py                                               30.3µs ± 1%              30.0µs ± 1%     ~     (p=0.373 n=5+5)
      fs1-zhash.go                                               4.62µs ± 3%              4.60µs ± 0%     ~     (p=0.968 n=5+4)
      fs1-zhash.go+prefetch128                                   5.76µs ± 8%              5.48µs ± 4%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zhash.py                                         632µs ±15%               560µs ± 3%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zhash.go                                         235µs ± 7%               167µs ± 1%  -28.85%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            87.2µs ± 1%              88.5µs ± 1%   +1.49%  (p=0.048 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                664µs ± 2%               452µs ±10%  -31.89%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                269µs ± 7%               208µs ± 1%  -22.79%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    162µs ± 0%               163µs ± 0%     ~     (p=0.397 n=4+5)
      neo/py(!log)/sql-zhash.py                                  1.03ms ±29%              0.57ms ±38%  -44.81%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go                                   406µs ± 2%               267µs ± 3%  -34.15%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       268µs ± 5%               228µs ±10%  -14.87%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.py                                         520µs ± 9%               321µs ±11%  -38.25%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go                                        83.2µs ± 7%              74.8µs ± 3%  -10.14%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            24.0µs ± 5%              24.1µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          67.0µs ± 3%              65.2µs ± 5%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              21.2µs ± 4%              21.1µs ± 2%     ~     (p=0.952 n=5+5)
      neo/go/sqlite-zhash.py                                      539µs ±11%               361µs ± 6%  -32.97%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      196µs ± 9%               128µs ± 2%  -34.66%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         35.0µs ± 3%              34.6µs ± 2%     ~     (p=0.302 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               168µs ± 8%               125µs ± 4%  -25.63%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  35.1µs ± 4%              34.9µs ± 2%     ~     (p=1.000 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zwrk.go·1                                                230k ± 1%                231k ± 1%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·2                                                437k ± 5%                444k ± 1%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·3                                                663k ± 4%                661k ± 4%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·4                                                880k ± 1%                878k ± 3%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·8                                               1.75M ± 2%               1.76M ± 2%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                              2.56M ± 0%               2.51M ± 3%     ~     (p=0.063 n=4+5)
      fs1-zwrk.go·16                                              2.89M ± 1%               2.90M ± 1%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        4.30k ± 8%               5.14k ± 2%  +19.34%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        6.33k ± 0%               6.38k ± 2%   +0.85%  (p=0.016 n=4+5)
      zeo/py/fs1-zwrk.go·3                                        6.90k ± 0%               7.05k ± 1%   +2.13%  (p=0.016 n=4+5)
      zeo/py/fs1-zwrk.go·4                                        7.14k ± 1%               7.22k ± 2%     ~     (p=0.111 n=4+5)
      zeo/py/fs1-zwrk.go·8                                        7.53k ± 2%               7.50k ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       7.65k ± 0%               7.53k ± 0%   -1.59%  (p=0.016 n=4+5)
      zeo/py/fs1-zwrk.go·16                                       7.57k ± 0%               7.66k ± 1%   +1.17%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               3.50k ±15%               4.55k ± 2%  +30.01%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               5.58k ± 0%               5.59k ± 1%     ~     (p=0.730 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·3                               5.63k ± 2%               5.56k ± 0%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·4                               5.56k ± 1%               5.54k ± 0%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               5.61k ± 2%               5.59k ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              5.62k ± 1%               5.57k ± 0%   -0.82%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              5.62k ± 1%               5.58k ± 0%     ~     (p=0.413 n=4+5)
      neo/py(!log)/sql-zwrk.go·1                                  2.53k ±17%               3.59k ± 1%  +41.99%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  3.57k ± 9%               4.26k ± 0%  +19.25%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  3.65k ±14%               4.29k ± 1%  +17.53%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  3.56k ±16%               4.17k ± 9%  +17.25%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  3.78k ±12%               4.20k ± 1%  +11.12%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 3.73k ±13%               4.25k ± 2%  +13.97%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.47k ± 9%               4.26k ± 1%  +22.71%  (p=0.016 n=5+4)
      neo/go/fs1-zwrk.go·1                                        10.7k ± 5%               11.1k ± 7%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·2                                        22.3k ± 1%               23.1k ± 2%   +3.68%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                        31.7k ± 1%               32.1k ± 1%   +1.34%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                        43.2k ± 1%               43.5k ± 0%   +0.72%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·8                                        78.3k ± 0%               78.1k ± 0%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·12                                       92.5k ± 0%               92.4k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·16                                        103k ± 1%                102k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          15.0k ± 5%               15.1k ± 3%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          31.5k ± 1%               31.8k ± 1%   +0.91%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          43.8k ± 0%               44.1k ± 0%   +0.82%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          57.4k ± 0%               57.9k ± 0%   +0.92%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                           100k ± 0%                100k ± 0%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          116k ± 0%                116k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                          126k ± 1%                126k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     4.85k ±15%               7.17k ± 1%  +47.73%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     12.0k ± 2%               13.6k ± 1%  +13.23%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     19.0k ± 1%               19.9k ± 0%   +4.82%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     24.7k ± 0%               25.5k ± 0%   +3.22%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     44.8k ± 0%               44.9k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    56.3k ± 0%               55.7k ± 0%   -0.92%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    58.0k ± 0%               57.4k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              5.41k ± 4%               7.67k ± 1%  +41.83%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              12.8k ± 1%               14.7k ± 1%  +14.92%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              20.2k ± 1%               21.6k ± 0%   +7.25%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              26.8k ± 1%               28.2k ± 0%   +5.05%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              48.1k ± 1%               49.1k ± 0%   +2.08%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             60.3k ± 0%               60.4k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             61.7k ± 1%               61.9k ± 1%     ~     (p=0.690 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zwrk.go·1                                                347k ± 2%                347k ± 2%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·2                                                660k ± 3%                659k ± 2%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·3                                                985k ± 4%                978k ± 4%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·4                                               1.31M ± 2%               1.30M ± 4%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·8                                               2.55M ± 4%               2.52M ± 6%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·12                                              2.81M ± 1%               3.02M ± 1%   +7.78%  (p=0.008 n=5+5)
      fs1-zwrk.go·16                                              2.85M ± 2%               3.06M ± 1%   +7.51%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        4.80k ± 5%               6.13k ± 1%  +27.58%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        8.18k ± 1%               8.16k ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        8.96k ± 1%               8.99k ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        8.88k ± 9%               9.37k ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        10.0k ± 2%                9.8k ± 5%     ~     (p=0.905 n=4+5)
      zeo/py/fs1-zwrk.go·12                                       9.80k ± 6%               9.19k ± 8%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       10.1k ± 6%                8.9k ±15%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               3.70k ± 6%               4.77k ± 6%  +29.01%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               5.77k ± 0%               5.92k ± 0%   +2.58%  (p=0.029 n=4+4)
      neo/py(!log)/sqlite-zwrk.go·3                               5.77k ± 0%               5.76k ± 0%   -0.25%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               5.77k ± 0%               5.82k ± 2%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               5.84k ± 1%               5.75k ± 0%   -1.67%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              5.78k ± 2%               5.71k ± 0%   -1.27%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              5.80k ± 1%               5.71k ± 0%   -1.63%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  2.51k ±12%               3.83k ± 1%  +52.68%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  3.62k ± 8%               4.32k ± 1%  +19.32%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  3.86k ±11%               4.33k ± 0%  +12.15%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  3.82k ±11%               4.33k ± 1%  +13.35%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  3.89k ±10%               4.36k ± 2%  +12.29%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 3.98k ± 7%               4.29k ± 3%   +7.85%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.72k ±13%               4.36k ± 2%  +17.09%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                        13.8k ± 3%               14.0k ± 3%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·2                                        28.1k ± 0%               28.4k ± 1%   +1.29%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                        40.2k ± 0%               40.5k ± 0%   +0.60%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                        52.8k ± 1%               53.1k ± 0%   +0.54%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·8                                        90.6k ± 0%               90.2k ± 0%   -0.48%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·12                                       95.8k ± 1%               95.0k ± 2%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·16                                       90.9k ± 1%               90.4k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          16.2k ± 2%               16.3k ± 2%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          32.9k ± 1%               33.4k ± 0%   +1.52%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          46.2k ± 0%               46.5k ± 0%   +0.68%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          59.8k ± 1%               60.4k ± 0%   +0.91%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          98.1k ± 0%               98.7k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          102k ± 1%                103k ± 1%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         97.0k ± 2%               98.4k ± 2%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     5.67k ± 8%               7.97k ± 1%  +40.55%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     13.3k ± 2%               14.7k ± 1%  +10.67%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     20.3k ± 1%               21.5k ± 0%   +5.90%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.5k ± 0%               27.6k ± 0%   +3.93%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     44.5k ± 1%               45.1k ± 1%   +1.33%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    52.3k ± 1%               52.6k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    48.9k ± 1%               48.8k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              5.69k ± 4%               8.31k ± 2%  +45.99%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              13.2k ± 3%               15.2k ± 1%  +15.42%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              20.5k ± 1%               22.2k ± 0%   +8.31%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.1k ± 2%               28.6k ± 1%   +5.47%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              45.4k ± 1%               46.2k ± 1%   +1.67%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             53.3k ± 1%               53.5k ± 0%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             49.8k ± 1%               49.8k ± 1%     ~     (p=1.000 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zwrk.go·1                                              4.34µs ± 1%              4.33µs ± 1%     ~     (p=0.540 n=5+5)
      fs1-zwrk.go·2                                              4.58µs ± 5%              4.51µs ± 1%     ~     (p=0.381 n=5+5)
      fs1-zwrk.go·3                                              4.52µs ± 4%              4.54µs ± 4%     ~     (p=0.952 n=5+5)
      fs1-zwrk.go·4                                              4.55µs ± 1%              4.56µs ± 3%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·8                                              4.58µs ± 2%              4.56µs ± 2%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                             4.69µs ± 0%              4.77µs ± 3%     ~     (p=0.063 n=4+5)
      fs1-zwrk.go·16                                             5.53µs ± 1%              5.51µs ± 1%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        233µs ± 8%               195µs ± 2%  -16.41%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        315µs ± 2%               314µs ± 2%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        435µs ± 0%               426µs ± 1%   -2.08%  (p=0.016 n=4+5)
      zeo/py/fs1-zwrk.go·4                                        560µs ± 1%               554µs ± 2%     ~     (p=0.111 n=4+5)
      zeo/py/fs1-zwrk.go·8                                       1.06ms ± 2%              1.07ms ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.57ms ± 0%              1.59ms ± 0%   +1.62%  (p=0.016 n=4+5)
      zeo/py/fs1-zwrk.go·16                                      2.11ms ± 0%              2.09ms ± 1%   -1.15%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               288µs ±14%               220µs ± 2%  -23.74%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               358µs ± 0%               358µs ± 1%     ~     (p=0.730 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·3                               533µs ± 2%               539µs ± 0%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·4                               720µs ± 1%               723µs ± 0%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.43ms ± 2%              1.43ms ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             2.14ms ± 1%              2.15ms ± 0%   +0.82%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.85ms ± 1%              2.87ms ± 0%     ~     (p=0.413 n=4+5)
      neo/py(!log)/sql-zwrk.go·1                                  400µs ±16%               278µs ± 1%  -30.47%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  562µs ± 8%               470µs ± 0%  -16.47%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  827µs ±13%               699µs ± 1%  -15.44%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.13ms ±14%              0.96ms ±10%  -15.10%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.13ms ±13%              1.90ms ± 1%  -10.78%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.24ms ±12%              2.82ms ± 2%  -12.82%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.62ms ± 8%              3.76ms ± 1%  -18.69%  (p=0.016 n=5+4)
      neo/go/fs1-zwrk.go·1                                       93.9µs ± 4%              90.4µs ± 7%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·2                                       89.6µs ± 1%              86.5µs ± 2%   -3.55%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                       94.6µs ± 1%              93.3µs ± 1%   -1.33%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                       92.6µs ± 1%              91.9µs ± 0%   -0.71%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·8                                        102µs ± 0%               102µs ± 0%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·12                                       130µs ± 0%               130µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·16                                       156µs ± 1%               157µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         66.8µs ± 5%              66.1µs ± 3%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         63.5µs ± 1%              62.9µs ± 1%   -0.90%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         68.5µs ± 0%              68.0µs ± 0%   -0.81%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         69.7µs ± 0%              69.0µs ± 0%   -0.91%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         79.7µs ± 0%              79.9µs ± 0%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         103µs ± 0%               103µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         127µs ± 1%               127µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     208µs ±14%               139µs ± 1%  -32.89%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     166µs ± 2%               147µs ± 1%  -11.70%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     158µs ± 1%               150µs ± 0%   -4.60%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     162µs ± 0%               157µs ± 0%   -3.12%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     178µs ± 0%               178µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    213µs ± 0%               215µs ± 0%   +0.93%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    276µs ± 0%               279µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              185µs ± 4%               130µs ± 1%  -29.53%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              156µs ± 1%               136µs ± 1%  -12.98%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              149µs ± 1%               139µs ± 0%   -6.76%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              149µs ± 1%               142µs ± 0%   -4.81%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              166µs ± 1%               163µs ± 0%   -2.04%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             199µs ± 0%               199µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             259µs ± 1%               259µs ± 1%     ~     (p=0.690 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zwrk.go·1                                              2.88µs ± 2%              2.88µs ± 2%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·2                                              3.03µs ± 3%              3.03µs ± 3%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·3                                              3.05µs ± 4%              3.07µs ± 4%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·4                                              3.05µs ± 2%              3.09µs ± 4%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·8                                              3.14µs ± 4%              3.18µs ± 6%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·12                                             4.28µs ± 1%              3.97µs ± 1%   -7.22%  (p=0.008 n=5+5)
      fs1-zwrk.go·16                                             5.63µs ± 2%              5.23µs ± 1%   -7.01%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        208µs ± 5%               163µs ± 1%  -21.69%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        245µs ± 1%               245µs ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        335µs ± 1%               334µs ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        453µs ±10%               427µs ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        803µs ± 2%               815µs ± 5%     ~     (p=0.905 n=4+5)
      zeo/py/fs1-zwrk.go·12                                      1.23ms ± 6%              1.31ms ± 8%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.59ms ± 6%              1.82ms ±14%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               271µs ± 7%               210µs ± 6%  -22.43%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               346µs ± 0%               338µs ± 0%   -2.52%  (p=0.029 n=4+4)
      neo/py(!log)/sqlite-zwrk.go·3                               520µs ± 0%               521µs ± 0%   +0.25%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               694µs ± 0%               688µs ± 2%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.37ms ± 1%              1.39ms ± 0%   +1.68%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             2.07ms ± 2%              2.10ms ± 0%   +1.28%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.76ms ± 1%              2.80ms ± 0%   +1.65%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  400µs ±11%               261µs ± 1%  -34.78%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  554µs ± 7%               463µs ± 1%  -16.42%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  783µs ±11%               692µs ± 0%  -11.57%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.06ms ±11%              0.92ms ± 1%  -12.52%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.07ms ± 9%              1.83ms ± 2%  -11.28%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.02ms ± 7%              2.80ms ± 3%   -7.52%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.32ms ±12%              3.67ms ± 2%  -15.10%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                       72.6µs ± 3%              71.5µs ± 3%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·2                                       71.2µs ± 0%              70.3µs ± 1%   -1.27%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                       74.6µs ± 0%              74.1µs ± 0%   -0.59%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                       75.7µs ± 1%              75.3µs ± 0%   -0.54%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·8                                       88.3µs ± 0%              88.7µs ± 0%   +0.48%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·12                                       125µs ± 1%               126µs ± 2%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·16                                       176µs ± 1%               177µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         61.7µs ± 2%              61.3µs ± 2%     ~     (p=0.651 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         60.7µs ± 1%              59.8µs ± 0%   -1.50%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         64.9µs ± 0%              64.5µs ± 0%   -0.68%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         66.9µs ± 1%              66.3µs ± 0%   -0.90%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         81.5µs ± 0%              81.0µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         118µs ± 1%               116µs ± 1%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         165µs ± 2%               163µs ± 2%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     177µs ± 8%               126µs ± 1%  -29.04%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     151µs ± 2%               136µs ± 1%   -9.65%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     148µs ± 1%               140µs ± 0%   -5.57%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     151µs ± 0%               145µs ± 0%   -3.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     180µs ± 1%               177µs ± 1%   -1.31%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    229µs ± 1%               228µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    327µs ± 1%               328µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              176µs ± 4%               120µs ± 2%  -31.54%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              152µs ± 3%               131µs ± 1%  -13.38%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              147µs ± 1%               135µs ± 0%   -7.68%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              148µs ± 2%               140µs ± 1%   -5.20%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              176µs ± 1%               173µs ± 1%   -1.65%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             225µs ± 1%               224µs ± 0%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             321µs ± 1%               321µs ± 1%     ~     (p=1.000 n=5+5)
      65de70b8
    • Kirill Smelkov's avatar
      X neo1: localhost timings, C > C1 disabled · f40c8b4b
      Kirill Smelkov authored
      $ benchstat -split node,cluster,dataset 20180306-neo1-ffixed-c.txt 20180306-neo1-ffixed-noc_C1\(3µs\).txt
      
      Disabling C states helps serial cases for zeo/py and neo/py/sqlite and
      both serial and parallel cases for neo/py/sql. For neo/py/sql it also
      denoises the timing.
      
      ---- 8< ----
      cluster:neo1 dataset:wczblk1-8
      zeo/py/fs1-zhash.py                                         523µs ± 1%               465µs ± 4%  -11.04%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go                                         194µs ± 4%               173µs ± 2%  -10.70%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                684µs ± 3%               389µs ± 1%  -43.08%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                236µs ± 2%               198µs ± 5%  -16.19%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                   942µs ±47%               448µs ± 3%  -52.47%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zhash.go                                   300µs ±17%               251µs ± 2%  -16.37%  (p=0.008 n=5+5)
      
      zeo/py/fs1-zwrk.go·1                                        194µs ± 1%               171µs ± 1%  -11.93%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               232µs ± 4%               198µs ± 3%  -14.97%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  323µs ± 6%               242µs ± 1%  -24.90%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  503µs ± 2%               421µs ± 5%  -16.28%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  742µs ± 3%               639µs ± 4%  -13.97%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  986µs ± 4%               838µs ± 2%  -15.02%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.11ms ± 8%              1.71ms ± 4%  -18.91%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.02ms ± 3%              2.57ms ± 3%  -14.83%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.06ms ± 1%              3.39ms ± 3%  -16.33%  (p=0.008 n=5+5)
      
      cluster:neo1 dataset:prod1-1024
      zeo/py/fs1-zhash.go                                         170µs ± 3%               148µs ± 3%  -13.05%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                665µs ± 2%               382µs ± 3%  -42.60%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                219µs ± 2%               181µs ± 1%  -17.27%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                   886µs ±56%               426µs ± 1%  -51.90%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zhash.go                                   298µs ± 9%               234µs ± 2%  -21.22%  (p=0.008 n=5+5)
      
      zeo/py/fs1-zwrk.go·1                                        173µs ± 3%               146µs ± 2%  -15.31%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               204µs ± 8%               182µs ± 3%  -11.14%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  287µs ± 8%               236µs ± 8%  -17.73%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  495µs ± 6%               406µs ± 1%  -17.95%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  740µs ± 8%               618µs ± 3%  -16.50%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.01ms ± 4%              0.82ms ± 2%  -18.75%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.93ms ± 3%              1.64ms ± 1%  -15.14%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.01ms ± 4%              2.45ms ± 3%  -18.53%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.05ms ±10%              3.33ms ± 8%  -17.74%  (p=0.008 n=5+5)
      ---- 8< ----
      
      It looks to be also helping to neo/go/* with python (thus slower)
      client:
      
      ---- 8< ----
      cluster:neo1 dataset:wczblk1-8
      neo/go/fs1-zhash.py                                         383µs ±20%               270µs ± 2%  -29.62%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.py                                      402µs ± 6%               323µs ± 1%  -19.66%  (p=0.008 n=5+5)
      
      cluster:neo1 dataset:prod1-1024
      neo/go/fs1-zhash.py                                         319µs ±11%               260µs ± 2%  -18.46%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.py                                      382µs ± 6%               310µs ± 2%  -19.04%  (p=0.008 n=5+5)
      ---- 8< ----
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset 20180306-neo1-ffixed-c.txt 20180306-neo1-ffixed-noc_C1\(3µs\).txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:neo1
      pystone                                                      106k ± 1%                106k ± 1%     ~     (p=0.548 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:neo1
      crc32/py/4K                                                5.13µs ± 1%              5.13µs ± 1%     ~     (p=1.000 n=5+5)
      crc32/go/4K                                                2.79µs ± 0%              2.79µs ± 0%   -0.06%  (p=0.032 n=5+5)
      sha1/py/4K                                                 13.4µs ± 1%              13.5µs ± 1%     ~     (p=0.548 n=5+5)
      sha1/go/4K                                                 9.83µs ± 0%              9.85µs ± 1%     ~     (p=0.905 n=5+4)
      unzlib/py/wczdata                                          36.1µs ± 0%              36.1µs ± 1%     ~     (p=0.841 n=5+5)
      unzlib/go/wczdata                                          31.1µs ± 1%              30.9µs ± 1%     ~     (p=0.111 n=5+5)
      unzlib/py/prod1-avg                                        16.3µs ± 2%              16.8µs ±10%     ~     (p=0.548 n=5+5)
      unzlib/go/prod1-avg                                        9.42µs ± 0%              9.27µs ± 1%   -1.58%  (p=0.008 n=5+5)
      disk/randread/direct/4K-min                                 162µs ± 0%               162µs ± 0%     ~     (p=0.270 n=5+4)
      disk/randread/direct/4K-avg                                 187µs ± 2%               172µs ± 0%   -8.20%  (p=0.008 n=5+5)
      disk/randread/pagecache/4K-min                              389ns ± 1%               390ns ± 1%     ~     (p=0.548 n=5+5)
      disk/randread/pagecache/4K-avg                              804ns ± 0%               894ns ± 0%  +11.28%  (p=0.016 n=4+5)
      
      name                                           old time/object          new time/object          delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zhash.py                                               34.7µs ± 2%              34.4µs ± 2%     ~     (p=0.119 n=5+5)
      fs1-zhash.go                                               6.00µs ± 2%              5.90µs ± 0%     ~     (p=0.095 n=5+4)
      fs1-zhash.go+prefetch128                                   6.52µs ± 4%              6.26µs ± 3%     ~     (p=0.079 n=5+5)
      zeo/py/fs1-zhash.py                                         523µs ± 1%               465µs ± 4%  -11.04%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go                                         194µs ± 4%               173µs ± 2%  -10.70%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            98.6µs ± 3%              98.8µs ± 1%     ~     (p=0.810 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                684µs ± 3%               389µs ± 1%  -43.08%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                236µs ± 2%               198µs ± 5%  -16.19%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    162µs ± 2%               165µs ± 4%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zhash.py                                   942µs ±47%               448µs ± 3%  -52.47%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zhash.go                                   300µs ±17%               251µs ± 2%  -16.37%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       240µs ± 6%               220µs ± 1%   -8.51%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.py                                         383µs ±20%               270µs ± 2%  -29.62%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go                                        81.3µs ± 1%              81.0µs ± 4%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            33.8µs ± 5%              34.9µs ± 6%     ~     (p=0.381 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          57.6µs ± 3%              56.0µs ± 3%   -2.71%  (p=0.024 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              22.9µs ± 6%              22.7µs ± 7%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zhash.py                                      402µs ± 6%               323µs ± 1%  -19.66%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      125µs ± 1%               124µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         48.4µs ± 8%              46.9µs ± 2%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               116µs ± 2%               113µs ± 2%   -1.96%  (p=0.032 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  45.9µs ± 5%              46.6µs ± 4%     ~     (p=0.341 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zhash.py                                               28.9µs ± 1%              28.9µs ± 1%     ~     (p=0.746 n=5+5)
      fs1-zhash.go                                               3.76µs ± 4%              3.76µs ± 2%     ~     (p=1.000 n=5+5)
      fs1-zhash.go+prefetch128                                   3.86µs ± 2%              3.74µs ± 2%   -3.11%  (p=0.048 n=5+5)
      zeo/py/fs1-zhash.py                                         474µs ± 2%               442µs ± 9%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zhash.go                                         170µs ± 3%               148µs ± 3%  -13.05%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            87.8µs ± 1%              87.9µs ± 2%     ~     (p=0.881 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                665µs ± 2%               382µs ± 3%  -42.60%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                219µs ± 2%               181µs ± 1%  -17.27%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    151µs ± 1%               150µs ± 1%     ~     (p=0.206 n=5+4)
      neo/py(!log)/sql-zhash.py                                   886µs ±56%               426µs ± 1%  -51.90%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zhash.go                                   298µs ± 9%               234µs ± 2%  -21.22%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       230µs ± 3%               210µs ± 6%   -8.71%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.py                                         319µs ±11%               260µs ± 2%  -18.46%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go                                        61.3µs ± 3%              61.4µs ± 2%     ~     (p=0.802 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            22.5µs ± 3%              22.2µs ± 5%     ~     (p=0.595 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          52.0µs ± 3%              51.9µs ± 4%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              18.3µs ± 2%              18.3µs ± 3%     ~     (p=0.667 n=5+5)
      neo/go/sqlite-zhash.py                                      382µs ± 6%               310µs ± 2%  -19.04%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      113µs ± 1%               112µs ± 1%     ~     (p=0.063 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         40.9µs ± 4%              41.9µs ± 4%     ~     (p=0.190 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               108µs ± 1%               107µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  41.1µs ± 5%              41.1µs ± 2%     ~     (p=0.881 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zwrk.go·1                                                229k ± 0%                229k ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·2                                                443k ± 1%                439k ± 0%     ~     (p=0.111 n=5+4)
      fs1-zwrk.go·3                                                662k ± 1%                660k ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·4                                                867k ± 1%                865k ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·8                                                988k ± 0%                959k ±11%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                              1.02M ± 0%               1.02M ± 0%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·16                                               976k ±12%               1015k ± 0%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        5.15k ± 1%               5.84k ± 1%  +13.54%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        7.08k ± 1%               7.05k ± 5%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        7.73k ± 1%               7.82k ± 1%   +1.29%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        7.97k ± 4%               8.07k ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        8.30k ± 2%               8.40k ± 2%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       8.15k ± 1%               8.40k ± 2%   +3.08%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       8.25k ± 1%               8.48k ± 1%   +2.85%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               4.31k ± 4%               5.06k ± 3%  +17.59%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               6.28k ± 5%               6.39k ± 0%     ~     (p=0.730 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·3                               6.38k ± 0%               6.28k ± 8%     ~     (p=0.730 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·4                               6.15k ± 5%               6.10k ± 5%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               6.27k ± 4%               6.22k ± 9%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              6.33k ± 2%               6.28k ± 6%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              6.25k ± 4%               6.17k ± 6%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  3.10k ± 6%               4.12k ± 1%  +33.05%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  3.98k ± 1%               4.76k ± 5%  +19.62%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  4.04k ± 3%               4.70k ± 4%  +16.27%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  4.06k ± 4%               4.78k ± 2%  +17.62%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  3.79k ± 7%               4.67k ± 5%  +23.22%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 3.98k ± 3%               4.67k ± 3%  +17.40%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.94k ± 1%               4.72k ± 3%  +19.55%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                        12.8k ± 0%               12.8k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·2                                        24.8k ± 0%               25.0k ± 1%     ~     (p=0.063 n=4+5)
      neo/go/fs1-zwrk.go·3                                        32.3k ± 0%               32.2k ± 2%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·4                                        40.7k ± 0%               40.9k ± 0%   +0.47%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        54.5k ± 1%               54.9k ± 0%   +0.66%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·12                                       56.5k ± 1%               56.7k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       53.2k ±10%               54.4k ± 2%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          19.0k ± 2%               19.3k ± 2%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          37.8k ± 0%               37.8k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          48.0k ± 1%               48.2k ± 0%   +0.50%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          59.0k ± 0%               59.2k ± 0%   +0.39%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          78.0k ± 1%               78.3k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         82.2k ± 2%               82.5k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         80.4k ± 1%               80.3k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     8.06k ± 4%               8.24k ± 1%   +2.17%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     14.9k ± 0%               15.0k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     20.7k ± 0%               20.8k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     24.8k ± 0%               24.9k ± 0%   +0.39%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     31.7k ± 1%               31.6k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    30.8k ± 5%               31.4k ± 1%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    30.4k ± 2%               30.6k ± 3%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              8.95k ± 1%               9.05k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              16.2k ± 1%               16.3k ± 1%   +0.88%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              22.6k ± 0%               22.6k ± 0%     ~     (p=0.905 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.9k ± 0%               27.7k ± 0%   -0.83%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              35.0k ± 1%               34.4k ± 1%   -1.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             34.7k ± 1%               33.4k ± 2%   -3.68%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             33.0k ±11%               32.9k ± 2%     ~     (p=0.151 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zwrk.go·1                                                451k ± 0%                451k ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·2                                                893k ± 0%                871k ± 9%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·3                                               1.34M ± 1%               1.33M ± 0%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·4                                               1.77M ± 0%               1.76M ± 0%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·8                                               1.99M ± 1%               2.00M ± 2%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·12                                              2.03M ± 1%               2.03M ± 0%     ~     (p=0.556 n=4+5)
      fs1-zwrk.go·16                                              2.03M ± 0%               2.03M ± 0%     ~     (p=0.111 n=5+4)
      zeo/py/fs1-zwrk.go·1                                        5.79k ± 3%               6.83k ± 2%  +18.03%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        8.55k ± 1%               8.70k ± 1%   +1.74%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        9.28k ± 7%               9.54k ± 2%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        9.72k ± 1%               9.77k ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        10.4k ± 1%               10.5k ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       10.5k ± 1%               10.6k ± 1%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       10.4k ± 4%               10.7k ± 1%   +2.75%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               4.90k ± 7%               5.51k ± 3%  +12.34%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               6.28k ± 4%               6.38k ± 3%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               6.32k ± 5%               6.27k ± 5%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               6.45k ± 2%               6.54k ± 0%   +1.35%  (p=0.032 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·8                               6.45k ± 2%               6.48k ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              6.31k ± 3%               6.43k ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              6.36k ± 5%               6.41k ± 3%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  3.50k ± 9%               4.25k ± 7%  +21.25%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  4.05k ± 6%               4.92k ± 1%  +21.64%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  4.06k ± 7%               4.85k ± 3%  +19.49%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  3.98k ± 4%               4.90k ± 2%  +22.98%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  4.15k ± 3%               4.89k ± 1%  +17.81%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 4.00k ± 5%               4.90k ± 3%  +22.72%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.96k ±11%               4.81k ± 7%  +21.32%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                        17.1k ± 1%               17.4k ± 2%   +2.02%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                        32.6k ± 0%               32.8k ± 1%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·3                                        43.3k ± 0%               43.2k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·4                                        52.9k ± 0%               52.9k ± 0%     ~     (p=0.905 n=5+4)
      neo/go/fs1-zwrk.go·8                                        66.3k ± 1%               65.4k ± 1%     ~     (p=0.063 n=4+5)
      neo/go/fs1-zwrk.go·12                                       61.6k ± 1%               59.6k ± 4%   -3.20%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·16                                       55.6k ± 4%               53.9k ± 2%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          19.6k ± 5%               20.1k ± 2%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          40.3k ± 0%               39.9k ± 5%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          51.6k ± 0%               51.7k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          62.0k ± 0%               62.5k ± 0%   +0.78%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          74.2k ± 4%               74.0k ± 3%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         64.8k ± 7%               66.8k ± 3%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         59.5k ± 4%               58.6k ± 2%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     9.02k ± 1%               9.16k ± 1%   +1.58%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     16.0k ± 0%               16.0k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     21.8k ± 1%               21.8k ± 0%     ~     (p=0.730 n=4+5)
      neo/go/sqlite-zwrk.go·4                                     26.2k ± 0%               26.2k ± 1%     ~     (p=0.905 n=5+4)
      neo/go/sqlite-zwrk.go·8                                     30.0k ± 2%               29.9k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    28.6k ± 2%               28.5k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    28.7k ± 1%               28.9k ± 2%     ~     (p=0.730 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              9.45k ± 1%               9.51k ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              16.6k ± 1%               16.5k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              23.0k ± 0%               22.7k ± 0%   -1.37%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              28.0k ± 1%               27.4k ± 0%   -2.02%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              32.3k ± 0%               30.4k ±12%   -5.86%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             30.6k ± 2%               29.6k ± 2%   -3.24%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             30.3k ± 2%               29.5k ± 2%   -2.73%  (p=0.008 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zwrk.go·1                                              4.36µs ± 0%              4.37µs ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·2                                              4.52µs ± 1%              4.56µs ± 0%     ~     (p=0.111 n=5+4)
      fs1-zwrk.go·3                                              4.53µs ± 1%              4.54µs ± 1%     ~     (p=0.881 n=5+5)
      fs1-zwrk.go·4                                              4.61µs ± 1%              4.62µs ± 0%     ~     (p=0.889 n=5+5)
      fs1-zwrk.go·8                                              8.10µs ± 0%              8.37µs ±12%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                             11.8µs ± 0%              11.8µs ± 0%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·16                                             16.5µs ±13%              15.8µs ± 0%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        194µs ± 1%               171µs ± 1%  -11.93%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        282µs ± 1%               284µs ± 5%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        388µs ± 1%               383µs ± 1%   -1.27%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        502µs ± 5%               496µs ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        964µs ± 2%               952µs ± 2%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.47ms ± 1%              1.43ms ± 2%   -2.98%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.94ms ± 1%              1.89ms ± 1%   -2.77%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               232µs ± 4%               198µs ± 3%  -14.97%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               319µs ± 5%               313µs ± 0%     ~     (p=0.730 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·3                               470µs ± 0%               469µs ± 1%     ~     (p=0.343 n=4+4)
      neo/py(!log)/sqlite-zwrk.go·4                               651µs ± 5%               656µs ± 5%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.28ms ± 4%              1.29ms ±10%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.90ms ± 2%              1.91ms ± 6%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.56ms ± 4%              2.60ms ± 6%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  323µs ± 6%               242µs ± 1%  -24.90%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  503µs ± 2%               421µs ± 5%  -16.28%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  742µs ± 3%               639µs ± 4%  -13.97%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  986µs ± 4%               838µs ± 2%  -15.02%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.11ms ± 8%              1.71ms ± 4%  -18.91%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.02ms ± 3%              2.57ms ± 3%  -14.83%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.06ms ± 1%              3.39ms ± 3%  -16.33%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                       77.8µs ± 0%              78.2µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·2                                       80.6µs ± 0%              80.0µs ± 1%     ~     (p=0.063 n=4+5)
      neo/go/fs1-zwrk.go·3                                       92.8µs ± 0%              93.1µs ± 2%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·4                                       98.2µs ± 0%              97.7µs ± 0%   -0.47%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        147µs ± 1%               146µs ± 0%   -0.66%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·12                                       212µs ± 1%               212µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       293µs ± 1%               294µs ± 2%     ~     (p=0.556 n=4+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         52.7µs ± 2%              51.8µs ± 2%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         53.0µs ± 0%              52.9µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         62.5µs ± 1%              62.2µs ± 0%   -0.50%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         67.8µs ± 0%              67.6µs ± 0%   -0.39%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          103µs ± 1%               102µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         146µs ± 2%               145µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         199µs ± 1%               199µs ± 2%     ~     (p=0.794 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     124µs ± 4%               121µs ± 1%   -2.17%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     134µs ± 0%               134µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     145µs ± 0%               144µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     161µs ± 0%               161µs ± 0%   -0.38%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     252µs ± 1%               253µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    390µs ± 5%               382µs ± 1%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    526µs ± 2%               524µs ± 3%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              112µs ± 1%               110µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              124µs ± 1%               123µs ± 1%   -0.87%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              133µs ± 0%               133µs ± 0%     ~     (p=0.905 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              143µs ± 0%               145µs ± 0%   +0.83%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              228µs ± 1%               232µs ± 1%   +1.81%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             346µs ± 1%               359µs ± 2%   +3.82%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             486µs ±11%               486µs ± 2%     ~     (p=0.151 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zwrk.go·1                                              2.22µs ± 1%              2.22µs ± 1%     ~     (p=0.889 n=5+5)
      fs1-zwrk.go·2                                              2.24µs ± 0%              2.30µs ± 9%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·3                                              2.25µs ± 1%              2.25µs ± 0%     ~     (p=0.738 n=5+5)
      fs1-zwrk.go·4                                              2.26µs ± 0%              2.27µs ± 0%     ~     (p=0.286 n=5+5)
      fs1-zwrk.go·8                                              4.02µs ± 1%              4.00µs ± 2%     ~     (p=0.460 n=5+5)
      fs1-zwrk.go·12                                             5.92µs ± 1%              5.91µs ± 0%     ~     (p=0.619 n=4+5)
      fs1-zwrk.go·16                                             7.87µs ± 0%              7.88µs ± 0%     ~     (p=0.127 n=5+4)
      zeo/py/fs1-zwrk.go·1                                        173µs ± 3%               146µs ± 2%  -15.31%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        234µs ± 1%               230µs ± 1%   -1.71%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        324µs ± 7%               315µs ± 2%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        412µs ± 1%               409µs ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        768µs ± 1%               765µs ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.14ms ± 1%              1.13ms ± 1%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.54ms ± 4%              1.49ms ± 1%   -2.71%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               204µs ± 8%               182µs ± 3%  -11.14%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               319µs ± 4%               314µs ± 3%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               475µs ± 5%               479µs ± 5%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               620µs ± 2%               612µs ± 0%   -1.34%  (p=0.032 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·8                              1.24ms ± 2%              1.23ms ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.90ms ± 3%              1.87ms ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.52ms ± 5%              2.49ms ± 3%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  287µs ± 8%               236µs ± 8%  -17.73%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  495µs ± 6%               406µs ± 1%  -17.95%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  740µs ± 8%               618µs ± 3%  -16.50%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.01ms ± 4%              0.82ms ± 2%  -18.75%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.93ms ± 3%              1.64ms ± 1%  -15.14%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.01ms ± 4%              2.45ms ± 3%  -18.53%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.05ms ±10%              3.33ms ± 8%  -17.74%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                       58.5µs ± 1%              57.4µs ± 2%   -1.98%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                       61.4µs ± 0%              61.1µs ± 1%     ~     (p=0.238 n=5+5)
      neo/go/fs1-zwrk.go·3                                       69.3µs ± 0%              69.4µs ± 0%     ~     (p=0.881 n=5+5)
      neo/go/fs1-zwrk.go·4                                       75.6µs ± 0%              75.6µs ± 0%     ~     (p=0.952 n=5+4)
      neo/go/fs1-zwrk.go·8                                        121µs ± 1%               122µs ± 1%     ~     (p=0.063 n=4+5)
      neo/go/fs1-zwrk.go·12                                       195µs ± 1%               201µs ± 4%   +3.35%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·16                                       288µs ± 4%               297µs ± 2%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         50.9µs ± 5%              49.8µs ± 2%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         49.7µs ± 0%              50.1µs ± 5%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         58.2µs ± 0%              58.0µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         64.5µs ± 0%              64.0µs ± 0%   -0.77%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          108µs ± 4%               108µs ± 3%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         185µs ± 8%               180µs ± 3%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         269µs ± 4%               273µs ± 2%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     111µs ± 1%               109µs ± 1%   -1.55%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     125µs ± 0%               125µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     137µs ± 1%               137µs ± 0%     ~     (p=0.730 n=4+5)
      neo/go/sqlite-zwrk.go·4                                     153µs ± 0%               153µs ± 1%     ~     (p=0.905 n=5+4)
      neo/go/sqlite-zwrk.go·8                                     267µs ± 1%               267µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    420µs ± 2%               421µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    558µs ± 1%               554µs ± 2%     ~     (p=0.730 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              106µs ± 1%               105µs ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              121µs ± 1%               121µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              130µs ± 0%               132µs ± 0%   +1.39%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              143µs ± 1%               146µs ± 0%   +2.06%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              248µs ± 0%               264µs ±13%   +6.65%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             393µs ± 2%               406µs ± 2%   +3.34%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             528µs ± 2%               543µs ± 2%   +2.81%  (p=0.008 n=5+5)
      f40c8b4b
    • Kirill Smelkov's avatar
      X deco: localhost timings, C > C1 disabled · 0867c981
      Kirill Smelkov authored
      Probably what is above noise is:
      
      ---- 8< ----
      cluster:deco dataset:wczblk1-8
      zeo/py/fs1-zhash.go                                         126µs ± 1%               112µs ± 1%  -10.86%  (p=0.008 n=5+5)
      
      zeo/py/fs1-zwrk.go·1                                        9.12k ± 0%               8.04k ± 4%  -11.87%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        11.6k ± 1%                9.5k ± 1%  -17.54%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        13.4k ± 1%               10.5k ± 0%  -21.56%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        14.0k ± 1%               11.0k ± 1%  -21.81%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        14.7k ± 1%               11.4k ± 1%  -22.03%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       15.0k ± 1%               11.7k ± 0%  -22.09%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       15.1k ± 0%               11.8k ± 2%  -22.32%  (p=0.008 n=5+5)
      
      zeo/py/fs1-zwrk.go·1                                        110µs ± 0%               125µs ± 4%  +13.55%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        173µs ± 1%               210µs ± 1%  +21.27%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        224µs ± 1%               286µs ± 0%  +27.49%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        286µs ± 1%               365µs ± 1%  +27.90%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        545µs ± 1%               699µs ± 1%  +28.25%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       802µs ± 1%              1029µs ± 0%  +28.35%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.06ms ± 0%              1.36ms ± 2%  +28.74%  (p=0.008 n=5+5)
      ---- 8< ----
      
      however it strangely shows that serial zeo-zhash.go latency improved
      126µs -> 112µs and serial zeo-zwrk.go latency got worse 110µs -> 125µs,
      so probably it is all noise and I will remeasure.
      
      Otherwise no significant change.
      
      $ benchstat -split node,cluster,dataset 20180306-deco-ffixed-c.txt 20180306-deco-ffixed-noc_C1\(2µs\).txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:deco
      pystone                                                      217k ± 4%                218k ± 2%     ~     (p=0.841 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:deco
      crc32/py/4K                                                5.73µs ± 0%              5.72µs ± 0%     ~     (p=0.151 n=5+5)
      crc32/go/4K                                                 279ns ± 0%               280ns ± 1%     ~     (p=0.444 n=5+5)
      sha1/py/4K                                                 6.74µs ± 1%              6.72µs ± 1%     ~     (p=0.310 n=5+5)
      sha1/go/4K                                                 5.60µs ± 0%              5.59µs ± 0%   -0.16%  (p=0.016 n=5+4)
      unzlib/py/wczdata                                          27.2µs ± 1%              27.2µs ± 1%     ~     (p=0.690 n=5+5)
      unzlib/go/wczdata                                          27.0µs ± 0%              26.8µs ± 0%   -0.49%  (p=0.032 n=5+5)
      unzlib/py/prod1-avg                                        5.14µs ± 3%              5.08µs ± 1%     ~     (p=0.690 n=5+5)
      unzlib/go/prod1-avg                                        5.30µs ± 1%              5.29µs ± 1%     ~     (p=0.151 n=5+5)
      disk/randread/direct/4K-min                                 104µs ± 2%               105µs ± 0%   +1.23%  (p=0.016 n=5+5)
      disk/randread/direct/4K-avg                                 141µs ± 0%               142µs ± 0%   +0.60%  (p=0.008 n=5+5)
      disk/randread/pagecache/4K-min                              579ns ± 2%               582ns ± 0%     ~     (p=0.548 n=5+5)
      disk/randread/pagecache/4K-avg                              993ns ± 0%               987ns ± 0%   -0.60%  (p=0.008 n=5+5)
      
      name                                           old time/object          new time/object          delta
      cluster:deco dataset:wczblk1-8
      fs1-zhash.py                                               20.3µs ± 1%              20.2µs ± 1%     ~     (p=0.444 n=4+5)
      fs1-zhash.go                                               3.26µs ± 4%              3.20µs ± 0%     ~     (p=0.444 n=5+5)
      fs1-zhash.go+prefetch128                                   4.04µs ± 1%              4.14µs ± 1%     ~     (p=0.079 n=5+5)
      zeo/py/fs1-zhash.py                                         383µs ± 5%               361µs ± 3%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zhash.go                                         126µs ± 1%               112µs ± 1%  -10.86%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            63.1µs ± 1%              63.9µs ± 1%   +1.14%  (p=0.040 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                344µs ± 6%               321µs ± 8%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                140µs ± 1%               141µs ± 3%     ~     (p=0.286 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    119µs ± 2%               119µs ± 1%     ~     (p=0.897 n=5+5)
      neo/py(!log)/sql-zhash.py                                   386µs ± 1%               376µs ± 2%     ~     (p=0.114 n=4+4)
      neo/py(!log)/sql-zhash.go                                   183µs ± 3%               187µs ± 5%     ~     (p=0.341 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       164µs ± 3%               164µs ± 2%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.py                                         226µs ± 3%               226µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zhash.go                                        57.1µs ± 0%              57.1µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            24.7µs ± 5%              24.0µs ± 4%   -2.91%  (p=0.048 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          40.2µs ± 1%              40.3µs ± 1%     ~     (p=0.952 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              17.1µs ± 6%              17.2µs ± 4%     ~     (p=0.786 n=5+5)
      neo/go/sqlite-zhash.py                                      272µs ± 3%               253µs ± 1%   -6.99%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                     92.8µs ± 0%              93.7µs ± 1%   +0.99%  (p=0.016 n=4+5)
      neo/go/sqlite-zhash.go+prefetch128                         40.5µs ± 5%              39.5µs ± 6%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              86.5µs ± 2%              86.4µs ± 3%     ~     (p=0.571 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  38.8µs ± 9%              39.4µs ± 7%     ~     (p=0.730 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zhash.py                                               15.8µs ± 3%              15.9µs ± 2%     ~     (p=0.413 n=4+5)
      fs1-zhash.go                                               2.80µs ± 0%              2.80µs ± 0%     ~     (all equal)
      fs1-zhash.go+prefetch128                                   3.42µs ± 8%              3.34µs ± 2%     ~     (p=0.683 n=5+5)
      zeo/py/fs1-zhash.py                                         361µs ± 5%               347µs ± 3%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zhash.go                                         105µs ± 0%               105µs ± 0%   -0.42%  (p=0.016 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            58.9µs ± 1%              58.9µs ± 1%     ~     (p=0.508 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                344µs ± 7%               317µs ± 5%   -7.93%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                137µs ± 2%               138µs ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    114µs ± 1%               112µs ± 1%   -1.48%  (p=0.024 n=5+5)
      neo/py(!log)/sql-zhash.py                                   380µs ± 4%               377µs ± 2%     ~     (p=1.000 n=4+4)
      neo/py(!log)/sql-zhash.go                                   180µs ± 1%               184µs ± 2%   +2.44%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       159µs ± 1%               160µs ± 2%     ~     (p=0.889 n=5+5)
      neo/go/fs1-zhash.py                                         221µs ± 1%               225µs ± 1%   +1.59%  (p=0.016 n=5+5)
      neo/go/fs1-zhash.go                                        45.2µs ± 2%              44.6µs ± 0%   -1.37%  (p=0.016 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            17.6µs ± 2%              17.2µs ± 3%     ~     (p=0.087 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          39.1µs ± 2%              39.1µs ± 3%     ~     (p=0.659 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              14.6µs ± 4%              15.2µs ± 3%   +4.25%  (p=0.024 n=5+5)
      neo/go/sqlite-zhash.py                                      271µs ± 2%               254µs ± 1%   -6.14%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                     86.4µs ± 0%              86.3µs ± 0%     ~     (p=0.325 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         35.8µs ± 2%              36.6µs ± 5%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              84.0µs ± 1%              83.8µs ± 2%     ~     (p=0.952 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  36.5µs ± 5%              36.9µs ± 8%     ~     (p=1.000 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:deco dataset:wczblk1-8
      fs1-zwrk.go·1                                                436k ± 0%                431k ± 1%   -1.23%  (p=0.008 n=5+5)
      fs1-zwrk.go·2                                                744k ± 1%                760k ± 3%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·3                                               1.09M ± 0%               1.08M ± 2%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·4                                               1.16M ± 1%               1.16M ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·8                                               1.27M ± 1%               1.27M ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·12                                              1.27M ± 1%               1.28M ± 1%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·16                                              1.27M ± 1%               1.28M ± 1%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        9.12k ± 0%               8.04k ± 4%  -11.87%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        11.6k ± 1%                9.5k ± 1%  -17.54%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        13.4k ± 1%               10.5k ± 0%  -21.56%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        14.0k ± 1%               11.0k ± 1%  -21.81%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        14.7k ± 1%               11.4k ± 1%  -22.03%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       15.0k ± 1%               11.7k ± 0%  -22.09%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       15.1k ± 0%               11.8k ± 2%  -22.32%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.09k ± 1%               7.04k ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.48k ± 1%               8.52k ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.48k ± 1%               8.51k ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.47k ± 1%               8.50k ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.43k ± 1%               8.53k ± 1%   +1.16%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.46k ± 1%               8.48k ± 2%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.46k ± 1%               8.48k ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.51k ± 1%               5.37k ± 3%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.32k ± 1%               6.34k ± 0%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.29k ± 1%               6.28k ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.27k ± 1%               6.29k ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.27k ± 1%               6.29k ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.29k ± 0%               6.25k ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.22k ± 1%               6.23k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                        18.4k ± 1%               18.4k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·2                                        38.1k ± 1%               38.3k ± 1%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·3                                        46.0k ± 1%               45.9k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·4                                        50.2k ± 1%               50.0k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·8                                        61.0k ± 0%               60.3k ± 1%   -1.09%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       62.1k ± 1%               62.1k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       62.5k ± 1%               61.6k ± 1%   -1.37%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.3k ± 1%               26.3k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          55.3k ± 1%               55.7k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          62.7k ± 1%               62.8k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          69.3k ± 1%               69.4k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          88.2k ± 0%               88.3k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         93.4k ± 0%               93.5k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         93.5k ± 2%               93.8k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.0k ± 1%               11.0k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     18.4k ± 1%               18.3k ± 1%     ~     (p=0.556 n=5+4)
      neo/go/sqlite-zwrk.go·3                                     24.4k ± 1%               24.2k ± 0%   -0.73%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.8k ± 0%               26.8k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     30.4k ± 2%               29.6k ± 2%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    30.5k ± 1%               29.3k ± 2%   -4.15%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    29.9k ± 2%               28.6k ± 1%   -4.50%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.9k ± 1%               11.9k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              19.7k ± 0%               19.6k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              26.5k ± 1%               26.4k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              30.0k ± 0%               30.0k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              31.2k ± 2%               31.2k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             28.9k ± 1%               28.8k ± 3%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             28.4k ± 2%               28.4k ± 1%     ~     (p=0.841 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zwrk.go·1                                                555k ± 0%                556k ± 0%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·2                                               1.01M ± 3%               0.99M ± 6%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·3                                               1.32M ± 1%               1.33M ± 2%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·4                                               1.55M ± 2%               1.53M ± 0%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·8                                               1.59M ± 0%               1.59M ± 1%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·12                                              1.59M ± 0%               1.60M ± 1%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·16                                              1.59M ± 0%               1.59M ± 0%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        9.70k ± 0%               9.75k ± 1%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        12.4k ± 1%               12.4k ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        14.2k ± 1%               14.2k ± 1%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        14.9k ± 0%               14.9k ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        15.6k ± 0%               15.6k ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       15.2k ±11%               16.0k ± 1%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       16.1k ± 1%               16.0k ± 6%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.44k ± 1%               7.45k ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.59k ± 1%               8.71k ± 1%   +1.33%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.61k ± 1%               8.69k ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.57k ± 1%               8.61k ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.56k ± 1%               8.61k ± 1%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.51k ± 1%               8.59k ± 1%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.54k ± 1%               8.60k ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.55k ± 2%               5.45k ± 2%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.36k ± 1%               6.25k ± 1%   -1.67%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.31k ± 0%               6.24k ± 1%   -1.09%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.28k ± 0%               6.27k ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.34k ± 1%               6.28k ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.35k ± 1%               6.33k ± 0%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.36k ± 0%               6.30k ± 1%   -0.95%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                        23.7k ± 0%               23.9k ± 0%   +0.71%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                        45.4k ± 0%               45.5k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·3                                        55.2k ± 1%               55.1k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·4                                        60.7k ± 2%               60.4k ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·8                                        70.9k ± 2%               69.2k ± 2%   -2.41%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·12                                       71.1k ± 3%               68.0k ± 5%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·16                                       71.0k ± 3%               68.1k ± 3%   -4.07%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          27.3k ± 0%               27.2k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          55.4k ± 1%               55.5k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          64.0k ± 1%               64.0k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          69.0k ± 1%               69.1k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          80.9k ± 2%               81.1k ± 4%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         78.3k ± 5%               77.8k ± 8%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         75.4k ± 3%               76.8k ± 5%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.7k ± 1%               11.7k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     19.0k ± 0%               18.9k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     24.5k ± 1%               24.4k ± 2%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.3k ± 1%               26.0k ± 3%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     24.9k ± 3%               24.6k ± 5%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    24.0k ± 5%               23.7k ± 3%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    25.4k ± 1%               24.1k ± 3%   -5.14%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              12.2k ± 0%               12.2k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              19.8k ± 0%               19.6k ± 1%   -0.81%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              26.2k ± 1%               25.5k ± 1%   -2.65%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              28.7k ± 1%               27.5k ± 2%   -4.20%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              27.2k ± 3%               25.6k ± 2%   -5.54%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             25.3k ± 2%               24.0k ± 2%   -5.13%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             25.3k ± 1%               24.2k ± 1%   -4.63%  (p=0.008 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:deco dataset:wczblk1-8
      fs1-zwrk.go·1                                              2.29µs ± 0%              2.32µs ± 1%   +1.24%  (p=0.008 n=5+5)
      fs1-zwrk.go·2                                              2.69µs ± 1%              2.63µs ± 3%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·3                                              2.76µs ± 0%              2.78µs ± 2%     ~     (p=0.079 n=5+5)
      fs1-zwrk.go·4                                              3.44µs ± 1%              3.44µs ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·8                                              6.28µs ± 1%              6.28µs ± 1%     ~     (p=0.984 n=5+5)
      fs1-zwrk.go·12                                             9.46µs ± 1%              9.40µs ± 1%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·16                                             12.6µs ± 1%              12.5µs ± 1%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        110µs ± 0%               125µs ± 4%  +13.55%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        173µs ± 1%               210µs ± 1%  +21.27%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        224µs ± 1%               286µs ± 0%  +27.49%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        286µs ± 1%               365µs ± 1%  +27.90%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        545µs ± 1%               699µs ± 1%  +28.25%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       802µs ± 1%              1029µs ± 0%  +28.35%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.06ms ± 0%              1.36ms ± 2%  +28.74%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               141µs ± 1%               142µs ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               236µs ± 1%               235µs ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               354µs ± 1%               353µs ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               472µs ± 1%               470µs ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               949µs ± 1%               938µs ± 1%   -1.15%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.42ms ± 1%              1.41ms ± 2%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.89ms ± 1%              1.89ms ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  181µs ± 1%               186µs ± 3%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  317µs ± 1%               315µs ± 0%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  477µs ± 1%               478µs ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  638µs ± 1%               636µs ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.28ms ± 1%              1.27ms ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.91ms ± 0%              1.92ms ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.57ms ± 1%              2.57ms ± 2%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                       54.2µs ± 1%              54.4µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·2                                       52.5µs ± 1%              52.2µs ± 1%     ~     (p=0.333 n=5+5)
      neo/go/fs1-zwrk.go·3                                       65.3µs ± 1%              65.3µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·4                                       79.6µs ± 1%              80.0µs ± 0%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·8                                        131µs ± 0%               133µs ± 1%   +1.10%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       193µs ± 1%               193µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       256µs ± 1%               260µs ± 1%   +1.38%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         38.0µs ± 1%              38.0µs ± 0%     ~     (p=0.889 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         36.1µs ± 1%              35.9µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         47.8µs ± 1%              47.7µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         57.7µs ± 1%              57.7µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         90.7µs ± 0%              90.6µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         129µs ± 0%               128µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         171µs ± 2%               171µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    90.7µs ± 1%              91.2µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     109µs ± 1%               109µs ± 1%     ~     (p=0.556 n=5+4)
      neo/go/sqlite-zwrk.go·3                                     123µs ± 1%               124µs ± 0%   +0.74%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     149µs ± 0%               149µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     263µs ± 2%               270µs ± 2%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    393µs ± 1%               410µs ± 2%   +4.33%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    534µs ± 2%               560µs ± 1%   +4.70%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             84.0µs ± 1%              84.0µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              102µs ± 0%               102µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              113µs ± 1%               113µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              133µs ± 0%               133µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              257µs ± 2%               257µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             415µs ± 1%               417µs ± 3%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             563µs ± 2%               563µs ± 1%     ~     (p=0.841 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zwrk.go·1                                              1.80µs ± 0%              1.80µs ± 0%     ~     (p=0.413 n=5+5)
      fs1-zwrk.go·2                                              1.98µs ± 3%              2.01µs ± 6%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·3                                              2.27µs ± 1%              2.26µs ± 2%     ~     (p=0.889 n=5+5)
      fs1-zwrk.go·4                                              2.58µs ± 2%              2.61µs ± 0%     ~     (p=0.492 n=5+5)
      fs1-zwrk.go·8                                              5.04µs ± 0%              5.04µs ± 1%     ~     (p=0.730 n=5+5)
      fs1-zwrk.go·12                                             7.55µs ± 0%              7.52µs ± 1%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·16                                             10.0µs ± 0%              10.0µs ± 0%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        103µs ± 0%               103µs ± 1%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        162µs ± 1%               161µs ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        212µs ± 1%               212µs ± 1%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        269µs ± 0%               268µs ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        512µs ± 0%               512µs ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       793µs ±12%               752µs ± 1%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       991µs ± 1%              1001µs ± 6%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               134µs ± 1%               134µs ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               233µs ± 1%               230µs ± 1%   -1.31%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               348µs ± 1%               345µs ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               467µs ± 1%               465µs ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               935µs ± 1%               929µs ± 1%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.41ms ± 1%              1.40ms ± 1%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.87ms ± 1%              1.86ms ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  180µs ± 2%               184µs ± 2%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  315µs ± 1%               320µs ± 1%   +1.69%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  475µs ± 0%               481µs ± 1%   +1.11%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  637µs ± 0%               638µs ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.26ms ± 1%              1.27ms ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.89ms ± 1%              1.89ms ± 0%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.52ms ± 0%              2.54ms ± 1%   +0.96%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                       42.2µs ± 0%              41.9µs ± 0%   -0.70%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                       44.1µs ± 0%              44.0µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·3                                       54.4µs ± 1%              54.5µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·4                                       65.9µs ± 2%              66.2µs ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·8                                        113µs ± 2%               116µs ± 2%   +2.48%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·12                                       169µs ± 4%               177µs ± 5%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·16                                       225µs ± 3%               235µs ± 3%   +4.24%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         36.6µs ± 0%              36.8µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         36.1µs ± 1%              36.0µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         46.9µs ± 1%              46.9µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         57.9µs ± 1%              57.9µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         98.9µs ± 2%              98.6µs ± 4%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         153µs ± 5%               155µs ± 8%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         212µs ± 3%               208µs ± 5%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    85.1µs ± 1%              85.5µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     105µs ± 0%               106µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     123µs ± 1%               123µs ± 2%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     152µs ± 1%               154µs ± 3%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     321µs ± 3%               325µs ± 5%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    500µs ± 5%               507µs ± 3%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    630µs ± 1%               665µs ± 3%   +5.46%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             82.0µs ± 0%              82.3µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              101µs ± 0%               102µs ± 1%   +0.82%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              115µs ± 1%               118µs ± 1%   +2.73%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              139µs ± 1%               145µs ± 2%   +4.40%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              295µs ± 3%               312µs ± 2%   +5.87%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             474µs ± 2%               500µs ± 2%   +5.41%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             632µs ± 1%               662µs ± 1%   +4.85%  (p=0.008 n=5+5)
      0867c981
    • Kirill Smelkov's avatar
      X rio: localhost timings, Cenabled · 31dc070d
      Kirill Smelkov authored
      Compared to yesterday shows relatively no significant change, though
      some benchmarks, like on neo1 & z6001, are itself noisy.
      
      Disk, like on neo1 is not stable from run to run (though it still shows
      a magnitude).
      
      $ benchstat -split node,cluster,dataset 20180305-rio-ffixed-c.txt 20180306-rio-ffixed-c.txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:rio
      pystone                                                      146k ± 1%                115k ±12%   -21.20%  (p=0.008 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:rio
      crc32/py/4K                                                4.76µs ± 0%              4.77µs ± 0%      ~     (p=0.730 n=5+4)
      crc32/go/4K                                                1.49µs ± 0%              1.49µs ± 0%    +0.22%  (p=0.016 n=4+5)
      sha1/py/4K                                                 8.02µs ± 2%              8.04µs ± 1%      ~     (p=0.500 n=5+5)
      sha1/go/4K                                                 8.95µs ± 0%              8.93µs ± 0%      ~     (p=0.397 n=4+5)
      unzlib/py/wczdata                                          25.0µs ± 0%              25.1µs ± 1%      ~     (p=0.778 n=4+5)
      unzlib/go/wczdata                                          23.0µs ± 0%              23.0µs ± 0%      ~     (p=0.548 n=5+5)
      unzlib/py/prod1-avg                                        7.25µs ± 3%              7.16µs ± 1%      ~     (p=0.151 n=5+5)
      unzlib/go/prod1-avg                                        5.07µs ± 0%              5.08µs ± 1%      ~     (p=0.841 n=5+5)
      disk/randread/direct/4K-min                                38.4µs ± 1%              92.4µs ± 0%  +140.70%  (p=0.008 n=5+5)
      disk/randread/direct/4K-avg                                96.9µs ± 0%             115.0µs ± 0%   +18.72%  (p=0.008 n=5+5)
      disk/randread/pagecache/4K-min                              571ns ± 1%               565ns ± 2%      ~     (p=0.167 n=5+5)
      disk/randread/pagecache/4K-avg                             1.01µs ± 0%              0.99µs ± 0%    -1.78%  (p=0.029 n=4+4)
      
      name                                           old time/object          new time/object          delta
      cluster:rio dataset:wczblk1-8
      fs1-zhash.py                                               28.7µs ± 2%              29.2µs ± 1%      ~     (p=0.063 n=5+4)
      fs1-zhash.go                                               4.60µs ± 0%              4.68µs ± 5%      ~     (p=0.444 n=5+5)
      fs1-zhash.go+prefetch128                                   4.72µs ± 6%              4.78µs ± 5%      ~     (p=0.460 n=5+5)
      zeo/py/fs1-zhash.py                                         395µs ± 3%               400µs ± 0%      ~     (p=0.690 n=5+5)
      zeo/py/fs1-zhash.go                                         138µs ± 1%               138µs ± 1%      ~     (p=0.897 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            73.5µs ± 1%              74.7µs ± 2%    +1.66%  (p=0.048 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                330µs ± 6%               318µs ± 7%      ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                157µs ± 4%               154µs ± 4%      ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    126µs ± 3%               125µs ± 3%      ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zhash.py                                   392µs ±45%               400µs ±57%      ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zhash.go                                   181µs ± 2%               183µs ±11%      ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       159µs ± 4%               158µs ± 3%      ~     (p=0.841 n=5+5)
      neo/go/fs1-zhash.py                                         228µs ± 2%               222µs ± 4%      ~     (p=0.079 n=5+5)
      neo/go/fs1-zhash.go                                        68.5µs ± 1%              68.6µs ± 2%      ~     (p=0.714 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            29.4µs ± 5%              29.0µs ± 6%      ~     (p=0.381 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          44.2µs ± 2%              43.9µs ± 3%      ~     (p=0.770 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              19.1µs ± 3%              18.8µs ± 5%      ~     (p=0.643 n=5+5)
      neo/go/sqlite-zhash.py                                      265µs ± 5%               273µs ± 3%      ~     (p=0.095 n=5+5)
      neo/go/sqlite-zhash.go                                      104µs ± 1%               104µs ± 1%      ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         38.6µs ± 6%              36.3µs ± 3%    -6.16%  (p=0.048 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              92.9µs ± 2%              94.2µs ± 3%      ~     (p=0.095 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  35.7µs ± 6%              35.1µs ± 6%      ~     (p=0.413 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zhash.py                                               23.9µs ± 1%              23.9µs ± 1%      ~     (p=1.000 n=5+4)
      fs1-zhash.go                                               3.40µs ± 0%              3.40µs ± 0%      ~     (all equal)
      fs1-zhash.go+prefetch128                                   3.00µs ± 0%              3.02µs ± 9%      ~     (p=0.444 n=5+5)
      zeo/py/fs1-zhash.py                                         367µs ± 5%               372µs ±10%      ~     (p=1.000 n=5+5)
      zeo/py/fs1-zhash.go                                         114µs ± 3%               114µs ± 1%      ~     (p=0.421 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            64.6µs ± 0%              64.6µs ± 1%      ~     (p=0.913 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                314µs ± 8%               321µs ±11%      ~     (p=0.952 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                144µs ± 2%               142µs ± 3%      ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    115µs ± 1%               117µs ± 1%      ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zhash.py                                   378µs ±44%               330µs ± 1%      ~     (p=0.286 n=5+4)
      neo/py(!log)/sql-zhash.go                                   174µs ± 5%               172µs ± 1%      ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       149µs ± 1%               149µs ± 2%      ~     (p=0.952 n=5+5)
      neo/go/fs1-zhash.py                                         218µs ± 1%               217µs ± 1%      ~     (p=0.857 n=4+5)
      neo/go/fs1-zhash.go                                        49.9µs ± 1%              49.8µs ± 2%      ~     (p=0.984 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            19.0µs ± 1%              18.8µs ± 1%      ~     (p=0.143 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          40.4µs ± 3%              40.4µs ± 3%      ~     (p=0.794 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              16.2µs ± 5%              16.1µs ± 2%      ~     (p=1.000 n=5+5)
      neo/go/sqlite-zhash.py                                      266µs ± 3%               263µs ± 4%      ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go                                     94.0µs ± 1%              93.1µs ± 1%    -1.00%  (p=0.040 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         33.0µs ± 4%              32.7µs ± 2%      ~     (p=0.651 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              90.1µs ± 2%              89.6µs ± 1%      ~     (p=0.381 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  32.9µs ± 4%              34.0µs ± 2%      ~     (p=0.063 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:rio dataset:wczblk1-8
      fs1-zwrk.go·1                                                300k ± 0%                300k ± 0%      ~     (p=0.151 n=5+5)
      fs1-zwrk.go·2                                                549k ± 0%                546k ± 0%    -0.53%  (p=0.016 n=4+5)
      fs1-zwrk.go·3                                                811k ± 0%                810k ± 0%      ~     (p=0.421 n=5+5)
      fs1-zwrk.go·4                                               1.07M ± 0%               1.08M ± 0%      ~     (p=0.310 n=5+5)
      fs1-zwrk.go·8                                               1.42M ± 0%               1.42M ± 0%      ~     (p=0.841 n=5+5)
      fs1-zwrk.go·12                                              1.54M ± 0%               1.55M ± 0%      ~     (p=0.310 n=5+5)
      fs1-zwrk.go·16                                              1.55M ± 0%               1.55M ± 0%      ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        7.55k ± 0%               7.41k ± 1%    -1.87%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        9.17k ± 1%               9.03k ± 1%    -1.60%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        9.74k ± 1%               9.77k ± 1%      ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        10.2k ± 2%               10.1k ± 3%      ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        10.6k ± 2%               10.5k ± 0%      ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       10.5k ± 1%               10.6k ± 1%      ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       10.6k ± 1%               10.6k ± 1%      ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               6.69k ± 4%               6.80k ± 2%      ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.31k ± 9%               8.31k ± 7%      ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               7.96k ± 6%               8.60k ± 1%    +8.12%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.27k ± 9%               8.60k ± 1%    +4.05%  (p=0.016 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·8                               8.42k ± 2%               8.61k ± 1%    +2.20%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.46k ± 1%               8.56k ± 1%    +1.19%  (p=0.032 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.34k ± 4%               8.49k ± 3%      ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.63k ± 1%               5.62k ± 6%      ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.80k ± 2%               6.75k ± 4%      ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.68k ± 2%               6.77k ± 2%      ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.63k ± 3%               6.51k ± 7%      ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.73k ± 2%               6.56k ± 4%      ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.71k ± 1%               6.84k ± 1%    +2.00%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zwrk.go·16                                 6.77k ± 2%               6.73k ± 3%      ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                        15.7k ± 1%               15.5k ± 0%    -1.10%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                        30.2k ± 0%               29.9k ± 1%    -1.04%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                        39.8k ± 0%               39.4k ± 0%    -0.82%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                        49.8k ± 0%               49.4k ± 0%    -0.85%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        69.1k ± 1%               68.4k ± 0%    -0.93%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       73.1k ± 1%               72.5k ± 0%    -0.74%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·16                                       73.8k ± 0%               73.2k ± 0%    -0.81%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          25.5k ± 2%               26.2k ± 1%    +2.41%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          47.9k ± 0%               47.6k ± 0%    -0.60%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          59.8k ± 0%               59.4k ± 0%    -0.63%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          72.7k ± 0%               72.2k ± 0%    -0.75%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          97.0k ± 0%               96.7k ± 0%      ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          110k ± 0%                109k ± 0%    -0.64%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                          114k ± 0%                113k ± 1%      ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     9.84k ± 1%               9.82k ± 0%      ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     18.2k ± 0%               18.3k ± 0%      ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     25.4k ± 0%               25.3k ± 0%      ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     30.3k ± 0%               30.3k ± 0%      ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     39.3k ± 1%               39.5k ± 0%      ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    40.6k ± 2%               40.8k ± 2%      ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    40.5k ± 1%               40.5k ± 2%      ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.1k ± 1%               11.0k ± 1%      ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              20.1k ± 0%               20.0k ± 0%    -0.49%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              27.9k ± 0%               27.9k ± 0%      ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              34.1k ± 1%               34.1k ± 0%      ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              44.2k ± 1%               44.1k ± 1%      ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             43.2k ± 1%               43.1k ± 1%      ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             41.3k ± 2%               41.2k ± 2%      ~     (p=1.000 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zwrk.go·1                                                463k ± 1%                465k ± 1%      ~     (p=0.095 n=5+5)
      fs1-zwrk.go·2                                                882k ± 7%                920k ± 0%    +4.29%  (p=0.016 n=5+4)
      fs1-zwrk.go·3                                               1.36M ± 1%               1.36M ± 1%      ~     (p=0.056 n=5+5)
      fs1-zwrk.go·4                                               1.79M ± 1%               1.81M ± 0%      ~     (p=0.095 n=5+5)
      fs1-zwrk.go·8                                               2.34M ± 2%               2.37M ± 1%      ~     (p=0.151 n=5+5)
      fs1-zwrk.go·12                                              2.40M ± 0%               2.41M ± 0%      ~     (p=0.056 n=5+5)
      fs1-zwrk.go·16                                              2.41M ± 0%               2.42M ± 0%    +0.61%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        8.99k ± 1%               8.98k ± 1%      ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        11.8k ± 1%               11.7k ± 1%    -1.10%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        12.9k ± 1%               12.9k ± 2%      ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        13.4k ± 3%               13.4k ± 4%      ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        14.1k ± 1%               14.0k ± 2%      ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       14.4k ± 2%               14.2k ± 2%      ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       14.4k ± 1%               14.2k ± 3%      ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.18k ± 2%               7.16k ± 4%      ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.65k ± 3%               8.75k ± 1%      ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.63k ± 1%               8.65k ± 4%      ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.67k ± 1%               8.53k ± 6%      ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.47k ± 6%               8.61k ± 3%      ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.45k ± 5%               8.64k ± 0%      ~     (p=0.286 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·16                              8.37k ± 3%               8.64k ± 1%    +3.14%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.91k ± 3%               5.88k ± 1%      ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.86k ± 3%               6.79k ± 2%      ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.91k ± 4%               6.58k ± 4%    -4.75%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.84k ± 2%               6.68k ± 4%      ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.98k ± 1%               6.83k ± 1%    -2.17%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.84k ± 6%               6.66k ± 4%      ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.92k ± 4%               6.65k ± 5%      ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·1                                        21.8k ± 0%               21.8k ± 1%      ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·2                                        39.4k ± 1%               39.2k ± 1%      ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·3                                        51.6k ± 0%               51.4k ± 0%    -0.37%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                        62.9k ± 0%               62.8k ± 0%      ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·8                                        80.3k ± 2%               80.7k ± 1%      ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·12                                       79.7k ± 2%               80.0k ± 2%      ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·16                                       78.1k ± 4%               78.3k ± 2%      ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.5k ± 2%               26.5k ± 1%      ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          49.2k ± 0%               48.8k ± 0%    -0.90%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          62.4k ± 0%               61.8k ± 0%    -0.97%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          74.5k ± 0%               74.0k ± 0%    -0.63%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          92.3k ± 2%               91.3k ± 0%      ~     (p=0.190 n=5+4)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         93.6k ± 4%               93.1k ± 2%      ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         90.7k ± 5%               89.7k ± 2%      ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.0k ± 0%               11.0k ± 1%    +0.63%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     19.4k ± 0%               19.4k ± 1%      ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     26.5k ± 0%               26.6k ± 0%      ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     31.8k ± 1%               31.9k ± 0%      ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     37.5k ± 1%               37.4k ± 2%      ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    36.4k ± 5%               35.2k ± 3%      ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    36.5k ± 3%               34.6k ± 2%    -5.21%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.5k ± 1%               11.5k ± 1%      ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              20.1k ± 1%               20.1k ± 0%      ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              28.0k ± 0%               27.6k ± 0%    -1.43%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              34.0k ± 0%               33.4k ± 0%    -1.74%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              40.2k ± 1%               38.8k ± 2%    -3.35%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             38.1k ± 1%               36.4k ± 1%    -4.51%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             36.8k ± 1%               35.2k ± 2%    -4.47%  (p=0.008 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:rio dataset:wczblk1-8
      fs1-zwrk.go·1                                              3.34µs ± 0%              3.33µs ± 0%      ~     (p=0.222 n=5+5)
      fs1-zwrk.go·2                                              3.65µs ± 0%              3.67µs ± 0%    +0.53%  (p=0.016 n=4+5)
      fs1-zwrk.go·3                                              3.70µs ± 0%              3.70µs ± 0%      ~     (p=0.421 n=5+5)
      fs1-zwrk.go·4                                              3.72µs ± 0%              3.72µs ± 0%      ~     (p=0.341 n=5+5)
      fs1-zwrk.go·8                                              5.62µs ± 0%              5.62µs ± 0%      ~     (p=0.889 n=5+5)
      fs1-zwrk.go·12                                             7.77µs ± 0%              7.76µs ± 0%      ~     (p=0.333 n=5+5)
      fs1-zwrk.go·16                                             10.4µs ± 0%              10.3µs ± 0%      ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        132µs ± 0%               135µs ± 1%    +1.91%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        218µs ± 1%               222µs ± 1%    +1.62%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        308µs ± 1%               307µs ± 1%      ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        392µs ± 2%               398µs ± 3%      ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        754µs ± 2%               759µs ± 0%      ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.15ms ± 1%              1.13ms ± 1%      ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.51ms ± 1%              1.50ms ± 1%      ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               150µs ± 4%               147µs ± 2%      ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               235µs ± 1%               241µs ± 8%      ~     (p=0.556 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·3                               378µs ± 6%               349µs ± 1%    -7.74%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               485µs ± 9%               465µs ± 1%    -4.08%  (p=0.016 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·8                               950µs ± 2%               930µs ± 1%    -2.15%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.42ms ± 1%              1.40ms ± 1%    -1.18%  (p=0.032 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.92ms ± 4%              1.88ms ± 3%      ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  178µs ± 1%               178µs ± 6%      ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  294µs ± 2%               297µs ± 4%      ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  449µs ± 2%               443µs ± 2%      ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  603µs ± 3%               616µs ± 8%      ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.19ms ± 2%              1.22ms ± 5%      ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.79ms ± 1%              1.75ms ± 1%    -1.96%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zwrk.go·16                                2.36ms ± 2%              2.38ms ± 3%      ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                       63.7µs ± 1%              64.4µs ± 0%    +1.11%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                       66.2µs ± 0%              66.8µs ± 1%    +1.05%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                       75.4µs ± 0%              76.1µs ± 0%    +0.82%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                       80.4µs ± 0%              81.0µs ± 0%    +0.85%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        116µs ± 1%               117µs ± 0%    +0.94%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       164µs ± 1%               165µs ± 0%    +0.74%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·16                                       217µs ± 0%               219µs ± 0%    +0.82%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         39.2µs ± 2%              38.2µs ± 1%    -2.37%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         41.8µs ± 0%              42.0µs ± 0%    +0.60%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         50.2µs ± 0%              50.5µs ± 0%    +0.64%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         55.0µs ± 0%              55.4µs ± 0%    +0.76%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         82.5µs ± 0%              82.8µs ± 0%      ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         109µs ± 0%               110µs ± 0%    +0.65%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         141µs ± 0%               142µs ± 1%      ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     102µs ± 1%               102µs ± 0%      ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     110µs ± 0%               110µs ± 0%      ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     118µs ± 0%               119µs ± 0%      ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     132µs ± 0%               132µs ± 0%      ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     204µs ± 1%               203µs ± 0%      ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    296µs ± 2%               294µs ± 2%      ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    395µs ± 1%               395µs ± 2%      ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             90.2µs ± 1%              91.1µs ± 1%      ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              100µs ± 0%               100µs ± 0%    +0.49%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              107µs ± 0%               108µs ± 0%      ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              117µs ± 1%               117µs ± 0%      ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              181µs ± 1%               182µs ± 1%      ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             278µs ± 1%               279µs ± 1%      ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             388µs ± 2%               388µs ± 2%      ~     (p=1.000 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zwrk.go·1                                              2.16µs ± 1%              2.15µs ± 1%      ~     (p=0.079 n=5+5)
      fs1-zwrk.go·2                                              2.27µs ± 7%              2.17µs ± 0%    -4.29%  (p=0.016 n=5+4)
      fs1-zwrk.go·3                                              2.21µs ± 1%              2.20µs ± 1%      ~     (p=0.056 n=5+5)
      fs1-zwrk.go·4                                              2.23µs ± 1%              2.21µs ± 0%      ~     (p=0.087 n=5+5)
      fs1-zwrk.go·8                                              3.42µs ± 2%              3.37µs ± 1%      ~     (p=0.151 n=5+5)
      fs1-zwrk.go·12                                             4.99µs ± 0%              4.97µs ± 0%      ~     (p=0.056 n=5+5)
      fs1-zwrk.go·16                                             6.65µs ± 0%              6.61µs ± 0%    -0.60%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        111µs ± 1%               111µs ± 1%      ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        169µs ± 1%               171µs ± 1%    +1.12%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        233µs ± 1%               233µs ± 2%      ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        298µs ± 3%               298µs ± 4%      ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        567µs ± 1%               572µs ± 2%      ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       835µs ± 2%               844µs ± 2%      ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.11ms ± 1%              1.12ms ± 3%      ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               139µs ± 2%               140µs ± 4%      ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               231µs ± 3%               229µs ± 1%      ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               348µs ± 1%               347µs ± 5%      ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               462µs ± 1%               470µs ± 7%      ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               945µs ± 6%               929µs ± 3%      ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.42ms ± 5%              1.39ms ± 0%      ~     (p=0.286 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·16                             1.91ms ± 3%              1.85ms ± 1%    -3.07%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  169µs ± 3%               170µs ± 1%      ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  292µs ± 3%               294µs ± 2%      ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  434µs ± 4%               456µs ± 4%    +4.99%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  585µs ± 2%               599µs ± 4%      ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.15ms ± 1%              1.17ms ± 1%    +2.21%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.76ms ± 7%              1.80ms ± 4%      ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.31ms ± 4%              2.41ms ± 5%      ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·1                                       45.8µs ± 0%              45.9µs ± 1%      ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·2                                       50.7µs ± 1%              51.0µs ± 1%      ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·3                                       58.1µs ± 0%              58.3µs ± 0%    +0.37%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                       63.6µs ± 0%              63.7µs ± 0%      ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·8                                        100µs ± 1%                99µs ± 1%      ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·12                                       151µs ± 2%               150µs ± 2%      ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·16                                       205µs ± 4%               204µs ± 3%      ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         37.7µs ± 2%              37.7µs ± 1%      ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         40.6µs ± 0%              41.0µs ± 0%    +0.91%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         48.1µs ± 0%              48.5µs ± 0%    +0.98%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         53.7µs ± 0%              54.0µs ± 0%    +0.63%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         86.7µs ± 2%              87.6µs ± 0%      ~     (p=0.190 n=5+4)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         128µs ± 4%               129µs ± 2%      ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         177µs ± 5%               178µs ± 2%      ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    91.3µs ± 0%              90.7µs ± 1%    -0.63%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     103µs ± 0%               103µs ± 1%      ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     113µs ± 0%               113µs ± 0%      ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     126µs ± 1%               125µs ± 0%      ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     214µs ± 1%               214µs ± 2%      ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    330µs ± 5%               341µs ± 3%      ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    438µs ± 3%               462µs ± 2%    +5.47%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             87.2µs ± 1%              86.7µs ± 1%      ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                             99.3µs ± 1%              99.7µs ± 0%      ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              107µs ± 0%               109µs ± 0%    +1.45%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              118µs ± 0%               120µs ± 0%    +1.77%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              199µs ± 1%               206µs ± 2%    +3.47%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             315µs ± 1%               330µs ± 1%    +4.73%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             434µs ± 1%               455µs ± 2%    +4.69%  (p=0.008 n=5+5)
      31dc070d
    • Kirill Smelkov's avatar
      X z6001: localhost timings, Cenabled · 850bfb9d
      Kirill Smelkov authored
      Compared to yesterday shows relatively no significant change, though
      some benchmarks, like on neo1, are itself noisy.
      
      disk/randread/direct/4K-avg changes by 55%, probably showing we should
      be taking into account mdev(=std) ioping gives us, not only averaging
      the average it prints.
      
      $ benchstat -split node,cluster,dataset 20180305-z6001-ffixed-c.txt 20180306-z6001-ffixed-c.txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:z6001
      pystone                                                      112k ± 8%                109k ± 9%     ~     (p=0.548 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:z6001
      crc32/py/4K                                                5.11µs ± 2%              5.11µs ± 1%     ~     (p=0.452 n=5+5)
      crc32/go/4K                                                1.72µs ± 0%              1.72µs ± 0%     ~     (p=1.000 n=4+4)
      sha1/py/4K                                                 17.1µs ±31%              14.7µs ± 1%     ~     (p=0.056 n=5+5)
      sha1/go/4K                                                 10.6µs ± 5%              10.3µs ± 0%     ~     (p=1.000 n=5+5)
      unzlib/py/wczdata                                          36.4µs ± 1%              37.1µs ± 8%     ~     (p=1.000 n=5+5)
      unzlib/go/wczdata                                          31.5µs ± 0%              31.5µs ± 0%     ~     (p=0.151 n=5+5)
      unzlib/py/prod1-avg                                        18.5µs ± 2%              18.5µs ± 3%     ~     (p=0.841 n=5+5)
      unzlib/go/prod1-avg                                        10.0µs ± 0%              10.0µs ± 1%     ~     (p=0.151 n=5+5)
      disk/randread/direct/4K-min                                 125µs ± 1%               126µs ± 1%   +0.92%  (p=0.048 n=5+4)
      disk/randread/direct/4K-avg                                 128µs ± 0%               199µs ± 9%  +55.41%  (p=0.016 n=4+5)
      disk/randread/pagecache/4K-min                              801ns ± 4%               806ns ± 3%     ~     (p=0.452 n=5+5)
      disk/randread/pagecache/4K-avg                             1.39µs ±12%              1.44µs ± 7%     ~     (p=0.643 n=5+5)
      
      name                                           old time/object          new time/object          delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zhash.py                                               37.4µs ± 2%              37.6µs ± 2%     ~     (p=0.579 n=5+5)
      fs1-zhash.go                                               5.94µs ± 1%              6.00µs ± 2%     ~     (p=0.365 n=5+5)
      fs1-zhash.go+prefetch128                                   8.06µs ± 7%              8.00µs ± 5%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zhash.py                                         657µs ±14%               650µs ± 7%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zhash.go                                         273µs ± 4%               274µs ±13%     ~     (p=0.889 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                             101µs ± 2%               101µs ± 2%     ~     (p=0.968 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                694µs ± 1%               696µs ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                326µs ±20%               338µs ± 7%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    174µs ± 2%               177µs ± 1%     ~     (p=0.063 n=5+5)
      neo/py(!log)/sql-zhash.py                                   934µs ± 3%              1000µs ±38%     ~     (p=0.730 n=4+5)
      neo/py(!log)/sql-zhash.go                                   422µs ±11%               434µs ± 6%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       274µs ±10%               277µs ± 9%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.py                                         527µs ±13%               526µs ± 8%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zhash.go                                         103µs ± 6%               102µs ± 8%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            35.7µs ± 3%              36.6µs ± 4%     ~     (p=0.175 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          73.8µs ± 5%              76.4µs ± 5%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              27.2µs ± 6%              26.5µs ± 2%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zhash.py                                      553µs ±14%               528µs ±15%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zhash.go                                      222µs ±17%               204µs ±22%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         39.6µs ± 4%              39.9µs ± 4%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               188µs ±14%               194µs ± 9%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  37.4µs ± 4%              38.2µs ± 7%     ~     (p=0.278 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zhash.py                                               30.3µs ± 3%              30.3µs ± 1%     ~     (p=0.444 n=5+5)
      fs1-zhash.go                                               4.60µs ± 0%              4.62µs ± 3%     ~     (p=0.556 n=4+5)
      fs1-zhash.go+prefetch128                                   5.90µs ± 5%              5.76µs ± 8%     ~     (p=0.476 n=5+5)
      zeo/py/fs1-zhash.py                                         617µs ± 9%               632µs ±15%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zhash.go                                         228µs ± 4%               235µs ± 7%     ~     (p=0.389 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            87.9µs ± 1%              87.2µs ± 1%     ~     (p=0.206 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                665µs ± 3%               664µs ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                285µs ± 4%               269µs ± 7%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    163µs ± 0%               162µs ± 0%   -0.52%  (p=0.029 n=4+4)
      neo/py(!log)/sql-zhash.py                                   970µs ±41%              1029µs ±29%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zhash.go                                   386µs ±11%               406µs ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       261µs ± 3%               268µs ± 5%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zhash.py                                         515µs ±16%               520µs ± 9%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.go                                        82.5µs ± 7%              83.2µs ± 7%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            24.2µs ± 3%              24.0µs ± 5%     ~     (p=0.452 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          70.4µs ± 2%              67.0µs ± 3%   -4.80%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              20.9µs ± 2%              21.2µs ± 4%     ~     (p=0.579 n=5+5)
      neo/go/sqlite-zhash.py                                      527µs ± 9%               539µs ±11%     ~     (p=0.587 n=5+5)
      neo/go/sqlite-zhash.go                                      190µs ±23%               196µs ± 9%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         34.7µs ± 2%              35.0µs ± 3%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               159µs ±21%               168µs ± 8%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  35.4µs ± 1%              35.1µs ± 4%     ~     (p=0.556 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zwrk.go·1                                                231k ± 0%                230k ± 1%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·2                                                444k ± 2%                437k ± 5%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·3                                                667k ± 2%                663k ± 4%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·4                                                877k ± 0%                880k ± 1%     ~     (p=0.286 n=4+5)
      fs1-zwrk.go·8                                               1.74M ± 2%               1.75M ± 2%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·12                                              2.52M ± 3%               2.56M ± 0%     ~     (p=0.190 n=5+4)
      fs1-zwrk.go·16                                              2.88M ± 0%               2.89M ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        4.42k ± 5%               4.30k ± 8%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        6.33k ± 0%               6.33k ± 0%     ~     (p=0.905 n=5+4)
      zeo/py/fs1-zwrk.go·3                                        6.91k ± 0%               6.90k ± 0%     ~     (p=0.730 n=5+4)
      zeo/py/fs1-zwrk.go·4                                        7.12k ± 0%               7.14k ± 1%     ~     (p=0.343 n=4+4)
      zeo/py/fs1-zwrk.go·8                                        7.52k ± 1%               7.53k ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       7.55k ± 2%               7.65k ± 0%     ~     (p=0.111 n=5+4)
      zeo/py/fs1-zwrk.go·16                                       7.67k ± 2%               7.57k ± 0%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               3.41k ±12%               3.50k ±15%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               5.63k ± 0%               5.58k ± 0%   -0.85%  (p=0.016 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·3                               5.54k ± 5%               5.63k ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               5.54k ± 1%               5.56k ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               5.74k ± 1%               5.61k ± 2%   -2.19%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              5.67k ± 1%               5.62k ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              5.64k ± 2%               5.62k ± 1%     ~     (p=0.556 n=5+4)
      neo/py(!log)/sql-zwrk.go·1                                  2.64k ± 8%               2.53k ±17%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  3.63k ± 9%               3.57k ± 9%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  3.91k ± 7%               3.65k ±14%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  3.73k ± 9%               3.56k ±16%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  3.79k ± 5%               3.78k ±12%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 3.65k ±11%               3.73k ±13%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.69k ±14%               3.47k ± 9%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·1                                        10.8k ± 6%               10.7k ± 5%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·2                                        22.5k ± 2%               22.3k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·3                                        31.8k ± 1%               31.7k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·4                                        43.3k ± 0%               43.2k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·8                                        78.1k ± 0%               78.3k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·12                                       92.5k ± 0%               92.5k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                        102k ± 1%                103k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          15.3k ± 5%               15.0k ± 5%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          31.5k ± 1%               31.5k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          43.8k ± 0%               43.8k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          57.6k ± 0%               57.4k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                           100k ± 0%                100k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          116k ± 0%                116k ± 0%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                          126k ± 0%                126k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     5.05k ±10%               4.85k ±15%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     11.8k ± 2%               12.0k ± 2%   +2.47%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     19.0k ± 0%               19.0k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     24.6k ± 1%               24.7k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     44.5k ± 1%               44.8k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    56.3k ± 1%               56.3k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    58.4k ± 0%               58.0k ± 0%   -0.72%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              5.62k ± 7%               5.41k ± 4%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              13.1k ± 3%               12.8k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              20.4k ± 1%               20.2k ± 1%   -1.15%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.1k ± 1%               26.8k ± 1%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              48.4k ± 1%               48.1k ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             60.2k ± 0%               60.3k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             61.6k ± 1%               61.7k ± 1%     ~     (p=0.548 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zwrk.go·1                                                342k ± 4%                347k ± 2%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·2                                                657k ± 6%                660k ± 3%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·3                                                985k ± 4%                985k ± 4%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·4                                               1.29M ± 2%               1.31M ± 2%     ~     (p=0.222 n=5+5)
      fs1-zwrk.go·8                                               2.57M ± 1%               2.55M ± 4%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·12                                              2.81M ± 2%               2.81M ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                              2.85M ± 1%               2.85M ± 2%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        5.07k ± 5%               4.80k ± 5%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        8.17k ± 2%               8.18k ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        8.84k ± 5%               8.96k ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        9.19k ± 1%               8.88k ± 9%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        9.82k ± 1%               9.96k ± 2%     ~     (p=0.111 n=5+4)
      zeo/py/fs1-zwrk.go·12                                       9.67k ± 6%               9.80k ± 6%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       10.0k ± 9%               10.1k ± 6%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               3.69k ± 9%               3.70k ± 6%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               5.76k ± 0%               5.77k ± 0%     ~     (p=0.343 n=4+4)
      neo/py(!log)/sqlite-zwrk.go·3                               5.44k ±11%               5.77k ± 0%   +6.20%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               5.81k ± 1%               5.77k ± 0%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               5.85k ± 0%               5.84k ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              5.67k ± 3%               5.78k ± 2%   +1.96%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              5.84k ± 0%               5.80k ± 1%     ~     (p=0.730 n=4+5)
      neo/py(!log)/sql-zwrk.go·1                                  2.63k ± 6%               2.51k ±12%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  3.83k ±11%               3.62k ± 8%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  3.64k ±13%               3.86k ±11%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  3.73k ±14%               3.82k ±11%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  4.12k ± 6%               3.89k ±10%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 3.89k ± 9%               3.98k ± 7%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.60k ± 9%               3.72k ±13%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                        13.4k ± 3%               13.8k ± 3%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·2                                        28.0k ± 1%               28.1k ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·3                                        40.0k ± 0%               40.2k ± 0%   +0.61%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                        52.8k ± 0%               52.8k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·8                                        90.7k ± 0%               90.6k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·12                                       96.4k ± 1%               95.8k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·16                                       91.2k ± 2%               90.9k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          15.9k ± 2%               16.2k ± 2%   +2.23%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          33.0k ± 0%               32.9k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          46.3k ± 0%               46.2k ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          59.9k ± 0%               59.8k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          98.7k ± 1%               98.1k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          103k ± 1%                102k ± 1%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         96.5k ± 3%               97.0k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     5.66k ±15%               5.67k ± 8%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     13.3k ± 2%               13.3k ± 2%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     20.4k ± 0%               20.3k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.6k ± 1%               26.5k ± 0%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     44.5k ± 0%               44.5k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    52.2k ± 1%               52.3k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    48.8k ± 1%               48.9k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              5.74k ± 8%               5.69k ± 4%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              13.3k ± 2%               13.2k ± 3%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              20.5k ± 1%               20.5k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.0k ± 1%               27.1k ± 2%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              44.8k ± 2%               45.4k ± 1%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             53.1k ± 1%               53.3k ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             49.8k ± 2%               49.8k ± 1%     ~     (p=1.000 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zwrk.go·1                                              4.32µs ± 0%              4.34µs ± 1%   +0.47%  (p=0.040 n=5+5)
      fs1-zwrk.go·2                                              4.51µs ± 2%              4.58µs ± 5%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·3                                              4.50µs ± 2%              4.52µs ± 4%     ~     (p=0.635 n=5+5)
      fs1-zwrk.go·4                                              4.56µs ± 0%              4.55µs ± 1%     ~     (p=0.381 n=4+5)
      fs1-zwrk.go·8                                              4.60µs ± 2%              4.58µs ± 2%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·12                                             4.77µs ± 3%              4.69µs ± 0%     ~     (p=0.190 n=5+4)
      fs1-zwrk.go·16                                             5.56µs ± 0%              5.53µs ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        227µs ± 5%               233µs ± 8%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        316µs ± 0%               315µs ± 2%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        434µs ± 0%               435µs ± 0%     ~     (p=0.730 n=5+4)
      zeo/py/fs1-zwrk.go·4                                        562µs ± 0%               560µs ± 1%     ~     (p=0.343 n=4+4)
      zeo/py/fs1-zwrk.go·8                                       1.06ms ± 1%              1.06ms ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.59ms ± 2%              1.57ms ± 0%     ~     (p=0.111 n=5+4)
      zeo/py/fs1-zwrk.go·16                                      2.09ms ± 2%              2.11ms ± 0%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               295µs ±11%               288µs ±14%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               355µs ± 0%               358µs ± 0%   +0.86%  (p=0.016 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·3                               542µs ± 5%               533µs ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               722µs ± 1%               720µs ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.39ms ± 1%              1.43ms ± 2%   +2.25%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             2.11ms ± 1%              2.14ms ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.84ms ± 2%              2.85ms ± 1%     ~     (p=0.556 n=5+4)
      neo/py(!log)/sql-zwrk.go·1                                  380µs ± 8%               400µs ±16%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  553µs ± 9%               562µs ± 8%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  769µs ± 7%               827µs ±13%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.08ms ± 9%              1.13ms ±14%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.11ms ± 5%              2.13ms ±13%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.31ms ±12%              3.24ms ±12%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.37ms ±15%              4.62ms ± 8%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·1                                       92.9µs ± 6%              93.9µs ± 4%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·2                                       88.7µs ± 2%              89.6µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·3                                       94.4µs ± 1%              94.6µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·4                                       92.5µs ± 0%              92.6µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·8                                        102µs ± 0%               102µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·12                                       130µs ± 0%               130µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       157µs ± 1%               156µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         65.6µs ± 5%              66.8µs ± 5%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         63.4µs ± 1%              63.5µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         68.4µs ± 0%              68.5µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         69.5µs ± 0%              69.7µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         79.9µs ± 0%              79.7µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         103µs ± 0%               103µs ± 0%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         127µs ± 0%               127µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     198µs ± 9%               208µs ±14%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     170µs ± 2%               166µs ± 2%   -2.41%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     157µs ± 0%               158µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     162µs ± 1%               162µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     180µs ± 1%               178µs ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    213µs ± 1%               213µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    274µs ± 0%               276µs ± 0%   +0.72%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              178µs ± 7%               185µs ± 4%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              152µs ± 3%               156µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              147µs ± 1%               149µs ± 1%   +1.17%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              148µs ± 1%               149µs ± 1%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              165µs ± 1%               166µs ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             199µs ± 0%               199µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             260µs ± 1%               259µs ± 1%     ~     (p=0.548 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zwrk.go·1                                              2.93µs ± 4%              2.88µs ± 2%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·2                                              3.05µs ± 6%              3.03µs ± 3%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·3                                              3.05µs ± 5%              3.05µs ± 4%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·4                                              3.10µs ± 2%              3.05µs ± 2%     ~     (p=0.222 n=5+5)
      fs1-zwrk.go·8                                              3.11µs ± 1%              3.14µs ± 4%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·12                                             4.27µs ± 2%              4.28µs ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                             5.62µs ± 1%              5.63µs ± 2%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        198µs ± 6%               208µs ± 5%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        245µs ± 2%               245µs ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        340µs ± 5%               335µs ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        435µs ± 1%               453µs ±10%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        814µs ± 1%               803µs ± 2%     ~     (p=0.111 n=5+4)
      zeo/py/fs1-zwrk.go·12                                      1.24ms ± 7%              1.23ms ± 6%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.61ms ±10%              1.59ms ± 6%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               272µs ± 8%               271µs ± 7%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               347µs ± 0%               346µs ± 0%     ~     (p=0.343 n=4+4)
      neo/py(!log)/sqlite-zwrk.go·3                               555µs ±12%               520µs ± 0%   -6.28%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               688µs ± 1%               694µs ± 0%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.37ms ± 0%              1.37ms ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             2.12ms ± 3%              2.07ms ± 2%   -1.93%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.74ms ± 0%              2.76ms ± 1%     ~     (p=0.730 n=4+5)
      neo/py(!log)/sql-zwrk.go·1                                  380µs ± 6%               400µs ±11%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  524µs ±10%               554µs ± 7%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  832µs ±12%               783µs ±11%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.08ms ±13%              1.06ms ±11%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.95ms ± 7%              2.07ms ± 9%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.09ms ±10%              3.02ms ± 7%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.45ms ± 8%              4.32ms ±12%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                       74.5µs ± 3%              72.6µs ± 3%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·2                                       71.4µs ± 1%              71.2µs ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·3                                       75.0µs ± 0%              74.6µs ± 0%   -0.61%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                       75.8µs ± 0%              75.7µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·8                                       88.2µs ± 0%              88.3µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·12                                       124µs ± 1%               125µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·16                                       175µs ± 2%               176µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         63.1µs ± 2%              61.7µs ± 2%   -2.19%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         60.6µs ± 0%              60.7µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         64.8µs ± 0%              64.9µs ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         66.7µs ± 0%              66.9µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         81.1µs ± 1%              81.5µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         117µs ± 1%               118µs ± 1%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         166µs ± 3%               165µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     178µs ±14%               177µs ± 8%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     150µs ± 2%               151µs ± 2%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     147µs ± 0%               148µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     151µs ± 1%               151µs ± 0%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     180µs ± 0%               180µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    230µs ± 1%               229µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    328µs ± 1%               327µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              175µs ± 8%               176µs ± 4%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              150µs ± 2%               152µs ± 3%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              147µs ± 1%               147µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              148µs ± 1%               148µs ± 2%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              179µs ± 2%               176µs ± 1%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             226µs ± 1%               225µs ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             322µs ± 2%               321µs ± 1%     ~     (p=1.000 n=5+5)
      850bfb9d
    • Kirill Smelkov's avatar
      X neo1: localhost timings, Cenabled · 9644774a
      Kirill Smelkov authored
      Compared to yesterday shows relatively no significant change, though
      some benchmarks, usually related to sql are itself noisy.
      
      $ benchstat -split node,cluster,dataset 20180305-neo1-ffixed-c.txt 20180306-neo1-ffixed-c.txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:neo1
      pystone                                                      106k ± 1%                106k ± 1%     ~     (p=0.690 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:neo1
      crc32/py/4K                                                5.13µs ± 1%              5.13µs ± 1%     ~     (p=0.548 n=5+5)
      crc32/go/4K                                                2.79µs ± 0%              2.79µs ± 0%     ~     (p=0.238 n=5+5)
      sha1/py/4K                                                 13.5µs ± 1%              13.4µs ± 1%     ~     (p=0.548 n=5+5)
      sha1/go/4K                                                 9.83µs ± 0%              9.83µs ± 0%     ~     (p=0.746 n=5+5)
      unzlib/py/wczdata                                          36.2µs ± 1%              36.1µs ± 0%     ~     (p=0.421 n=5+5)
      unzlib/go/wczdata                                          31.2µs ± 1%              31.1µs ± 1%     ~     (p=0.548 n=5+5)
      unzlib/py/prod1-avg                                        16.4µs ± 2%              16.3µs ± 2%     ~     (p=0.690 n=5+5)
      unzlib/go/prod1-avg                                        9.42µs ± 0%              9.42µs ± 0%     ~     (p=0.786 n=5+5)
      disk/randread/direct/4K-min                                 161µs ± 0%               162µs ± 0%   +0.37%  (p=0.008 n=5+5)
      disk/randread/direct/4K-avg                                 187µs ± 1%               187µs ± 2%     ~     (p=0.381 n=5+5)
      disk/randread/pagecache/4K-min                              390ns ± 1%               389ns ± 1%     ~     (p=0.317 n=5+5)
      disk/randread/pagecache/4K-avg                              801ns ± 0%               804ns ± 0%   +0.34%  (p=0.048 n=5+4)
      
      name                                           old time/object          new time/object          delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zhash.py                                               34.9µs ± 1%              34.7µs ± 2%     ~     (p=0.651 n=5+5)
      fs1-zhash.go                                               5.96µs ± 1%              6.00µs ± 2%     ~     (p=0.683 n=5+5)
      fs1-zhash.go+prefetch128                                   6.64µs ± 2%              6.52µs ± 4%     ~     (p=0.317 n=5+5)
      zeo/py/fs1-zhash.py                                         517µs ± 2%               523µs ± 1%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zhash.go                                         200µs ± 3%               194µs ± 4%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            99.3µs ± 4%              98.6µs ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                668µs ±18%               684µs ± 3%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                242µs ± 1%               236µs ± 2%   -2.46%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    166µs ± 1%               162µs ± 2%   -2.30%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                   933µs ±54%               942µs ±47%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zhash.go                                   317µs ± 8%               300µs ±17%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       245µs ± 7%               240µs ± 6%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zhash.py                                         382µs ±22%               383µs ±20%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.go                                        81.3µs ± 3%              81.3µs ± 1%     ~     (p=0.532 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            33.9µs ± 4%              33.8µs ± 5%     ~     (p=0.952 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          57.4µs ± 3%              57.6µs ± 3%     ~     (p=0.746 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              23.2µs ± 4%              22.9µs ± 6%     ~     (p=0.500 n=5+5)
      neo/go/sqlite-zhash.py                                      410µs ± 3%               402µs ± 6%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zhash.go                                      125µs ± 1%               125µs ± 1%     ~     (p=0.333 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         47.4µs ± 3%              48.4µs ± 8%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               114µs ± 2%               116µs ± 2%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  47.0µs ±13%              45.9µs ± 5%     ~     (p=1.000 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zhash.py                                               29.0µs ± 1%              28.9µs ± 1%     ~     (p=0.341 n=5+5)
      fs1-zhash.go                                               3.76µs ± 2%              3.76µs ± 4%     ~     (p=1.000 n=5+5)
      fs1-zhash.go+prefetch128                                   3.80µs ± 0%              3.86µs ± 2%     ~     (p=0.238 n=4+5)
      zeo/py/fs1-zhash.py                                         481µs ± 3%               474µs ± 2%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zhash.go                                         170µs ± 5%               170µs ± 3%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            87.7µs ± 2%              87.8µs ± 1%     ~     (p=0.881 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                657µs ±11%               665µs ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                213µs ± 5%               219µs ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    151µs ± 2%               151µs ± 1%     ~     (p=0.881 n=5+5)
      neo/py(!log)/sql-zhash.py                                   897µs ±54%               886µs ±56%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zhash.go                                   320µs ± 9%               298µs ± 9%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       230µs ± 2%               230µs ± 3%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.py                                         346µs ±35%               319µs ±11%     ~     (p=0.794 n=5+5)
      neo/go/fs1-zhash.go                                        61.2µs ± 1%              61.3µs ± 3%     ~     (p=0.794 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            22.6µs ± 2%              22.5µs ± 3%     ~     (p=0.738 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          51.2µs ± 2%              52.0µs ± 3%     ~     (p=0.135 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              18.5µs ± 5%              18.3µs ± 2%     ~     (p=0.460 n=5+5)
      neo/go/sqlite-zhash.py                                      391µs ± 7%               382µs ± 6%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zhash.go                                      113µs ± 1%               113µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         41.5µs ± 6%              40.9µs ± 4%     ~     (p=0.730 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               109µs ± 1%               108µs ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  41.1µs ± 3%              41.1µs ± 5%     ~     (p=1.000 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zwrk.go·1                                                230k ± 0%                229k ± 0%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·2                                                446k ± 1%                443k ± 1%     ~     (p=0.151 n=5+5)
      fs1-zwrk.go·3                                                663k ± 0%                662k ± 1%     ~     (p=0.730 n=4+5)
      fs1-zwrk.go·4                                                868k ± 0%                867k ± 1%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·8                                                989k ± 1%                988k ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·12                                              1.02M ± 0%               1.02M ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                              1.01M ± 0%               0.98M ±12%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        5.09k ± 2%               5.15k ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        7.08k ± 2%               7.08k ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        7.75k ± 1%               7.73k ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        7.93k ± 2%               7.97k ± 4%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        8.30k ± 2%               8.30k ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       8.43k ± 1%               8.15k ± 1%   -3.31%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       8.41k ± 2%               8.25k ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               4.36k ± 4%               4.31k ± 4%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               6.27k ± 3%               6.28k ± 5%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               6.21k ± 2%               6.38k ± 0%   +2.64%  (p=0.016 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·4                               6.07k ± 6%               6.15k ± 5%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               6.22k ± 3%               6.27k ± 4%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              6.19k ± 4%               6.33k ± 2%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              6.09k ± 6%               6.25k ± 4%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  3.12k ± 7%               3.10k ± 6%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  4.02k ± 7%               3.98k ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  4.08k ± 8%               4.04k ± 3%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  4.03k ± 4%               4.06k ± 4%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  3.95k ± 3%               3.79k ± 7%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 4.04k ± 5%               3.98k ± 3%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.97k ± 5%               3.94k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                        12.9k ± 2%               12.8k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·2                                        24.9k ± 1%               24.8k ± 0%     ~     (p=0.286 n=5+4)
      neo/go/fs1-zwrk.go·3                                        32.4k ± 0%               32.3k ± 0%   -0.29%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·4                                        40.8k ± 1%               40.7k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·8                                        54.8k ± 1%               54.5k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·12                                       56.5k ± 1%               56.5k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       54.4k ± 2%               53.2k ±10%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          18.9k ± 2%               19.0k ± 2%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          37.8k ± 0%               37.8k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          48.1k ± 0%               48.0k ± 1%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          59.2k ± 0%               59.0k ± 0%   -0.45%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          78.4k ± 0%               78.0k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         82.9k ± 1%               82.2k ± 2%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         80.4k ± 2%               80.4k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     8.13k ± 0%               8.06k ± 4%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     14.9k ± 0%               14.9k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     20.8k ± 1%               20.7k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     24.9k ± 0%               24.8k ± 0%   -0.37%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     31.7k ± 1%               31.7k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    31.4k ± 1%               30.8k ± 5%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    30.5k ± 2%               30.4k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              8.96k ± 0%               8.95k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              16.4k ± 0%               16.2k ± 1%   -1.04%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              22.7k ± 0%               22.6k ± 0%   -0.59%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.7k ± 0%               27.9k ± 0%   +0.58%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              34.4k ± 0%               35.0k ± 1%   +1.92%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             33.5k ± 2%               34.7k ± 1%   +3.56%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             33.0k ± 2%               33.0k ±11%     ~     (p=0.222 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zwrk.go·1                                                452k ± 1%                451k ± 0%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·2                                                895k ± 0%                893k ± 0%   -0.30%  (p=0.032 n=5+5)
      fs1-zwrk.go·3                                               1.33M ± 1%               1.34M ± 1%     ~     (p=0.151 n=5+5)
      fs1-zwrk.go·4                                               1.76M ± 1%               1.77M ± 0%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·8                                               1.94M ±12%               1.99M ± 1%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·12                                              2.03M ± 0%               2.03M ± 1%     ~     (p=0.286 n=5+4)
      fs1-zwrk.go·16                                              2.03M ± 0%               2.03M ± 0%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        6.00k ± 2%               5.79k ± 3%   -3.52%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        8.45k ± 7%               8.55k ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        9.33k ± 2%               9.28k ± 7%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        9.80k ± 0%               9.72k ± 1%   -0.89%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        10.4k ± 1%               10.4k ± 1%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       10.5k ± 2%               10.5k ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       10.4k ± 4%               10.4k ± 4%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               4.87k ±11%               4.90k ± 7%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               6.44k ± 1%               6.28k ± 4%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               6.31k ± 6%               6.32k ± 5%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               6.36k ± 7%               6.45k ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               6.47k ± 1%               6.45k ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              6.48k ± 1%               6.31k ± 3%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              6.35k ± 2%               6.36k ± 5%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  3.07k ± 9%               3.50k ± 9%  +14.08%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  4.09k ± 3%               4.05k ± 6%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  3.99k ±11%               4.06k ± 7%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  3.99k ± 2%               3.98k ± 4%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  4.15k ± 4%               4.15k ± 3%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 4.13k ± 5%               4.00k ± 5%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 4.22k ± 7%               3.96k ±11%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·1                                        17.3k ± 1%               17.1k ± 1%     ~     (p=0.063 n=5+5)
      neo/go/fs1-zwrk.go·2                                        32.5k ± 1%               32.6k ± 0%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·3                                        43.3k ± 0%               43.3k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·4                                        52.9k ± 0%               52.9k ± 0%     ~     (p=0.730 n=4+5)
      neo/go/fs1-zwrk.go·8                                        65.3k ± 2%               66.3k ± 1%   +1.57%  (p=0.032 n=5+4)
      neo/go/fs1-zwrk.go·12                                       61.0k ± 6%               61.6k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·16                                       55.9k ± 2%               55.6k ± 4%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          20.0k ± 3%               19.6k ± 5%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          40.5k ± 1%               40.3k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          51.6k ± 0%               51.6k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          62.6k ± 0%               62.0k ± 0%   -0.83%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          74.6k ± 1%               74.2k ± 4%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         66.3k ± 4%               64.8k ± 7%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         58.9k ± 2%               59.5k ± 4%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     9.01k ± 1%               9.02k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     15.9k ± 1%               16.0k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     21.8k ± 0%               21.8k ± 1%     ~     (p=1.000 n=4+4)
      neo/go/sqlite-zwrk.go·4                                     26.3k ± 0%               26.2k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     29.8k ± 1%               30.0k ± 2%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    28.5k ± 1%               28.6k ± 2%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    28.5k ± 8%               28.7k ± 1%     ~     (p=0.730 n=5+4)
      neo/go/sqlite-zwrk.go(!sha1)·1                              9.38k ± 1%               9.45k ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              16.5k ± 0%               16.6k ± 1%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              22.7k ± 0%               23.0k ± 0%   +1.59%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.5k ± 1%               28.0k ± 1%   +1.81%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              32.3k ± 5%               32.3k ± 0%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             30.7k ± 2%               30.6k ± 2%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             30.3k ± 2%               30.3k ± 2%     ~     (p=0.841 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zwrk.go·1                                              4.35µs ± 0%              4.36µs ± 0%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·2                                              4.49µs ± 1%              4.52µs ± 1%     ~     (p=0.151 n=5+5)
      fs1-zwrk.go·3                                              4.53µs ± 0%              4.53µs ± 1%     ~     (p=0.730 n=4+5)
      fs1-zwrk.go·4                                              4.61µs ± 0%              4.61µs ± 1%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·8                                              8.09µs ± 1%              8.10µs ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·12                                             11.8µs ± 0%              11.8µs ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                             15.8µs ± 0%              16.5µs ±13%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        197µs ± 2%               194µs ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        283µs ± 2%               282µs ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        387µs ± 1%               388µs ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        504µs ± 2%               502µs ± 5%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        964µs ± 2%               964µs ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.42ms ± 1%              1.47ms ± 1%   +3.43%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.90ms ± 2%              1.94ms ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               230µs ± 4%               232µs ± 4%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               319µs ± 3%               319µs ± 5%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               483µs ± 2%               470µs ± 0%   -2.59%  (p=0.016 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·4                               661µs ± 6%               651µs ± 5%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.29ms ± 3%              1.28ms ± 4%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.94ms ± 4%              1.90ms ± 2%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.63ms ± 6%              2.56ms ± 4%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  321µs ± 7%               323µs ± 6%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  499µs ± 7%               503µs ± 2%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  737µs ± 8%               742µs ± 3%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  993µs ± 4%               986µs ± 4%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.03ms ± 3%              2.11ms ± 8%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                2.97ms ± 4%              3.02ms ± 3%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.03ms ± 4%              4.06ms ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                       77.7µs ± 2%              77.8µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·2                                       80.2µs ± 1%              80.6µs ± 0%     ~     (p=0.286 n=5+4)
      neo/go/fs1-zwrk.go·3                                       92.5µs ± 0%              92.8µs ± 0%   +0.30%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·4                                       98.1µs ± 1%              98.2µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·8                                        146µs ± 1%               147µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·12                                       212µs ± 1%               212µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       294µs ± 2%               293µs ± 1%     ~     (p=0.905 n=5+4)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         52.8µs ± 2%              52.7µs ± 2%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         53.0µs ± 0%              53.0µs ± 0%     ~     (p=0.889 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         62.3µs ± 0%              62.5µs ± 1%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         67.5µs ± 0%              67.8µs ± 0%   +0.46%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          102µs ± 0%               103µs ± 1%   +0.54%  (p=0.040 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         145µs ± 1%               146µs ± 2%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         199µs ± 2%               199µs ± 1%     ~     (p=0.651 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     123µs ± 0%               124µs ± 4%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     134µs ± 0%               134µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     144µs ± 1%               145µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     161µs ± 0%               161µs ± 0%   +0.38%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     253µs ± 1%               252µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    383µs ± 1%               390µs ± 5%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    524µs ± 2%               526µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              112µs ± 0%               112µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              122µs ± 0%               124µs ± 1%   +1.05%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              132µs ± 0%               133µs ± 0%   +0.60%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go(!sha1)·4                              144µs ± 0%               143µs ± 0%   -0.57%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              233µs ± 0%               228µs ± 1%   -1.88%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             359µs ± 2%               346µs ± 1%   -3.44%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             485µs ± 2%               486µs ±11%     ~     (p=0.222 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zwrk.go·1                                              2.21µs ± 1%              2.22µs ± 1%     ~     (p=0.667 n=5+5)
      fs1-zwrk.go·2                                              2.23µs ± 0%              2.24µs ± 0%   +0.30%  (p=0.040 n=5+5)
      fs1-zwrk.go·3                                              2.25µs ± 1%              2.25µs ± 1%     ~     (p=0.135 n=5+5)
      fs1-zwrk.go·4                                              2.27µs ± 1%              2.26µs ± 0%     ~     (p=0.611 n=5+5)
      fs1-zwrk.go·8                                              4.15µs ±13%              4.02µs ± 1%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·12                                             5.90µs ± 0%              5.92µs ± 1%     ~     (p=0.317 n=5+4)
      fs1-zwrk.go·16                                             7.89µs ± 0%              7.87µs ± 0%     ~     (p=0.087 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        167µs ± 2%               173µs ± 3%   +3.68%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        237µs ± 7%               234µs ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        322µs ± 2%               324µs ± 7%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        408µs ± 0%               412µs ± 1%   +0.91%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        770µs ± 1%               768µs ± 1%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.14ms ± 2%              1.14ms ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.54ms ± 4%              1.54ms ± 4%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               206µs ±11%               204µs ± 8%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               311µs ± 1%               319µs ± 4%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               476µs ± 7%               475µs ± 5%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               629µs ± 7%               620µs ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.24ms ± 1%              1.24ms ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.85ms ± 1%              1.90ms ± 3%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.52ms ± 2%              2.52ms ± 5%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  327µs ± 8%               287µs ± 8%  -12.18%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  489µs ± 3%               495µs ± 6%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  755µs ±10%               740µs ± 8%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.00ms ± 2%              1.01ms ± 4%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.93ms ± 3%              1.93ms ± 3%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                2.91ms ± 5%              3.01ms ± 4%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                3.80ms ± 7%              4.05ms ±10%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·1                                       57.8µs ± 1%              58.5µs ± 1%     ~     (p=0.063 n=5+5)
      neo/go/fs1-zwrk.go·2                                       61.5µs ± 1%              61.4µs ± 0%     ~     (p=0.254 n=5+5)
      neo/go/fs1-zwrk.go·3                                       69.3µs ± 0%              69.3µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·4                                       75.6µs ± 0%              75.6µs ± 0%     ~     (p=0.730 n=4+5)
      neo/go/fs1-zwrk.go·8                                        123µs ± 2%               121µs ± 1%   -1.56%  (p=0.032 n=5+4)
      neo/go/fs1-zwrk.go·12                                       197µs ± 6%               195µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·16                                       286µs ± 2%               288µs ± 4%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         50.0µs ± 3%              50.9µs ± 5%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         49.4µs ± 1%              49.7µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         58.1µs ± 0%              58.2µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         63.9µs ± 0%              64.5µs ± 0%   +0.84%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          107µs ± 1%               108µs ± 4%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         181µs ± 4%               185µs ± 8%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         272µs ± 2%               269µs ± 4%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     111µs ± 1%               111µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     126µs ± 1%               125µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     137µs ± 0%               137µs ± 1%     ~     (p=1.000 n=4+4)
      neo/go/sqlite-zwrk.go·4                                     152µs ± 0%               153µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     268µs ± 1%               267µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    421µs ± 1%               420µs ± 2%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    562µs ± 8%               558µs ± 1%     ~     (p=0.730 n=5+4)
      neo/go/sqlite-zwrk.go(!sha1)·1                              107µs ± 1%               106µs ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              121µs ± 0%               121µs ± 1%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              132µs ± 0%               130µs ± 0%   -1.57%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              146µs ± 1%               143µs ± 1%   -1.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              247µs ± 5%               248µs ± 0%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             391µs ± 2%               393µs ± 2%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             528µs ± 2%               528µs ± 2%     ~     (p=0.841 n=5+5)
      9644774a
    • Kirill Smelkov's avatar
      X deco: localhost timings, Cenabled · dabeb4b8
      Kirill Smelkov authored
      Compared to yesterday shows not significant change, thus meaning
      benchmarking is more or less stable (+/- 5% at ·12 and ·16 is probably
      due to scheduling):
      
      $ benchstat -split node,cluster,dataset 20180305-deco-ffixed-c.txt 20180306-deco-ffixed-c.txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:deco
      pystone                                                      219k ± 3%                217k ± 4%    ~     (p=0.548 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:deco
      crc32/py/4K                                                5.72µs ± 0%              5.73µs ± 0%    ~     (p=0.460 n=5+5)
      crc32/go/4K                                                 279ns ± 0%               279ns ± 0%    ~     (all equal)
      sha1/py/4K                                                 6.69µs ± 0%              6.74µs ± 1%  +0.66%  (p=0.024 n=5+5)
      sha1/go/4K                                                 5.59µs ± 0%              5.60µs ± 0%  +0.19%  (p=0.008 n=5+5)
      unzlib/py/wczdata                                          27.2µs ± 0%              27.2µs ± 1%    ~     (p=0.905 n=4+5)
      unzlib/go/wczdata                                          26.9µs ± 1%              27.0µs ± 0%    ~     (p=0.222 n=5+5)
      unzlib/py/prod1-avg                                        5.06µs ± 0%              5.14µs ± 3%    ~     (p=0.603 n=4+5)
      unzlib/go/prod1-avg                                        5.33µs ± 1%              5.30µs ± 1%    ~     (p=0.087 n=5+5)
      disk/randread/direct/4K-min                                 105µs ± 0%               104µs ± 2%    ~     (p=0.270 n=5+5)
      disk/randread/direct/4K-avg                                 142µs ± 0%               141µs ± 0%  -0.31%  (p=0.032 n=5+5)
      disk/randread/pagecache/4K-min                              583ns ± 1%               579ns ± 2%    ~     (p=0.246 n=5+5)
      disk/randread/pagecache/4K-avg                             1.00µs ± 1%              0.99µs ± 0%  -0.98%  (p=0.024 n=5+5)
      
      name                                           old time/object          new time/object          delta
      cluster:deco dataset:wczblk1-8
      fs1-zhash.py                                               20.2µs ± 1%              20.3µs ± 1%    ~     (p=0.571 n=4+4)
      fs1-zhash.go                                               3.20µs ± 0%              3.26µs ± 4%    ~     (p=0.444 n=5+5)
      fs1-zhash.go+prefetch128                                   4.14µs ± 6%              4.04µs ± 1%    ~     (p=0.444 n=5+5)
      zeo/py/fs1-zhash.py                                         379µs ± 3%               383µs ± 5%    ~     (p=0.730 n=5+5)
      zeo/py/fs1-zhash.go                                         127µs ± 1%               126µs ± 1%    ~     (p=0.317 n=4+5)
      zeo/py/fs1-zhash.go+prefetch128                            64.1µs ± 2%              63.1µs ± 1%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                335µs ± 4%               344µs ± 6%    ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                145µs ± 2%               140µs ± 1%  -3.07%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    118µs ± 1%               119µs ± 2%    ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zhash.py                                   454µs ±61%               386µs ± 1%    ~     (p=1.000 n=5+4)
      neo/py(!log)/sql-zhash.go                                   183µs ± 1%               183µs ± 3%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       164µs ± 2%               164µs ± 3%    ~     (p=0.690 n=5+5)
      neo/go/fs1-zhash.py                                         227µs ± 2%               226µs ± 3%    ~     (p=0.690 n=5+5)
      neo/go/fs1-zhash.go                                        56.9µs ± 1%              57.1µs ± 0%    ~     (p=0.119 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            24.7µs ± 2%              24.7µs ± 5%    ~     (p=0.571 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          40.5µs ± 1%              40.2µs ± 1%    ~     (p=0.254 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              16.8µs ± 5%              17.1µs ± 6%    ~     (p=0.579 n=5+5)
      neo/go/sqlite-zhash.py                                      269µs ± 1%               272µs ± 3%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go                                     92.7µs ± 0%              92.8µs ± 0%    ~     (p=0.397 n=5+4)
      neo/go/sqlite-zhash.go+prefetch128                         39.8µs ± 8%              40.5µs ± 5%    ~     (p=0.548 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              86.4µs ± 2%              86.5µs ± 2%    ~     (p=0.571 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  40.1µs ±11%              38.8µs ± 9%    ~     (p=0.579 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zhash.py                                               15.8µs ± 2%              15.8µs ± 3%    ~     (p=0.629 n=4+4)
      fs1-zhash.go                                               2.80µs ± 0%              2.80µs ± 0%    ~     (all equal)
      fs1-zhash.go+prefetch128                                   3.54µs ± 7%              3.42µs ± 8%    ~     (p=0.381 n=5+5)
      zeo/py/fs1-zhash.py                                         362µs ± 6%               361µs ± 5%    ~     (p=1.000 n=5+5)
      zeo/py/fs1-zhash.go                                         106µs ± 1%               105µs ± 0%    ~     (p=0.214 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            58.9µs ± 1%              58.9µs ± 1%    ~     (p=0.881 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                331µs ± 1%               344µs ± 7%    ~     (p=0.063 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                136µs ± 1%               137µs ± 2%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    112µs ± 1%               114µs ± 1%  +1.73%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                   389µs ± 6%               380µs ± 4%    ~     (p=0.486 n=4+4)
      neo/py(!log)/sql-zhash.go                                   180µs ± 2%               180µs ± 1%    ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       157µs ± 1%               159µs ± 1%    ~     (p=0.095 n=5+5)
      neo/go/fs1-zhash.py                                         223µs ± 0%               221µs ± 1%  -0.79%  (p=0.016 n=5+5)
      neo/go/fs1-zhash.go                                        44.9µs ± 1%              45.2µs ± 2%    ~     (p=0.357 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            17.6µs ± 5%              17.6µs ± 2%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          39.1µs ± 1%              39.1µs ± 2%    ~     (p=0.714 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              14.8µs ± 3%              14.6µs ± 4%    ~     (p=0.302 n=5+5)
      neo/go/sqlite-zhash.py                                      269µs ± 3%               271µs ± 2%    ~     (p=0.548 n=5+5)
      neo/go/sqlite-zhash.go                                     86.0µs ± 1%              86.4µs ± 0%    ~     (p=0.206 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         36.4µs ± 6%              35.8µs ± 2%    ~     (p=0.532 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              83.6µs ± 1%              84.0µs ± 1%    ~     (p=0.516 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  35.9µs ± 5%              36.5µs ± 5%    ~     (p=0.444 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:deco dataset:wczblk1-8
      fs1-zwrk.go·1                                                438k ± 1%                436k ± 0%    ~     (p=0.222 n=5+5)
      fs1-zwrk.go·2                                                745k ± 1%                744k ± 1%    ~     (p=0.548 n=5+5)
      fs1-zwrk.go·3                                               1.09M ± 0%               1.09M ± 0%    ~     (p=0.095 n=5+5)
      fs1-zwrk.go·4                                               1.15M ± 1%               1.16M ± 1%    ~     (p=0.095 n=5+5)
      fs1-zwrk.go·8                                               1.27M ± 1%               1.27M ± 1%    ~     (p=0.841 n=5+5)
      fs1-zwrk.go·12                                              1.27M ± 1%               1.27M ± 1%    ~     (p=0.690 n=5+5)
      fs1-zwrk.go·16                                              1.28M ± 1%               1.27M ± 1%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        9.04k ± 1%               9.12k ± 0%  +0.89%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        11.4k ± 1%               11.6k ± 1%  +1.58%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        13.4k ± 1%               13.4k ± 1%    ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        14.0k ± 1%               14.0k ± 1%    ~     (p=0.595 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        14.6k ± 4%               14.7k ± 1%    ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       14.9k ± 1%               15.0k ± 1%    ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       15.3k ± 1%               15.1k ± 0%  -0.79%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.03k ± 3%               7.09k ± 1%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.52k ± 1%               8.48k ± 1%    ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.48k ± 1%               8.48k ± 1%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.45k ± 1%               8.47k ± 1%    ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.44k ± 1%               8.43k ± 1%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.48k ± 1%               8.46k ± 1%    ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.49k ± 1%               8.46k ± 1%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.51k ± 1%               5.51k ± 1%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.31k ± 1%               6.32k ± 1%    ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.20k ± 1%               6.29k ± 1%  +1.37%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.22k ± 1%               6.27k ± 1%  +0.83%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.25k ± 1%               6.27k ± 1%    ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.26k ± 1%               6.29k ± 0%    ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.26k ± 1%               6.22k ± 1%    ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·1                                        18.4k ± 0%               18.4k ± 1%    ~     (p=0.167 n=5+5)
      neo/go/fs1-zwrk.go·2                                        38.2k ± 1%               38.1k ± 1%    ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·3                                        45.8k ± 1%               46.0k ± 1%    ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·4                                        49.8k ± 0%               50.2k ± 1%  +0.94%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        60.3k ± 1%               61.0k ± 0%  +1.16%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·12                                       61.6k ± 1%               62.1k ± 1%    ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·16                                       61.4k ± 1%               62.5k ± 1%    ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.1k ± 1%               26.3k ± 1%    ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          55.3k ± 1%               55.3k ± 1%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          62.7k ± 1%               62.7k ± 1%    ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          69.1k ± 0%               69.3k ± 1%    ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          87.9k ± 0%               88.2k ± 0%    ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         92.2k ± 1%               93.4k ± 0%  +1.32%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         93.4k ± 1%               93.5k ± 2%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.1k ± 0%               11.0k ± 1%    ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     18.5k ± 0%               18.4k ± 1%  -0.68%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     24.5k ± 0%               24.4k ± 1%    ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.9k ± 1%               26.8k ± 0%    ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     29.9k ± 2%               30.4k ± 2%    ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    29.2k ± 2%               30.5k ± 1%  +4.49%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    28.4k ± 2%               29.9k ± 2%  +5.53%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.8k ± 0%               11.9k ± 1%    ~     (p=0.063 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              19.5k ± 0%               19.7k ± 0%  +0.60%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              26.8k ± 1%               26.5k ± 1%  -1.14%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              30.3k ± 1%               30.0k ± 0%  -1.12%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              32.0k ± 2%               31.2k ± 2%  -2.46%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             30.2k ± 3%               28.9k ± 1%  -4.20%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             29.7k ± 1%               28.4k ± 2%  -4.27%  (p=0.008 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zwrk.go·1                                                555k ± 0%                555k ± 0%    ~     (p=1.000 n=5+5)
      fs1-zwrk.go·2                                                982k ± 2%               1008k ± 3%  +2.66%  (p=0.032 n=5+5)
      fs1-zwrk.go·3                                               1.32M ± 1%               1.32M ± 1%    ~     (p=0.421 n=5+5)
      fs1-zwrk.go·4                                               1.51M ± 1%               1.55M ± 2%  +2.80%  (p=0.032 n=5+5)
      fs1-zwrk.go·8                                               1.58M ± 1%               1.59M ± 0%    ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                              1.59M ± 0%               1.59M ± 0%    ~     (p=0.548 n=5+5)
      fs1-zwrk.go·16                                              1.59M ± 0%               1.59M ± 0%    ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        9.70k ± 1%               9.70k ± 0%    ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        12.2k ± 1%               12.4k ± 1%  +1.67%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        14.2k ± 1%               14.2k ± 1%    ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        14.9k ± 0%               14.9k ± 0%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        15.6k ± 0%               15.6k ± 0%    ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       15.9k ± 1%               15.2k ±11%    ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       16.1k ± 0%               16.1k ± 1%    ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.51k ± 1%               7.44k ± 1%  -0.91%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.72k ± 1%               8.59k ± 1%  -1.45%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.69k ± 1%               8.61k ± 1%    ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.67k ± 1%               8.57k ± 1%    ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.72k ± 0%               8.56k ± 1%  -1.83%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.63k ± 1%               8.51k ± 1%    ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.64k ± 1%               8.54k ± 1%    ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.56k ± 2%               5.55k ± 2%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.42k ± 0%               6.36k ± 1%  -0.97%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.40k ± 0%               6.31k ± 0%  -1.44%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.38k ± 1%               6.28k ± 0%  -1.57%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.39k ± 1%               6.34k ± 1%    ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.42k ± 1%               6.35k ± 1%  -1.11%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.41k ± 2%               6.36k ± 0%    ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·1                                        23.8k ± 0%               23.7k ± 0%  -0.33%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·2                                        45.0k ± 1%               45.4k ± 0%  +0.93%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·3                                        55.1k ± 1%               55.2k ± 1%    ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·4                                        60.1k ± 0%               60.7k ± 2%    ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·8                                        68.3k ± 2%               70.9k ± 2%  +3.72%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·12                                       69.3k ± 5%               71.1k ± 3%    ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·16                                       68.8k ± 6%               71.0k ± 3%    ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          27.3k ± 0%               27.3k ± 0%    ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          54.9k ± 1%               55.4k ± 1%    ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          64.0k ± 0%               64.0k ± 1%    ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          68.7k ± 1%               69.0k ± 1%    ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          79.4k ± 2%               80.9k ± 2%    ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         77.9k ± 2%               78.3k ± 5%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         75.3k ± 6%               75.4k ± 3%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.8k ± 0%               11.7k ± 1%    ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     19.2k ± 0%               19.0k ± 0%  -0.85%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     24.5k ± 1%               24.5k ± 1%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.6k ± 1%               26.3k ± 1%  -1.38%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     25.1k ± 3%               24.9k ± 3%    ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    23.8k ± 2%               24.0k ± 5%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    24.3k ± 2%               25.4k ± 1%  +4.53%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              12.1k ± 1%               12.2k ± 0%    ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              19.6k ± 0%               19.8k ± 0%  +0.98%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              25.3k ± 1%               26.2k ± 1%  +3.40%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.3k ± 1%               28.7k ± 1%  +5.03%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              25.4k ± 3%               27.2k ± 3%  +6.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             23.8k ± 2%               25.3k ± 2%  +6.21%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             23.9k ± 2%               25.3k ± 1%  +6.14%  (p=0.008 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:deco dataset:wczblk1-8
      fs1-zwrk.go·1                                              2.29µs ± 1%              2.29µs ± 0%    ~     (p=0.222 n=5+5)
      fs1-zwrk.go·2                                              2.68µs ± 1%              2.69µs ± 1%    ~     (p=0.524 n=5+5)
      fs1-zwrk.go·3                                              2.76µs ± 0%              2.76µs ± 0%    ~     (p=0.111 n=5+5)
      fs1-zwrk.go·4                                              3.46µs ± 1%              3.44µs ± 1%    ~     (p=0.095 n=5+5)
      fs1-zwrk.go·8                                              6.28µs ± 1%              6.28µs ± 1%    ~     (p=0.889 n=5+5)
      fs1-zwrk.go·12                                             9.42µs ± 1%              9.46µs ± 1%    ~     (p=0.690 n=5+5)
      fs1-zwrk.go·16                                             12.5µs ± 1%              12.6µs ± 1%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        111µs ± 1%               110µs ± 0%  -0.88%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        176µs ± 1%               173µs ± 1%  -1.56%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        224µs ± 1%               224µs ± 1%    ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        285µs ± 1%               286µs ± 1%    ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        549µs ± 4%               545µs ± 1%    ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       805µs ± 1%               802µs ± 1%    ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.05ms ± 1%              1.06ms ± 0%  +0.80%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               142µs ± 3%               141µs ± 1%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               235µs ± 1%               236µs ± 1%    ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               354µs ± 1%               354µs ± 1%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               473µs ± 1%               472µs ± 1%    ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               948µs ± 1%               949µs ± 1%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.42ms ± 1%              1.42ms ± 1%    ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.88ms ± 1%              1.89ms ± 1%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  181µs ± 1%               181µs ± 1%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  317µs ± 1%               317µs ± 1%    ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  484µs ± 1%               477µs ± 1%  -1.36%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  643µs ± 1%               638µs ± 1%  -0.82%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.28ms ± 1%              1.28ms ± 1%    ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.92ms ± 1%              1.91ms ± 0%    ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.56ms ± 1%              2.57ms ± 1%    ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·1                                       54.5µs ± 0%              54.2µs ± 1%    ~     (p=0.167 n=5+5)
      neo/go/fs1-zwrk.go·2                                       52.4µs ± 1%              52.5µs ± 1%    ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·3                                       65.4µs ± 1%              65.3µs ± 1%    ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·4                                       80.4µs ± 0%              79.6µs ± 1%  -0.93%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        133µs ± 1%               131µs ± 0%  -1.15%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·12                                       195µs ± 1%               193µs ± 1%    ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·16                                       261µs ± 1%               256µs ± 1%    ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         38.3µs ± 1%              38.0µs ± 1%    ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         36.2µs ± 1%              36.1µs ± 1%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         47.8µs ± 1%              47.8µs ± 1%    ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         57.9µs ± 0%              57.7µs ± 1%    ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         91.0µs ± 0%              90.7µs ± 0%    ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         130µs ± 1%               129µs ± 0%  -1.31%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         171µs ± 1%               171µs ± 2%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    90.4µs ± 0%              90.7µs ± 1%    ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     108µs ± 0%               109µs ± 1%  +0.69%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     123µs ± 0%               123µs ± 1%    ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     148µs ± 1%               149µs ± 0%    ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     267µs ± 2%               263µs ± 2%    ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    411µs ± 2%               393µs ± 1%  -4.31%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    564µs ± 2%               534µs ± 2%  -5.24%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             84.5µs ± 0%              84.0µs ± 1%    ~     (p=0.063 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              102µs ± 0%               102µs ± 0%  -0.60%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              112µs ± 1%               113µs ± 1%  +1.16%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              132µs ± 1%               133µs ± 0%  +1.13%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              250µs ± 2%               257µs ± 2%  +2.52%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             397µs ± 3%               415µs ± 1%  +4.38%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             539µs ± 1%               563µs ± 2%  +4.47%  (p=0.008 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zwrk.go·1                                              1.80µs ± 0%              1.80µs ± 0%    ~     (p=0.968 n=5+5)
      fs1-zwrk.go·2                                              2.04µs ± 2%              1.98µs ± 3%  -2.55%  (p=0.032 n=5+5)
      fs1-zwrk.go·3                                              2.28µs ± 1%              2.27µs ± 1%    ~     (p=0.389 n=5+5)
      fs1-zwrk.go·4                                              2.65µs ± 1%              2.58µs ± 2%  -2.71%  (p=0.032 n=5+5)
      fs1-zwrk.go·8                                              5.05µs ± 1%              5.04µs ± 0%    ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                             7.54µs ± 0%              7.55µs ± 0%    ~     (p=0.571 n=5+5)
      fs1-zwrk.go·16                                             10.1µs ± 0%              10.0µs ± 0%    ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        103µs ± 1%               103µs ± 0%    ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        164µs ± 1%               162µs ± 1%  -1.64%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        211µs ± 1%               212µs ± 1%    ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        269µs ± 0%               269µs ± 0%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        512µs ± 0%               512µs ± 0%    ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       755µs ± 1%               793µs ±12%    ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       993µs ± 0%               991µs ± 1%    ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               133µs ± 1%               134µs ± 1%  +0.92%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               229µs ± 1%               233µs ± 1%  +1.47%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               345µs ± 1%               348µs ± 1%    ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               461µs ± 1%               467µs ± 1%    ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               917µs ± 0%               935µs ± 1%  +1.87%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.39ms ± 1%              1.41ms ± 1%    ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.85ms ± 1%              1.87ms ± 1%    ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  180µs ± 2%               180µs ± 2%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  311µs ± 0%               315µs ± 1%  +0.99%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  468µs ± 0%               475µs ± 0%  +1.47%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  627µs ± 1%               637µs ± 0%  +1.59%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.25ms ± 1%              1.26ms ± 1%    ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.87ms ± 1%              1.89ms ± 1%  +1.13%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.50ms ± 2%              2.52ms ± 0%    ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·1                                       42.0µs ± 0%              42.2µs ± 0%  +0.33%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·2                                       44.5µs ± 1%              44.1µs ± 0%  -0.92%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·3                                       54.5µs ± 1%              54.4µs ± 1%    ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·4                                       66.5µs ± 0%              65.9µs ± 2%    ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·8                                        117µs ± 2%               113µs ± 2%  -3.59%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·12                                       173µs ± 4%               169µs ± 4%    ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·16                                       233µs ± 6%               225µs ± 3%    ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         36.7µs ± 0%              36.6µs ± 0%    ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         36.4µs ± 1%              36.1µs ± 1%    ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         46.9µs ± 0%              46.9µs ± 1%    ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         58.2µs ± 1%              57.9µs ± 1%    ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          101µs ± 2%                99µs ± 2%    ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         154µs ± 2%               153µs ± 5%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         213µs ± 6%               212µs ± 3%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    84.7µs ± 0%              85.1µs ± 1%    ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     104µs ± 0%               105µs ± 0%  +0.86%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     123µs ± 1%               123µs ± 1%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     150µs ± 1%               152µs ± 1%  +1.40%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     319µs ± 3%               321µs ± 3%    ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    504µs ± 2%               500µs ± 5%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    659µs ± 2%               630µs ± 1%  -4.34%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             82.5µs ± 1%              82.0µs ± 0%    ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              102µs ± 0%               101µs ± 0%  -0.97%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              119µs ± 1%               115µs ± 1%  -3.29%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              146µs ± 1%               139µs ± 1%  -4.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              315µs ± 3%               295µs ± 3%  -6.37%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             503µs ± 2%               474µs ± 2%  -5.86%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             671µs ± 2%               632µs ± 1%  -5.79%  (p=0.008 n=5+5)
      dabeb4b8
    • Kirill Smelkov's avatar
    • Kirill Smelkov's avatar
      X neo1 timings (ffixed, C not disabled) · 8748ba93
      Kirill Smelkov authored
      8748ba93
  3. 05 Mar, 2018 6 commits
    • Kirill Smelkov's avatar
      b655da26
    • Kirill Smelkov's avatar
      X deco-rio timings · a1dde3c9
      Kirill Smelkov authored
      Latency is awful (> 500µs) because RX coalescing is not disabled on rio.
      a1dde3c9
    • Kirill Smelkov's avatar
      X rio localhost timings after switch to zwrk & stabilizing output format · 2d0b54ad
      Kirill Smelkov authored
      Like in previous commit should not be changing compared to 39a77e3b, but
      it was not checked.
      2d0b54ad
    • Kirill Smelkov's avatar
      X noturbo deco timings after switch to zwrk + stabilizing neotest output format · ea5f9d26
      Kirill Smelkov authored
      Compared to 0ed7b1fc there should not be a difference (checked only on
      serial cases with manually ediging 20180221-deco-noturbo-noz.txt-fix to
      use updated output format for wczblk1-8 dataset):
      
      $ benchstat -split node,cluster,dataset 20180221-deco-noturbo-noz.txt-fix 20180305-deco-noturbo-c.txt
      name                                      old pystone/s    new pystone/s    delta
      node:deco
      pystone                                         221k ± 0%        219k ± 3%     ~     (p=0.690 n=5+5)
      
      name                                      old time/op      new time/op      delta
      node:deco
      sha1/py/1K                                    1.85µs ± 2%      1.84µs ± 1%     ~     (p=0.508 n=5+5)
      sha1/go/1K                                    1.53µs ± 0%      1.53µs ± 0%     ~     (p=0.103 n=5+5)
      sha1/py/4K                                    6.68µs ± 1%      6.69µs ± 0%     ~     (p=0.151 n=5+5)
      sha1/go/4K                                    5.59µs ± 0%      5.59µs ± 0%     ~     (p=0.333 n=5+5)
      sha1/py/2M                                    3.18ms ± 0%      3.18ms ± 0%     ~     (p=0.421 n=5+5)
      sha1/go/2M                                    2.78ms ± 0%      2.78ms ± 0%     ~     (p=1.000 n=5+5)
      unzlib/py/null-1K                             2.81µs ± 0%      2.91µs ± 3%   +3.49%  (p=0.008 n=5+5)
      unzlib/go/null-1K                             2.86µs ± 0%      2.88µs ± 1%   +0.93%  (p=0.008 n=5+5)
      unzlib/py/null-4K                             11.3µs ± 1%      11.4µs ± 2%   +0.89%  (p=0.040 n=5+5)
      unzlib/go/null-4K                             11.3µs ± 0%      11.4µs ± 0%   +0.89%  (p=0.008 n=5+5)
      unzlib/py/null-2M                             5.71ms ± 5%      5.66ms ± 3%     ~     (p=1.000 n=5+5)
      unzlib/go/null-2M                             4.79ms ± 0%      4.79ms ± 0%     ~     (p=0.095 n=5+5)
      unzlib/py/prod1-avg                           5.02µs ± 1%      5.06µs ± 0%     ~     (p=0.057 n=4+4)
      unzlib/go/prod1-avg                           5.27µs ± 1%      5.33µs ± 1%     ~     (p=0.087 n=5+5)
      unzlib/py/prod1-max                            512µs ± 2%       438µs ± 5%  -14.45%  (p=0.008 n=5+5)
      unzlib/go/prod1-max                            336µs ± 0%       352µs ± 4%   +4.67%  (p=0.008 n=5+5)
      disk/randread/direct/4K-min                    105µs ± 1%       105µs ± 0%     ~     (p=1.000 n=5+5)
      disk/randread/direct/4K-avg                    144µs ± 0%       142µs ± 0%   -1.54%  (p=0.008 n=5+5)
      disk/randread/direct/2M-min                   5.48ms ± 3%      5.34ms ± 3%     ~     (p=0.135 n=5+5)
      disk/randread/direct/2M-avg                   6.13ms ± 1%      6.04ms ± 2%     ~     (p=0.056 n=5+5)
      disk/randread/pagecache/4K-min                 570ns ± 1%       583ns ± 1%   +2.28%  (p=0.008 n=5+5)
      disk/randread/pagecache/4K-avg                 975ns ± 0%      1003ns ± 1%   +2.91%  (p=0.008 n=5+5)
      disk/randread/pagecache/2M-min                 195µs ± 4%       197µs ± 4%     ~     (p=0.690 n=5+5)
      disk/randread/pagecache/2M-avg                 214µs ± 0%       220µs ± 1%   +2.80%  (p=0.008 n=5+5)
      
      name                                      old time/object  new time/object  delta
      cluster:deco dataset:wczblk1-8
      fs1-zhash.py                                  20.3µs ± 1%      20.2µs ± 1%     ~     (p=0.444 n=5+4)
      fs1-zhash.go                                  3.20µs ± 0%      3.20µs ± 0%     ~     (all equal)
      fs1-zhash.go+prefetch128                      4.16µs ± 4%      4.14µs ± 6%     ~     (p=0.952 n=5+5)
      zeo/py/fs1-zhash.py                            375µs ± 4%       379µs ± 3%     ~     (p=0.690 n=5+5)
      neo/py/sqlite-zhash.py                         355µs ± 6%       362µs ± 6%     ~     (p=0.421 n=5+5)
      neo/py/sqlite-zhash.go                         156µs ± 2%       158µs ± 1%     ~     (p=0.151 n=5+5)
      neo/py/sqlite-zhash.go+prefetch128             134µs ± 2%       135µs ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zhash.py                   326µs ± 3%       335µs ± 4%     ~     (p=0.381 n=5+5)
      neo/py(!log)/sqlite-zhash.go                   143µs ± 3%       145µs ± 2%     ~     (p=0.508 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128       119µs ± 2%       118µs ± 1%     ~     (p=0.421 n=5+5)
      neo/py/sql-zhash.py                            466µs ±45%       392µs ± 5%     ~     (p=0.111 n=5+4)
      neo/py/sql-zhash.go                            201µs ± 2%       197µs ± 1%   -1.63%  (p=0.008 n=5+5)
      neo/py/sql-zhash.go+prefetch128                184µs ± 2%       180µs ± 2%   -1.96%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zhash.py                      375µs ± 2%       454µs ±61%     ~     (p=0.286 n=4+5)
      neo/py(!log)/sql-zhash.go                      182µs ± 2%       183µs ± 1%     ~     (p=0.802 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128          164µs ± 1%       164µs ± 2%     ~     (p=0.881 n=5+5)
      neo/go/fs1-zhash.py                            226µs ± 1%       227µs ± 2%     ~     (p=0.397 n=5+5)
      neo/go/fs1-zhash.go                           56.8µs ± 1%      56.9µs ± 1%     ~     (p=0.889 n=5+5)
      neo/go/fs1-zhash.go+prefetch128               24.8µs ± 3%      24.7µs ± 2%     ~     (p=0.651 n=5+5)
      neo/go/sqlite-zhash.py                         264µs ± 4%       269µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zhash.go                        93.5µs ± 0%      92.7µs ± 0%   -0.83%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128            39.3µs ± 4%      39.8µs ± 8%     ~     (p=0.952 n=5+5)
      
      ( not sure what it was for unzlib/py/prod1-max - probaby some background process
        was also running last time at that test )
      ea5f9d26
    • Kirill Smelkov's avatar
      . · 7c21fb98
      Kirill Smelkov authored
      7c21fb98
    • Kirill Smelkov's avatar
  4. 04 Mar, 2018 9 commits
  5. 02 Mar, 2018 6 commits
  6. 01 Mar, 2018 2 commits
  7. 28 Feb, 2018 4 commits