-
Kirill Smelkov authored
Disabling C-states on rio tendto help serial cases, like it was on neo1 and z6001, but it is closer to noise. ---- 8< ---- cluster:rio dataset:wczblk1-8 zeo/py/fs1-zhash.py 400µs ± 0% 370µs ± 1% -7.32% (p=0.008 n=5+5) neo/py(!log)/sqlite-zhash.py 318µs ± 7% 295µs ± 0% -7.16% (p=0.008 n=5+5) neo/py(!log)/sql-zhash.go+prefetch128 158µs ± 3% 158µs ± 2% ~ (p=1.000 n=5+5) neo/go/fs1-zhash.py 222µs ± 4% 214µs ± 2% -3.73% (p=0.040 n=5+5) neo/go/sqlite-zhash.py 273µs ± 3% 256µs ± 4% -6.45% (p=0.008 n=5+5) cluster:rio dataset:prod1-1024 zeo/py/fs1-zhash.py 372µs ±10% 347µs ± 5% -6.84% (p=0.032 n=5+5) neo/py(!log)/sqlite-zhash.py 321µs ±11% 298µs ± 5% -7.13% (p=0.048 n=5+5) ---- 8< ---- the pystone/s change is nose as pystone/s for C-enabled case was 146k on prev-prev run (see 31dc070d). ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ $ benchstat -split node,cluster,dataset 20180306-rio-ffixed-c.txt 20180306-rio-ffixed-noc_C1\(1µs\).txt name old pystone/s new pystone/s delta node:rio pystone 115k ±12% 144k ± 1% +25.53% (p=0.008 n=5+5) name old time/op new time/op delta node:rio crc32/py/4K 4.77µs ± 0% 4.78µs ± 1% ~ (p=0.825 n=4+5) crc32/go/4K 1.49µs ± 0% 1.49µs ± 0% ~ (p=0.484 n=5+5) sha1/py/4K 8.04µs ± 1% 8.00µs ± 1% ~ (p=0.206 n=5+5) sha1/go/4K 8.93µs ± 0% 8.93µs ± 0% ~ (p=0.389 n=5+5) unzlib/py/wczdata 25.1µs ± 1% 25.1µs ± 1% ~ (p=1.000 n=5+5) unzlib/go/wczdata 23.0µs ± 0% 22.9µs ± 0% -0.45% (p=0.016 n=5+5) unzlib/py/prod1-avg 7.16µs ± 1% 7.08µs ± 1% ~ (p=0.056 n=5+5) unzlib/go/prod1-avg 5.08µs ± 1% 5.04µs ± 0% -0.82% (p=0.008 n=5+5) disk/randread/direct/4K-min 92.4µs ± 0% 92.7µs ± 0% ~ (p=0.198 n=5+5) disk/randread/direct/4K-avg 115µs ± 0% 115µs ± 0% +0.37% (p=0.008 n=5+5) disk/randread/pagecache/4K-min 565ns ± 2% 562ns ± 1% ~ (p=0.444 n=5+5) disk/randread/pagecache/4K-avg 992ns ± 0% 992ns ± 0% ~ (p=1.032 n=4+5) name old time/object new time/object delta cluster:rio dataset:wczblk1-8 fs1-zhash.py 29.2µs ± 1% 28.8µs ± 2% ~ (p=0.111 n=4+5) fs1-zhash.go 4.68µs ± 5% 4.60µs ± 0% ~ (p=0.444 n=5+5) fs1-zhash.go+prefetch128 4.78µs ± 5% 4.62µs ±15% ~ (p=0.159 n=5+5) zeo/py/fs1-zhash.py 400µs ± 0% 370µs ± 1% -7.32% (p=0.008 n=5+5) zeo/py/fs1-zhash.go 138µs ± 1% 136µs ± 2% ~ (p=0.087 n=5+5) zeo/py/fs1-zhash.go+prefetch128 74.7µs ± 2% 74.9µs ± 2% ~ (p=0.730 n=5+5) neo/py(!log)/sqlite-zhash.py 318µs ± 7% 295µs ± 0% -7.16% (p=0.008 n=5+5) neo/py(!log)/sqlite-zhash.go 154µs ± 4% 151µs ± 6% ~ (p=1.000 n=5+5) neo/py(!log)/sqlite-zhash.go+prefetch128 125µs ± 3% 126µs ± 2% ~ (p=0.746 n=5+5) neo/py(!log)/sql-zhash.py 400µs ±57% 325µs ± 2% ~ (p=0.063 n=5+4) neo/py(!log)/sql-zhash.go 183µs ±11% 178µs ± 2% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zhash.go+prefetch128 158µs ± 3% 158µs ± 2% ~ (p=1.000 n=5+5) neo/go/fs1-zhash.py 222µs ± 4% 214µs ± 2% -3.73% (p=0.040 n=5+5) neo/go/fs1-zhash.go 68.6µs ± 2% 68.9µs ± 3% ~ (p=0.722 n=5+5) neo/go/fs1-zhash.go+prefetch128 29.0µs ± 6% 28.3µs ± 4% ~ (p=0.135 n=5+5) neo/go/fs1(!sha1)-zhash.go(!sha1) 43.9µs ± 3% 43.7µs ± 2% ~ (p=0.881 n=5+5) neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 18.8µs ± 5% 18.6µs ± 4% ~ (p=0.516 n=5+5) neo/go/sqlite-zhash.py 273µs ± 3% 256µs ± 4% -6.45% (p=0.008 n=5+5) neo/go/sqlite-zhash.go 104µs ± 1% 104µs ± 2% ~ (p=0.651 n=5+5) neo/go/sqlite-zhash.go+prefetch128 36.3µs ± 3% 37.0µs ± 8% ~ (p=0.595 n=5+5) neo/go/sqlite-zhash.go(!sha1) 94.2µs ± 3% 93.1µs ± 3% ~ (p=0.151 n=5+5) neo/go/sqlite-zhash.go+prefetch128(!sha1) 35.1µs ± 6% 35.7µs ±13% ~ (p=1.000 n=5+5) cluster:rio dataset:prod1-1024 fs1-zhash.py 23.9µs ± 1% 24.0µs ± 2% ~ (p=0.937 n=4+5) fs1-zhash.go 3.40µs ± 0% 3.40µs ± 0% ~ (all equal) fs1-zhash.go+prefetch128 3.02µs ± 9% 3.04µs ± 2% ~ (p=0.397 n=5+5) zeo/py/fs1-zhash.py 372µs ±10% 347µs ± 5% -6.84% (p=0.032 n=5+5) zeo/py/fs1-zhash.go 114µs ± 1% 114µs ± 2% ~ (p=0.548 n=5+5) zeo/py/fs1-zhash.go+prefetch128 64.6µs ± 1% 66.6µs ± 1% +3.07% (p=0.008 n=5+5) neo/py(!log)/sqlite-zhash.py 321µs ±11% 298µs ± 5% -7.13% (p=0.048 n=5+5) neo/py(!log)/sqlite-zhash.go 142µs ± 3% 142µs ± 3% ~ (p=1.000 n=5+5) neo/py(!log)/sqlite-zhash.go+prefetch128 117µs ± 1% 115µs ± 1% ~ (p=0.087 n=5+5) neo/py(!log)/sql-zhash.py 330µs ± 1% 380µs ±34% +15.42% (p=0.016 n=4+5) neo/py(!log)/sql-zhash.go 172µs ± 1% 170µs ± 2% ~ (p=0.310 n=5+5) neo/py(!log)/sql-zhash.go+prefetch128 149µs ± 2% 148µs ± 1% ~ (p=0.222 n=5+5) neo/go/fs1-zhash.py 217µs ± 1% 214µs ± 5% ~ (p=0.643 n=5+5) neo/go/fs1-zhash.go 49.8µs ± 2% 49.5µs ± 1% ~ (p=0.246 n=5+5) neo/go/fs1-zhash.go+prefetch128 18.8µs ± 1% 19.1µs ± 2% +2.03% (p=0.048 n=5+5) neo/go/fs1(!sha1)-zhash.go(!sha1) 40.4µs ± 3% 40.5µs ± 2% ~ (p=0.587 n=5+5) neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 16.1µs ± 2% 15.8µs ± 3% ~ (p=0.238 n=5+5) neo/go/sqlite-zhash.py 263µs ± 4% 253µs ± 3% -3.90% (p=0.024 n=5+5) neo/go/sqlite-zhash.go 93.1µs ± 1% 92.7µs ± 1% ~ (p=0.595 n=5+5) neo/go/sqlite-zhash.go+prefetch128 32.7µs ± 2% 32.6µs ± 4% ~ (p=0.659 n=5+5) neo/go/sqlite-zhash.go(!sha1) 89.6µs ± 1% 91.2µs ± 1% +1.79% (p=0.024 n=5+5) neo/go/sqlite-zhash.go+prefetch128(!sha1) 34.0µs ± 2% 32.7µs ± 2% -3.82% (p=0.008 n=5+5) name old req/s new req/s delta cluster:rio dataset:wczblk1-8 fs1-zwrk.go·1 300k ± 0% 299k ± 1% ~ (p=0.310 n=5+5) fs1-zwrk.go·2 546k ± 0% 547k ± 1% ~ (p=0.690 n=5+5) fs1-zwrk.go·3 810k ± 0% 812k ± 0% ~ (p=0.310 n=5+5) fs1-zwrk.go·4 1.08M ± 0% 1.08M ± 0% ~ (p=0.841 n=5+5) fs1-zwrk.go·8 1.42M ± 0% 1.42M ± 0% ~ (p=1.000 n=5+5) fs1-zwrk.go·12 1.55M ± 0% 1.55M ± 0% ~ (p=1.000 n=5+5) fs1-zwrk.go·16 1.55M ± 0% 1.54M ± 0% -0.34% (p=0.016 n=5+5) zeo/py/fs1-zwrk.go·1 7.41k ± 1% 7.42k ± 1% ~ (p=0.690 n=5+5) zeo/py/fs1-zwrk.go·2 9.03k ± 1% 8.95k ± 1% ~ (p=0.310 n=5+5) zeo/py/fs1-zwrk.go·3 9.77k ± 1% 9.86k ± 1% ~ (p=0.151 n=5+5) zeo/py/fs1-zwrk.go·4 10.1k ± 3% 10.1k ± 2% ~ (p=1.000 n=5+5) zeo/py/fs1-zwrk.go·8 10.5k ± 0% 10.4k ± 2% -1.37% (p=0.032 n=5+5) zeo/py/fs1-zwrk.go·12 10.6k ± 1% 10.6k ± 2% ~ (p=1.000 n=5+5) zeo/py/fs1-zwrk.go·16 10.6k ± 1% 10.6k ± 1% ~ (p=0.222 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 6.80k ± 2% 6.78k ± 1% ~ (p=0.841 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 8.31k ± 7% 8.25k ± 8% ~ (p=0.690 n=5+5) neo/py(!log)/sqlite-zwrk.go·3 8.60k ± 1% 8.48k ± 1% ~ (p=0.056 n=5+5) neo/py(!log)/sqlite-zwrk.go·4 8.60k ± 1% 8.52k ± 0% ~ (p=0.114 n=4+4) neo/py(!log)/sqlite-zwrk.go·8 8.61k ± 1% 8.51k ± 1% ~ (p=0.095 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 8.56k ± 1% 8.46k ± 2% ~ (p=0.151 n=5+5) neo/py(!log)/sqlite-zwrk.go·16 8.49k ± 3% 8.51k ± 1% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·1 5.62k ± 6% 5.59k ± 2% ~ (p=0.310 n=5+5) neo/py(!log)/sql-zwrk.go·2 6.75k ± 4% 6.83k ± 1% ~ (p=0.190 n=5+4) neo/py(!log)/sql-zwrk.go·3 6.77k ± 2% 6.71k ± 2% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zwrk.go·4 6.51k ± 7% 6.56k ± 4% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·8 6.56k ± 4% 6.68k ± 4% ~ (p=0.310 n=5+5) neo/py(!log)/sql-zwrk.go·12 6.84k ± 1% 6.73k ± 6% ~ (p=0.730 n=4+5) neo/py(!log)/sql-zwrk.go·16 6.73k ± 3% 6.71k ± 3% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·1 15.5k ± 0% 15.6k ± 0% ~ (p=0.095 n=5+5) neo/go/fs1-zwrk.go·2 29.9k ± 1% 30.2k ± 1% +0.84% (p=0.032 n=5+5) neo/go/fs1-zwrk.go·3 39.4k ± 0% 39.7k ± 0% +0.70% (p=0.008 n=5+5) neo/go/fs1-zwrk.go·4 49.4k ± 0% 49.6k ± 0% +0.54% (p=0.008 n=5+5) neo/go/fs1-zwrk.go·8 68.4k ± 0% 68.8k ± 0% +0.62% (p=0.008 n=5+5) neo/go/fs1-zwrk.go·12 72.5k ± 0% 73.0k ± 0% +0.66% (p=0.016 n=5+5) neo/go/fs1-zwrk.go·16 73.2k ± 0% 73.7k ± 1% +0.79% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 26.2k ± 1% 25.3k ± 2% -3.17% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 47.6k ± 0% 47.8k ± 0% +0.46% (p=0.032 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 59.4k ± 0% 59.6k ± 0% ~ (p=0.095 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 72.2k ± 0% 72.4k ± 0% ~ (p=0.056 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 96.7k ± 0% 96.8k ± 0% ~ (p=0.841 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 109k ± 0% 110k ± 0% ~ (p=0.841 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 113k ± 1% 113k ± 1% ~ (p=0.548 n=5+5) neo/go/sqlite-zwrk.go·1 9.82k ± 0% 9.91k ± 0% +0.88% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go·2 18.3k ± 0% 18.4k ± 0% +0.56% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go·3 25.3k ± 0% 25.5k ± 0% +0.91% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go·4 30.3k ± 0% 30.6k ± 0% +0.80% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go·8 39.5k ± 0% 40.1k ± 0% +1.54% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go·12 40.8k ± 2% 41.8k ± 1% +2.31% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go·16 40.5k ± 2% 41.8k ± 2% +3.20% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·1 11.0k ± 1% 11.1k ± 1% ~ (p=0.222 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 20.0k ± 0% 20.1k ± 0% +0.35% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·3 27.9k ± 0% 28.0k ± 0% +0.27% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·4 34.1k ± 0% 34.3k ± 0% +0.62% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 44.1k ± 1% 44.7k ± 1% +1.53% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·12 43.1k ± 1% 44.5k ± 1% +3.33% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 41.2k ± 2% 43.0k ± 2% +4.21% (p=0.008 n=5+5) cluster:rio dataset:prod1-1024 fs1-zwrk.go·1 465k ± 1% 461k ± 1% ~ (p=0.056 n=5+5) fs1-zwrk.go·2 920k ± 0% 918k ± 0% ~ (p=0.730 n=4+5) fs1-zwrk.go·3 1.36M ± 1% 1.37M ± 1% ~ (p=0.548 n=5+5) fs1-zwrk.go·4 1.81M ± 0% 1.80M ± 3% ~ (p=0.310 n=5+5) fs1-zwrk.go·8 2.37M ± 1% 2.38M ± 2% ~ (p=0.690 n=5+5) fs1-zwrk.go·12 2.41M ± 0% 2.42M ± 0% ~ (p=0.690 n=5+5) fs1-zwrk.go·16 2.42M ± 0% 2.41M ± 0% ~ (p=0.056 n=5+5) zeo/py/fs1-zwrk.go·1 8.98k ± 1% 8.88k ± 1% -1.08% (p=0.032 n=5+5) zeo/py/fs1-zwrk.go·2 11.7k ± 1% 11.6k ± 2% ~ (p=0.310 n=5+5) zeo/py/fs1-zwrk.go·3 12.9k ± 2% 12.5k ± 2% -2.84% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·4 13.4k ± 4% 13.1k ± 2% ~ (p=0.095 n=5+5) zeo/py/fs1-zwrk.go·8 14.0k ± 2% 13.6k ± 1% -2.77% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·12 14.2k ± 2% 13.9k ± 1% -2.05% (p=0.032 n=5+5) zeo/py/fs1-zwrk.go·16 14.2k ± 3% 13.8k ± 1% -2.84% (p=0.032 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 7.16k ± 4% 7.12k ± 3% ~ (p=0.548 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 8.75k ± 1% 8.64k ± 7% ~ (p=1.000 n=5+5) neo/py(!log)/sqlite-zwrk.go·3 8.65k ± 4% 8.79k ± 1% ~ (p=0.548 n=5+5) neo/py(!log)/sqlite-zwrk.go·4 8.53k ± 6% 8.73k ± 2% ~ (p=0.310 n=5+5) neo/py(!log)/sqlite-zwrk.go·8 8.61k ± 3% 8.60k ± 2% ~ (p=1.000 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 8.64k ± 0% 8.78k ± 1% +1.63% (p=0.016 n=4+5) neo/py(!log)/sqlite-zwrk.go·16 8.64k ± 1% 8.58k ± 3% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·1 5.88k ± 1% 5.91k ± 1% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zwrk.go·2 6.79k ± 2% 6.71k ± 9% ~ (p=0.841 n=5+5) neo/py(!log)/sql-zwrk.go·3 6.58k ± 4% 6.85k ± 2% ~ (p=0.056 n=5+5) neo/py(!log)/sql-zwrk.go·4 6.68k ± 4% 6.82k ± 1% ~ (p=0.730 n=5+4) neo/py(!log)/sql-zwrk.go·8 6.83k ± 1% 6.80k ± 6% ~ (p=0.421 n=5+5) neo/py(!log)/sql-zwrk.go·12 6.66k ± 4% 6.87k ± 2% +3.10% (p=0.016 n=5+5) neo/py(!log)/sql-zwrk.go·16 6.65k ± 5% 6.90k ± 2% ~ (p=0.151 n=5+5) neo/go/fs1-zwrk.go·1 21.8k ± 1% 21.9k ± 2% ~ (p=0.222 n=5+5) neo/go/fs1-zwrk.go·2 39.2k ± 1% 39.6k ± 1% +0.94% (p=0.016 n=5+5) neo/go/fs1-zwrk.go·3 51.4k ± 0% 51.5k ± 0% ~ (p=0.421 n=5+5) neo/go/fs1-zwrk.go·4 62.8k ± 0% 62.8k ± 0% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·8 80.7k ± 1% 80.2k ± 1% ~ (p=0.421 n=5+5) neo/go/fs1-zwrk.go·12 80.0k ± 2% 79.6k ± 3% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·16 78.3k ± 2% 77.1k ± 5% ~ (p=0.421 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 26.5k ± 1% 26.9k ± 1% +1.52% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 48.8k ± 0% 49.2k ± 0% +0.89% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 61.8k ± 0% 62.1k ± 0% ~ (p=0.056 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 74.0k ± 0% 74.2k ± 0% ~ (p=0.151 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 91.3k ± 0% 91.9k ± 2% ~ (p=0.190 n=4+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 93.1k ± 2% 92.9k ± 2% ~ (p=0.841 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 89.7k ± 2% 90.1k ± 2% ~ (p=0.841 n=5+5) neo/go/sqlite-zwrk.go·1 11.0k ± 1% 11.1k ± 0% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go·2 19.4k ± 1% 19.4k ± 0% ~ (p=0.841 n=5+5) neo/go/sqlite-zwrk.go·3 26.6k ± 0% 26.5k ± 0% ~ (p=0.095 n=5+5) neo/go/sqlite-zwrk.go·4 31.9k ± 0% 31.7k ± 0% -0.47% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go·8 37.4k ± 2% 37.3k ± 2% ~ (p=0.841 n=5+5) neo/go/sqlite-zwrk.go·12 35.2k ± 3% 35.4k ± 2% ~ (p=0.421 n=5+5) neo/go/sqlite-zwrk.go·16 34.6k ± 2% 34.8k ± 2% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·1 11.5k ± 1% 11.4k ± 1% -1.34% (p=0.032 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 20.1k ± 0% 19.8k ± 0% -1.52% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·3 27.6k ± 0% 27.3k ± 1% -0.93% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·4 33.4k ± 0% 33.1k ± 1% -0.81% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 38.8k ± 2% 38.8k ± 1% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·12 36.4k ± 1% 36.0k ± 2% ~ (p=0.222 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 35.2k ± 2% 35.1k ± 2% ~ (p=0.690 n=5+5) name old latency-time/object new latency-time/object delta cluster:rio dataset:wczblk1-8 fs1-zwrk.go·1 3.33µs ± 0% 3.34µs ± 1% ~ (p=0.286 n=5+5) fs1-zwrk.go·2 3.67µs ± 0% 3.65µs ± 1% ~ (p=0.667 n=5+5) fs1-zwrk.go·3 3.70µs ± 0% 3.69µs ± 0% ~ (p=0.310 n=5+5) fs1-zwrk.go·4 3.72µs ± 0% 3.72µs ± 0% ~ (p=0.984 n=5+5) fs1-zwrk.go·8 5.62µs ± 0% 5.62µs ± 0% ~ (p=0.889 n=5+5) fs1-zwrk.go·12 7.76µs ± 0% 7.76µs ± 0% ~ (p=1.000 n=5+5) fs1-zwrk.go·16 10.3µs ± 0% 10.4µs ± 0% +0.34% (p=0.016 n=5+5) zeo/py/fs1-zwrk.go·1 135µs ± 1% 135µs ± 1% ~ (p=0.690 n=5+5) zeo/py/fs1-zwrk.go·2 222µs ± 1% 223µs ± 1% ~ (p=0.310 n=5+5) zeo/py/fs1-zwrk.go·3 307µs ± 1% 304µs ± 1% ~ (p=0.151 n=5+5) zeo/py/fs1-zwrk.go·4 398µs ± 3% 397µs ± 2% ~ (p=1.000 n=5+5) zeo/py/fs1-zwrk.go·8 759µs ± 0% 770µs ± 2% +1.41% (p=0.032 n=5+5) zeo/py/fs1-zwrk.go·12 1.13ms ± 1% 1.14ms ± 2% ~ (p=1.000 n=5+5) zeo/py/fs1-zwrk.go·16 1.50ms ± 1% 1.51ms ± 1% ~ (p=0.222 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 147µs ± 2% 147µs ± 1% ~ (p=0.841 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 241µs ± 8% 243µs ± 8% ~ (p=0.690 n=5+5) neo/py(!log)/sqlite-zwrk.go·3 349µs ± 1% 354µs ± 1% ~ (p=0.056 n=5+5) neo/py(!log)/sqlite-zwrk.go·4 465µs ± 1% 470µs ± 0% ~ (p=0.114 n=4+4) neo/py(!log)/sqlite-zwrk.go·8 930µs ± 1% 940µs ± 1% ~ (p=0.095 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 1.40ms ± 1% 1.42ms ± 2% ~ (p=0.151 n=5+5) neo/py(!log)/sqlite-zwrk.go·16 1.88ms ± 3% 1.88ms ± 1% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·1 178µs ± 6% 179µs ± 2% ~ (p=0.310 n=5+5) neo/py(!log)/sql-zwrk.go·2 297µs ± 4% 293µs ± 1% ~ (p=0.190 n=5+4) neo/py(!log)/sql-zwrk.go·3 443µs ± 2% 447µs ± 2% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zwrk.go·4 616µs ± 8% 610µs ± 4% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·8 1.22ms ± 5% 1.20ms ± 4% ~ (p=0.310 n=5+5) neo/py(!log)/sql-zwrk.go·12 1.75ms ± 1% 1.79ms ± 6% ~ (p=0.730 n=4+5) neo/py(!log)/sql-zwrk.go·16 2.38ms ± 3% 2.38ms ± 3% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·1 64.4µs ± 0% 64.1µs ± 0% ~ (p=0.095 n=5+5) neo/go/fs1-zwrk.go·2 66.8µs ± 1% 66.3µs ± 1% -0.83% (p=0.032 n=5+5) neo/go/fs1-zwrk.go·3 76.1µs ± 0% 75.5µs ± 0% -0.69% (p=0.008 n=5+5) neo/go/fs1-zwrk.go·4 81.0µs ± 0% 80.6µs ± 0% -0.53% (p=0.008 n=5+5) neo/go/fs1-zwrk.go·8 117µs ± 0% 116µs ± 0% -0.62% (p=0.008 n=5+5) neo/go/fs1-zwrk.go·12 165µs ± 0% 164µs ± 0% -0.65% (p=0.016 n=5+5) neo/go/fs1-zwrk.go·16 219µs ± 0% 217µs ± 1% -0.78% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 38.2µs ± 1% 39.5µs ± 2% +3.29% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 42.0µs ± 0% 41.8µs ± 0% -0.45% (p=0.032 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 50.5µs ± 0% 50.4µs ± 0% ~ (p=0.095 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 55.4µs ± 0% 55.3µs ± 0% ~ (p=0.063 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 82.8µs ± 0% 82.7µs ± 0% ~ (p=0.841 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 110µs ± 0% 110µs ± 0% ~ (p=0.841 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 142µs ± 1% 142µs ± 1% ~ (p=0.548 n=5+5) neo/go/sqlite-zwrk.go·1 102µs ± 0% 101µs ± 0% -0.87% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go·2 110µs ± 0% 109µs ± 0% -0.55% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go·3 119µs ± 0% 117µs ± 0% -0.90% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go·4 132µs ± 0% 131µs ± 0% -0.79% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go·8 203µs ± 0% 200µs ± 0% -1.52% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go·12 294µs ± 2% 287µs ± 1% -2.26% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go·16 395µs ± 2% 383µs ± 2% -3.11% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·1 91.1µs ± 1% 90.4µs ± 1% ~ (p=0.222 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 100µs ± 0% 100µs ± 0% -0.35% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·3 108µs ± 0% 107µs ± 0% -0.27% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·4 117µs ± 0% 117µs ± 0% -0.62% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 182µs ± 1% 179µs ± 1% -1.51% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·12 279µs ± 1% 270µs ± 1% -3.22% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 388µs ± 2% 372µs ± 2% -4.03% (p=0.008 n=5+5) cluster:rio dataset:prod1-1024 fs1-zwrk.go·1 2.15µs ± 1% 2.17µs ± 1% ~ (p=0.056 n=5+5) fs1-zwrk.go·2 2.17µs ± 0% 2.18µs ± 0% ~ (p=0.603 n=4+5) fs1-zwrk.go·3 2.20µs ± 1% 2.20µs ± 1% ~ (p=0.460 n=5+5) fs1-zwrk.go·4 2.21µs ± 0% 2.23µs ± 3% ~ (p=0.278 n=5+5) fs1-zwrk.go·8 3.37µs ± 1% 3.36µs ± 2% ~ (p=0.690 n=5+5) fs1-zwrk.go·12 4.97µs ± 0% 4.97µs ± 0% ~ (p=0.675 n=5+5) fs1-zwrk.go·16 6.61µs ± 0% 6.63µs ± 0% ~ (p=0.063 n=5+5) zeo/py/fs1-zwrk.go·1 111µs ± 1% 113µs ± 1% +1.09% (p=0.032 n=5+5) zeo/py/fs1-zwrk.go·2 171µs ± 1% 173µs ± 2% ~ (p=0.310 n=5+5) zeo/py/fs1-zwrk.go·3 233µs ± 2% 240µs ± 2% +2.94% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·4 298µs ± 4% 306µs ± 2% ~ (p=0.095 n=5+5) zeo/py/fs1-zwrk.go·8 572µs ± 2% 588µs ± 1% +2.84% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·12 844µs ± 2% 861µs ± 1% +2.07% (p=0.032 n=5+5) zeo/py/fs1-zwrk.go·16 1.12ms ± 3% 1.16ms ± 1% +2.90% (p=0.032 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 140µs ± 4% 140µs ± 3% ~ (p=0.548 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 229µs ± 1% 232µs ± 7% ~ (p=1.000 n=5+5) neo/py(!log)/sqlite-zwrk.go·3 347µs ± 5% 341µs ± 1% ~ (p=0.548 n=5+5) neo/py(!log)/sqlite-zwrk.go·4 470µs ± 7% 458µs ± 2% ~ (p=0.310 n=5+5) neo/py(!log)/sqlite-zwrk.go·8 929µs ± 3% 930µs ± 2% ~ (p=1.000 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 1.39ms ± 0% 1.37ms ± 1% -1.60% (p=0.016 n=4+5) neo/py(!log)/sqlite-zwrk.go·16 1.85ms ± 1% 1.86ms ± 3% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·1 170µs ± 1% 169µs ± 1% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zwrk.go·2 294µs ± 2% 299µs ±10% ~ (p=0.841 n=5+5) neo/py(!log)/sql-zwrk.go·3 456µs ± 4% 438µs ± 1% ~ (p=0.056 n=5+5) neo/py(!log)/sql-zwrk.go·4 599µs ± 4% 587µs ± 1% ~ (p=0.730 n=5+4) neo/py(!log)/sql-zwrk.go·8 1.17ms ± 1% 1.18ms ± 6% ~ (p=0.421 n=5+5) neo/py(!log)/sql-zwrk.go·12 1.80ms ± 4% 1.75ms ± 2% -3.05% (p=0.016 n=5+5) neo/py(!log)/sql-zwrk.go·16 2.41ms ± 5% 2.32ms ± 2% ~ (p=0.151 n=5+5) neo/go/fs1-zwrk.go·1 45.9µs ± 1% 45.6µs ± 2% ~ (p=0.167 n=5+5) neo/go/fs1-zwrk.go·2 51.0µs ± 1% 50.6µs ± 1% -0.94% (p=0.016 n=5+5) neo/go/fs1-zwrk.go·3 58.3µs ± 0% 58.3µs ± 0% ~ (p=0.421 n=5+5) neo/go/fs1-zwrk.go·4 63.7µs ± 0% 63.7µs ± 0% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·8 99.2µs ± 1% 99.8µs ± 1% ~ (p=0.421 n=5+5) neo/go/fs1-zwrk.go·12 150µs ± 2% 151µs ± 3% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·16 204µs ± 3% 208µs ± 5% ~ (p=0.421 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 37.7µs ± 1% 37.2µs ± 1% -1.50% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 41.0µs ± 0% 40.6µs ± 0% -0.88% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 48.5µs ± 0% 48.3µs ± 0% ~ (p=0.056 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 54.0µs ± 0% 53.9µs ± 0% ~ (p=0.151 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 87.6µs ± 0% 87.1µs ± 2% ~ (p=0.190 n=4+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 129µs ± 2% 129µs ± 2% ~ (p=0.841 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 178µs ± 2% 178µs ± 2% ~ (p=0.841 n=5+5) neo/go/sqlite-zwrk.go·1 90.7µs ± 1% 90.4µs ± 0% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go·2 103µs ± 1% 103µs ± 0% ~ (p=0.841 n=5+5) neo/go/sqlite-zwrk.go·3 113µs ± 0% 113µs ± 0% ~ (p=0.095 n=5+5) neo/go/sqlite-zwrk.go·4 125µs ± 0% 126µs ± 0% +0.47% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go·8 214µs ± 2% 215µs ± 2% ~ (p=0.841 n=5+5) neo/go/sqlite-zwrk.go·12 341µs ± 3% 339µs ± 2% ~ (p=0.421 n=5+5) neo/go/sqlite-zwrk.go·16 462µs ± 2% 460µs ± 2% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·1 86.7µs ± 1% 87.9µs ± 1% +1.36% (p=0.032 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 100µs ± 0% 101µs ± 0% +1.54% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·3 109µs ± 0% 110µs ± 1% +0.94% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·4 120µs ± 0% 121µs ± 1% +0.82% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 206µs ± 2% 206µs ± 1% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·12 330µs ± 1% 333µs ± 2% ~ (p=0.222 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 455µs ± 2% 456µs ± 2% ~ (p=0.690 n=5+5)
3695ff12