-
Kirill Smelkov authored
Remeasure with same settings as previous neo1 localhost with C-enabled (9644774a): The data is more or less the same and in particular timings for either sql backend or python client are noisy. ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ $ benchstat -split node,cluster,dataset 20180306-neo1-ffixed-c.txt 20180308-neo1-ffixed-c-zwrk1s.txt name old pystone/s new pystone/s delta node:neo1 pystone 106k ± 1% 106k ± 1% ~ (p=0.690 n=5+5) name old time/op new time/op delta node:neo1 crc32/py/4K 5.13µs ± 1% 5.13µs ± 1% ~ (p=1.000 n=5+5) crc32/go/4K 2.79µs ± 0% 2.79µs ± 0% ~ (p=1.000 n=5+5) sha1/py/4K 13.4µs ± 1% 13.5µs ± 1% ~ (p=0.730 n=5+4) sha1/go/4K 9.83µs ± 0% 9.82µs ± 0% ~ (p=0.810 n=5+5) unzlib/py/wczdata 36.1µs ± 0% 35.9µs ± 1% ~ (p=0.421 n=5+5) unzlib/go/wczdata 31.1µs ± 1% 31.2µs ± 0% ~ (p=0.421 n=5+5) unzlib/py/prod1-avg 16.3µs ± 2% 16.1µs ± 3% ~ (p=0.310 n=5+5) unzlib/go/prod1-avg 9.42µs ± 0% 9.38µs ± 1% ~ (p=0.222 n=5+5) disk/randread/direct/4K-min 162µs ± 0% 162µs ± 0% ~ (p=0.619 n=5+4) disk/randread/direct/4K-avg 187µs ± 2% 187µs ± 1% ~ (p=0.952 n=5+5) disk/randread/pagecache/4K-min 389ns ± 1% 392ns ± 1% ~ (p=0.167 n=5+5) disk/randread/pagecache/4K-avg 804ns ± 0% 808ns ± 0% +0.53% (p=0.016 n=4+5) name old time/object new time/object delta cluster:neo1 dataset:wczblk1-8 fs1-zhash.py 34.7µs ± 2% 34.8µs ± 1% ~ (p=0.770 n=5+5) fs1-zhash.go 6.00µs ± 2% 5.96µs ± 1% ~ (p=0.683 n=5+5) fs1-zhash.go+prefetch128 6.52µs ± 4% 6.60µs ± 0% ~ (p=0.397 n=5+4) zeo/py/fs1-zhash.py 523µs ± 1% 524µs ± 2% ~ (p=0.841 n=5+5) zeo/py/fs1-zhash.go 194µs ± 4% 197µs ± 6% ~ (p=0.421 n=5+5) zeo/py/fs1-zhash.go+prefetch128 98.6µs ± 3% 100.1µs ± 2% ~ (p=0.135 n=5+5) neo/py(!log)/sqlite-zhash.py 684µs ± 3% 625µs ±20% ~ (p=0.056 n=5+5) neo/py(!log)/sqlite-zhash.go 236µs ± 2% 231µs ± 5% ~ (p=0.421 n=5+5) neo/py(!log)/sqlite-zhash.go+prefetch128 162µs ± 2% 164µs ± 1% ~ (p=0.095 n=5+5) neo/py(!log)/sql-zhash.py 942µs ±47% 992µs ±44% ~ (p=0.841 n=5+5) neo/py(!log)/sql-zhash.go 300µs ±17% 329µs ±14% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zhash.go+prefetch128 240µs ± 6% 242µs ± 5% ~ (p=1.000 n=5+5) neo/go/fs1-zhash.py 383µs ±20% 373µs ±19% ~ (p=0.802 n=5+5) neo/go/fs1-zhash.go 81.3µs ± 1% 80.0µs ± 2% -1.62% (p=0.040 n=5+5) neo/go/fs1-zhash.go+prefetch128 33.8µs ± 5% 34.8µs ± 5% ~ (p=0.389 n=5+5) neo/go/fs1(!sha1)-zhash.go(!sha1) 57.6µs ± 3% 57.5µs ± 3% ~ (p=1.000 n=5+5) neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 22.9µs ± 6% 23.8µs ± 7% ~ (p=0.103 n=5+5) neo/go/sqlite-zhash.py 402µs ± 6% 415µs ± 3% ~ (p=0.421 n=5+5) neo/go/sqlite-zhash.go 125µs ± 1% 126µs ± 1% ~ (p=0.421 n=5+5) neo/go/sqlite-zhash.go+prefetch128 48.4µs ± 8% 45.6µs ± 6% ~ (p=0.310 n=5+5) neo/go/sqlite-zhash.go(!sha1) 116µs ± 2% 117µs ± 3% ~ (p=0.413 n=5+5) neo/go/sqlite-zhash.go+prefetch128(!sha1) 45.9µs ± 5% 45.8µs ± 4% ~ (p=0.841 n=5+5) cluster:neo1 dataset:prod1-1024 fs1-zhash.py 28.9µs ± 1% 29.1µs ± 1% ~ (p=0.167 n=5+5) fs1-zhash.go 3.76µs ± 4% 3.76µs ± 2% ~ (p=1.000 n=5+5) fs1-zhash.go+prefetch128 3.86µs ± 2% 3.82µs ± 3% ~ (p=0.683 n=5+5) zeo/py/fs1-zhash.py 474µs ± 2% 490µs ± 1% +3.34% (p=0.008 n=5+5) zeo/py/fs1-zhash.go 170µs ± 3% 173µs ±12% ~ (p=0.690 n=5+5) zeo/py/fs1-zhash.go+prefetch128 87.8µs ± 1% 86.6µs ± 1% -1.32% (p=0.032 n=5+5) neo/py(!log)/sqlite-zhash.py 665µs ± 2% 639µs ±23% ~ (p=0.651 n=5+5) neo/py(!log)/sqlite-zhash.go 219µs ± 2% 216µs ± 3% ~ (p=0.206 n=5+5) neo/py(!log)/sqlite-zhash.go+prefetch128 151µs ± 1% 150µs ± 2% ~ (p=0.611 n=5+5) neo/py(!log)/sql-zhash.py 886µs ±56% 912µs ±50% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zhash.go 298µs ± 9% 307µs ±10% ~ (p=0.421 n=5+5) neo/py(!log)/sql-zhash.go+prefetch128 230µs ± 3% 227µs ± 3% ~ (p=0.421 n=5+5) neo/go/fs1-zhash.py 319µs ±11% 336µs ±11% ~ (p=0.389 n=5+5) neo/go/fs1-zhash.go 61.3µs ± 3% 61.5µs ± 3% ~ (p=0.968 n=5+5) neo/go/fs1-zhash.go+prefetch128 22.5µs ± 3% 22.6µs ± 3% ~ (p=0.857 n=5+5) neo/go/fs1(!sha1)-zhash.go(!sha1) 52.0µs ± 3% 52.5µs ± 4% ~ (p=0.841 n=5+5) neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 18.3µs ± 2% 18.2µs ± 4% ~ (p=0.968 n=5+5) neo/go/sqlite-zhash.py 382µs ± 6% 387µs ± 4% ~ (p=0.690 n=5+5) neo/go/sqlite-zhash.go 113µs ± 1% 113µs ± 1% ~ (p=0.524 n=5+5) neo/go/sqlite-zhash.go+prefetch128 40.9µs ± 4% 41.7µs ± 3% ~ (p=0.341 n=5+5) neo/go/sqlite-zhash.go(!sha1) 108µs ± 1% 110µs ± 2% ~ (p=0.063 n=5+5) neo/go/sqlite-zhash.go+prefetch128(!sha1) 41.1µs ± 5% 40.9µs ± 5% ~ (p=0.841 n=5+5) name old req/s new req/s delta cluster:neo1 dataset:wczblk1-8 fs1-zwrk.go·1 229k ± 0% 230k ± 0% +0.37% (p=0.016 n=5+5) fs1-zwrk.go·2 443k ± 1% 447k ± 1% +1.08% (p=0.032 n=5+5) fs1-zwrk.go·3 662k ± 1% 666k ± 0% +0.61% (p=0.032 n=5+5) fs1-zwrk.go·4 867k ± 1% 870k ± 0% ~ (p=0.413 n=5+4) fs1-zwrk.go·8 988k ± 0% 991k ± 0% ~ (p=0.095 n=5+5) fs1-zwrk.go·12 1.02M ± 0% 1.02M ± 0% ~ (p=0.841 n=5+5) fs1-zwrk.go·16 976k ±12% 1016k ± 0% ~ (p=0.421 n=5+5) zeo/py/fs1-zwrk.go·1 5.15k ± 1% 5.06k ± 1% -1.78% (p=0.032 n=5+5) zeo/py/fs1-zwrk.go·2 7.08k ± 1% 6.93k ± 2% -2.23% (p=0.032 n=5+5) zeo/py/fs1-zwrk.go·3 7.73k ± 1% 7.48k ± 1% -3.20% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·4 7.97k ± 4% 7.69k ± 2% ~ (p=0.095 n=5+5) zeo/py/fs1-zwrk.go·8 8.30k ± 2% 8.02k ± 1% -3.33% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·12 8.15k ± 1% 8.40k ± 2% +3.06% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·16 8.25k ± 1% 8.46k ± 1% +2.60% (p=0.008 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 4.31k ± 4% 4.22k ± 2% ~ (p=0.222 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 6.28k ± 5% 6.29k ± 3% ~ (p=0.548 n=5+5) neo/py(!log)/sqlite-zwrk.go·3 6.38k ± 0% 6.29k ± 2% -1.48% (p=0.016 n=4+5) neo/py(!log)/sqlite-zwrk.go·4 6.15k ± 5% 6.26k ± 3% ~ (p=0.690 n=5+5) neo/py(!log)/sqlite-zwrk.go·8 6.27k ± 4% 6.18k ± 3% ~ (p=0.222 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 6.33k ± 2% 6.04k ± 5% -4.50% (p=0.032 n=5+5) neo/py(!log)/sqlite-zwrk.go·16 6.25k ± 4% 6.21k ± 5% ~ (p=0.421 n=5+5) neo/py(!log)/sql-zwrk.go·1 3.10k ± 6% 3.27k ±13% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zwrk.go·2 3.98k ± 1% 3.98k ± 3% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·3 4.04k ± 3% 3.97k ± 4% ~ (p=0.690 n=5+5) neo/py(!log)/sql-zwrk.go·4 4.06k ± 4% 3.95k ± 5% ~ (p=0.222 n=5+5) neo/py(!log)/sql-zwrk.go·8 3.79k ± 7% 4.07k ± 4% +7.21% (p=0.032 n=5+5) neo/py(!log)/sql-zwrk.go·12 3.98k ± 3% 4.11k ± 6% ~ (p=0.421 n=5+5) neo/py(!log)/sql-zwrk.go·16 3.94k ± 1% 4.03k ± 9% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·1 12.8k ± 0% 12.9k ± 1% ~ (p=0.548 n=5+5) neo/go/fs1-zwrk.go·2 24.8k ± 0% 24.9k ± 0% ~ (p=0.556 n=4+5) neo/go/fs1-zwrk.go·3 32.3k ± 0% 32.3k ± 0% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·4 40.7k ± 0% 40.9k ± 0% +0.37% (p=0.008 n=5+5) neo/go/fs1-zwrk.go·8 54.5k ± 1% 54.7k ± 1% ~ (p=0.421 n=5+5) neo/go/fs1-zwrk.go·12 56.5k ± 1% 56.5k ± 1% ~ (p=1.000 n=5+5) neo/go/fs1-zwrk.go·16 53.2k ±10% 54.5k ± 1% ~ (p=0.548 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 19.0k ± 2% 19.0k ± 2% ~ (p=1.000 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 37.8k ± 0% 37.5k ± 2% ~ (p=0.222 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 48.0k ± 1% 48.0k ± 0% ~ (p=1.000 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 59.0k ± 0% 59.0k ± 0% ~ (p=0.548 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 78.0k ± 1% 78.1k ± 0% ~ (p=0.690 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 82.2k ± 2% 80.7k ± 7% ~ (p=0.421 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 80.4k ± 1% 80.7k ± 1% ~ (p=0.841 n=5+5) neo/go/sqlite-zwrk.go·1 8.06k ± 4% 8.12k ± 0% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go·2 14.9k ± 0% 14.9k ± 0% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go·3 20.7k ± 0% 20.9k ± 0% +0.59% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go·4 24.8k ± 0% 25.0k ± 0% +0.78% (p=0.016 n=5+4) neo/go/sqlite-zwrk.go·8 31.7k ± 1% 32.1k ± 1% +1.34% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go·12 30.8k ± 5% 32.3k ± 1% +4.85% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go·16 30.4k ± 2% 30.6k ±10% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·1 8.95k ± 1% 8.84k ± 1% -1.25% (p=0.032 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 16.2k ± 1% 16.2k ± 0% ~ (p=0.548 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·3 22.6k ± 0% 22.5k ± 0% -0.34% (p=0.016 n=4+5) neo/go/sqlite-zwrk.go(!sha1)·4 27.9k ± 0% 27.5k ± 0% -1.27% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 35.0k ± 1% 34.2k ± 1% -2.32% (p=0.016 n=5+4) neo/go/sqlite-zwrk.go(!sha1)·12 34.7k ± 1% 33.4k ± 2% -3.75% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 33.0k ±11% 32.8k ± 2% ~ (p=0.222 n=5+5) cluster:neo1 dataset:prod1-1024 fs1-zwrk.go·1 451k ± 0% 454k ± 0% ~ (p=0.056 n=5+5) fs1-zwrk.go·2 893k ± 0% 899k ± 0% +0.68% (p=0.008 n=5+5) fs1-zwrk.go·3 1.34M ± 1% 1.31M ± 8% ~ (p=0.841 n=5+5) fs1-zwrk.go·4 1.77M ± 0% 1.77M ± 1% ~ (p=0.841 n=5+5) fs1-zwrk.go·8 1.99M ± 1% 2.02M ± 2% ~ (p=0.151 n=5+5) fs1-zwrk.go·12 2.03M ± 1% 2.04M ± 0% ~ (p=0.190 n=4+5) fs1-zwrk.go·16 2.03M ± 0% 2.04M ± 0% ~ (p=0.841 n=5+5) zeo/py/fs1-zwrk.go·1 5.79k ± 3% 5.84k ± 4% ~ (p=0.548 n=5+5) zeo/py/fs1-zwrk.go·2 8.55k ± 1% 8.59k ± 2% ~ (p=0.310 n=5+5) zeo/py/fs1-zwrk.go·3 9.28k ± 7% 9.37k ± 2% ~ (p=1.000 n=5+5) zeo/py/fs1-zwrk.go·4 9.72k ± 1% 9.75k ± 3% ~ (p=0.841 n=5+5) zeo/py/fs1-zwrk.go·8 10.4k ± 1% 10.2k ± 3% -1.89% (p=0.032 n=5+5) zeo/py/fs1-zwrk.go·12 10.5k ± 1% 10.5k ± 1% ~ (p=0.841 n=5+5) zeo/py/fs1-zwrk.go·16 10.4k ± 4% 10.5k ± 1% ~ (p=1.000 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 4.90k ± 7% 4.79k ± 5% ~ (p=0.548 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 6.28k ± 4% 6.49k ± 0% ~ (p=0.190 n=5+4) neo/py(!log)/sqlite-zwrk.go·3 6.32k ± 5% 6.37k ± 6% ~ (p=1.000 n=5+5) neo/py(!log)/sqlite-zwrk.go·4 6.45k ± 2% 6.41k ± 1% ~ (p=0.548 n=5+5) neo/py(!log)/sqlite-zwrk.go·8 6.45k ± 2% 6.36k ± 5% ~ (p=0.690 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 6.31k ± 3% 6.43k ± 0% ~ (p=0.556 n=5+4) neo/py(!log)/sqlite-zwrk.go·16 6.36k ± 5% 6.37k ± 1% ~ (p=0.310 n=5+5) neo/py(!log)/sql-zwrk.go·1 3.50k ± 9% 3.32k ±13% ~ (p=0.310 n=5+5) neo/py(!log)/sql-zwrk.go·2 4.05k ± 6% 4.08k ± 7% ~ (p=0.841 n=5+5) neo/py(!log)/sql-zwrk.go·3 4.06k ± 7% 4.11k ± 3% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·4 3.98k ± 4% 4.08k ± 4% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zwrk.go·8 4.15k ± 3% 3.98k ± 3% ~ (p=0.056 n=5+5) neo/py(!log)/sql-zwrk.go·12 4.00k ± 5% 4.11k ± 5% ~ (p=0.310 n=5+5) neo/py(!log)/sql-zwrk.go·16 3.96k ±11% 4.22k ± 4% ~ (p=0.151 n=5+5) neo/go/fs1-zwrk.go·1 17.1k ± 1% 17.3k ± 1% +1.36% (p=0.008 n=5+5) neo/go/fs1-zwrk.go·2 32.6k ± 0% 32.8k ± 1% ~ (p=0.111 n=5+4) neo/go/fs1-zwrk.go·3 43.3k ± 0% 43.3k ± 0% ~ (p=0.690 n=5+5) neo/go/fs1-zwrk.go·4 52.9k ± 0% 53.0k ± 0% ~ (p=0.690 n=5+5) neo/go/fs1-zwrk.go·8 66.3k ± 1% 66.5k ± 1% ~ (p=0.905 n=4+5) neo/go/fs1-zwrk.go·12 61.6k ± 1% 60.7k ± 2% ~ (p=0.310 n=5+5) neo/go/fs1-zwrk.go·16 55.6k ± 4% 55.5k ± 2% ~ (p=0.841 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 19.6k ± 5% 20.1k ± 2% ~ (p=0.151 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 40.3k ± 0% 40.2k ± 1% ~ (p=0.548 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 51.6k ± 0% 51.5k ± 0% ~ (p=0.548 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 62.0k ± 0% 62.1k ± 0% ~ (p=0.548 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 74.2k ± 4% 74.3k ± 2% ~ (p=1.000 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 64.8k ± 7% 67.1k ± 3% ~ (p=0.222 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 59.5k ± 4% 59.5k ± 2% ~ (p=0.841 n=5+5) neo/go/sqlite-zwrk.go·1 9.02k ± 1% 8.89k ± 4% ~ (p=0.310 n=5+5) neo/go/sqlite-zwrk.go·2 16.0k ± 0% 15.9k ± 0% -0.66% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go·3 21.8k ± 1% 21.8k ± 1% ~ (p=0.286 n=4+5) neo/go/sqlite-zwrk.go·4 26.2k ± 0% 26.2k ± 0% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go·8 30.0k ± 2% 29.9k ± 1% ~ (p=1.000 n=5+5) neo/go/sqlite-zwrk.go·12 28.6k ± 2% 28.7k ± 0% ~ (p=0.556 n=5+4) neo/go/sqlite-zwrk.go·16 28.7k ± 1% 28.8k ± 1% ~ (p=0.905 n=4+5) neo/go/sqlite-zwrk.go(!sha1)·1 9.45k ± 1% 9.33k ± 1% -1.20% (p=0.032 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 16.6k ± 1% 16.4k ± 0% -1.24% (p=0.016 n=5+4) neo/go/sqlite-zwrk.go(!sha1)·3 23.0k ± 0% 22.7k ± 0% -1.44% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·4 28.0k ± 1% 27.4k ± 0% -2.10% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 32.3k ± 0% 31.4k ± 1% -2.83% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·12 30.6k ± 2% 29.8k ± 1% -2.48% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 30.3k ± 2% 29.6k ± 2% -2.37% (p=0.032 n=5+5) name old latency-time/object new latency-time/object delta cluster:neo1 dataset:wczblk1-8 fs1-zwrk.go·1 4.36µs ± 0% 4.35µs ± 0% -0.37% (p=0.016 n=5+5) fs1-zwrk.go·2 4.52µs ± 1% 4.47µs ± 1% -1.07% (p=0.032 n=5+5) fs1-zwrk.go·3 4.53µs ± 1% 4.51µs ± 0% -0.61% (p=0.040 n=5+5) fs1-zwrk.go·4 4.61µs ± 1% 4.60µs ± 0% ~ (p=0.413 n=5+4) fs1-zwrk.go·8 8.10µs ± 0% 8.07µs ± 0% ~ (p=0.095 n=5+5) fs1-zwrk.go·12 11.8µs ± 0% 11.8µs ± 0% ~ (p=0.841 n=5+5) fs1-zwrk.go·16 16.5µs ±13% 15.7µs ± 0% ~ (p=0.421 n=5+5) zeo/py/fs1-zwrk.go·1 194µs ± 1% 198µs ± 1% +1.81% (p=0.032 n=5+5) zeo/py/fs1-zwrk.go·2 282µs ± 1% 289µs ± 2% +2.29% (p=0.032 n=5+5) zeo/py/fs1-zwrk.go·3 388µs ± 1% 401µs ± 1% +3.30% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·4 502µs ± 5% 520µs ± 2% ~ (p=0.095 n=5+5) zeo/py/fs1-zwrk.go·8 964µs ± 2% 997µs ± 1% +3.43% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·12 1.47ms ± 1% 1.43ms ± 2% -2.97% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·16 1.94ms ± 1% 1.89ms ± 1% -2.54% (p=0.008 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 232µs ± 4% 237µs ± 2% ~ (p=0.222 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 319µs ± 5% 318µs ± 3% ~ (p=0.548 n=5+5) neo/py(!log)/sqlite-zwrk.go·3 470µs ± 0% 477µs ± 2% +1.52% (p=0.016 n=4+5) neo/py(!log)/sqlite-zwrk.go·4 651µs ± 5% 639µs ± 3% ~ (p=0.690 n=5+5) neo/py(!log)/sqlite-zwrk.go·8 1.28ms ± 4% 1.30ms ± 3% ~ (p=0.222 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 1.90ms ± 2% 1.99ms ± 5% +4.85% (p=0.032 n=5+5) neo/py(!log)/sqlite-zwrk.go·16 2.56ms ± 4% 2.58ms ± 5% ~ (p=0.421 n=5+5) neo/py(!log)/sql-zwrk.go·1 323µs ± 6% 308µs ±13% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zwrk.go·2 503µs ± 2% 503µs ± 3% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·3 742µs ± 3% 756µs ± 4% ~ (p=0.690 n=5+5) neo/py(!log)/sql-zwrk.go·4 986µs ± 4% 1014µs ± 5% ~ (p=0.222 n=5+5) neo/py(!log)/sql-zwrk.go·8 2.11ms ± 8% 1.97ms ± 4% -6.85% (p=0.032 n=5+5) neo/py(!log)/sql-zwrk.go·12 3.02ms ± 3% 2.92ms ± 6% ~ (p=0.421 n=5+5) neo/py(!log)/sql-zwrk.go·16 4.06ms ± 1% 3.98ms ± 8% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·1 77.8µs ± 0% 77.3µs ± 1% ~ (p=0.548 n=5+5) neo/go/fs1-zwrk.go·2 80.6µs ± 0% 80.4µs ± 0% ~ (p=0.556 n=4+5) neo/go/fs1-zwrk.go·3 92.8µs ± 0% 92.8µs ± 0% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·4 98.2µs ± 0% 97.8µs ± 0% -0.36% (p=0.008 n=5+5) neo/go/fs1-zwrk.go·8 147µs ± 1% 146µs ± 1% ~ (p=0.421 n=5+5) neo/go/fs1-zwrk.go·12 212µs ± 1% 212µs ± 1% ~ (p=1.000 n=5+5) neo/go/fs1-zwrk.go·16 293µs ± 1% 294µs ± 1% ~ (p=0.905 n=4+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 52.7µs ± 2% 52.6µs ± 2% ~ (p=1.000 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 53.0µs ± 0% 53.3µs ± 2% ~ (p=0.222 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 62.5µs ± 1% 62.5µs ± 0% ~ (p=1.000 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 67.8µs ± 0% 67.8µs ± 0% ~ (p=0.548 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 103µs ± 1% 102µs ± 0% ~ (p=0.690 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 146µs ± 2% 149µs ± 7% ~ (p=0.421 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 199µs ± 1% 198µs ± 1% ~ (p=0.802 n=5+5) neo/go/sqlite-zwrk.go·1 124µs ± 4% 123µs ± 0% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go·2 134µs ± 0% 134µs ± 0% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go·3 145µs ± 0% 144µs ± 0% -0.59% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go·4 161µs ± 0% 160µs ± 0% -0.77% (p=0.016 n=5+4) neo/go/sqlite-zwrk.go·8 252µs ± 1% 249µs ± 1% -1.32% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go·12 390µs ± 5% 372µs ± 1% -4.68% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go·16 526µs ± 2% 524µs ±11% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·1 112µs ± 1% 113µs ± 1% +1.26% (p=0.032 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 124µs ± 1% 124µs ± 0% ~ (p=0.548 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·3 133µs ± 0% 133µs ± 0% +0.34% (p=0.016 n=4+5) neo/go/sqlite-zwrk.go(!sha1)·4 143µs ± 0% 145µs ± 0% +1.29% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 228µs ± 1% 234µs ± 1% +2.37% (p=0.016 n=5+4) neo/go/sqlite-zwrk.go(!sha1)·12 346µs ± 1% 360µs ± 2% +3.91% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 486µs ±11% 487µs ± 2% ~ (p=0.222 n=5+5) cluster:neo1 dataset:prod1-1024 fs1-zwrk.go·1 2.22µs ± 1% 2.21µs ± 0% ~ (p=0.056 n=5+5) fs1-zwrk.go·2 2.24µs ± 0% 2.23µs ± 0% -0.69% (p=0.008 n=5+5) fs1-zwrk.go·3 2.25µs ± 1% 2.30µs ± 9% ~ (p=0.841 n=5+5) fs1-zwrk.go·4 2.26µs ± 0% 2.26µs ± 1% ~ (p=0.714 n=5+5) fs1-zwrk.go·8 4.02µs ± 1% 3.97µs ± 2% ~ (p=0.111 n=5+5) fs1-zwrk.go·12 5.92µs ± 1% 5.90µs ± 0% ~ (p=0.190 n=4+5) fs1-zwrk.go·16 7.87µs ± 0% 7.86µs ± 0% ~ (p=0.738 n=5+5) zeo/py/fs1-zwrk.go·1 173µs ± 3% 171µs ± 4% ~ (p=0.548 n=5+5) zeo/py/fs1-zwrk.go·2 234µs ± 1% 233µs ± 2% ~ (p=0.310 n=5+5) zeo/py/fs1-zwrk.go·3 324µs ± 7% 320µs ± 2% ~ (p=1.000 n=5+5) zeo/py/fs1-zwrk.go·4 412µs ± 1% 410µs ± 3% ~ (p=0.841 n=5+5) zeo/py/fs1-zwrk.go·8 768µs ± 1% 783µs ± 3% +1.95% (p=0.032 n=5+5) zeo/py/fs1-zwrk.go·12 1.14ms ± 1% 1.14ms ± 1% ~ (p=0.841 n=5+5) zeo/py/fs1-zwrk.go·16 1.54ms ± 4% 1.53ms ± 1% ~ (p=1.000 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 204µs ± 8% 209µs ± 5% ~ (p=0.548 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 319µs ± 4% 308µs ± 0% ~ (p=0.190 n=5+4) neo/py(!log)/sqlite-zwrk.go·3 475µs ± 5% 472µs ± 6% ~ (p=1.000 n=5+5) neo/py(!log)/sqlite-zwrk.go·4 620µs ± 2% 624µs ± 1% ~ (p=0.548 n=5+5) neo/py(!log)/sqlite-zwrk.go·8 1.24ms ± 2% 1.26ms ± 6% ~ (p=0.690 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 1.90ms ± 3% 1.87ms ± 0% ~ (p=0.556 n=5+4) neo/py(!log)/sqlite-zwrk.go·16 2.52ms ± 5% 2.51ms ± 1% ~ (p=0.310 n=5+5) neo/py(!log)/sql-zwrk.go·1 287µs ± 8% 304µs ±13% ~ (p=0.310 n=5+5) neo/py(!log)/sql-zwrk.go·2 495µs ± 6% 491µs ± 7% ~ (p=0.841 n=5+5) neo/py(!log)/sql-zwrk.go·3 740µs ± 8% 730µs ± 3% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·4 1.01ms ± 4% 0.98ms ± 4% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zwrk.go·8 1.93ms ± 3% 2.01ms ± 3% ~ (p=0.056 n=5+5) neo/py(!log)/sql-zwrk.go·12 3.01ms ± 4% 2.92ms ± 5% ~ (p=0.310 n=5+5) neo/py(!log)/sql-zwrk.go·16 4.05ms ±10% 3.79ms ± 4% ~ (p=0.151 n=5+5) neo/go/fs1-zwrk.go·1 58.5µs ± 1% 57.8µs ± 1% -1.34% (p=0.008 n=5+5) neo/go/fs1-zwrk.go·2 61.4µs ± 0% 61.1µs ± 1% ~ (p=0.111 n=5+4) neo/go/fs1-zwrk.go·3 69.3µs ± 0% 69.3µs ± 0% ~ (p=0.651 n=5+5) neo/go/fs1-zwrk.go·4 75.6µs ± 0% 75.5µs ± 0% ~ (p=0.690 n=5+5) neo/go/fs1-zwrk.go·8 121µs ± 1% 120µs ± 1% ~ (p=0.905 n=4+5) neo/go/fs1-zwrk.go·12 195µs ± 1% 198µs ± 2% ~ (p=0.310 n=5+5) neo/go/fs1-zwrk.go·16 288µs ± 4% 289µs ± 2% ~ (p=0.841 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 50.9µs ± 5% 49.9µs ± 2% ~ (p=0.151 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 49.7µs ± 0% 49.8µs ± 1% ~ (p=0.548 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 58.2µs ± 0% 58.3µs ± 0% ~ (p=0.548 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 64.5µs ± 0% 64.4µs ± 0% ~ (p=0.548 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 108µs ± 4% 108µs ± 2% ~ (p=1.000 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 185µs ± 8% 179µs ± 3% ~ (p=0.222 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 269µs ± 4% 269µs ± 2% ~ (p=0.841 n=5+5) neo/go/sqlite-zwrk.go·1 111µs ± 1% 113µs ± 4% ~ (p=0.310 n=5+5) neo/go/sqlite-zwrk.go·2 125µs ± 0% 126µs ± 0% +0.66% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go·3 137µs ± 1% 138µs ± 1% ~ (p=0.286 n=4+5) neo/go/sqlite-zwrk.go·4 153µs ± 0% 152µs ± 0% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go·8 267µs ± 1% 267µs ± 1% ~ (p=1.000 n=5+5) neo/go/sqlite-zwrk.go·12 420µs ± 2% 418µs ± 0% ~ (p=0.556 n=5+4) neo/go/sqlite-zwrk.go·16 558µs ± 1% 556µs ± 1% ~ (p=0.905 n=4+5) neo/go/sqlite-zwrk.go(!sha1)·1 106µs ± 1% 107µs ± 1% +1.21% (p=0.032 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 121µs ± 1% 122µs ± 0% +1.25% (p=0.016 n=5+4) neo/go/sqlite-zwrk.go(!sha1)·3 130µs ± 0% 132µs ± 0% +1.47% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·4 143µs ± 1% 146µs ± 0% +2.14% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 248µs ± 0% 255µs ± 1% +2.92% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·12 393µs ± 2% 403µs ± 1% +2.53% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 528µs ± 2% 541µs ± 2% +2.42% (p=0.032 n=5+5)
4cbd62f7