-
Kirill Smelkov authored
Remeasure with the same sattings as previous z6001 localhost with C-enabled (850bfb9d): Like on neo1 the data is more or less the same and in particular timings for either sql backend or python client or even neo/go vs go client are noisy. ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ $ benchstat -split node,cluster,dataset 20180306-z6001-ffixed-c.txt 20180308-z6001-ffixed-c-zwrk1s.txt name old pystone/s new pystone/s delta node:z6001 pystone 109k ± 9% 114k ± 1% ~ (p=0.421 n=5+5) name old time/op new time/op delta node:z6001 crc32/py/4K 5.11µs ± 1% 5.10µs ± 0% ~ (p=0.968 n=5+5) crc32/go/4K 1.72µs ± 0% 1.72µs ± 0% ~ (p=1.000 n=4+4) sha1/py/4K 14.7µs ± 1% 14.6µs ± 0% -0.55% (p=0.032 n=5+5) sha1/go/4K 10.3µs ± 0% 10.3µs ± 0% ~ (p=0.103 n=5+5) unzlib/py/wczdata 37.1µs ± 8% 36.2µs ± 1% ~ (p=0.421 n=5+5) unzlib/go/wczdata 31.5µs ± 0% 31.5µs ± 0% ~ (p=0.889 n=5+5) unzlib/py/prod1-avg 18.5µs ± 3% 18.2µs ± 1% ~ (p=0.222 n=5+5) unzlib/go/prod1-avg 10.0µs ± 1% 10.0µs ± 2% ~ (p=0.690 n=5+5) disk/randread/direct/4K-min 126µs ± 1% 129µs ± 4% +2.33% (p=0.048 n=4+5) disk/randread/direct/4K-avg 199µs ± 9% 201µs ± 7% ~ (p=1.000 n=5+5) disk/randread/pagecache/4K-min 806ns ± 3% 793ns ± 2% ~ (p=0.310 n=5+5) disk/randread/pagecache/4K-avg 1.44µs ± 7% 1.41µs ± 4% ~ (p=0.635 n=5+5) name old time/object new time/object delta cluster:z6001 dataset:wczblk1-8 fs1-zhash.py 37.6µs ± 2% 37.5µs ± 1% ~ (p=0.738 n=5+5) fs1-zhash.go 6.00µs ± 2% 5.90µs ± 0% -1.67% (p=0.048 n=5+5) fs1-zhash.go+prefetch128 8.00µs ± 5% 8.10µs ± 5% ~ (p=0.659 n=5+5) zeo/py/fs1-zhash.py 650µs ± 7% 661µs ± 8% ~ (p=0.421 n=5+5) zeo/py/fs1-zhash.go 274µs ±13% 267µs ± 8% ~ (p=0.841 n=5+5) zeo/py/fs1-zhash.go+prefetch128 101µs ± 2% 102µs ± 1% ~ (p=0.548 n=5+5) neo/py(!log)/sqlite-zhash.py 696µs ± 1% 692µs ± 4% ~ (p=0.421 n=5+5) neo/py(!log)/sqlite-zhash.go 338µs ± 7% 309µs ±15% ~ (p=0.095 n=5+5) neo/py(!log)/sqlite-zhash.go+prefetch128 177µs ± 1% 176µs ± 1% ~ (p=0.056 n=5+5) neo/py(!log)/sql-zhash.py 1.00ms ±38% 0.99ms ±31% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zhash.go 434µs ± 6% 377µs ±16% -13.15% (p=0.032 n=5+5) neo/py(!log)/sql-zhash.go+prefetch128 277µs ± 9% 268µs ±12% ~ (p=0.690 n=5+5) neo/go/fs1-zhash.py 526µs ± 8% 482µs ±20% ~ (p=0.222 n=5+5) neo/go/fs1-zhash.go 102µs ± 8% 102µs ± 9% ~ (p=0.841 n=5+5) neo/go/fs1-zhash.go+prefetch128 36.6µs ± 4% 37.2µs ± 2% ~ (p=0.238 n=5+5) neo/go/fs1(!sha1)-zhash.go(!sha1) 76.4µs ± 5% 73.1µs ±12% ~ (p=0.151 n=5+5) neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 26.5µs ± 2% 26.9µs ± 7% ~ (p=0.730 n=5+5) neo/go/sqlite-zhash.py 528µs ±15% 525µs ±10% ~ (p=1.000 n=5+5) neo/go/sqlite-zhash.go 204µs ±22% 193µs ±16% ~ (p=0.690 n=5+5) neo/go/sqlite-zhash.go+prefetch128 39.9µs ± 4% 39.6µs ± 4% ~ (p=0.817 n=5+5) neo/go/sqlite-zhash.go(!sha1) 194µs ± 9% 195µs ±25% ~ (p=0.690 n=5+5) neo/go/sqlite-zhash.go+prefetch128(!sha1) 38.2µs ± 7% 36.7µs ± 3% ~ (p=0.151 n=5+5) cluster:z6001 dataset:prod1-1024 fs1-zhash.py 30.3µs ± 1% 30.3µs ± 2% ~ (p=1.000 n=5+5) fs1-zhash.go 4.62µs ± 3% 4.56µs ± 1% ~ (p=0.397 n=5+5) fs1-zhash.go+prefetch128 5.76µs ± 8% 5.96µs ± 9% ~ (p=0.413 n=5+5) zeo/py/fs1-zhash.py 632µs ±15% 615µs ±13% ~ (p=0.421 n=5+5) zeo/py/fs1-zhash.go 235µs ± 7% 235µs ± 6% ~ (p=1.000 n=5+5) zeo/py/fs1-zhash.go+prefetch128 87.2µs ± 1% 87.6µs ± 1% ~ (p=0.270 n=5+5) neo/py(!log)/sqlite-zhash.py 664µs ± 2% 658µs ± 5% ~ (p=0.310 n=5+5) neo/py(!log)/sqlite-zhash.go 269µs ± 7% 256µs ± 8% ~ (p=0.151 n=5+5) neo/py(!log)/sqlite-zhash.go+prefetch128 162µs ± 0% 161µs ± 0% -0.74% (p=0.016 n=4+5) neo/py(!log)/sql-zhash.py 1.03ms ±29% 1.02ms ±33% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zhash.go 406µs ± 2% 385µs ± 8% ~ (p=0.095 n=5+5) neo/py(!log)/sql-zhash.go+prefetch128 268µs ± 5% 263µs ±11% ~ (p=0.690 n=5+5) neo/go/fs1-zhash.py 520µs ± 9% 461µs ±16% ~ (p=0.222 n=5+5) neo/go/fs1-zhash.go 83.2µs ± 7% 82.9µs ± 5% ~ (p=1.000 n=5+5) neo/go/fs1-zhash.go+prefetch128 24.0µs ± 5% 23.9µs ± 3% ~ (p=0.968 n=5+5) neo/go/fs1(!sha1)-zhash.go(!sha1) 67.0µs ± 3% 69.7µs ±11% ~ (p=0.548 n=5+5) neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 21.2µs ± 4% 21.0µs ± 2% ~ (p=0.619 n=5+5) neo/go/sqlite-zhash.py 539µs ±11% 541µs ± 9% ~ (p=1.000 n=5+5) neo/go/sqlite-zhash.go 196µs ± 9% 181µs ±13% ~ (p=0.151 n=5+5) neo/go/sqlite-zhash.go+prefetch128 35.0µs ± 3% 35.5µs ± 2% ~ (p=0.238 n=5+5) neo/go/sqlite-zhash.go(!sha1) 168µs ± 8% 162µs ±14% ~ (p=0.690 n=5+5) neo/go/sqlite-zhash.go+prefetch128(!sha1) 35.1µs ± 4% 35.3µs ± 1% ~ (p=0.500 n=5+5) name old req/s new req/s delta cluster:z6001 dataset:wczblk1-8 fs1-zwrk.go·1 230k ± 1% 228k ± 3% ~ (p=1.000 n=5+5) fs1-zwrk.go·2 437k ± 5% 444k ± 1% ~ (p=0.310 n=5+5) fs1-zwrk.go·3 663k ± 4% 660k ± 3% ~ (p=0.548 n=5+5) fs1-zwrk.go·4 880k ± 1% 882k ± 1% ~ (p=1.000 n=5+5) fs1-zwrk.go·8 1.75M ± 2% 1.75M ± 2% ~ (p=0.841 n=5+5) fs1-zwrk.go·12 2.56M ± 0% 2.50M ± 3% -2.26% (p=0.016 n=4+5) fs1-zwrk.go·16 2.89M ± 1% 2.88M ± 1% ~ (p=0.222 n=5+5) zeo/py/fs1-zwrk.go·1 4.30k ± 8% 4.44k ± 6% ~ (p=0.421 n=5+5) zeo/py/fs1-zwrk.go·2 6.33k ± 0% 6.32k ± 0% ~ (p=0.063 n=4+5) zeo/py/fs1-zwrk.go·3 6.90k ± 0% 6.89k ± 0% ~ (p=0.365 n=4+5) zeo/py/fs1-zwrk.go·4 7.14k ± 1% 7.15k ± 1% ~ (p=1.000 n=4+5) zeo/py/fs1-zwrk.go·8 7.53k ± 2% 7.46k ± 2% ~ (p=0.690 n=5+5) zeo/py/fs1-zwrk.go·12 7.65k ± 0% 7.55k ± 1% ~ (p=0.063 n=4+5) zeo/py/fs1-zwrk.go·16 7.57k ± 0% 7.55k ± 1% ~ (p=1.000 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 3.50k ±15% 3.74k ±12% ~ (p=0.222 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 5.58k ± 0% 5.59k ± 1% ~ (p=1.000 n=4+5) neo/py(!log)/sqlite-zwrk.go·3 5.63k ± 2% 5.58k ± 1% ~ (p=0.310 n=5+5) neo/py(!log)/sqlite-zwrk.go·4 5.56k ± 1% 5.54k ± 1% ~ (p=0.690 n=5+5) neo/py(!log)/sqlite-zwrk.go·8 5.61k ± 2% 5.65k ± 0% ~ (p=0.548 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 5.62k ± 1% 5.59k ± 0% ~ (p=0.222 n=5+5) neo/py(!log)/sqlite-zwrk.go·16 5.62k ± 1% 5.58k ± 1% ~ (p=0.413 n=4+5) neo/py(!log)/sql-zwrk.go·1 2.53k ±17% 2.61k ± 5% ~ (p=0.841 n=5+5) neo/py(!log)/sql-zwrk.go·2 3.57k ± 9% 3.88k ±11% ~ (p=0.151 n=5+5) neo/py(!log)/sql-zwrk.go·3 3.65k ±14% 3.80k ±12% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zwrk.go·4 3.56k ±16% 3.85k ± 5% ~ (p=0.151 n=5+5) neo/py(!log)/sql-zwrk.go·8 3.78k ±12% 3.64k ±12% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·12 3.73k ±13% 3.62k ± 6% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·16 3.47k ± 9% 3.92k ±13% ~ (p=0.056 n=5+5) neo/go/fs1-zwrk.go·1 10.7k ± 5% 10.6k ± 5% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·2 22.3k ± 1% 22.4k ± 1% ~ (p=0.421 n=5+5) neo/go/fs1-zwrk.go·3 31.7k ± 1% 31.9k ± 1% ~ (p=0.151 n=5+5) neo/go/fs1-zwrk.go·4 43.2k ± 1% 43.2k ± 0% ~ (p=1.000 n=5+5) neo/go/fs1-zwrk.go·8 78.3k ± 0% 78.2k ± 0% ~ (p=0.151 n=5+5) neo/go/fs1-zwrk.go·12 92.5k ± 0% 92.3k ± 0% ~ (p=0.421 n=5+5) neo/go/fs1-zwrk.go·16 103k ± 1% 102k ± 1% ~ (p=0.421 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 15.0k ± 5% 15.0k ± 4% ~ (p=1.000 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 31.5k ± 1% 31.4k ± 1% ~ (p=0.421 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 43.8k ± 0% 43.9k ± 0% ~ (p=0.548 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 57.4k ± 0% 57.6k ± 0% ~ (p=0.087 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 100k ± 0% 100k ± 0% ~ (p=0.690 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 116k ± 0% 116k ± 0% ~ (p=0.310 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 126k ± 1% 126k ± 0% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go·1 4.85k ±15% 5.06k ± 8% ~ (p=0.548 n=5+5) neo/go/sqlite-zwrk.go·2 12.0k ± 2% 11.9k ± 2% ~ (p=0.548 n=5+5) neo/go/sqlite-zwrk.go·3 19.0k ± 1% 19.0k ± 1% ~ (p=0.548 n=5+5) neo/go/sqlite-zwrk.go·4 24.7k ± 0% 24.6k ± 1% ~ (p=0.841 n=5+5) neo/go/sqlite-zwrk.go·8 44.8k ± 0% 44.8k ± 0% ~ (p=0.548 n=5+5) neo/go/sqlite-zwrk.go·12 56.3k ± 0% 56.3k ± 0% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go·16 58.0k ± 0% 58.2k ± 0% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·1 5.41k ± 4% 5.71k ± 8% ~ (p=0.095 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 12.8k ± 1% 13.2k ± 3% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·3 20.2k ± 1% 20.4k ± 1% +1.19% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·4 26.8k ± 1% 27.1k ± 1% +1.11% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 48.1k ± 1% 48.3k ± 0% ~ (p=0.841 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·12 60.3k ± 0% 60.2k ± 0% ~ (p=0.095 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 61.7k ± 1% 61.7k ± 0% ~ (p=0.548 n=5+5) cluster:z6001 dataset:prod1-1024 fs1-zwrk.go·1 347k ± 2% 347k ± 2% ~ (p=1.000 n=5+5) fs1-zwrk.go·2 660k ± 3% 662k ± 1% ~ (p=1.000 n=5+5) fs1-zwrk.go·3 985k ± 4% 982k ± 1% ~ (p=0.310 n=5+5) fs1-zwrk.go·4 1.31M ± 2% 1.30M ± 2% ~ (p=0.151 n=5+5) fs1-zwrk.go·8 2.55M ± 4% 2.56M ± 2% ~ (p=1.000 n=5+5) fs1-zwrk.go·12 2.81M ± 1% 2.83M ± 1% ~ (p=0.690 n=5+5) fs1-zwrk.go·16 2.85M ± 2% 2.82M ± 1% ~ (p=0.310 n=5+5) zeo/py/fs1-zwrk.go·1 4.80k ± 5% 4.90k ± 6% ~ (p=0.421 n=5+5) zeo/py/fs1-zwrk.go·2 8.18k ± 1% 8.11k ± 0% ~ (p=0.310 n=5+5) zeo/py/fs1-zwrk.go·3 8.96k ± 1% 9.07k ± 2% ~ (p=0.222 n=5+5) zeo/py/fs1-zwrk.go·4 8.88k ± 9% 9.36k ± 0% ~ (p=1.000 n=5+5) zeo/py/fs1-zwrk.go·8 10.0k ± 2% 10.0k ± 2% ~ (p=0.286 n=4+5) zeo/py/fs1-zwrk.go·12 9.80k ± 6% 10.22k ± 2% ~ (p=0.063 n=5+4) zeo/py/fs1-zwrk.go·16 10.1k ± 6% 10.3k ± 2% ~ (p=0.095 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 3.70k ± 6% 3.80k ±13% ~ (p=0.690 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 5.77k ± 0% 5.80k ± 0% +0.52% (p=0.016 n=4+5) neo/py(!log)/sqlite-zwrk.go·3 5.77k ± 0% 5.57k ± 8% ~ (p=0.690 n=5+5) neo/py(!log)/sqlite-zwrk.go·4 5.77k ± 0% 5.80k ± 0% +0.67% (p=0.008 n=5+5) neo/py(!log)/sqlite-zwrk.go·8 5.84k ± 1% 5.78k ± 2% ~ (p=0.421 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 5.78k ± 2% 5.77k ± 0% ~ (p=0.548 n=5+5) neo/py(!log)/sqlite-zwrk.go·16 5.80k ± 1% 5.80k ± 0% ~ (p=0.690 n=5+5) neo/py(!log)/sql-zwrk.go·1 2.51k ±12% 2.74k ±24% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zwrk.go·2 3.62k ± 8% 3.69k ± 8% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zwrk.go·3 3.86k ±11% 3.68k ± 8% ~ (p=0.421 n=5+5) neo/py(!log)/sql-zwrk.go·4 3.82k ±11% 3.80k ±10% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·8 3.89k ±10% 3.94k ±12% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·12 3.98k ± 7% 4.04k ±12% ~ (p=0.690 n=5+5) neo/py(!log)/sql-zwrk.go·16 3.72k ±13% 3.82k ±10% ~ (p=0.690 n=5+5) neo/go/fs1-zwrk.go·1 13.8k ± 3% 13.7k ± 4% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·2 28.1k ± 0% 28.0k ± 0% ~ (p=0.690 n=5+5) neo/go/fs1-zwrk.go·3 40.2k ± 0% 40.2k ± 0% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·4 52.8k ± 1% 52.8k ± 0% ~ (p=1.000 n=5+5) neo/go/fs1-zwrk.go·8 90.6k ± 0% 90.5k ± 0% ~ (p=0.421 n=5+5) neo/go/fs1-zwrk.go·12 95.8k ± 1% 95.9k ± 1% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·16 90.9k ± 1% 89.9k ± 1% ~ (p=0.151 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 16.2k ± 2% 16.2k ± 3% ~ (p=0.548 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 32.9k ± 1% 33.0k ± 0% ~ (p=0.151 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 46.2k ± 0% 46.1k ± 1% ~ (p=0.151 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 59.8k ± 1% 60.2k ± 0% ~ (p=0.095 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 98.1k ± 0% 99.2k ± 1% +1.06% (p=0.016 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 102k ± 1% 103k ± 0% +1.27% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 97.0k ± 2% 97.3k ± 2% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go·1 5.67k ± 8% 5.79k ± 8% ~ (p=0.548 n=5+5) neo/go/sqlite-zwrk.go·2 13.3k ± 2% 13.3k ± 1% ~ (p=1.000 n=5+5) neo/go/sqlite-zwrk.go·3 20.3k ± 1% 20.3k ± 1% ~ (p=1.000 n=5+5) neo/go/sqlite-zwrk.go·4 26.5k ± 0% 26.4k ± 1% ~ (p=0.841 n=5+5) neo/go/sqlite-zwrk.go·8 44.5k ± 1% 44.7k ± 0% ~ (p=0.111 n=5+4) neo/go/sqlite-zwrk.go·12 52.3k ± 1% 52.6k ± 0% ~ (p=0.095 n=5+5) neo/go/sqlite-zwrk.go·16 48.9k ± 1% 48.6k ± 1% ~ (p=0.310 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·1 5.69k ± 4% 5.81k ±12% ~ (p=0.421 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 13.2k ± 3% 13.1k ± 3% ~ (p=0.548 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·3 20.5k ± 1% 20.5k ± 1% ~ (p=0.841 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·4 27.1k ± 2% 27.2k ± 2% ~ (p=0.421 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 45.4k ± 1% 45.3k ± 0% ~ (p=0.222 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·12 53.3k ± 1% 53.3k ± 1% ~ (p=0.841 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 49.8k ± 1% 49.9k ± 1% ~ (p=0.690 n=5+5) name old latency-time/object new latency-time/object delta cluster:z6001 dataset:wczblk1-8 fs1-zwrk.go·1 4.34µs ± 1% 4.39µs ± 4% ~ (p=1.000 n=5+5) fs1-zwrk.go·2 4.58µs ± 5% 4.50µs ± 1% ~ (p=0.310 n=5+5) fs1-zwrk.go·3 4.52µs ± 4% 4.55µs ± 3% ~ (p=0.444 n=5+5) fs1-zwrk.go·4 4.55µs ± 1% 4.54µs ± 1% ~ (p=1.000 n=5+5) fs1-zwrk.go·8 4.58µs ± 2% 4.57µs ± 2% ~ (p=0.841 n=5+5) fs1-zwrk.go·12 4.69µs ± 0% 4.80µs ± 3% +2.35% (p=0.016 n=4+5) fs1-zwrk.go·16 5.53µs ± 1% 5.56µs ± 1% ~ (p=0.214 n=5+5) zeo/py/fs1-zwrk.go·1 233µs ± 8% 225µs ± 6% ~ (p=0.421 n=5+5) zeo/py/fs1-zwrk.go·2 315µs ± 2% 317µs ± 0% +0.55% (p=0.032 n=5+5) zeo/py/fs1-zwrk.go·3 435µs ± 0% 435µs ± 0% ~ (p=0.413 n=4+5) zeo/py/fs1-zwrk.go·4 560µs ± 1% 559µs ± 1% ~ (p=1.000 n=4+5) zeo/py/fs1-zwrk.go·8 1.06ms ± 2% 1.07ms ± 2% ~ (p=0.690 n=5+5) zeo/py/fs1-zwrk.go·12 1.57ms ± 0% 1.59ms ± 1% ~ (p=0.063 n=4+5) zeo/py/fs1-zwrk.go·16 2.11ms ± 0% 2.12ms ± 1% ~ (p=1.000 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 288µs ±14% 269µs ±12% ~ (p=0.222 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 358µs ± 0% 358µs ± 1% ~ (p=1.000 n=4+5) neo/py(!log)/sqlite-zwrk.go·3 533µs ± 2% 537µs ± 1% ~ (p=0.310 n=5+5) neo/py(!log)/sqlite-zwrk.go·4 720µs ± 1% 721µs ± 1% ~ (p=0.690 n=5+5) neo/py(!log)/sqlite-zwrk.go·8 1.43ms ± 2% 1.42ms ± 0% ~ (p=0.548 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 2.14ms ± 1% 2.15ms ± 0% ~ (p=0.222 n=5+5) neo/py(!log)/sqlite-zwrk.go·16 2.85ms ± 1% 2.87ms ± 1% ~ (p=0.413 n=4+5) neo/py(!log)/sql-zwrk.go·1 400µs ±16% 384µs ± 5% ~ (p=0.841 n=5+5) neo/py(!log)/sql-zwrk.go·2 562µs ± 8% 518µs ±11% ~ (p=0.151 n=5+5) neo/py(!log)/sql-zwrk.go·3 827µs ±13% 795µs ±13% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zwrk.go·4 1.13ms ±14% 1.04ms ± 5% ~ (p=0.151 n=5+5) neo/py(!log)/sql-zwrk.go·8 2.13ms ±13% 2.21ms ±11% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·12 3.24ms ±12% 3.31ms ± 6% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·16 4.62ms ± 8% 4.10ms ±15% ~ (p=0.056 n=5+5) neo/go/fs1-zwrk.go·1 93.9µs ± 4% 94.0µs ± 5% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·2 89.6µs ± 1% 89.1µs ± 1% ~ (p=0.421 n=5+5) neo/go/fs1-zwrk.go·3 94.6µs ± 1% 94.0µs ± 1% ~ (p=0.151 n=5+5) neo/go/fs1-zwrk.go·4 92.6µs ± 1% 92.7µs ± 0% ~ (p=1.000 n=5+5) neo/go/fs1-zwrk.go·8 102µs ± 0% 102µs ± 0% ~ (p=0.151 n=5+5) neo/go/fs1-zwrk.go·12 130µs ± 0% 130µs ± 0% ~ (p=0.421 n=5+5) neo/go/fs1-zwrk.go·16 156µs ± 1% 156µs ± 1% ~ (p=0.421 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 66.8µs ± 5% 66.5µs ± 4% ~ (p=1.000 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 63.5µs ± 1% 63.6µs ± 1% ~ (p=0.421 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 68.5µs ± 0% 68.4µs ± 0% ~ (p=0.548 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 69.7µs ± 0% 69.4µs ± 0% ~ (p=0.087 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 79.7µs ± 0% 79.8µs ± 0% ~ (p=0.690 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 103µs ± 0% 103µs ± 0% ~ (p=0.310 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 127µs ± 1% 127µs ± 0% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go·1 208µs ±14% 198µs ± 8% ~ (p=0.548 n=5+5) neo/go/sqlite-zwrk.go·2 166µs ± 2% 169µs ± 2% ~ (p=0.548 n=5+5) neo/go/sqlite-zwrk.go·3 158µs ± 1% 158µs ± 1% ~ (p=0.548 n=5+5) neo/go/sqlite-zwrk.go·4 162µs ± 0% 162µs ± 1% ~ (p=0.841 n=5+5) neo/go/sqlite-zwrk.go·8 178µs ± 0% 179µs ± 0% ~ (p=0.548 n=5+5) neo/go/sqlite-zwrk.go·12 213µs ± 0% 213µs ± 0% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go·16 276µs ± 0% 275µs ± 0% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·1 185µs ± 4% 175µs ± 8% ~ (p=0.095 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 156µs ± 1% 152µs ± 3% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·3 149µs ± 1% 147µs ± 1% -1.17% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·4 149µs ± 1% 147µs ± 1% -1.10% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 166µs ± 1% 166µs ± 0% ~ (p=0.841 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·12 199µs ± 0% 199µs ± 0% ~ (p=0.095 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 259µs ± 1% 259µs ± 0% ~ (p=0.548 n=5+5) cluster:z6001 dataset:prod1-1024 fs1-zwrk.go·1 2.88µs ± 2% 2.88µs ± 2% ~ (p=1.000 n=5+5) fs1-zwrk.go·2 3.03µs ± 3% 3.02µs ± 1% ~ (p=0.952 n=5+5) fs1-zwrk.go·3 3.05µs ± 4% 3.05µs ± 1% ~ (p=0.310 n=5+5) fs1-zwrk.go·4 3.05µs ± 2% 3.08µs ± 2% ~ (p=0.167 n=5+5) fs1-zwrk.go·8 3.14µs ± 4% 3.12µs ± 2% ~ (p=1.000 n=5+5) fs1-zwrk.go·12 4.28µs ± 1% 4.25µs ± 1% ~ (p=0.690 n=5+5) fs1-zwrk.go·16 5.63µs ± 2% 5.68µs ± 1% ~ (p=0.310 n=5+5) zeo/py/fs1-zwrk.go·1 208µs ± 5% 204µs ± 6% ~ (p=0.421 n=5+5) zeo/py/fs1-zwrk.go·2 245µs ± 1% 247µs ± 0% ~ (p=0.310 n=5+5) zeo/py/fs1-zwrk.go·3 335µs ± 1% 331µs ± 2% ~ (p=0.222 n=5+5) zeo/py/fs1-zwrk.go·4 453µs ±10% 427µs ± 0% ~ (p=1.000 n=5+5) zeo/py/fs1-zwrk.go·8 803µs ± 2% 801µs ± 2% ~ (p=0.286 n=4+5) zeo/py/fs1-zwrk.go·12 1.23ms ± 6% 1.17ms ± 2% ~ (p=0.063 n=5+4) zeo/py/fs1-zwrk.go·16 1.59ms ± 6% 1.55ms ± 2% ~ (p=0.095 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 271µs ± 7% 265µs ±12% ~ (p=0.690 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 346µs ± 0% 345µs ± 0% -0.51% (p=0.016 n=4+5) neo/py(!log)/sqlite-zwrk.go·3 520µs ± 0% 540µs ± 8% ~ (p=0.690 n=5+5) neo/py(!log)/sqlite-zwrk.go·4 694µs ± 0% 689µs ± 0% -0.67% (p=0.008 n=5+5) neo/py(!log)/sqlite-zwrk.go·8 1.37ms ± 1% 1.38ms ± 2% ~ (p=0.421 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 2.07ms ± 2% 2.08ms ± 0% ~ (p=0.548 n=5+5) neo/py(!log)/sqlite-zwrk.go·16 2.76ms ± 1% 2.76ms ± 0% ~ (p=0.690 n=5+5) neo/py(!log)/sql-zwrk.go·1 400µs ±11% 372µs ±21% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zwrk.go·2 554µs ± 7% 543µs ± 8% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zwrk.go·3 783µs ±11% 818µs ± 8% ~ (p=0.421 n=5+5) neo/py(!log)/sql-zwrk.go·4 1.06ms ±11% 1.06ms ±10% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·8 2.07ms ± 9% 2.05ms ±13% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·12 3.02ms ± 7% 2.98ms ±13% ~ (p=0.690 n=5+5) neo/py(!log)/sql-zwrk.go·16 4.32ms ±12% 4.20ms ±10% ~ (p=0.690 n=5+5) neo/go/fs1-zwrk.go·1 72.6µs ± 3% 73.3µs ± 4% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·2 71.2µs ± 0% 71.3µs ± 0% ~ (p=0.690 n=5+5) neo/go/fs1-zwrk.go·3 74.6µs ± 0% 74.5µs ± 0% ~ (p=0.881 n=5+5) neo/go/fs1-zwrk.go·4 75.7µs ± 1% 75.8µs ± 0% ~ (p=1.000 n=5+5) neo/go/fs1-zwrk.go·8 88.3µs ± 0% 88.4µs ± 0% ~ (p=0.421 n=5+5) neo/go/fs1-zwrk.go·12 125µs ± 1% 125µs ± 1% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·16 176µs ± 1% 178µs ± 1% ~ (p=0.151 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 61.7µs ± 2% 61.6µs ± 3% ~ (p=0.548 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 60.7µs ± 1% 60.5µs ± 0% ~ (p=0.151 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 64.9µs ± 0% 65.1µs ± 1% ~ (p=0.151 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 66.9µs ± 1% 66.5µs ± 0% ~ (p=0.095 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 81.5µs ± 0% 80.7µs ± 1% -1.05% (p=0.016 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 118µs ± 1% 116µs ± 0% -1.26% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 165µs ± 2% 164µs ± 2% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go·1 177µs ± 8% 173µs ± 8% ~ (p=0.548 n=5+5) neo/go/sqlite-zwrk.go·2 151µs ± 2% 151µs ± 1% ~ (p=1.000 n=5+5) neo/go/sqlite-zwrk.go·3 148µs ± 1% 148µs ± 1% ~ (p=1.000 n=5+5) neo/go/sqlite-zwrk.go·4 151µs ± 0% 151µs ± 1% ~ (p=0.841 n=5+5) neo/go/sqlite-zwrk.go·8 180µs ± 1% 179µs ± 0% ~ (p=0.111 n=5+4) neo/go/sqlite-zwrk.go·12 229µs ± 1% 228µs ± 0% ~ (p=0.095 n=5+5) neo/go/sqlite-zwrk.go·16 327µs ± 1% 329µs ± 1% ~ (p=0.310 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·1 176µs ± 4% 173µs ±13% ~ (p=0.421 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 152µs ± 3% 153µs ± 3% ~ (p=0.548 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·3 147µs ± 1% 146µs ± 1% ~ (p=0.841 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·4 148µs ± 2% 147µs ± 2% ~ (p=0.421 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 176µs ± 1% 177µs ± 0% ~ (p=0.222 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·12 225µs ± 1% 225µs ± 1% ~ (p=0.841 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 321µs ± 1% 321µs ± 1% ~ (p=0.690 n=5+5)
7f785235