Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Compare a matrix of nogil to other upstreams #597

Open
mdboom opened this issue Jun 7, 2023 · 4 comments
Open

Compare a matrix of nogil to other upstreams #597

mdboom opened this issue Jun 7, 2023 · 4 comments

Comments

@mdboom
Copy link
Contributor

mdboom commented Jun 7, 2023 •
edited
Loading

In the PEP 703 update thread on discuss, @colesbury suggested a few things to measure and compare.

  1. There is a newer version of nogil-3.12 than what we tested a few months ago. Sam suggested to use d595911.
  2. This should be compared against an upstream with the immortal object merged. Sam suggested using 018be4c, but I can't find that commit, so I'm using ea2c001, which is the merge commit of PEP 683.

In addition, the Faster CPython feels that:

  1. Comparing against the merge base of d595911, which is 3d5d3f7 is useful to see the measure the effect of only the nogil changes directly.
  2. It is also useful comparing against an upstream which has the same gc thresholds as the nogil branch, since the effect of that alone is so large. (See Investigate performance of the nogil branch with matching GC thresholds #593)

Therefore, this issue is a place to report comparisons of a recent nogil commit (d595911) against:

  • immortal: Upstream CPython immediately after the PEP 683 immortal objects changes were completed (ea2c001)
  • gc: merge-base modified so that the gc thresholds match nogil (0fd3163)
  • immortal-gc: PEP 683 (ea2c001) with the gc thresholds updated (82b39b9)
  • merge-base: Upstream CPython at the point the nogil branch was created (3d5d3f7)

Summary of results:

vs. pyperf compare_to distribution plots
immortal 5% slower 2% slower
gc 14% slower 12% slower
immortal-gc 10% slower 8% slower
merge-base 9% slower 7% slower

EDIT 2023-06-07T21:00: Updated summary table to include both pyperf compare_to and distribution plot results. Added a new target immortal-gc.
@mdboom
Copy link
Contributor Author

mdboom commented Jun 7, 2023 •
edited
Loading

immortal results

Benchmarks with tag 'apps':

2to3: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 266 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 287 ms +- 1 ms: 1.08x slower
chameleon: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 6.84 ms +- 0.06 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 7.73 ms +- 0.06 ms: 1.13x slower
html5lib: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 64.6 ms +- 2.6 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 68.3 ms +- 0.2 ms: 1.06x slower

Geometric mean: 1.09x slower

Benchmarks with tag 'math':

float: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 79.4 ms +- 0.9 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 67.0 ms +- 0.4 ms: 1.19x faster
nbody: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 88.8 ms +- 1.4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 103 ms +- 1 ms: 1.16x slower
pidigits: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 189 ms +- 0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 187 ms +- 0 ms: 1.01x faster

Geometric mean: 1.01x faster

Benchmarks with tag 'regex':

regex_compile: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 143 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 151 ms +- 1 ms: 1.06x slower
regex_dna: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 204 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 219 ms +- 1 ms: 1.07x slower
regex_effbot: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 3.32 ms +- 0.03 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.52 ms +- 0.01 ms: 1.06x slower
regex_v8: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 22.3 ms +- 0.2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 22.0 ms +- 0.3 ms: 1.01x faster

Geometric mean: 1.04x slower

Benchmarks with tag 'serialize':

json_dumps: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 9.74 ms +- 0.09 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 10.5 ms +- 0.3 ms: 1.07x slower
json_loads: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 24.9 us +- 0.4 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 28.1 us +- 0.2 us: 1.13x slower
pickle: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 10.4 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.82 us +- 0.06 us: 1.06x faster
pickle_dict: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 31.7 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 29.9 us +- 0.6 us: 1.06x faster
pickle_list: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 4.43 us +- 0.05 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 4.47 us +- 0.02 us: 1.01x slower
pickle_pure_python: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 308 us +- 2 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 315 us +- 2 us: 1.02x slower
unpickle: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 14.6 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 15.3 us +- 0.1 us: 1.05x slower
unpickle_list: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 5.41 us +- 0.04 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 5.35 us +- 0.05 us: 1.01x faster
unpickle_pure_python: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 213 us +- 1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 237 us +- 5 us: 1.11x slower
xml_etree_parse: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 155 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 133 ms +- 1 ms: 1.16x faster
xml_etree_iterparse: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 104 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 121 ms +- 7 ms: 1.16x slower
xml_etree_process: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 58.5 ms +- 1.0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 60.5 ms +- 0.5 ms: 1.03x slower

Benchmark hidden because not significant (1): xml_etree_generate

Geometric mean: 1.02x slower

Benchmarks with tag 'startup':

python_startup: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 9.04 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.33 ms +- 0.01 ms: 1.03x slower
python_startup_no_site: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 6.64 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.70 ms +- 0.01 ms: 1.01x slower

Geometric mean: 1.02x slower

Benchmarks with tag 'template':

genshi_text: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 22.5 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 24.3 ms +- 0.3 ms: 1.08x slower
genshi_xml: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 50.0 ms +- 1.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 51.9 ms +- 0.5 ms: 1.04x slower
mako: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 10.5 ms +- 0.1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 13.6 ms +- 0.1 ms: 1.29x slower

Geometric mean: 1.13x slower

All benchmarks:

2to3: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 266 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 287 ms +- 1 ms: 1.08x slower
async_generators: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 438 ms +- 5 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 369 ms +- 3 ms: 1.19x faster
async_tree_none: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 529 ms +- 17 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 289 ms +- 3 ms: 1.83x faster
async_tree_cpu_io_mixed: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 746 ms +- 28 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 514 ms +- 6 ms: 1.45x faster
async_tree_io: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 1.30 sec +- 0.02 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 580 ms +- 5 ms: 2.24x faster
async_tree_memoization: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 661 ms +- 32 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 362 ms +- 6 ms: 1.83x faster
asyncio_tcp: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 501 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 535 ms +- 2 ms: 1.07x slower
chameleon: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 6.84 ms +- 0.06 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 7.73 ms +- 0.06 ms: 1.13x slower
chaos: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 68.0 ms +- 0.6 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 76.6 ms +- 0.9 ms: 1.13x slower
comprehensions: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 23.2 us +- 0.2 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 26.8 us +- 0.2 us: 1.16x slower
bench_thread_pool: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 834 us +- 4 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.64 ms +- 0.01 ms: 1.97x slower
coroutines: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 21.9 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 25.1 ms +- 0.0 ms: 1.15x slower
crypto_pyaes: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 78.1 ms +- 0.5 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 81.9 ms +- 0.5 ms: 1.05x slower
deepcopy: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 359 us +- 2 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 373 us +- 2 us: 1.04x slower
deepcopy_reduce: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 3.17 us +- 0.04 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.32 us +- 0.05 us: 1.05x slower
deepcopy_memo: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 37.5 us +- 0.3 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 40.1 us +- 0.5 us: 1.07x slower
deltablue: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 3.57 ms +- 0.04 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.67 ms +- 0.02 ms: 1.03x slower
fannkuch: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 387 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 433 ms +- 2 ms: 1.12x slower
float: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 79.4 ms +- 0.9 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 67.0 ms +- 0.4 ms: 1.19x faster
create_gc_cycles: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 1.51 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.50 ms +- 0.01 ms: 1.01x faster
gc_traversal: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 3.84 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.11 ms +- 0.01 ms: 1.24x faster
generators: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 30.4 ms +- 0.4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 78.3 ms +- 0.3 ms: 2.58x slower
genshi_text: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 22.5 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 24.3 ms +- 0.3 ms: 1.08x slower
genshi_xml: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 50.0 ms +- 1.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 51.9 ms +- 0.5 ms: 1.04x slower
go: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 136 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 147 ms +- 2 ms: 1.09x slower
hexiom: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 6.25 ms +- 0.03 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.85 ms +- 0.03 ms: 1.10x slower
html5lib: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 64.6 ms +- 2.6 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 68.3 ms +- 0.2 ms: 1.06x slower
json: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 4.69 ms +- 0.07 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 5.05 ms +- 0.12 ms: 1.08x slower
json_dumps: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 9.74 ms +- 0.09 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 10.5 ms +- 0.3 ms: 1.07x slower
json_loads: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 24.9 us +- 0.4 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 28.1 us +- 0.2 us: 1.13x slower
logging_format: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 6.93 us +- 0.10 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 7.75 us +- 0.11 us: 1.12x slower
logging_silent: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 95.9 ns +- 0.4 ns -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 109 ns +- 0 ns: 1.13x slower
logging_simple: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 6.16 us +- 0.10 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.89 us +- 0.13 us: 1.12x slower
mako: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 10.5 ms +- 0.1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 13.6 ms +- 0.1 ms: 1.29x slower
mdp: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 2.58 sec +- 0.02 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 2.94 sec +- 0.02 sec: 1.14x slower
meteor_contest: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 113 ms +- 0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 126 ms +- 3 ms: 1.12x slower
mypy2: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 360 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 445 ms +- 8 ms: 1.24x slower
nbody: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 88.8 ms +- 1.4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 103 ms +- 1 ms: 1.16x slower
nqueens: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 80.7 ms +- 0.5 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 86.4 ms +- 0.6 ms: 1.07x slower
pathlib: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 17.9 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 19.5 ms +- 0.2 ms: 1.09x slower
pickle: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 10.4 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.82 us +- 0.06 us: 1.06x faster
pickle_dict: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 31.7 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 29.9 us +- 0.6 us: 1.06x faster
pickle_list: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 4.43 us +- 0.05 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 4.47 us +- 0.02 us: 1.01x slower
pickle_pure_python: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 308 us +- 2 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 315 us +- 2 us: 1.02x slower
pidigits: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 189 ms +- 0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 187 ms +- 0 ms: 1.01x faster
pprint_safe_repr: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 738 ms +- 11 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 772 ms +- 5 ms: 1.05x slower
pprint_pformat: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 1.51 sec +- 0.02 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.60 sec +- 0.01 sec: 1.06x slower
pyflate: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 455 ms +- 5 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 475 ms +- 3 ms: 1.04x slower
python_startup: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 9.04 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.33 ms +- 0.01 ms: 1.03x slower
python_startup_no_site: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 6.64 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.70 ms +- 0.01 ms: 1.01x slower
raytrace: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 296 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 346 ms +- 6 ms: 1.17x slower
regex_compile: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 143 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 151 ms +- 1 ms: 1.06x slower
regex_dna: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 204 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 219 ms +- 1 ms: 1.07x slower
regex_effbot: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 3.32 ms +- 0.03 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.52 ms +- 0.01 ms: 1.06x slower
regex_v8: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 22.3 ms +- 0.2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 22.0 ms +- 0.3 ms: 1.01x faster
richards: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 42.9 ms +- 0.7 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 48.8 ms +- 0.6 ms: 1.14x slower
scimark_fft: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 347 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 374 ms +- 3 ms: 1.08x slower
scimark_lu: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 112 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 125 ms +- 4 ms: 1.12x slower
scimark_monte_carlo: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 72.0 ms +- 1.2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 76.1 ms +- 1.2 ms: 1.06x slower
scimark_sor: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 118 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 125 ms +- 2 ms: 1.06x slower
scimark_sparse_mat_mult: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 4.70 ms +- 0.12 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 4.91 ms +- 0.07 ms: 1.04x slower
spectral_norm: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 102 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 112 ms +- 1 ms: 1.10x slower
sqlglot_parse: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 1.31 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.67 ms +- 0.07 ms: 1.28x slower
sqlglot_transpile: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 1.63 ms +- 0.03 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.97 ms +- 0.06 ms: 1.21x slower
sqlglot_optimize: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 54.2 ms +- 0.4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 55.4 ms +- 0.3 ms: 1.02x slower
sqlglot_normalize: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 111 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 114 ms +- 1 ms: 1.03x slower
sqlite_synth: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 2.68 us +- 0.04 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.33 us +- 0.05 us: 1.24x slower
sympy_expand: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 500 ms +- 17 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 533 ms +- 4 ms: 1.07x slower
sympy_integrate: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 21.9 ms +- 0.1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 22.8 ms +- 0.1 ms: 1.04x slower
sympy_sum: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 181 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 192 ms +- 1 ms: 1.06x slower
sympy_str: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 315 ms +- 14 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 329 ms +- 6 ms: 1.04x slower
telco: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 6.69 ms +- 0.18 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.81 ms +- 0.08 ms: 1.02x slower
unpack_sequence: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 46.7 ns +- 0.2 ns -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 51.8 ns +- 1.1 ns: 1.11x slower
unpickle: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 14.6 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 15.3 us +- 0.1 us: 1.05x slower
unpickle_list: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 5.41 us +- 0.04 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 5.35 us +- 0.05 us: 1.01x faster
unpickle_pure_python: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 213 us +- 1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 237 us +- 5 us: 1.11x slower
xml_etree_parse: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 155 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 133 ms +- 1 ms: 1.16x faster
xml_etree_iterparse: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 104 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 121 ms +- 7 ms: 1.16x slower
xml_etree_process: Mean +- std dev: [bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001] 58.5 ms +- 1.0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 60.5 ms +- 0.5 ms: 1.03x slower

Benchmark hidden because not significant (3): bench_mp_pool, pycparser, xml_etree_generate

Geometric mean: 1.05x slower
Ignored benchmarks (11) of ../results/bm-20230422-3.12.0a7+-ea2c001/bm-20230422-linux-x86_64-python-ea2c0016502472aa8baa-3.12.0a7+-ea2c001.json: coverage, dask, django_template, djangocms, docutils, dulwich_log, pylint, sqlalchemy_declarative, sqlalchemy_imperative, thrift, tornado_http
Ignored benchmarks (4) of ../results/bm-20230427-3.12.0a4-d595911/bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911.json: asyncio_tcp_ssl, richards_super, tomli_loads, typing_runtime_protocols

immortal

@mdboom
Copy link
Contributor Author

mdboom commented Jun 7, 2023 •
edited
Loading

gc results

Benchmarks with tag 'apps':

2to3: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 245 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 287 ms +- 1 ms: 1.17x slower
chameleon: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 6.37 ms +- 0.09 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 7.73 ms +- 0.06 ms: 1.21x slower
html5lib: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 57.8 ms +- 0.4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 68.3 ms +- 0.2 ms: 1.18x slower

Geometric mean: 1.19x slower

Benchmarks with tag 'math':

float: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 60.7 ms +- 0.5 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 67.0 ms +- 0.4 ms: 1.10x slower
nbody: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 92.3 ms +- 1.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 103 ms +- 1 ms: 1.12x slower
pidigits: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 189 ms +- 0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 187 ms +- 0 ms: 1.01x faster

Geometric mean: 1.07x slower

Benchmarks with tag 'regex':

regex_compile: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 131 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 151 ms +- 1 ms: 1.15x slower
regex_dna: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 210 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 219 ms +- 1 ms: 1.04x slower
regex_effbot: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 3.46 ms +- 0.02 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.52 ms +- 0.01 ms: 1.02x slower

Benchmark hidden because not significant (1): regex_v8

Geometric mean: 1.05x slower

Benchmarks with tag 'serialize':

json_dumps: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 9.55 ms +- 0.28 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 10.5 ms +- 0.3 ms: 1.09x slower
json_loads: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 23.7 us +- 0.3 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 28.1 us +- 0.2 us: 1.19x slower
pickle: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 10.2 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.82 us +- 0.06 us: 1.04x faster
pickle_dict: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 31.2 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 29.9 us +- 0.6 us: 1.05x faster
pickle_list: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 4.05 us +- 0.04 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 4.47 us +- 0.02 us: 1.11x slower
pickle_pure_python: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 282 us +- 3 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 315 us +- 2 us: 1.12x slower
tomli_loads: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 1.98 sec +- 0.03 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 2.39 sec +- 0.02 sec: 1.21x slower
unpickle: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 13.0 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 15.3 us +- 0.1 us: 1.17x slower
unpickle_list: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 4.95 us +- 0.06 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 5.35 us +- 0.05 us: 1.08x slower
unpickle_pure_python: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 198 us +- 3 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 237 us +- 5 us: 1.20x slower
xml_etree_parse: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 122 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 133 ms +- 1 ms: 1.10x slower
xml_etree_iterparse: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 80.9 ms +- 0.7 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 121 ms +- 7 ms: 1.49x slower
xml_etree_generate: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 73.4 ms +- 0.9 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 83.3 ms +- 1.1 ms: 1.14x slower
xml_etree_process: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 51.6 ms +- 0.2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 60.5 ms +- 0.5 ms: 1.17x slower

Geometric mean: 1.14x slower

Benchmarks with tag 'startup':

python_startup: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 8.24 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.33 ms +- 0.01 ms: 1.13x slower
python_startup_no_site: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 5.93 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.70 ms +- 0.01 ms: 1.13x slower

Geometric mean: 1.13x slower

Benchmarks with tag 'template':

genshi_text: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 20.2 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 24.3 ms +- 0.3 ms: 1.20x slower
genshi_xml: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 45.9 ms +- 0.6 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 51.9 ms +- 0.5 ms: 1.13x slower
mako: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 9.69 ms +- 0.08 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 13.6 ms +- 0.1 ms: 1.40x slower

Geometric mean: 1.24x slower

All benchmarks:

2to3: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 245 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 287 ms +- 1 ms: 1.17x slower
async_generators: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 338 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 369 ms +- 3 ms: 1.09x slower
async_tree_none: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 260 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 289 ms +- 3 ms: 1.11x slower
async_tree_cpu_io_mixed: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 469 ms +- 6 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 514 ms +- 6 ms: 1.10x slower
async_tree_io: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 534 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 580 ms +- 5 ms: 1.09x slower
async_tree_memoization: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 315 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 362 ms +- 6 ms: 1.15x slower
asyncio_tcp: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 511 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 535 ms +- 2 ms: 1.05x slower
asyncio_tcp_ssl: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 1.79 sec +- 0.00 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.85 sec +- 0.01 sec: 1.03x slower
chameleon: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 6.37 ms +- 0.09 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 7.73 ms +- 0.06 ms: 1.21x slower
chaos: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 68.8 ms +- 0.9 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 76.6 ms +- 0.9 ms: 1.11x slower
comprehensions: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 23.9 us +- 0.3 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 26.8 us +- 0.2 us: 1.12x slower
bench_thread_pool: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 792 us +- 4 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.64 ms +- 0.01 ms: 2.07x slower
coroutines: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 26.1 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 25.1 ms +- 0.0 ms: 1.04x faster
crypto_pyaes: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 73.7 ms +- 0.9 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 81.9 ms +- 0.5 ms: 1.11x slower
deepcopy: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 332 us +- 3 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 373 us +- 2 us: 1.12x slower
deepcopy_reduce: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 2.97 us +- 0.04 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.32 us +- 0.05 us: 1.12x slower
deepcopy_memo: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 33.8 us +- 0.5 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 40.1 us +- 0.5 us: 1.18x slower
deltablue: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 3.11 ms +- 0.02 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.67 ms +- 0.02 ms: 1.18x slower
fannkuch: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 368 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 433 ms +- 2 ms: 1.17x slower
float: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 60.7 ms +- 0.5 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 67.0 ms +- 0.4 ms: 1.10x slower
create_gc_cycles: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 1.46 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.50 ms +- 0.01 ms: 1.03x slower
gc_traversal: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 3.38 ms +- 0.04 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.11 ms +- 0.01 ms: 1.09x faster
generators: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 79.1 ms +- 0.5 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 78.3 ms +- 0.3 ms: 1.01x faster
genshi_text: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 20.2 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 24.3 ms +- 0.3 ms: 1.20x slower
genshi_xml: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 45.9 ms +- 0.6 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 51.9 ms +- 0.5 ms: 1.13x slower
go: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 137 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 147 ms +- 2 ms: 1.07x slower
hexiom: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 6.06 ms +- 0.05 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.85 ms +- 0.03 ms: 1.13x slower
html5lib: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 57.8 ms +- 0.4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 68.3 ms +- 0.2 ms: 1.18x slower
json: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 4.59 ms +- 0.10 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 5.05 ms +- 0.12 ms: 1.10x slower
json_dumps: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 9.55 ms +- 0.28 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 10.5 ms +- 0.3 ms: 1.09x slower
json_loads: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 23.7 us +- 0.3 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 28.1 us +- 0.2 us: 1.19x slower
logging_format: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 6.44 us +- 0.14 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 7.75 us +- 0.11 us: 1.20x slower
logging_silent: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 89.6 ns +- 2.5 ns -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 109 ns +- 0 ns: 1.21x slower
logging_simple: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 5.80 us +- 0.08 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.89 us +- 0.13 us: 1.19x slower
mako: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 9.69 ms +- 0.08 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 13.6 ms +- 0.1 ms: 1.40x slower
mdp: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 2.48 sec +- 0.01 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 2.94 sec +- 0.02 sec: 1.19x slower
meteor_contest: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 109 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 126 ms +- 3 ms: 1.16x slower
mypy2: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 309 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 445 ms +- 8 ms: 1.44x slower
nbody: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 92.3 ms +- 1.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 103 ms +- 1 ms: 1.12x slower
nqueens: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 77.6 ms +- 0.8 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 86.4 ms +- 0.6 ms: 1.11x slower
pathlib: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 18.2 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 19.5 ms +- 0.2 ms: 1.08x slower
pickle: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 10.2 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.82 us +- 0.06 us: 1.04x faster
pickle_dict: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 31.2 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 29.9 us +- 0.6 us: 1.05x faster
pickle_list: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 4.05 us +- 0.04 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 4.47 us +- 0.02 us: 1.11x slower
pickle_pure_python: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 282 us +- 3 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 315 us +- 2 us: 1.12x slower
pidigits: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 189 ms +- 0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 187 ms +- 0 ms: 1.01x faster
pprint_safe_repr: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 676 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 772 ms +- 5 ms: 1.14x slower
pprint_pformat: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 1.39 sec +- 0.01 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.60 sec +- 0.01 sec: 1.15x slower
pycparser: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 1.06 sec +- 0.01 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.14 sec +- 0.04 sec: 1.08x slower
pyflate: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 403 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 475 ms +- 3 ms: 1.18x slower
python_startup: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 8.24 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.33 ms +- 0.01 ms: 1.13x slower
python_startup_no_site: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 5.93 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.70 ms +- 0.01 ms: 1.13x slower
raytrace: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 286 ms +- 7 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 346 ms +- 6 ms: 1.21x slower
regex_compile: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 131 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 151 ms +- 1 ms: 1.15x slower
regex_dna: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 210 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 219 ms +- 1 ms: 1.04x slower
regex_effbot: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 3.46 ms +- 0.02 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.52 ms +- 0.01 ms: 1.02x slower
richards: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 42.5 ms +- 0.8 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 48.8 ms +- 0.6 ms: 1.15x slower
richards_super: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 52.9 ms +- 0.5 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 60.2 ms +- 0.4 ms: 1.14x slower
scimark_fft: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 309 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 374 ms +- 3 ms: 1.21x slower
scimark_lu: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 105 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 125 ms +- 4 ms: 1.19x slower
scimark_monte_carlo: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 65.2 ms +- 1.4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 76.1 ms +- 1.2 ms: 1.17x slower
scimark_sor: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 106 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 125 ms +- 2 ms: 1.18x slower
scimark_sparse_mat_mult: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 4.12 ms +- 0.12 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 4.91 ms +- 0.07 ms: 1.19x slower
spectral_norm: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 94.7 ms +- 1.0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 112 ms +- 1 ms: 1.18x slower
sqlglot_parse: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 1.38 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.67 ms +- 0.07 ms: 1.21x slower
sqlglot_transpile: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 1.67 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.97 ms +- 0.06 ms: 1.18x slower
sqlglot_optimize: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 51.6 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 55.4 ms +- 0.3 ms: 1.07x slower
sqlglot_normalize: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 108 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 114 ms +- 1 ms: 1.05x slower
sqlite_synth: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 2.67 us +- 0.06 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.33 us +- 0.05 us: 1.24x slower
sympy_expand: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 455 ms +- 5 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 533 ms +- 4 ms: 1.17x slower
sympy_integrate: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 20.2 ms +- 0.1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 22.8 ms +- 0.1 ms: 1.13x slower
sympy_sum: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 163 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 192 ms +- 1 ms: 1.18x slower
sympy_str: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 281 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 329 ms +- 6 ms: 1.17x slower
telco: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 6.52 ms +- 0.15 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.81 ms +- 0.08 ms: 1.04x slower
tomli_loads: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 1.98 sec +- 0.03 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 2.39 sec +- 0.02 sec: 1.21x slower
typing_runtime_protocols: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 463 us +- 3 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 535 us +- 2 us: 1.16x slower
unpack_sequence: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 43.6 ns +- 0.8 ns -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 51.8 ns +- 1.1 ns: 1.19x slower
unpickle: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 13.0 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 15.3 us +- 0.1 us: 1.17x slower
unpickle_list: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 4.95 us +- 0.06 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 5.35 us +- 0.05 us: 1.08x slower
unpickle_pure_python: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 198 us +- 3 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 237 us +- 5 us: 1.20x slower
xml_etree_parse: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 122 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 133 ms +- 1 ms: 1.10x slower
xml_etree_iterparse: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 80.9 ms +- 0.7 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 121 ms +- 7 ms: 1.49x slower
xml_etree_generate: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 73.4 ms +- 0.9 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 83.3 ms +- 1.1 ms: 1.14x slower
xml_etree_process: Mean +- std dev: [bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163] 51.6 ms +- 0.2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 60.5 ms +- 0.5 ms: 1.17x slower

Benchmark hidden because not significant (2): bench_mp_pool, regex_v8

Geometric mean: 1.14x slower
Ignored benchmarks (7) of ../results/bm-20230531-3.12.0a4-0fd3163/bm-20230531-linux-x86_64-mdboom-match_nogil_gc-3.12.0a4-0fd3163.json: coverage, dask, django_template, djangocms, docutils, dulwich_log, thrift

merge-base

@mdboom
Copy link
Contributor Author

mdboom commented Jun 7, 2023 •
edited
Loading

immortal + gc results

Benchmarks with tag 'apps':

2to3: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 260 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 287 ms +- 1 ms: 1.10x slower
chameleon: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 6.91 ms +- 0.08 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 7.73 ms +- 0.06 ms: 1.12x slower
html5lib: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 62.9 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 68.3 ms +- 0.2 ms: 1.09x slower

Geometric mean: 1.10x slower

Benchmarks with tag 'math':

float: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 69.2 ms +- 0.7 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 67.0 ms +- 0.4 ms: 1.03x faster
nbody: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 91.3 ms +- 0.8 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 103 ms +- 1 ms: 1.13x slower
pidigits: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 197 ms +- 0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 187 ms +- 0 ms: 1.06x faster

Geometric mean: 1.01x slower

Benchmarks with tag 'regex':

regex_compile: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 146 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 151 ms +- 1 ms: 1.03x slower
regex_dna: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 209 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 219 ms +- 1 ms: 1.05x slower
regex_effbot: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 3.38 ms +- 0.02 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.52 ms +- 0.01 ms: 1.04x slower
regex_v8: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 21.9 ms +- 0.0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 22.0 ms +- 0.3 ms: 1.00x slower

Geometric mean: 1.03x slower

Benchmarks with tag 'serialize':

json_dumps: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 9.70 ms +- 0.10 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 10.5 ms +- 0.3 ms: 1.08x slower
json_loads: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 24.9 us +- 1.3 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 28.1 us +- 0.2 us: 1.13x slower
pickle: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 10.3 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.82 us +- 0.06 us: 1.05x faster
pickle_list: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 4.36 us +- 0.04 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 4.47 us +- 0.02 us: 1.03x slower
pickle_pure_python: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 314 us +- 2 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 315 us +- 2 us: 1.01x slower
tomli_loads: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 2.18 sec +- 0.02 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 2.39 sec +- 0.02 sec: 1.09x slower
unpickle: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 14.5 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 15.3 us +- 0.1 us: 1.05x slower
unpickle_list: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 5.09 us +- 0.05 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 5.35 us +- 0.05 us: 1.05x slower
unpickle_pure_python: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 218 us +- 1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 237 us +- 5 us: 1.08x slower
xml_etree_parse: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 124 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 133 ms +- 1 ms: 1.07x slower
xml_etree_iterparse: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 79.5 ms +- 0.6 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 121 ms +- 7 ms: 1.52x slower
xml_etree_generate: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 78.4 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 83.3 ms +- 1.1 ms: 1.06x slower
xml_etree_process: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 56.6 ms +- 0.5 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 60.5 ms +- 0.5 ms: 1.07x slower

Benchmark hidden because not significant (1): pickle_dict

Geometric mean: 1.08x slower

Benchmarks with tag 'startup':

python_startup: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 8.83 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.33 ms +- 0.01 ms: 1.06x slower
python_startup_no_site: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 6.46 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.70 ms +- 0.01 ms: 1.04x slower

Geometric mean: 1.05x slower

Benchmarks with tag 'template':

genshi_text: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 23.0 ms +- 0.4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 24.3 ms +- 0.3 ms: 1.06x slower
genshi_xml: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 49.2 ms +- 0.8 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 51.9 ms +- 0.5 ms: 1.05x slower
mako: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 10.6 ms +- 0.2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 13.6 ms +- 0.1 ms: 1.28x slower

Geometric mean: 1.12x slower

All benchmarks:

2to3: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 260 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 287 ms +- 1 ms: 1.10x slower
async_generators: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 411 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 369 ms +- 3 ms: 1.12x faster
async_tree_none: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 262 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 289 ms +- 3 ms: 1.11x slower
async_tree_cpu_io_mixed: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 469 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 514 ms +- 6 ms: 1.09x slower
async_tree_io: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 523 ms +- 5 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 580 ms +- 5 ms: 1.11x slower
async_tree_memoization: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 318 ms +- 5 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 362 ms +- 6 ms: 1.14x slower
asyncio_tcp: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 512 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 535 ms +- 2 ms: 1.04x slower
asyncio_tcp_ssl: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 1.80 sec +- 0.00 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.85 sec +- 0.01 sec: 1.03x slower
chameleon: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 6.91 ms +- 0.08 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 7.73 ms +- 0.06 ms: 1.12x slower
chaos: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 68.0 ms +- 0.4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 76.6 ms +- 0.9 ms: 1.13x slower
comprehensions: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 23.4 us +- 0.2 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 26.8 us +- 0.2 us: 1.15x slower
bench_thread_pool: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 846 us +- 6 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.64 ms +- 0.01 ms: 1.94x slower
coroutines: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 23.5 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 25.1 ms +- 0.0 ms: 1.07x slower
crypto_pyaes: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 78.0 ms +- 0.4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 81.9 ms +- 0.5 ms: 1.05x slower
deepcopy: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 361 us +- 2 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 373 us +- 2 us: 1.03x slower
deepcopy_reduce: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 3.20 us +- 0.04 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.32 us +- 0.05 us: 1.04x slower
deepcopy_memo: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 38.9 us +- 0.2 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 40.1 us +- 0.5 us: 1.03x slower
deltablue: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 3.55 ms +- 0.04 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.67 ms +- 0.02 ms: 1.03x slower
fannkuch: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 390 ms +- 7 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 433 ms +- 2 ms: 1.11x slower
float: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 69.2 ms +- 0.7 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 67.0 ms +- 0.4 ms: 1.03x faster
create_gc_cycles: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 1.53 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.50 ms +- 0.01 ms: 1.02x faster
gc_traversal: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 3.72 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.11 ms +- 0.01 ms: 1.20x faster
generators: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 30.7 ms +- 0.1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 78.3 ms +- 0.3 ms: 2.55x slower
genshi_text: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 23.0 ms +- 0.4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 24.3 ms +- 0.3 ms: 1.06x slower
genshi_xml: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 49.2 ms +- 0.8 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 51.9 ms +- 0.5 ms: 1.05x slower
go: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 138 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 147 ms +- 2 ms: 1.07x slower
hexiom: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 6.34 ms +- 0.03 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.85 ms +- 0.03 ms: 1.08x slower
html5lib: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 62.9 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 68.3 ms +- 0.2 ms: 1.09x slower
json: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 4.79 ms +- 0.10 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 5.05 ms +- 0.12 ms: 1.05x slower
json_dumps: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 9.70 ms +- 0.10 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 10.5 ms +- 0.3 ms: 1.08x slower
json_loads: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 24.9 us +- 1.3 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 28.1 us +- 0.2 us: 1.13x slower
logging_format: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 7.00 us +- 0.10 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 7.75 us +- 0.11 us: 1.11x slower
logging_silent: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 97.5 ns +- 1.3 ns -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 109 ns +- 0 ns: 1.12x slower
logging_simple: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 6.31 us +- 0.09 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.89 us +- 0.13 us: 1.09x slower
mako: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 10.6 ms +- 0.2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 13.6 ms +- 0.1 ms: 1.28x slower
mdp: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 2.56 sec +- 0.03 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 2.94 sec +- 0.02 sec: 1.15x slower
meteor_contest: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 114 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 126 ms +- 3 ms: 1.11x slower
mypy2: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 337 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 445 ms +- 8 ms: 1.32x slower
nbody: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 91.3 ms +- 0.8 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 103 ms +- 1 ms: 1.13x slower
nqueens: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 80.5 ms +- 0.7 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 86.4 ms +- 0.6 ms: 1.07x slower
pathlib: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 17.7 ms +- 0.1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 19.5 ms +- 0.2 ms: 1.10x slower
pickle: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 10.3 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.82 us +- 0.06 us: 1.05x faster
pickle_list: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 4.36 us +- 0.04 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 4.47 us +- 0.02 us: 1.03x slower
pickle_pure_python: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 314 us +- 2 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 315 us +- 2 us: 1.01x slower
pidigits: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 197 ms +- 0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 187 ms +- 0 ms: 1.06x faster
pprint_safe_repr: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 732 ms +- 8 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 772 ms +- 5 ms: 1.06x slower
pprint_pformat: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 1.49 sec +- 0.01 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.60 sec +- 0.01 sec: 1.07x slower
pycparser: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 1.05 sec +- 0.01 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.14 sec +- 0.04 sec: 1.09x slower
pyflate: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 459 ms +- 6 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 475 ms +- 3 ms: 1.03x slower
python_startup: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 8.83 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.33 ms +- 0.01 ms: 1.06x slower
python_startup_no_site: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 6.46 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.70 ms +- 0.01 ms: 1.04x slower
raytrace: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 304 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 346 ms +- 6 ms: 1.14x slower
regex_compile: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 146 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 151 ms +- 1 ms: 1.03x slower
regex_dna: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 209 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 219 ms +- 1 ms: 1.05x slower
regex_effbot: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 3.38 ms +- 0.02 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.52 ms +- 0.01 ms: 1.04x slower
regex_v8: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 21.9 ms +- 0.0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 22.0 ms +- 0.3 ms: 1.00x slower
richards: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 44.0 ms +- 1.0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 48.8 ms +- 0.6 ms: 1.11x slower
richards_super: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 55.0 ms +- 0.9 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 60.2 ms +- 0.4 ms: 1.09x slower
scimark_fft: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 353 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 374 ms +- 3 ms: 1.06x slower
scimark_lu: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 110 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 125 ms +- 4 ms: 1.13x slower
scimark_monte_carlo: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 72.5 ms +- 1.0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 76.1 ms +- 1.2 ms: 1.05x slower
scimark_sparse_mat_mult: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 4.62 ms +- 0.03 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 4.91 ms +- 0.07 ms: 1.06x slower
spectral_norm: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 106 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 112 ms +- 1 ms: 1.05x slower
sqlglot_parse: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 1.29 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.67 ms +- 0.07 ms: 1.30x slower
sqlglot_transpile: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 1.61 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.97 ms +- 0.06 ms: 1.22x slower
sqlglot_optimize: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 55.1 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 55.4 ms +- 0.3 ms: 1.01x slower
sqlglot_normalize: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 112 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 114 ms +- 1 ms: 1.02x slower
sqlite_synth: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 2.68 us +- 0.04 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.33 us +- 0.05 us: 1.24x slower
sympy_expand: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 495 ms +- 6 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 533 ms +- 4 ms: 1.08x slower
sympy_integrate: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 21.9 ms +- 0.1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 22.8 ms +- 0.1 ms: 1.04x slower
sympy_sum: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 180 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 192 ms +- 1 ms: 1.07x slower
sympy_str: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 310 ms +- 11 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 329 ms +- 6 ms: 1.06x slower
telco: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 6.92 ms +- 0.16 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.81 ms +- 0.08 ms: 1.02x faster
tomli_loads: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 2.18 sec +- 0.02 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 2.39 sec +- 0.02 sec: 1.09x slower
typing_runtime_protocols: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 216 us +- 11 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 535 us +- 2 us: 2.48x slower
unpack_sequence: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 49.8 ns +- 0.2 ns -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 51.8 ns +- 1.1 ns: 1.04x slower
unpickle: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 14.5 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 15.3 us +- 0.1 us: 1.05x slower
unpickle_list: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 5.09 us +- 0.05 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 5.35 us +- 0.05 us: 1.05x slower
unpickle_pure_python: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 218 us +- 1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 237 us +- 5 us: 1.08x slower
xml_etree_parse: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 124 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 133 ms +- 1 ms: 1.07x slower
xml_etree_iterparse: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 79.5 ms +- 0.6 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 121 ms +- 7 ms: 1.52x slower
xml_etree_generate: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 78.4 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 83.3 ms +- 1.1 ms: 1.06x slower
xml_etree_process: Mean +- std dev: [bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9] 56.6 ms +- 0.5 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 60.5 ms +- 0.5 ms: 1.07x slower

Benchmark hidden because not significant (3): bench_mp_pool, pickle_dict, scimark_sor

Geometric mean: 1.10x slower
Ignored benchmarks (13) of ../results/bm-20230607-3.12.0a7+-82b39b9/bm-20230607-linux-x86_64-mdboom-match_nogil_immortal-3.12.0a7+-82b39b9.json: aiohttp, coverage, dask, django_template, djangocms, docutils, dulwich_log, gunicorn, pylint, sqlalchemy_declarative, sqlalchemy_imperative, thrift, tornado_http

immortal-gc

@mdboom
Copy link
Contributor Author

mdboom commented Jun 7, 2023

merge base results

Benchmarks with tag 'apps':

2to3: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 253 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 287 ms +- 1 ms: 1.13x slower
chameleon: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 6.46 ms +- 0.09 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 7.73 ms +- 0.06 ms: 1.20x slower
html5lib: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 59.8 ms +- 2.7 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 68.3 ms +- 0.2 ms: 1.14x slower

Geometric mean: 1.16x slower

Benchmarks with tag 'math':

float: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 72.2 ms +- 0.9 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 67.0 ms +- 0.4 ms: 1.08x faster
nbody: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 93.1 ms +- 1.6 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 103 ms +- 1 ms: 1.11x slower
pidigits: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 192 ms +- 0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 187 ms +- 0 ms: 1.03x faster

Geometric mean: 1.00x faster

Benchmarks with tag 'regex':

regex_compile: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 132 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 151 ms +- 1 ms: 1.15x slower
regex_dna: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 209 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 219 ms +- 1 ms: 1.05x slower
regex_effbot: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 3.49 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.52 ms +- 0.01 ms: 1.01x slower
regex_v8: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 21.1 ms +- 0.1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 22.0 ms +- 0.3 ms: 1.04x slower

Geometric mean: 1.06x slower

Benchmarks with tag 'serialize':

json_dumps: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 9.54 ms +- 0.32 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 10.5 ms +- 0.3 ms: 1.10x slower
json_loads: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 24.3 us +- 0.5 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 28.1 us +- 0.2 us: 1.16x slower
pickle: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 10.0 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.82 us +- 0.06 us: 1.02x faster
pickle_list: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 4.02 us +- 0.03 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 4.47 us +- 0.02 us: 1.11x slower
pickle_pure_python: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 285 us +- 3 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 315 us +- 2 us: 1.10x slower
unpickle: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 13.0 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 15.3 us +- 0.1 us: 1.18x slower
unpickle_list: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 4.96 us +- 0.06 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 5.35 us +- 0.05 us: 1.08x slower
unpickle_pure_python: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 200 us +- 2 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 237 us +- 5 us: 1.19x slower
xml_etree_parse: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 149 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 133 ms +- 1 ms: 1.12x faster
xml_etree_iterparse: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 106 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 121 ms +- 7 ms: 1.13x slower
xml_etree_generate: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 77.5 ms +- 1.0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 83.3 ms +- 1.1 ms: 1.08x slower
xml_etree_process: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 53.9 ms +- 0.7 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 60.5 ms +- 0.5 ms: 1.12x slower

Benchmark hidden because not significant (1): pickle_dict

Geometric mean: 1.08x slower

Benchmarks with tag 'startup':

python_startup: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 8.54 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.33 ms +- 0.01 ms: 1.09x slower
python_startup_no_site: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 6.09 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.70 ms +- 0.01 ms: 1.10x slower

Geometric mean: 1.10x slower

Benchmarks with tag 'template':

genshi_text: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 20.8 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 24.3 ms +- 0.3 ms: 1.17x slower
genshi_xml: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 46.5 ms +- 0.8 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 51.9 ms +- 0.5 ms: 1.11x slower
mako: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 9.74 ms +- 0.07 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 13.6 ms +- 0.1 ms: 1.39x slower

Geometric mean: 1.22x slower

All benchmarks:

2to3: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 253 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 287 ms +- 1 ms: 1.13x slower
async_generators: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 354 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 369 ms +- 3 ms: 1.04x slower
async_tree_none: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 521 ms +- 17 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 289 ms +- 3 ms: 1.80x faster
async_tree_cpu_io_mixed: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 747 ms +- 14 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 514 ms +- 6 ms: 1.45x faster
async_tree_io: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 1.30 sec +- 0.02 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 580 ms +- 5 ms: 2.23x faster
async_tree_memoization: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 616 ms +- 34 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 362 ms +- 6 ms: 1.70x faster
asyncio_tcp: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 504 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 535 ms +- 2 ms: 1.06x slower
chameleon: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 6.46 ms +- 0.09 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 7.73 ms +- 0.06 ms: 1.20x slower
chaos: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 67.7 ms +- 0.9 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 76.6 ms +- 0.9 ms: 1.13x slower
comprehensions: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 23.7 us +- 0.2 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 26.8 us +- 0.2 us: 1.13x slower
bench_thread_pool: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 782 us +- 4 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.64 ms +- 0.01 ms: 2.10x slower
coroutines: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 25.4 ms +- 0.2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 25.1 ms +- 0.0 ms: 1.01x faster
crypto_pyaes: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 75.7 ms +- 0.7 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 81.9 ms +- 0.5 ms: 1.08x slower
deepcopy: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 339 us +- 3 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 373 us +- 2 us: 1.10x slower
deepcopy_reduce: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 2.99 us +- 0.04 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.32 us +- 0.05 us: 1.11x slower
deepcopy_memo: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 34.7 us +- 0.7 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 40.1 us +- 0.5 us: 1.16x slower
deltablue: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 3.25 ms +- 0.05 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.67 ms +- 0.02 ms: 1.13x slower
fannkuch: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 362 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 433 ms +- 2 ms: 1.19x slower
float: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 72.2 ms +- 0.9 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 67.0 ms +- 0.4 ms: 1.08x faster
create_gc_cycles: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 1.45 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.50 ms +- 0.01 ms: 1.03x slower
gc_traversal: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 3.57 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.11 ms +- 0.01 ms: 1.15x faster
generators: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 79.1 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 78.3 ms +- 0.3 ms: 1.01x faster
genshi_text: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 20.8 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 24.3 ms +- 0.3 ms: 1.17x slower
genshi_xml: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 46.5 ms +- 0.8 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 51.9 ms +- 0.5 ms: 1.11x slower
go: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 135 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 147 ms +- 2 ms: 1.09x slower
hexiom: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 5.98 ms +- 0.05 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.85 ms +- 0.03 ms: 1.15x slower
html5lib: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 59.8 ms +- 2.7 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 68.3 ms +- 0.2 ms: 1.14x slower
json: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 4.74 ms +- 0.16 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 5.05 ms +- 0.12 ms: 1.06x slower
json_dumps: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 9.54 ms +- 0.32 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 10.5 ms +- 0.3 ms: 1.10x slower
json_loads: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 24.3 us +- 0.5 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 28.1 us +- 0.2 us: 1.16x slower
logging_format: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 6.35 us +- 0.11 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 7.75 us +- 0.11 us: 1.22x slower
logging_silent: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 93.5 ns +- 1.2 ns -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 109 ns +- 0 ns: 1.16x slower
logging_simple: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 5.77 us +- 0.07 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.89 us +- 0.13 us: 1.19x slower
mako: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 9.74 ms +- 0.07 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 13.6 ms +- 0.1 ms: 1.39x slower
mdp: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 2.66 sec +- 0.01 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 2.94 sec +- 0.02 sec: 1.11x slower
meteor_contest: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 104 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 126 ms +- 3 ms: 1.21x slower
mypy2: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 332 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 445 ms +- 8 ms: 1.34x slower
nbody: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 93.1 ms +- 1.6 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 103 ms +- 1 ms: 1.11x slower
nqueens: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 78.0 ms +- 1.0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 86.4 ms +- 0.6 ms: 1.11x slower
pathlib: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 18.0 ms +- 0.2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 19.5 ms +- 0.2 ms: 1.08x slower
pickle: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 10.0 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.82 us +- 0.06 us: 1.02x faster
pickle_list: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 4.02 us +- 0.03 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 4.47 us +- 0.02 us: 1.11x slower
pickle_pure_python: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 285 us +- 3 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 315 us +- 2 us: 1.10x slower
pidigits: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 192 ms +- 0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 187 ms +- 0 ms: 1.03x faster
pprint_safe_repr: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 680 ms +- 9 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 772 ms +- 5 ms: 1.14x slower
pprint_pformat: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 1.38 sec +- 0.01 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.60 sec +- 0.01 sec: 1.16x slower
pycparser: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 1.08 sec +- 0.02 sec -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.14 sec +- 0.04 sec: 1.06x slower
pyflate: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 397 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 475 ms +- 3 ms: 1.20x slower
python_startup: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 8.54 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 9.33 ms +- 0.01 ms: 1.09x slower
python_startup_no_site: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 6.09 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.70 ms +- 0.01 ms: 1.10x slower
raytrace: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 284 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 346 ms +- 6 ms: 1.22x slower
regex_compile: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 132 ms +- 4 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 151 ms +- 1 ms: 1.15x slower
regex_dna: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 209 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 219 ms +- 1 ms: 1.05x slower
regex_effbot: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 3.49 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.52 ms +- 0.01 ms: 1.01x slower
regex_v8: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 21.1 ms +- 0.1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 22.0 ms +- 0.3 ms: 1.04x slower
richards: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 42.3 ms +- 0.6 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 48.8 ms +- 0.6 ms: 1.15x slower
scimark_fft: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 314 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 374 ms +- 3 ms: 1.19x slower
scimark_lu: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 107 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 125 ms +- 4 ms: 1.16x slower
scimark_monte_carlo: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 65.7 ms +- 0.7 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 76.1 ms +- 1.2 ms: 1.16x slower
scimark_sor: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 108 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 125 ms +- 2 ms: 1.16x slower
scimark_sparse_mat_mult: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 4.13 ms +- 0.10 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 4.91 ms +- 0.07 ms: 1.19x slower
spectral_norm: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 95.0 ms +- 2.0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 112 ms +- 1 ms: 1.18x slower
sqlglot_parse: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 1.41 ms +- 0.01 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.67 ms +- 0.07 ms: 1.19x slower
sqlglot_transpile: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 1.69 ms +- 0.02 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 1.97 ms +- 0.06 ms: 1.16x slower
sqlglot_optimize: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 50.7 ms +- 0.3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 55.4 ms +- 0.3 ms: 1.09x slower
sqlglot_normalize: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 104 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 114 ms +- 1 ms: 1.09x slower
sqlite_synth: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 2.57 us +- 0.04 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 3.33 us +- 0.05 us: 1.29x slower
sympy_expand: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 455 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 533 ms +- 4 ms: 1.17x slower
sympy_integrate: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 20.3 ms +- 0.1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 22.8 ms +- 0.1 ms: 1.12x slower
sympy_sum: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 163 ms +- 1 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 192 ms +- 1 ms: 1.18x slower
sympy_str: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 282 ms +- 3 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 329 ms +- 6 ms: 1.16x slower
telco: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 6.26 ms +- 0.12 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 6.81 ms +- 0.08 ms: 1.09x slower
unpack_sequence: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 41.4 ns +- 0.5 ns -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 51.8 ns +- 1.1 ns: 1.25x slower
unpickle: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 13.0 us +- 0.1 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 15.3 us +- 0.1 us: 1.18x slower
unpickle_list: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 4.96 us +- 0.06 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 5.35 us +- 0.05 us: 1.08x slower
unpickle_pure_python: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 200 us +- 2 us -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 237 us +- 5 us: 1.19x slower
xml_etree_parse: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 149 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 133 ms +- 1 ms: 1.12x faster
xml_etree_iterparse: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 106 ms +- 2 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 121 ms +- 7 ms: 1.13x slower
xml_etree_generate: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 77.5 ms +- 1.0 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 83.3 ms +- 1.1 ms: 1.08x slower
xml_etree_process: Mean +- std dev: [bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7] 53.9 ms +- 0.7 ms -> [bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911] 60.5 ms +- 0.5 ms: 1.12x slower

Benchmark hidden because not significant (2): bench_mp_pool, pickle_dict

Geometric mean: 1.09x slower
Ignored benchmarks (7) of ../results/bm-20230110-3.12.0a4-3d5d3f7/bm-20230110-linux-x86_64-python-3d5d3f7af6498effbc60-3.12.0a4-3d5d3f7.json: coverage, dask, django_template, djangocms, docutils, dulwich_log, thrift
Ignored benchmarks (4) of ../results/bm-20230427-3.12.0a4-d595911/bm-20230427-linux-x86_64-mdboom-nogil_d595911-3.12.0a4-d595911.json: asyncio_tcp_ssl, richards_super, tomli_loads, typing_runtime_protocols

merge-base

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@mdboom