Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor: move main macro benchmarks to python #1235

Merged
merged 8 commits into from
Sep 8, 2023

Conversation

wjones127
Copy link
Contributor

@wjones127 wjones127 commented Sep 6, 2023

Fixes #1218

This makes it easier to write, run, and profile benchmarks. Writing them in Python makes them faster to compile and not require recompilation if we only modify the benchmark itself.

We cache the expensive fixtures (like an indexed table) so that we can quickly run the benchmarks.

@wjones127 wjones127 force-pushed the wjones127/python-benchmarks branch from 9dff2ea to d59a1f3 Compare September 7, 2023 15:20
@wjones127 wjones127 marked this pull request as ready for review September 7, 2023 15:39
import pyarrow.compute as pc
import pytest

N_DIMS = 128
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's make this 768 or 1536 more realistic these days.

@wjones127 wjones127 merged commit ad82887 into main Sep 8, 2023
@wjones127 wjones127 deleted the wjones127/python-benchmarks branch September 8, 2023 00:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Move macro benchmarks to Python
2 participants