After merging your PR, Conbench analyzed the 4 benchmarking runs that have been run so far on merge-commit 92c4948.

Benchmarks with performance regressions

There were 0 possible performance regressions, according to the lookback z-score method.

All benchmark runs analyzed:

• Commit Run on ec2-t3-xlarge-us-east-2 at 2024-04-12 06:56:38Z
• Commit Run on arm64-t4g-linux-compute at 2024-04-12 07:29:47Z
• Commit Run on ec2-m5-4xlarge-us-east-2 at 2024-04-12 07:56:58Z
• Commit Run on arm64-m6g-linux-compute at 2024-04-12 10:13:37Z

Unstable benchmarks with performance regressions

The following benchmark results indicate a possible performance regression, but are known to sometimes produce false positives when applying the lookback z-score analysis.

• Commit Run on arm64-t4g-linux-compute at 2024-04-12 07:29:47Z

  • SetBitRunReader (C++) with params=75, source=cpp-micro, suite=arrow-bit-util-benchmark
  • BenchmarkBitmapVisitBitsetAnd (C++) with params=131072/2, source=cpp-micro, suite=arrow-bit-util-benchmark
  • BenchmarkBitmapVisitUInt8And (C++) with params=131072/1, source=cpp-micro, suite=arrow-bit-util-benchmark
  • FirstTimeBitmapWriter (C++) with params=8192, source=cpp-micro, suite=arrow-bit-util-benchmark
  • SetBitsTo (C++) with params=1024, source=cpp-micro, suite=arrow-bit-util-benchmark
  • VisitBitsUnrolled (C++) with params=8192, source=cpp-micro, suite=arrow-bit-util-benchmark
  • BenchmarkBitmapVisitBitsetAnd (C++) with params=131072/1, source=cpp-micro, suite=arrow-bit-util-benchmark
  • BenchmarkBitmapVisitUInt8And (C++) with params=131072/2, source=cpp-micro, suite=arrow-bit-util-benchmark
  • BenchmarkBitmapAnd (C++) with params=131072/2, source=cpp-micro, suite=arrow-bit-util-benchmark
  • ReferenceNaiveBitmapWriter (C++) with params=8192, source=cpp-micro, suite=arrow-bit-util-benchmark
  • BenchmarkBitmapVisitUInt64And (C++) with params=131072/1, source=cpp-micro, suite=arrow-bit-util-benchmark
  • BenchmarkBitmapVisitBitsetAnd (C++) with params=32768/2, source=cpp-micro, suite=arrow-bit-util-benchmark
  • BenchmarkBitmapVisitUInt8And (C++) with params=32768/1, source=cpp-micro, suite=arrow-bit-util-benchmark
  • BenchmarkBitmapVisitBitsetAnd (C++) with params=32768/0, source=cpp-micro, suite=arrow-bit-util-benchmark
  • SetBitsTo (C++) with params=131072, source=cpp-micro, suite=arrow-bit-util-benchmark
  • ReverseSetBitRunReader (C++) with params=50, source=cpp-micro, suite=arrow-bit-util-benchmark
  • BenchmarkBitmapAnd (C++) with params=32768/2, source=cpp-micro, suite=arrow-bit-util-benchmark
  • BenchmarkBitmapAnd (C++) with params=32768/1, source=cpp-micro, suite=arrow-bit-util-benchmark
  • CheckIndexBoundsUInt32 (C++) with params=1048576/1000, source=cpp-micro, suite=arrow-int-util-benchmark

• Commit Run on ec2-m5-4xlarge-us-east-2 at 2024-04-12 07:56:58Z

  • arrowBufEquals (Java) with source=java-micro, suite=arrow.memory.util.ByteFunctionHelpersBenchmarks