Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Require BangBang 0.3.24 #299

Merged
merged 1 commit into from
Jun 1, 2020
Merged

Require BangBang 0.3.24 #299

merged 1 commit into from
Jun 1, 2020

Conversation

tkf
Copy link
Member

@tkf tkf commented Jun 1, 2020

This introduces two recent important updates in BangBang:

@tkf
Require BangBang 0.3.24
e2886ec 
This introduces two recent important updates in BangBang:

* Custom definition for `append!!(_, Init(append!!))`
  JuliaFolds/BangBang.jl#148
  (requires v0.3.23)

* Fix widening path of `materialize!!`
  JuliaFolds/BangBang.jl#154
  (requires v0.3.24)
@github-actions
Copy link
Contributor

github-actions bot commented Jun 1, 2020

Benchmark result

Judge result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

  • Time of benchmarks:
    • Target: 1 Jun 2020 - 02:27
    • Baseline: 1 Jun 2020 - 02:31
  • Package commits:
    • Target: 14db52
    • Baseline: ae32c1
  • Julia commits:
    • Target: 44fa15
    • Baseline: 44fa15
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: OMP_NUM_THREADS => 1 JULIA_NUM_THREADS => 1
    • Baseline: OMP_NUM_THREADS => 1 JULIA_NUM_THREADS => 1

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["findall", "xf-array"] 0.95 (5%) ✅ 0.99 (1%) ✅
["gemm", "mul", "man", "false", "32"] 0.94 (5%) ✅ 1.00 (1%)
["gemm", "mul", "man", "true", "32"] 0.92 (5%) ✅ 1.00 (1%)
["gemm", "mul", "man", "true", "8"] 1.08 (5%) ❌ 1.00 (1%)
["gemm", "mul", "xf", "false", "32"] 0.93 (5%) ✅ 1.00 (1%)
["gemm", "mul", "xf", "false", "8"] 1.25 (5%) ❌ 1.00 (1%)
["gemm", "mul", "xf", "true", "32"] 0.92 (5%) ✅ 1.00 (1%)
["gemm", "mul", "xf", "true", "8"] 1.06 (5%) ❌ 1.00 (1%)
["missing_dot", "man"] 0.85 (5%) ✅ 1.00 (1%)
["missing_dot", "rf"] 0.94 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["cat"]
  • ["collect"]
  • ["dot"]
  • ["filter_map_map!"]
  • ["filter_map_reduce"]
  • ["findall"]
  • ["gemm", "fusedmul", "blas"]
  • ["gemm", "fusedmul", "xf"]
  • ["gemm", "mul", "linalg"]
  • ["gemm", "mul", "man", "false"]
  • ["gemm", "mul", "man", "ivdep"]
  • ["gemm", "mul", "man", "true"]
  • ["gemm", "mul", "xf", "false"]
  • ["gemm", "mul", "xf", "ivdep"]
  • ["gemm", "mul", "xf", "true"]
  • ["groupby", "sum"]
  • ["missing_argmax"]
  • ["missing_dot"]
  • ["partition_by"]

Julia versioninfo

Target

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz: 
              speed         user         nice          sys         idle          irq
       #1  2394 MHz      30534 s          0 s       1213 s      43114 s          0 s
       #2  2394 MHz      28612 s          0 s       1412 s      44064 s          0 s
       
  Memory: 6.764888763427734 GB (3263.921875 MB free)
  Uptime: 760.0 sec
  Load Avg:  1.0  0.921875  0.55712890625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, haswell)

Baseline

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz: 
              speed         user         nice          sys         idle          irq
       #1  2394 MHz      37170 s          0 s       1327 s      60484 s          0 s
       #2  2394 MHz      46044 s          0 s       1591 s      50575 s          0 s
       
  Memory: 6.764888763427734 GB (3337.015625 MB free)
  Uptime: 1002.0 sec
  Load Avg:  1.0  0.9736328125  0.6689453125
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, haswell)

Target result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

  • Time of benchmark: 1 Jun 2020 - 2:27
  • Package commit: 14db52
  • Julia commit: 44fa15
  • Julia command flags: None
  • Environment variables: OMP_NUM_THREADS => 1 JULIA_NUM_THREADS => 1

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["cat", "base"] 2.078 μs (5%)
["cat", "xf"] 2.000 μs (5%) 80 bytes (1%) 3
["collect", "filter-missing"] 122.900 μs (5%) 345.36 KiB (1%) 10018
["collect", "identity-float"] 102.800 μs (5%) 569.20 KiB (1%) 10018
["collect", "identity-union"] 361.199 μs (5%) 705.22 KiB (1%) 16670
["dot", "blas"] 2.344 μs (5%)
["dot", "man"] 2.322 μs (5%)
["dot", "rf"] 2.722 μs (5%)
["dot", "xf"] 2.733 μs (5%)
["filter_map_map!", "man"] 64.700 μs (5%)
["filter_map_map!", "xf"] 713.699 μs (5%) 304 bytes (1%) 17
["filter_map_reduce", "man"] 259.899 μs (5%)
["filter_map_reduce", "xf"] 259.899 μs (5%)
["findall", "base"] 1.068 ms (5%) 2.00 MiB (1%) 21
["findall", "xf-array"] 949.798 μs (5%) 3.01 MiB (1%) 98616
["findall", "xf-iter"] 4.038 ms (5%) 9.63 MiB (1%) 299922
["gemm", "fusedmul", "blas", "16"] 4.799 ms (5%)
["gemm", "fusedmul", "blas", "2"] 3.544 ms (5%)
["gemm", "fusedmul", "blas", "32"] 6.343 ms (5%)
["gemm", "fusedmul", "blas", "8"] 3.682 ms (5%)
["gemm", "fusedmul", "xf", "16"] 5.298 ms (5%) 160 bytes (1%) 6
["gemm", "fusedmul", "xf", "2"] 663.299 μs (5%) 160 bytes (1%) 6
["gemm", "fusedmul", "xf", "32"] 10.610 ms (5%) 160 bytes (1%) 6
["gemm", "fusedmul", "xf", "8"] 2.654 ms (5%) 160 bytes (1%) 6
["gemm", "mul", "linalg", "256"] 1.005 ms (5%)
["gemm", "mul", "linalg", "32"] 3.575 μs (5%)
["gemm", "mul", "linalg", "8"] 304.665 ns (5%)
["gemm", "mul", "man", "false", "256"] 4.323 ms (5%)
["gemm", "mul", "man", "false", "32"] 7.075 μs (5%)
["gemm", "mul", "man", "false", "8"] 519.366 ns (5%)
["gemm", "mul", "man", "ivdep", "256"] 4.284 ms (5%)
["gemm", "mul", "man", "ivdep", "32"] 6.320 μs (5%)
["gemm", "mul", "man", "ivdep", "8"] 514.578 ns (5%)
["gemm", "mul", "man", "true", "256"] 4.307 ms (5%)
["gemm", "mul", "man", "true", "32"] 7.000 μs (5%)
["gemm", "mul", "man", "true", "8"] 540.212 ns (5%)
["gemm", "mul", "xf", "false", "256"] 4.322 ms (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "false", "32"] 7.075 μs (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "false", "8"] 501.031 ns (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "ivdep", "256"] 4.276 ms (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "ivdep", "32"] 5.850 μs (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "ivdep", "8"] 521.461 ns (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "true", "256"] 4.312 ms (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "true", "32"] 7.000 μs (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "true", "8"] 528.942 ns (5%) 48 bytes (1%) 2
["groupby", "sum", "sac"] 288.299 μs (5%) 313.14 KiB (1%) 10007
["groupby", "sum", "xf-with-init"] 215.800 μs (5%) 157.44 KiB (1%) 10008
["groupby", "sum", "xf-without-init"] 213.299 μs (5%) 157.44 KiB (1%) 10008
["missing_argmax", "man"] 1.410 μs (5%) 32 bytes (1%) 1
["missing_argmax", "rf"] 2.911 μs (5%) 32 bytes (1%) 1
["missing_argmax", "xf"] 2.922 μs (5%) 32 bytes (1%) 1
["missing_dot", "equiv"] 1.440 μs (5%) 16 bytes (1%) 1
["missing_dot", "man"] 1.350 μs (5%) 16 bytes (1%) 1
["missing_dot", "naive"] 5.433 μs (5%) 16 bytes (1%) 1
["missing_dot", "rf"] 1.360 μs (5%) 16 bytes (1%) 1
["missing_dot", "rf_nota"] 1.440 μs (5%) 16 bytes (1%) 1
["missing_dot", "xf"] 249.900 μs (5%) 72.14 KiB (1%) 3743
["missing_dot", "xf_nota"] 248.000 μs (5%) 72.11 KiB (1%) 3743
["partition_by", "man"] 2.221 ms (5%) 352 bytes (1%) 4
["partition_by", "xf"] 3.350 ms (5%) 6.10 MiB (1%) 200007

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["cat"]
  • ["collect"]
  • ["dot"]
  • ["filter_map_map!"]
  • ["filter_map_reduce"]
  • ["findall"]
  • ["gemm", "fusedmul", "blas"]
  • ["gemm", "fusedmul", "xf"]
  • ["gemm", "mul", "linalg"]
  • ["gemm", "mul", "man", "false"]
  • ["gemm", "mul", "man", "ivdep"]
  • ["gemm", "mul", "man", "true"]
  • ["gemm", "mul", "xf", "false"]
  • ["gemm", "mul", "xf", "ivdep"]
  • ["gemm", "mul", "xf", "true"]
  • ["groupby", "sum"]
  • ["missing_argmax"]
  • ["missing_dot"]
  • ["partition_by"]

Julia versioninfo

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz: 
              speed         user         nice          sys         idle          irq
       #1  2394 MHz      30534 s          0 s       1213 s      43114 s          0 s
       #2  2394 MHz      28612 s          0 s       1412 s      44064 s          0 s
       
  Memory: 6.764888763427734 GB (3263.921875 MB free)
  Uptime: 760.0 sec
  Load Avg:  1.0  0.921875  0.55712890625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, haswell)

Baseline result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

  • Time of benchmark: 1 Jun 2020 - 2:31
  • Package commit: ae32c1
  • Julia commit: 44fa15
  • Julia command flags: None
  • Environment variables: OMP_NUM_THREADS => 1 JULIA_NUM_THREADS => 1

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["cat", "base"] 1.989 μs (5%)
["cat", "xf"] 2.022 μs (5%) 80 bytes (1%) 3
["collect", "filter-missing"] 121.600 μs (5%) 345.36 KiB (1%) 10018
["collect", "identity-float"] 100.900 μs (5%) 569.20 KiB (1%) 10018
["collect", "identity-union"] 363.300 μs (5%) 705.05 KiB (1%) 16660
["dot", "blas"] 2.344 μs (5%)
["dot", "man"] 2.322 μs (5%)
["dot", "rf"] 2.733 μs (5%)
["dot", "xf"] 2.733 μs (5%)
["filter_map_map!", "man"] 63.900 μs (5%)
["filter_map_map!", "xf"] 710.499 μs (5%) 304 bytes (1%) 17
["filter_map_reduce", "man"] 259.899 μs (5%)
["filter_map_reduce", "xf"] 259.899 μs (5%)
["findall", "base"] 1.071 ms (5%) 2.00 MiB (1%) 21
["findall", "xf-array"] 999.799 μs (5%) 3.05 MiB (1%) 99796
["findall", "xf-iter"] 3.924 ms (5%) 9.63 MiB (1%) 299916
["gemm", "fusedmul", "blas", "16"] 4.810 ms (5%)
["gemm", "fusedmul", "blas", "2"] 3.586 ms (5%)
["gemm", "fusedmul", "blas", "32"] 6.555 ms (5%)
["gemm", "fusedmul", "blas", "8"] 3.695 ms (5%)
["gemm", "fusedmul", "xf", "16"] 5.296 ms (5%) 160 bytes (1%) 6
["gemm", "fusedmul", "xf", "2"] 659.899 μs (5%) 160 bytes (1%) 6
["gemm", "fusedmul", "xf", "32"] 10.607 ms (5%) 160 bytes (1%) 6
["gemm", "fusedmul", "xf", "8"] 2.641 ms (5%) 160 bytes (1%) 6
["gemm", "mul", "linalg", "256"] 1.005 ms (5%)
["gemm", "mul", "linalg", "32"] 3.699 μs (5%)
["gemm", "mul", "linalg", "8"] 300.000 ns (5%)
["gemm", "mul", "man", "false", "256"] 4.325 ms (5%)
["gemm", "mul", "man", "false", "32"] 7.500 μs (5%)
["gemm", "mul", "man", "false", "8"] 499.000 ns (5%)
["gemm", "mul", "man", "ivdep", "256"] 4.291 ms (5%)
["gemm", "mul", "man", "ivdep", "32"] 6.499 μs (5%)
["gemm", "mul", "man", "ivdep", "8"] 499.000 ns (5%)
["gemm", "mul", "man", "true", "256"] 4.309 ms (5%)
["gemm", "mul", "man", "true", "32"] 7.599 μs (5%)
["gemm", "mul", "man", "true", "8"] 500.000 ns (5%)
["gemm", "mul", "xf", "false", "256"] 4.327 ms (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "false", "32"] 7.599 μs (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "false", "8"] 400.000 ns (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "ivdep", "256"] 4.281 ms (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "ivdep", "32"] 5.999 μs (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "ivdep", "8"] 500.000 ns (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "true", "256"] 4.318 ms (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "true", "32"] 7.599 μs (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "true", "8"] 500.000 ns (5%) 48 bytes (1%) 2
["groupby", "sum", "sac"] 282.199 μs (5%) 313.14 KiB (1%) 10007
["groupby", "sum", "xf-with-init"] 214.199 μs (5%) 157.44 KiB (1%) 10008
["groupby", "sum", "xf-without-init"] 208.400 μs (5%) 157.44 KiB (1%) 10008
["missing_argmax", "man"] 1.420 μs (5%) 32 bytes (1%) 1
["missing_argmax", "rf"] 2.944 μs (5%) 32 bytes (1%) 1
["missing_argmax", "xf"] 2.911 μs (5%) 32 bytes (1%) 1
["missing_dot", "equiv"] 1.480 μs (5%) 16 bytes (1%) 1
["missing_dot", "man"] 1.580 μs (5%) 16 bytes (1%) 1
["missing_dot", "naive"] 5.433 μs (5%) 16 bytes (1%) 1
["missing_dot", "rf"] 1.440 μs (5%) 16 bytes (1%) 1
["missing_dot", "rf_nota"] 1.510 μs (5%) 16 bytes (1%) 1
["missing_dot", "xf"] 245.400 μs (5%) 72.23 KiB (1%) 3745
["missing_dot", "xf_nota"] 244.400 μs (5%) 72.22 KiB (1%) 3745
["partition_by", "man"] 2.227 ms (5%) 352 bytes (1%) 4
["partition_by", "xf"] 3.343 ms (5%) 6.10 MiB (1%) 200007

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["cat"]
  • ["collect"]
  • ["dot"]
  • ["filter_map_map!"]
  • ["filter_map_reduce"]
  • ["findall"]
  • ["gemm", "fusedmul", "blas"]
  • ["gemm", "fusedmul", "xf"]
  • ["gemm", "mul", "linalg"]
  • ["gemm", "mul", "man", "false"]
  • ["gemm", "mul", "man", "ivdep"]
  • ["gemm", "mul", "man", "true"]
  • ["gemm", "mul", "xf", "false"]
  • ["gemm", "mul", "xf", "ivdep"]
  • ["gemm", "mul", "xf", "true"]
  • ["groupby", "sum"]
  • ["missing_argmax"]
  • ["missing_dot"]
  • ["partition_by"]

Julia versioninfo

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz: 
              speed         user         nice          sys         idle          irq
       #1  2394 MHz      37170 s          0 s       1327 s      60484 s          0 s
       #2  2394 MHz      46044 s          0 s       1591 s      50575 s          0 s
       
  Memory: 6.764888763427734 GB (3337.015625 MB free)
  Uptime: 1002.0 sec
  Load Avg:  1.0  0.9736328125  0.6689453125
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, haswell)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() openblas64
Sys.CPU_THREADS 2

lscpu output:

Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              2
On-line CPU(s) list: 0,1
Thread(s) per core:  1
Core(s) per socket:  2
Socket(s):           1
NUMA node(s):        1
Vendor ID:           GenuineIntel
CPU family:          6
Model:               63
Model name:          Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Stepping:            2
CPU MHz:             2394.453
BogoMIPS:            4788.90
Hypervisor vendor:   Microsoft
Virtualization type: full
L1d cache:           32K
L1i cache:           32K
L2 cache:            256K
L3 cache:            30720K
NUMA node0 CPU(s):   0,1
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm invpcid_single pti fsgsbase bmi1 avx2 smep bmi2 erms invpcid xsaveopt md_clear
Cpu Property Value
Brand Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Vendor :Intel
Architecture :Haswell
Model Family: 0x06, Model: 0x3f, Stepping: 0x02, Type: 0x00
Cores 2 physical cores, 2 logical cores (on executing CPU)
No Hyperthreading detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 256, 30720) kbytes
64 byte cache line size
Address Size 48 bits virtual, 44 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@github-actions
Copy link
Contributor

github-actions bot commented Jun 1, 2020

Multi-thread benchmark result

Judge result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

  • Time of benchmarks:
    • Target: 1 Jun 2020 - 02:28
    • Baseline: 1 Jun 2020 - 02:33
  • Package commits:
    • Target: 14db52
    • Baseline: ae32c1
  • Julia commits:
    • Target: 44fa15
    • Baseline: 44fa15
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: JULIA_NUM_THREADS => 2
    • Baseline: JULIA_NUM_THREADS => 2

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["collect", "unordered", "basesize=1"] 0.93 (5%) ✅ 1.00 (1%)
["collect", "unordered", "basesize=1024"] 0.96 (5%) 0.97 (1%) ✅
["findfirst", "n=1000", "reduce", "basesize=256"] 1.10 (5%) ❌ 1.00 (1%)
["findfirst", "n=1000", "reduce", "basesize=512"] 1.08 (5%) ❌ 1.00 (1%)
["findfirst", "n=500", "reduce", "basesize=256"] 0.95 (5%) ✅ 1.00 (1%)
["findfirst", "n=500", "reduce", "basesize=512"] 0.91 (5%) ✅ 1.00 (1%)
["parallel_histogram", "assoc", "basesize=4096"] 1.04 (5%) 0.87 (1%) ✅
["parallel_histogram", "comm", "basesize=4096"] 0.99 (5%) 1.02 (1%) ❌
["parallel_histogram", "comm", "basesize=8192"] 0.94 (5%) ✅ 1.00 (1%)
["sum", "random", "reduce", "basesize=128"] 1.07 (5%) ❌ 1.00 (1%)
["sum", "random", "reduce", "basesize=512"] 0.93 (5%) ✅ 1.00 (1%)
["sum", "uniform", "foldl"] 1.14 (5%) ❌ 1.00 (1%)
["sum", "uniform", "reduce", "basesize=128"] 1.07 (5%) ❌ 1.00 (1%)
["sum", "uniform", "reduce", "basesize=256"] 1.12 (5%) ❌ 1.00 (1%)
["sum", "uniform", "reduce", "basesize=512"] 1.15 (5%) ❌ 1.00 (1%)
["sum", "valley", "reduce", "basesize=128"] 1.06 (5%) ❌ 1.00 (1%)
["sum", "valley", "reduce", "basesize=256"] 1.15 (5%) ❌ 1.00 (1%)
["sum", "valley", "reduce", "basesize=512"] 1.12 (5%) ❌ 1.00 (1%)
["words", "nthreads=1"] 0.93 (5%) ✅ 0.99 (1%)
["words", "nthreads=2"] 0.92 (5%) ✅ 0.99 (1%) ✅
["words", "nthreads=4"] 0.91 (5%) ✅ 0.99 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["collect", "assoc"]
  • ["collect"]
  • ["collect", "unordered"]
  • ["findfirst", "n=1000"]
  • ["findfirst", "n=1000", "reduce"]
  • ["findfirst", "n=400"]
  • ["findfirst", "n=400", "reduce"]
  • ["findfirst", "n=500"]
  • ["findfirst", "n=500", "reduce"]
  • ["overhead"]
  • ["parallel_histogram", "assoc"]
  • ["parallel_histogram", "comm"]
  • ["parallel_histogram"]
  • ["sum", "random"]
  • ["sum", "random", "reduce"]
  • ["sum", "uniform"]
  • ["sum", "uniform", "reduce"]
  • ["sum", "valley"]
  • ["sum", "valley", "reduce"]
  • ["words"]

Julia versioninfo

Target

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz: 
              speed         user         nice          sys         idle          irq
       #1  2397 MHz      50278 s          0 s       2352 s      36005 s          0 s
       #2  2397 MHz      50932 s          0 s       2316 s      32787 s          0 s
       
  Memory: 6.764888763427734 GB (3429.98046875 MB free)
  Uptime: 933.0 sec
  Load Avg:  1.7607421875  1.5615234375  0.9951171875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, haswell)

Baseline

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz: 
              speed         user         nice          sys         idle          irq
       #1  2397 MHz      73069 s          0 s       2947 s      41876 s          0 s
       #2  2397 MHz      73306 s          0 s       2776 s      39205 s          0 s
       
  Memory: 6.764888763427734 GB (3474.00390625 MB free)
  Uptime: 1228.0 sec
  Load Avg:  1.62451171875  1.62548828125  1.1767578125
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, haswell)

Target result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

  • Time of benchmark: 1 Jun 2020 - 2:28
  • Package commit: 14db52
  • Julia commit: 44fa15
  • Julia command flags: None
  • Environment variables: JULIA_NUM_THREADS => 2

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["collect", "assoc", "basesize=1"] 410.521 ms (5%) 14.133 ms 87.55 MiB (1%) 1590823
["collect", "assoc", "basesize=1024"] 250.570 ms (5%) 1.84 MiB (1%) 1826
["collect", "assoc", "basesize=32"] 254.708 ms (5%) 5.64 MiB (1%) 54030
["collect", "seq"] 503.531 ms (5%) 1.50 MiB (1%) 32787
["collect", "unordered", "basesize=1"] 466.694 ms (5%) 29.16 MiB (1%) 403278
["collect", "unordered", "basesize=1024"] 350.935 ms (5%) 860.47 KiB (1%) 8117
["collect", "unordered", "basesize=32"] 277.492 ms (5%) 1.50 MiB (1%) 18545
["findfirst", "n=1000", "foldl"] 710.719 ms (5%)
["findfirst", "n=1000", "reduce", "basesize=128"] 363.209 ms (5%) 565.36 KiB (1%) 10256
["findfirst", "n=1000", "reduce", "basesize=256"] 365.761 ms (5%) 288.44 KiB (1%) 5244
["findfirst", "n=1000", "reduce", "basesize=512"] 373.328 ms (5%) 150.56 KiB (1%) 2747
["findfirst", "n=400", "foldl"] 504.528 ms (5%)
["findfirst", "n=400", "reduce", "basesize=128"] 276.157 ms (5%) 1.02 MiB (1%) 18985
["findfirst", "n=400", "reduce", "basesize=256"] 276.786 ms (5%) 527.55 KiB (1%) 9605
["findfirst", "n=400", "reduce", "basesize=512"] 250.765 ms (5%) 268.45 KiB (1%) 4900
["findfirst", "n=500", "foldl"] 85.255 ms (5%)
["findfirst", "n=500", "reduce", "basesize=128"] 46.667 ms (5%) 158.59 KiB (1%) 2873
["findfirst", "n=500", "reduce", "basesize=256"] 42.711 ms (5%) 85.75 KiB (1%) 1556
["findfirst", "n=500", "reduce", "basesize=512"] 45.348 ms (5%) 49.48 KiB (1%) 900
["overhead", "default"] 215.104 μs (5%) 147.05 KiB (1%) 2646
["overhead", "stoppable=false"] 201.804 μs (5%) 146.25 KiB (1%) 2632
["overhead", "stoppable=true"] 362.607 μs (5%) 146.47 KiB (1%) 2647
["parallel_histogram", "assoc", "basesize=16384"] 5.276 ms (5%) 732.86 KiB (1%) 118
["parallel_histogram", "assoc", "basesize=4096"] 6.090 ms (5%) 1.80 MiB (1%) 512
["parallel_histogram", "assoc", "basesize=8192"] 4.961 ms (5%) 1.43 MiB (1%) 257
["parallel_histogram", "comm", "basesize=16384"] 11.441 ms (5%) 1.22 MiB (1%) 159
["parallel_histogram", "comm", "basesize=4096"] 16.988 ms (5%) 1.03 MiB (1%) 3400
["parallel_histogram", "comm", "basesize=8192"] 14.946 ms (5%) 1.23 MiB (1%) 452
["parallel_histogram", "seq"] 8.567 ms (5%) 364.64 KiB (1%) 26
["sum", "random", "foldl"] 16.148 ms (5%)
["sum", "random", "reduce", "basesize=128"] 9.664 ms (5%) 314.11 KiB (1%) 6082
["sum", "random", "reduce", "basesize=256"] 8.883 ms (5%) 155.84 KiB (1%) 3024
["sum", "random", "reduce", "basesize=512"] 8.184 ms (5%) 77.00 KiB (1%) 1497
["sum", "uniform", "foldl"] 18.069 ms (5%)
["sum", "uniform", "reduce", "basesize=128"] 9.532 ms (5%) 314.08 KiB (1%) 6080
["sum", "uniform", "reduce", "basesize=256"] 9.171 ms (5%) 155.83 KiB (1%) 3023
["sum", "uniform", "reduce", "basesize=512"] 9.197 ms (5%) 77.00 KiB (1%) 1497
["sum", "valley", "foldl"] 16.386 ms (5%)
["sum", "valley", "reduce", "basesize=128"] 9.769 ms (5%) 313.98 KiB (1%) 6074
["sum", "valley", "reduce", "basesize=256"] 9.656 ms (5%) 155.83 KiB (1%) 3023
["sum", "valley", "reduce", "basesize=512"] 9.212 ms (5%) 77.00 KiB (1%) 1497
["words", "nthreads=1"] 42.450 ms (5%) 8.766 ms 64.69 MiB (1%) 2093565
["words", "nthreads=2"] 22.121 ms (5%) 65.05 MiB (1%) 2093641
["words", "nthreads=4"] 23.365 ms (5%) 65.95 MiB (1%) 2093939

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["collect", "assoc"]
  • ["collect"]
  • ["collect", "unordered"]
  • ["findfirst", "n=1000"]
  • ["findfirst", "n=1000", "reduce"]
  • ["findfirst", "n=400"]
  • ["findfirst", "n=400", "reduce"]
  • ["findfirst", "n=500"]
  • ["findfirst", "n=500", "reduce"]
  • ["overhead"]
  • ["parallel_histogram", "assoc"]
  • ["parallel_histogram", "comm"]
  • ["parallel_histogram"]
  • ["sum", "random"]
  • ["sum", "random", "reduce"]
  • ["sum", "uniform"]
  • ["sum", "uniform", "reduce"]
  • ["sum", "valley"]
  • ["sum", "valley", "reduce"]
  • ["words"]

Julia versioninfo

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz: 
              speed         user         nice          sys         idle          irq
       #1  2397 MHz      50278 s          0 s       2352 s      36005 s          0 s
       #2  2397 MHz      50932 s          0 s       2316 s      32787 s          0 s
       
  Memory: 6.764888763427734 GB (3429.98046875 MB free)
  Uptime: 933.0 sec
  Load Avg:  1.7607421875  1.5615234375  0.9951171875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, haswell)

Baseline result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

  • Time of benchmark: 1 Jun 2020 - 2:33
  • Package commit: ae32c1
  • Julia commit: 44fa15
  • Julia command flags: None
  • Environment variables: JULIA_NUM_THREADS => 2

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["collect", "assoc", "basesize=1"] 395.215 ms (5%) 12.734 ms 87.55 MiB (1%) 1590813
["collect", "assoc", "basesize=1024"] 255.594 ms (5%) 1.84 MiB (1%) 1826
["collect", "assoc", "basesize=32"] 254.047 ms (5%) 5.64 MiB (1%) 54026
["collect", "seq"] 494.274 ms (5%) 1.50 MiB (1%) 32787
["collect", "unordered", "basesize=1"] 499.753 ms (5%) 29.15 MiB (1%) 402375
["collect", "unordered", "basesize=1024"] 364.887 ms (5%) 890.36 KiB (1%) 10075
["collect", "unordered", "basesize=32"] 282.111 ms (5%) 1.50 MiB (1%) 18504
["findfirst", "n=1000", "foldl"] 701.870 ms (5%)
["findfirst", "n=1000", "reduce", "basesize=128"] 353.358 ms (5%) 565.25 KiB (1%) 10249
["findfirst", "n=1000", "reduce", "basesize=256"] 333.282 ms (5%) 288.55 KiB (1%) 5251
["findfirst", "n=1000", "reduce", "basesize=512"] 347.222 ms (5%) 150.53 KiB (1%) 2745
["findfirst", "n=400", "foldl"] 520.557 ms (5%)
["findfirst", "n=400", "reduce", "basesize=128"] 269.045 ms (5%) 1.02 MiB (1%) 18997
["findfirst", "n=400", "reduce", "basesize=256"] 268.461 ms (5%) 527.34 KiB (1%) 9592
["findfirst", "n=400", "reduce", "basesize=512"] 250.687 ms (5%) 268.47 KiB (1%) 4901
["findfirst", "n=500", "foldl"] 84.665 ms (5%)
["findfirst", "n=500", "reduce", "basesize=128"] 46.623 ms (5%) 158.64 KiB (1%) 2876
["findfirst", "n=500", "reduce", "basesize=256"] 45.014 ms (5%) 85.73 KiB (1%) 1555
["findfirst", "n=500", "reduce", "basesize=512"] 49.758 ms (5%) 49.47 KiB (1%) 899
["overhead", "default"] 210.508 μs (5%) 147.05 KiB (1%) 2646
["overhead", "stoppable=false"] 200.507 μs (5%) 146.23 KiB (1%) 2631
["overhead", "stoppable=true"] 366.414 μs (5%) 146.48 KiB (1%) 2648
["parallel_histogram", "assoc", "basesize=16384"] 5.189 ms (5%) 732.86 KiB (1%) 118
["parallel_histogram", "assoc", "basesize=4096"] 5.828 ms (5%) 2.07 MiB (1%) 518
["parallel_histogram", "assoc", "basesize=8192"] 4.958 ms (5%) 1.43 MiB (1%) 257
["parallel_histogram", "comm", "basesize=16384"] 11.566 ms (5%) 1.22 MiB (1%) 160
["parallel_histogram", "comm", "basesize=4096"] 17.242 ms (5%) 1.01 MiB (1%) 1934
["parallel_histogram", "comm", "basesize=8192"] 15.982 ms (5%) 1.23 MiB (1%) 559
["parallel_histogram", "seq"] 8.386 ms (5%) 364.64 KiB (1%) 26
["sum", "random", "foldl"] 16.117 ms (5%)
["sum", "random", "reduce", "basesize=128"] 9.002 ms (5%) 314.09 KiB (1%) 6081
["sum", "random", "reduce", "basesize=256"] 8.548 ms (5%) 155.86 KiB (1%) 3025
["sum", "random", "reduce", "basesize=512"] 8.771 ms (5%) 77.03 KiB (1%) 1499
["sum", "uniform", "foldl"] 15.900 ms (5%)
["sum", "uniform", "reduce", "basesize=128"] 8.872 ms (5%) 314.08 KiB (1%) 6080
["sum", "uniform", "reduce", "basesize=256"] 8.160 ms (5%) 155.86 KiB (1%) 3025
["sum", "uniform", "reduce", "basesize=512"] 8.019 ms (5%) 77.00 KiB (1%) 1497
["sum", "valley", "foldl"] 16.302 ms (5%)
["sum", "valley", "reduce", "basesize=128"] 9.207 ms (5%) 313.98 KiB (1%) 6074
["sum", "valley", "reduce", "basesize=256"] 8.398 ms (5%) 155.84 KiB (1%) 3024
["sum", "valley", "reduce", "basesize=512"] 8.260 ms (5%) 77.00 KiB (1%) 1497
["words", "nthreads=1"] 45.640 ms (5%) 9.236 ms 65.13 MiB (1%) 2107096
["words", "nthreads=2"] 24.158 ms (5%) 65.85 MiB (1%) 2107250
["words", "nthreads=4"] 25.556 ms (5%) 66.48 MiB (1%) 2107542

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["collect", "assoc"]
  • ["collect"]
  • ["collect", "unordered"]
  • ["findfirst", "n=1000"]
  • ["findfirst", "n=1000", "reduce"]
  • ["findfirst", "n=400"]
  • ["findfirst", "n=400", "reduce"]
  • ["findfirst", "n=500"]
  • ["findfirst", "n=500", "reduce"]
  • ["overhead"]
  • ["parallel_histogram", "assoc"]
  • ["parallel_histogram", "comm"]
  • ["parallel_histogram"]
  • ["sum", "random"]
  • ["sum", "random", "reduce"]
  • ["sum", "uniform"]
  • ["sum", "uniform", "reduce"]
  • ["sum", "valley"]
  • ["sum", "valley", "reduce"]
  • ["words"]

Julia versioninfo

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz: 
              speed         user         nice          sys         idle          irq
       #1  2397 MHz      73069 s          0 s       2947 s      41876 s          0 s
       #2  2397 MHz      73306 s          0 s       2776 s      39205 s          0 s
       
  Memory: 6.764888763427734 GB (3474.00390625 MB free)
  Uptime: 1228.0 sec
  Load Avg:  1.62451171875  1.62548828125  1.1767578125
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, haswell)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() openblas64
Sys.CPU_THREADS 2

lscpu output:

Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              2
On-line CPU(s) list: 0,1
Thread(s) per core:  1
Core(s) per socket:  2
Socket(s):           1
NUMA node(s):        1
Vendor ID:           GenuineIntel
CPU family:          6
Model:               63
Model name:          Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Stepping:            2
CPU MHz:             2397.222
BogoMIPS:            4794.44
Hypervisor vendor:   Microsoft
Virtualization type: full
L1d cache:           32K
L1i cache:           32K
L2 cache:            256K
L3 cache:            30720K
NUMA node0 CPU(s):   0,1
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm invpcid_single pti fsgsbase bmi1 avx2 smep bmi2 erms invpcid xsaveopt md_clear
Cpu Property Value
Brand Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Vendor :Intel
Architecture :Haswell
Model Family: 0x06, Model: 0x3f, Stepping: 0x02, Type: 0x00
Cores 2 physical cores, 2 logical cores (on executing CPU)
No Hyperthreading detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 256, 30720) kbytes
64 byte cache line size
Address Size 48 bits virtual, 44 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@codecov-commenter
Copy link

codecov-commenter commented Jun 1, 2020 •
edited
Loading

Codecov Report

Merging #299 into master will not change coverage.
The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##           master     #299   +/-   ##
=======================================
  Coverage   90.04%   90.04%           
=======================================
  Files          24       24           
  Lines        1447     1447           
=======================================
  Hits         1303     1303           
  Misses        144      144

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ae32c13...e2886ec. Read the comment docs.

@mergify mergify bot merged commit 69ff7a7 into master Jun 1, 2020
@mergify mergify bot deleted the bump-bangbang branch June 1, 2020 02:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@mergify mergify[bot] mergify[bot] approved these changes

Assignees
No one assigned
Labels
ready-to-merge:squash
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@tkf @codecov-commenter