Skip to content

Benchmarks report

Benchmarks report #66

Manually triggered November 23, 2023 17:07
Status Failure
Total duration 22s
Artifacts

bench_report.yml

on: workflow_dispatch
Benchmark report
11s
Benchmark report
Fit to window
Zoom out
Zoom in

Annotations

1 error and 10 warnings
Benchmark report
# :warning: **Performance Alert** :warning: Possible performance regression was detected for benchmark. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `2`. | Benchmark suite | Current: 9991dbd98700f6c06b99c104f6f3a9ce00d3a401 | Previous: 3302a44512c906b860437214fd37361dcbf5a280 | Ratio | |-|-|-|-| | `matmul_split_0_N1_GPU - CPU_UTIL` | `79.34303240496943` % (`9.556012184634824`) | `26.097684747403566` % (`3.261074024611978`) | `3.04` | | `matmul_split_1_N1_GPU - CPU_UTIL` | `79.73226475680185` % (`9.626459537685502`) | `25.856649768274337` % (`3.4118364558357817`) | `3.08` | | `qr_split_0_N1_GPU - CPU_UTIL` | `81.62734885023163` % (`10.026707135190904`) | `24.821012981107344` % (`4.18130343902579`) | `3.29` | | `qr_split_1_N1_GPU - CPU_UTIL` | `84.76290845980762` % (`10.901901020345662`) | `22.965160953705908` % (`6.261581862048063`) | `3.69` | | `lanczos_N1_GPU - CPU_UTIL` | `89.35644171552765` % (`12.117634078178122`) | `20.336936804483464` % (`9.524618075954992`) | `4.39` | | `hierachical_svd_rank_N1_GPU - CPU_UTIL` | `91.3595834431279` % (`11.784608883857976`) | `19.19226304383277` % (`11.024591515344797`) | `4.76` | | `hierachical_svd_tol_N1_GPU - CPU_UTIL` | `91.53603087943534` % (`11.532082521083646`) | `18.981862685590478` % (`11.33747446609521`) | `4.82` | | `kmeans_N1_GPU - CPU_UTIL` | `89.75126871514854` % (`14.855071963010147`) | `18.856300757391526` % (`11.715180439146348`) | `4.76` | | `kmedians_N1_GPU - CPU_UTIL` | `91.31622507387262` % (`13.351201342347752`) | `18.85433358177458` % (`11.852101519451143`) | `4.84` | | `kmedoids_N1_GPU - CPU_UTIL` | `92.17292889434697` % (`12.639252721640363`) | `20.783858639013737` % (`11.972159856220008`) | `4.43` | | `reshape_N1_GPU - CPU_UTIL` | `93.203170308714` % (`11.775241200664077`) | `22.155914415212216` % (`13.53664413597613`) | `4.21` | | `concatenate_N1_GPU - CPU_UTIL` | `93.20709463645717` % (`11.77361423321995`) | `22.155092273835585` % (`13.53602296426989`) | `4.21` | | `apply_inplace_standard_scaler_and_inverse_N1_GPU - CPU_UTIL` | `93.23729772807619` % (`11.756592755725926`) | `22.14764316500045` % (`13.530839525169128`) | `4.21` | | `apply_inplace_min_max_scaler_and_inverse_N1_GPU - CPU_UTIL` | `93.25220448824659` % (`11.746316463454528`) | `22.144700916487018` % (`13.528898709519552`) | `4.21` | | `apply_inplace_max_abs_scaler_and_inverse_N1_GPU - CPU_UTIL` | `93.25988648850947` % (`11.74166730241032`) | `22.143611868533533` % (`13.52801327438862`) | `4.21` | | `apply_inplace_robust_scaler_and_inverse_N1_GPU - CPU_UTIL` | `91.72353589886953` % (`17.03605938821631`) | `20.080137089728744` % (`11.171567823872769`) | `4.57` | | `apply_inplace_normalizer_N1_GPU - CPU_UTIL` | `92.8941349245514` % (`12.537000451359761`) | `19.101003681864807` % (`13.064362492410353`) | `4.86` | | `matmul_split_0_N4_CPU - POWER` | `33.94804681761594` W (`19.64201265987623`) | `15.890759183255938` W (`14.621856580797465`) | `2.14` | | `matmul_split_0_N4_CPU - GPU_UTIL` | `5.210545444488526` % (`3.6865718149354842`) | `1.55914306640625` % (`0.43572262352865454`) | `3.34` | | `matmul_split_1_N4_CPU - POWER` | `34.18112768758794` W (`19.89703595192072`) | `15.818158042476867` W (`14.68703414527611`) | `2.16` | | `matmul_split_1_N4_CPU - GPU_UTIL` | `5.21514892578125` % (`3.6911373948781754`) | `1.55914306640625` % (`0.43572262352865454`) | `3.34` | | `qr_split_0_N4_CPU - GPU_UTIL` | `5.20538330078125` % (`3.6815070575800335`) | `1.56427001953125` % (`0.43338805122187496`) | `3.33` | | `qr_split_1_N4_CPU - GPU_UTIL` | `5.20050048828125` % (`3.6767699708775567`) | `1.56768798828125` % (`0.43212890625`) | `3.32` | | `lanczos_N4_CPU - GPU_UTIL` | `5.20050048828125` % (`3.6767699708775567`) | `1.53167724609375` % (`0.45692509453523056`) | `3.40` | | `hierachical_svd_rank_N4_CPU - GPU_UTIL` | `5.20050048828125` % (`3.6767699708775567`) | `1.49566650390625` % (`0.504150390625`) | `3.48` | | `hierachical_svd_tol_N4_CPU - GPU_UTIL` | `5.20050048828125` % (`3.6767699708775567`) | `1.49566650390625` % (`0.504150390625`) | `3.48` | | `kmeans_N
Benchmark report
Performance alert! Previous value was 26.097684747403566 and current value is 79.34303240496943. It is 3.0402326172961835x worse than previous exceeding a ratio threshold 2
Benchmark report
Performance alert! Previous value was 25.856649768274337 and current value is 79.73226475680185. It is 3.0836270542145785x worse than previous exceeding a ratio threshold 2
Benchmark report
Performance alert! Previous value was 24.821012981107344 and current value is 81.62734885023163. It is 3.2886389009329613x worse than previous exceeding a ratio threshold 2
Benchmark report
Performance alert! Previous value was 22.965160953705908 and current value is 84.76290845980762. It is 3.6909346566599766x worse than previous exceeding a ratio threshold 2
Benchmark report
Performance alert! Previous value was 20.336936804483464 and current value is 89.35644171552765. It is 4.393800431922875x worse than previous exceeding a ratio threshold 2
Benchmark report
Performance alert! Previous value was 19.19226304383277 and current value is 91.3595834431279. It is 4.760229850668149x worse than previous exceeding a ratio threshold 2
Benchmark report
Performance alert! Previous value was 18.981862685590478 and current value is 91.53603087943534. It is 4.822289171279393x worse than previous exceeding a ratio threshold 2
Benchmark report
Performance alert! Previous value was 18.856300757391526 and current value is 89.75126871514854. It is 4.7597495325251815x worse than previous exceeding a ratio threshold 2
Benchmark report
Performance alert! Previous value was 18.85433358177458 and current value is 91.31622507387262. It is 4.843248618563897x worse than previous exceeding a ratio threshold 2
Benchmark report
Performance alert! Previous value was 20.783858639013737 and current value is 92.17292889434697. It is 4.434832361750555x worse than previous exceeding a ratio threshold 2