Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove unsupported Julia versions from Buildkite tests. #530

Merged
merged 1 commit into from
Sep 17, 2024

Conversation

maleadt
Copy link
Member

@maleadt maleadt commented Sep 17, 2024

CUDA.jl, Metal.jl, oneAPI.jl and AMDGPU.jl are all being developed here, however, the current master branches of said packages only support Julia 1.10+, leading to all these tests failing all the time. Remove the older Julia versions from the roster, except for the Enzyme job where CUDA is added.

Copy link
Contributor

Benchmark Results

main 573a995... main/573a995de38cd5...
saxpy/default/Float16/1024 2.76 ± 0.19 μs 2.75 ± 0.18 μs 1.01
saxpy/default/Float16/1048576 2.07 ± 0.017 ms 2.07 ± 0.012 ms 1
saxpy/default/Float16/16384 0.0327 ± 0.00014 ms 0.0327 ± 0.00014 ms 1
saxpy/default/Float16/2048 5.16 ± 0.048 μs 5.14 ± 0.037 μs 1
saxpy/default/Float16/256 0.963 ± 0.11 μs 0.953 ± 0.11 μs 1.01
saxpy/default/Float16/262144 0.516 ± 0.0018 ms 0.516 ± 0.0016 ms 1
saxpy/default/Float16/32768 0.0649 ± 0.00017 ms 0.0649 ± 0.00017 ms 1
saxpy/default/Float16/4096 9.98 ± 0.06 μs 9.97 ± 0.049 μs 1
saxpy/default/Float16/512 1.55 ± 0.088 μs 1.55 ± 0.052 μs 1
saxpy/default/Float16/64 0.61 ± 0.014 μs 0.599 ± 0.015 μs 1.02
saxpy/default/Float16/65536 0.129 ± 0.0003 ms 0.129 ± 0.00027 ms 1
saxpy/default/Float32/1024 1.02 ± 0.012 μs 1.01 ± 0.011 μs 1.01
saxpy/default/Float32/1048576 0.889 ± 0.015 ms 0.89 ± 0.018 ms 0.998
saxpy/default/Float32/16384 14.5 ± 0.13 μs 14.4 ± 0.14 μs 1
saxpy/default/Float32/2048 1.73 ± 0.023 μs 1.71 ± 0.02 μs 1.01
saxpy/default/Float32/256 0.526 ± 0.12 μs 0.525 ± 0.13 μs 1
saxpy/default/Float32/262144 0.221 ± 0.00096 ms 0.221 ± 0.00086 ms 1
saxpy/default/Float32/32768 28.4 ± 0.2 μs 28.3 ± 0.21 μs 1
saxpy/default/Float32/4096 3.02 ± 0.026 μs 3.02 ± 0.022 μs 1
saxpy/default/Float32/512 0.693 ± 0.11 μs 0.685 ± 0.11 μs 1.01
saxpy/default/Float32/64 0.415 ± 0.0049 μs 0.411 ± 0.0046 μs 1.01
saxpy/default/Float32/65536 0.056 ± 0.00026 ms 0.056 ± 0.00026 ms 1
saxpy/default/Float64/1024 1.06 ± 0.025 μs 1.05 ± 0.02 μs 1.01
saxpy/default/Float64/1048576 0.988 ± 0.043 ms 0.964 ± 0.043 ms 1.02
saxpy/default/Float64/16384 15.6 ± 0.83 μs 15.7 ± 0.65 μs 0.996
saxpy/default/Float64/2048 1.75 ± 0.029 μs 1.73 ± 0.023 μs 1.01
saxpy/default/Float64/256 0.519 ± 0.011 μs 0.525 ± 0.0072 μs 0.988
saxpy/default/Float64/262144 0.228 ± 0.0034 ms 0.228 ± 0.0056 ms 1
saxpy/default/Float64/32768 30.4 ± 1.2 μs 30 ± 1.5 μs 1.01
saxpy/default/Float64/4096 3.04 ± 0.038 μs 3.03 ± 0.038 μs 1
saxpy/default/Float64/512 0.696 ± 0.12 μs 0.707 ± 0.11 μs 0.985
saxpy/default/Float64/64 0.403 ± 0.0074 μs 0.402 ± 0.0056 μs 1
saxpy/default/Float64/65536 0.0579 ± 0.0015 ms 0.0582 ± 0.0022 ms 0.994
saxpy/static workgroup=(1024,)/Float16/1024 2.09 ± 0.21 μs 2.11 ± 0.2 μs 0.987
saxpy/static workgroup=(1024,)/Float16/1048576 0.184 ± 0.017 ms 0.172 ± 0.0081 ms 1.07
saxpy/static workgroup=(1024,)/Float16/16384 4.35 ± 0.19 μs 4.35 ± 0.2 μs 1
saxpy/static workgroup=(1024,)/Float16/2048 2.15 ± 0.21 μs 2.14 ± 0.2 μs 1
saxpy/static workgroup=(1024,)/Float16/256 2.63 ± 0.039 μs 2.65 ± 0.039 μs 0.995
saxpy/static workgroup=(1024,)/Float16/262144 0.0467 ± 0.0037 ms 0.0441 ± 0.002 ms 1.06
saxpy/static workgroup=(1024,)/Float16/32768 6.81 ± 0.3 μs 6.75 ± 0.23 μs 1.01
saxpy/static workgroup=(1024,)/Float16/4096 2.43 ± 0.033 μs 2.46 ± 0.037 μs 0.989
saxpy/static workgroup=(1024,)/Float16/512 3.15 ± 0.076 μs 3.16 ± 0.085 μs 0.995
saxpy/static workgroup=(1024,)/Float16/64 2.24 ± 0.024 μs 2.28 ± 0.027 μs 0.984
saxpy/static workgroup=(1024,)/Float16/65536 12.8 ± 0.76 μs 12.5 ± 0.45 μs 1.03
saxpy/static workgroup=(1024,)/Float32/1024 1.97 ± 0.028 μs 1.95 ± 0.026 μs 1.01
saxpy/static workgroup=(1024,)/Float32/1048576 0.29 ± 0.033 ms 0.278 ± 0.025 ms 1.04
saxpy/static workgroup=(1024,)/Float32/16384 4.84 ± 0.56 μs 4.77 ± 0.36 μs 1.01
saxpy/static workgroup=(1024,)/Float32/2048 2.28 ± 0.24 μs 2.26 ± 0.21 μs 1.01
saxpy/static workgroup=(1024,)/Float32/256 2.66 ± 0.4 μs 2.66 ± 0.45 μs 1
saxpy/static workgroup=(1024,)/Float32/262144 0.0662 ± 0.0065 ms 0.0676 ± 0.0065 ms 0.98
saxpy/static workgroup=(1024,)/Float32/32768 7.68 ± 1.2 μs 7.65 ± 0.97 μs 1
saxpy/static workgroup=(1024,)/Float32/4096 2.6 ± 0.18 μs 2.56 ± 0.18 μs 1.01
saxpy/static workgroup=(1024,)/Float32/512 2.5 ± 0.22 μs 2.48 ± 0.21 μs 1.01
saxpy/static workgroup=(1024,)/Float32/64 2.45 ± 0.056 μs 2.44 ± 0.054 μs 1.01
saxpy/static workgroup=(1024,)/Float32/65536 18.2 ± 2.2 μs 18.1 ± 1.7 μs 1.01
saxpy/static workgroup=(1024,)/Float64/1024 2.07 ± 0.041 μs 2.04 ± 0.027 μs 1.01
saxpy/static workgroup=(1024,)/Float64/1048576 0.642 ± 0.061 ms 0.589 ± 0.043 ms 1.09
saxpy/static workgroup=(1024,)/Float64/16384 7.61 ± 1.3 μs 7.85 ± 1.2 μs 0.969
saxpy/static workgroup=(1024,)/Float64/2048 2.53 ± 0.25 μs 2.52 ± 0.23 μs 1.01
saxpy/static workgroup=(1024,)/Float64/256 2.4 ± 0.052 μs 2.39 ± 0.052 μs 1
saxpy/static workgroup=(1024,)/Float64/262144 0.127 ± 0.013 ms 0.127 ± 0.012 ms 1
saxpy/static workgroup=(1024,)/Float64/32768 17.4 ± 2 μs 17.1 ± 1.8 μs 1.02
saxpy/static workgroup=(1024,)/Float64/4096 3.15 ± 0.37 μs 3.13 ± 0.35 μs 1.01
saxpy/static workgroup=(1024,)/Float64/512 2.4 ± 0.043 μs 2.4 ± 0.043 μs 0.999
saxpy/static workgroup=(1024,)/Float64/64 2.37 ± 0.085 μs 2.38 ± 0.084 μs 0.997
saxpy/static workgroup=(1024,)/Float64/65536 0.035 ± 0.003 ms 0.0349 ± 0.0029 ms 1
time_to_load 0.318 ± 0.0025 s 0.315 ± 0.00092 s 1.01

Benchmark Plots

A plot of the benchmark results have been uploaded as an artifact to the workflow run for this PR.
Go to "Actions"->"Benchmark a pull request"->[the most recent run]->"Artifacts" (at the bottom).

@maleadt maleadt merged commit 4aad86a into main Sep 17, 2024
30 of 36 checks passed
@maleadt maleadt deleted the tb/buildkite_julia branch September 17, 2024 11:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant