Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add tensilelite client performance args to hipblaslt-bench #1544

Draft
wants to merge 2 commits into
base: develop
Choose a base branch
from

Conversation

NaveenElumalaiAMD
Copy link
Contributor

@NaveenElumalaiAMD NaveenElumalaiAMD commented Jan 14, 2025

  1. Set the environment variable HIPBLASLT_BENCH_PERF=1 to print performance related args and frequencies.
  2. Set the environment variable HIPBLASLT_BENCH_PERF_ALL=1 to print multi-XCD frequencies along with performance args.
  3. Example use case:- HIPBLASLT_BENCH_PERF=1 ./hipblaslt-bench -f matmul -m 16 -n 16 -k 4096 --transA T --transB N --a_type bf16_r --b_type bf16_r --c_type bf16_r --d_type bf16_r --activation_type none --compute_type f32_r

Output:- transA,transB,grouped_gemm,batch_count,m,n,k,alpha,lda,stride_a,beta,ldb,stride_b,ldc,stride_c,ldd,stride_d,a_type,b_type,c_type,d_type,compute_type,scaleA,scaleB,scaleC,scaleD,amaxD,activation_type,bias_vector,bias_type,Total Granularity,Tiles Per-CU,Tile-0 Granularity,Tile-1 Granularity,CU granularity,Wave granularity,#CU's,mem-read-bytes,mem-write-bytes,lowest-avg-freq,lowest-median-freq,avg-MCLK,median-MCLK,hipblaslt-Gflops,hipblaslt-GB/s,us T,N,0,1,16,16,4096,1,4096,65536,0,4096,65536,16,256,16,256,bf16_r,bf16_r,bf16_r,bf16_r,f32_r,0,0,0,0,0,none,0,bf16_r,0.0175439,0.0701754,1,1,0.0701754,0.25,228,262144,1536,0,0,1100,1100,123.362,14.3893,17

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant