Skip to content

Commit

Permalink
Provide well-formed TIR in moe_misc
Browse files Browse the repository at this point in the history
Required for TVM compatibility after apache/tvm#16569
  • Loading branch information
Lunderberg committed Mar 27, 2024
1 parent 865434a commit 8e0135f
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion python/mlc_chat/op/moe_misc.py
Original file line number Diff line number Diff line change
Expand Up @@ -101,7 +101,7 @@ def topk_softmax_func(
with T.block("output"):
vj = T.axis.remap("S", [j])
out[vi, vj] = T.cast(
T.exp(local_top_k_f32[j] - local_top_k_max[0])
T.exp(local_top_k_f32[vj] - local_top_k_max[0])
/ (
T.exp(local_top_k_f32[0] - local_top_k_max[0])
+ T.exp(local_top_k_f32[1] - local_top_k_max[0])
Expand Down

0 comments on commit 8e0135f

Please sign in to comment.