Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

selu, softmin and hardtanh #185

Merged
merged 12 commits into from
Nov 10, 2024
Merged

selu, softmin and hardtanh #185

merged 12 commits into from
Nov 10, 2024

Conversation

abourramouss
Copy link
Contributor

No description provided.

@abourramouss abourramouss marked this pull request as draft November 8, 2024 20:28
@hikettei
Copy link
Owner

hikettei commented Nov 9, 2024

so the ci looks failing due to a compiler's bug. it is valuable for us to discovery new bugs so thank you for your contributions. i will dig deeper into this issue once I finish my current task.

@hikettei
Copy link
Owner

hikettei commented Nov 9, 2024

the problem is in softmin+JIT=1, failing to run this jit-generated function FUSED_MAXREDUCE_SOFTMIN_SUMNODE_SOFTMAX6385202.

@hikettei
Copy link
Owner

hikettei commented Nov 9, 2024

solved at #190

source/nn/activations.lisp Outdated Show resolved Hide resolved
(define-nn-test Softmin
"Testing w/ Softmin([512, 256])"
:compile (caten (!softmin (make-tensor `(512 256) :from 'x)))
:inputs (ctx:with-contextvar (:jit 0 :avm :lisp)
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

no need to set (ctx:with-contextvar (:jit 0 :avm :lisp) here

Copy link
Owner

@hikettei hikettei Nov 9, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

hmm is that line needed? if so im fine with leaving this line (but add a comment plz)

source/nn/activations.lisp Outdated Show resolved Hide resolved
source/nn/activations.lisp Outdated Show resolved Hide resolved
@hikettei hikettei marked this pull request as ready for review November 9, 2024 15:29
@hikettei
Copy link
Owner

looks clean! LGTM!

@hikettei hikettei merged commit db411c0 into hikettei:main Nov 10, 2024
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants