Skip to content

Commit

Permalink
rename positional_forward to encoder_forward as it should have been
Browse files Browse the repository at this point in the history
  • Loading branch information
karpathy committed Apr 23, 2024
1 parent 0b59d80 commit 2491402
Showing 1 changed file with 3 additions and 3 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -2,13 +2,13 @@
Kernels for the positional encoder forward pass in GPT-2.
Compile example:
nvcc -O3 --use_fast_math positional_forward.cu -o positional_forward
nvcc -O3 --use_fast_math encoder_forward.cu -o encoder_forward
version 1 is naive port from CPU code to kernel: parallelizes over B,T, loops over C
./positional_forward 1
./encoder_forward 1
version 2 is more optimized, parallelizes over all of B,T,C
./positional_forward 2
./encoder_forward 2
*/

#include <stdio.h>
Expand Down

0 comments on commit 2491402

Please sign in to comment.