My implementation of the Multiclass Classification with numerically stable softmax and cross-entropy functions from scratch and using it to tackle the problem of Handwritten Digit Recognition. To get a deeper understanding I've decided not to use any famous libraries like Tensorflow, Pytorch, etc. But, used the NumPy library for Vectorization.
I've used the MNIST database of handwritten digits for the project. For more details on numerically stable Softmax and Cross Entropy refer to this blog.
-
Install python3 on your systems.
-
Use python pip to install the following packages:
pip install numpy
-
Run the script using:
python3 main.py