RESOURCES.md

Resources

Collection of links I found while googling about backpropagation, (stochastic) gradient descent, Haskell and CLI tools such as htop.

General ML and other things I discovered:

• Knuth-Fisher-Yates Random Shuffle
• Numpy Config
• Understand htop once and for all
• Blog about ML
• Blog of Director of AI @ Tesla (also on Github Pages)
• Google Blog on Deep Learning
• Google Blog on Neural Networks
• Blog post about production Haskell code
• Reasoning about algorithmic complexity in Haskell
• Haskell faster than C
• MIT Free Course on Data Structures & Algorithms
• MIT Lecture on Airplane Aerodynamics (yes, I may have gotten a bit off track every now and then)
• MIT Lecture on Binary Search Trees
• Use Excalidraw if you need to visualize something
• Blog about ML, in particular:
  • Real time recommendations
  • RL for recommendations
  • System design for recommendations
  • Patterns for personalization

Profiling/Optimizing/Debugging Haskell

• Parallel profiling
• Zeta Function Concurrency example
• Haskell Multithreading
• Foreign Function Interface (FFI) RWH Book
• Parallel Arrays
• A Journey of optimizing Haskell code
• Detecting Lazy Memory Leaks
• On Allocation And Readabiltiy
• Utilize all Cores
• Memory in Haskell
• Managing Memory in Haskell
• Never use Lazy Foldl
• Concurrent Haskell
• Benchmarking using Criterion package
• Profiling and Optimization RWH Book
• Haskell Profiling

Matrix Multiplication

• Algorithms
• Algorithmic Complexity

BLAS (Basic Linear Algebra Subprograms)

• OpenBLAS FAQ
• BLAS Numpy
• Intel oneAPI
• Intel oneAPI MKL Installation and For APT
• MKL Sample
• ATLAS
• LAPACK
• Numerical Linear Algebra (Wikipedia)
• Symmetric Multiprocessing (SMP) (Wikipedia)
• Scipy parallel programming
• Parallelism & Concurrency RWH Book

Memory Leaks

• Haskell: how to detect "lazy memory leaks"
• bgamari.github.com - The many arrays of GHC
• haskell - Differences between Storable and Unboxed Vectors - Stack Overflow
• Lessons in Managing Haskell Memory
• Garbage collector issues in Haskell runtime when (de)allocations are managed in C - Stack Overflow
• All About Strictness
• Real World Haskell - Chapter 17. Interfacing with C: the FFI
• Haskell: how to get rid of the memory leak - Stack Overflow
• What I Wish I Knew When Learning Haskell - Function Pointers
• Memory leak - HaskellWiki
• acmqueue - Eliminating memory hogs
• Neil Mitchell's Blog (Haskell etc): Detecting Space Leaks
• Pinpointing space leaks in big programs: ezyang’s blog
• Understanding Memory Fragmentation - Well-Typed: The Haskell Consultants
• haskell - Memory leak when generating a list of tuples - Stack Overflow

Further Material for ML

• DEEP LEARNING BOOK
  • Note: This might be good to supplement Neural Networks and Deep Learning after I am done with that.
• OTHER DEEP LEARNING BOOK
• Why the Bias is Important
• Backprop Calculus Video
  • Note: This is VERY sparse on details. It merely serves as an initial visualization.
• ML Cheatsheet
• Gradient = Steepest Ascent: (top comment is useful)
• Box-Muller Transform for Sampling from Gaussian
• Blog Post on Sampling from Gaussian Distribution (Math heavy)
• Gradient Descent (Wikipedia)
• Peculiarity of Quadratic Loss Function Explained
• Motivation for Doing the Problems in the Book
• Solutions for the Problems in the Book
• 3b1b Amazing Visualization Explanation
• Why is the Gradient the Direction of Steepest Ascent?
• Wikipedia Gradient Defintion
• Cauchy-Schwarz Difference Vector Form and Normal
• Blog Post About Stochastic Gradient Descent