Notes

Pretrain | finetuning

Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution https://openreview.net/forum?id=UYneFzXSJWh https://openreview.net/forum?id=1v4gKsyGfe&referrer=%5Bthe%20profile%20of%20Issei%20Sato%5D(%2Fprofile%3Fid%3D~Issei_Sato2) NOTE: https://hackmd.io/@machineS/ByvCpMs0j

Visual instruct tuning https://hackmd.io/@machineS/S1CiW9boC

Regarding the huggingface cache management

https://huggingface.co/docs/huggingface_hub/en/guides/manage-cache

Optimization vis.

Notebooks https://distill.pub/ Momentum for opt. https://distill.pub/2017/momentum/ Logs https://poloclub.github.io/

Class note

csc2541_2022 https://www.cs.toronto.edu/~rgrosse/courses/csc2541_2022/

csc413 https://csc413-w25.notion.site/CSC413-2516-Neural-Networks-and-Deep-Learning-152946d7006c803087fddccbbdd36a86

AI alignment https://alignment-w2024.notion.site/CSC2547-AI-Alignment-b44359978f3a4a8f95c90adb0a6e7d53

GAN visualization

https://poloclub.github.io/ganlab/