NucGPT

Purpose

Local Document-Specific Chat. Initially for UIUC NPRE.

Setup

Download A Language Models (Only Works for RWKV atm)

• RWKV : https://huggingface.co/BlinkDL
• Llama :
  • https://github.com/facebookresearch/llama
  • https://www.reddit.com/r/LocalLLaMA/wiki/models/

Clone Repo

git clone https://github.com/YunWang-yunw3/NucGPT.git
cd NucGPT

Then in this repository:

pip install -r requirements.txt

Run

1. run parse.py if you do not have index and data yet
2. run main.py

Dev Logs

April 27th: Initial, generic HGTR text with 400M RWKV model. Looking into 4-bit quntized 7B and 13B models.

Star History