GPT.md

GPT specific notes

My best timeline of GPT efforts is listed here: https://lspace.swyx.io/p/open-source-ai

GPT3 applications:

• text to graphviz https://twitter.com/goodside/status/1561549768987496449?s=21&t=rliacnWOIjJMiS37s8qCCw
• suspending to python for math
  • https://twitter.com/sharifshameem/status/1414029295043764226?lang=en
  • https://twitter.com/amasad/status/1568824744367259648
  • and API's https://twitter.com/sergeykarayev/status/1569377881440276481

Top GPT3 Prompt Engineering Reads

• Overview
  • https://www.gwern.net/GPT-3#prompts-as-programming
  • https://andymatuschak.org/prompts/
• Beginner
  • go through all the GPT3 examples https://beta.openai.com/examples
• Intermediate
  • and deploy GPT2 https://huggingface.co/gpt2
  • play with the smaller GPT3 models https://beta.openai.com/docs/models/gpt-3
  • technique: self-asking, two step prompts https://twitter.com/OfirPress/status/1577302998136819713
    • chain of thought prompting https://twitter.com/OfirPress/status/1577303423602790401
  • Prompt structure with extensive examples
    • review feedback extraction https://www.youtube.com/watch?v=3EjtHs_lXnk&t=1009s
  • Ask Me Anything prompting
    • https://twitter.com/_akhaliq/status/1577838951905247235
  • using gpt3 for text2image prompts https://twitter.com/fabianstelzer/status/1554229347506176001
• Advanced
  • write a blogpost with GPT3 https://www.youtube.com/watch?v=NC7990PmDfM
  • integrating Google Search with GPT3: https://twitter.com/OfirPress/status/1577302733383925762
  • teach AI how to fish - You are X, you can do Y: https://github.com/nat/natbot/blob/main/natbot.py
  • play with gpt-neoX and gpt-j https://neox.labml.ai/playground
  • defense against prompt injection https://twitter.com/goodside/status/1578278974526222336
  • whatever the f this is https://twitter.com/goodside/status/1578614244290924545?s=20&t=UX2WDbF9c2ZgFNBcyYF2iQ