Add flash attention support for inference#367

Merged

ymcui merged 3 commits intoymcui:mainfrom GoGoJoestar:main

Oct 26, 2023

+118-5

Commits on Oct 25, 2023

Commits on Oct 26, 2023

Remove trailing whitespace
airaria
authored