Skip to content

v0.1.4

Compare
Choose a tag to compare
@github-actions github-actions released this 31 Jan 09:06
· 53 commits to master since this release
8156b29
  • Changes to simplify streaming/async inference pathways still somewhat in progress.
  • WebUI added as a lighter-weight alternative to the Gradio UI
  • More of the configuration variables are exposed, temporary file management settings
  • Added new debug endpoints for system and storage information (threads, sessions, etc)
  • Significant restructuring towards concurrency, decoupling inference workflows, more flexibility

What's Changed

New Contributors

Full Changelog: v0.1.0...v0.1.4