Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add LLaMA3 chat session example. #708

Merged
merged 1 commit into from
Apr 29, 2024
Merged

Add LLaMA3 chat session example. #708

merged 1 commit into from
Apr 29, 2024

Conversation

AsakusaRinne
Copy link
Collaborator

@AsakusaRinne AsakusaRinne commented Apr 28, 2024 •
edited
Loading

  1. Add an example for LLaMA3 chat session. I have to say that the implementation is a bit ugly due to some of unreasonable designs a year ago. We've been aware of it and is on the way to rebuild them and add chat template. Anyway, we have an example that works well with LLaMA3 now!
  2. Fix a BUG in KeywordOutputTransform. Some tokens were not removed when there're more than one matched tokens appears at the same time.

It works well for me on Windows with CUDA11.

image

@AsakusaRinne AsakusaRinne added the bug Something isn't working label Apr 28, 2024
@AsakusaRinne AsakusaRinne merged commit 98909dc into SciSharp:master Apr 29, 2024
3 checks passed
@AsakusaRinne AsakusaRinne mentioned this pull request Apr 29, 2024
Closed
@patrick-hovsepian patrick-hovsepian mentioned this pull request Jun 3, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@AsakusaRinne