-
Notifications
You must be signed in to change notification settings - Fork 343
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Support for using 'langchain serve' endpoints #588
Conversation
DCO Assistant Lite bot All contributors have signed the DCO ✍️ ✅ |
I have read the DCO Document and I hereby sign the DCO |
recheck |
Thanks for this! We'll get it reviewed |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for this, looking pretty good
- We need to fix how
model_name
is used - Config variables need to be handled cleaning
- Exception handling can get clarified a bit - interested in your feedback re: intended behavior with this generator & when it might make sense to backoff, skip, or abort
- What do you think we can do in regard to tests?
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Some minor thought and I think this will be ready to go!
Co-authored-by: Jeffrey Martin <[email protected]> Signed-off-by: Leon Derczynski <[email protected]>
Co-authored-by: Jeffrey Martin <[email protected]> Signed-off-by: Leon Derczynski <[email protected]>
Co-authored-by: Jeffrey Martin <[email protected]> Signed-off-by: Leon Derczynski <[email protected]>
Signed-off-by: Leon Derczynski <[email protected]>
LangChainServeLLMGenerator
Class: Implements HTTP POST request handling to interact with LangChain Serve LLM APIs, allowing integration with Garak probes.