Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Explore support for content endpoint of detectors API #15

Open
evaline-ju opened this issue Jan 30, 2025 · 0 comments
Open

Explore support for content endpoint of detectors API #15

evaline-ju opened this issue Jan 30, 2025 · 0 comments
Assignees
Labels
enhancement New feature or request

Comments

@evaline-ju
Copy link
Collaborator

Is your feature request related to a problem? Please describe.

The contents endpoint of the detector API has generally been a quick way for users to quickly try out detectors. This detectors endpoint currently is integrated with text generation, allowing for detection on unary text generation or streaming text generation through the orchestrator and is in-progress of being integrated with chat completions through this orchestrator endpoint.

It would then be beneficial to consider how some LLMs could be used as detectors in a workflow with LLM generation, whether on individual chat completion messages [input to chat completion] or choice messages [output of chat completions] or just on text generation input/output.

Describe the solution you'd like

Most of the current adapter-supported model classes like Granite Guardian or Llama Guard take in chat history. We want to firstly explore how these model classes can be used to analyze general text generation input/output.

@evaline-ju evaline-ju added the enhancement New feature or request label Jan 30, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants