Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] show raw input/response within tasks #698

Closed
davidberenstein1957 opened this issue Jun 5, 2024 · 1 comment · Fixed by #903
Closed

[FEATURE] show raw input/response within tasks #698

davidberenstein1957 opened this issue Jun 5, 2024 · 1 comment · Fixed by #903
Assignees
Labels
enhancement New feature or request good first issue Good for newcomers
Milestone

Comments

@davidberenstein1957
Copy link
Member

Is your feature request related to a problem? Please describe.
I was experiencing some uncertainty when making calls to my expensive GPT4 model w.r.t. the actual prompts I was sending to it. You might want to disable this for memory purposes but I think it would be good to have the formatted prompts available or accessible somewhere during pipeline/project iteration.

Describe the solution you'd like
An optional flag to show raw_output and/or raw_input

Describe alternatives you've considered
N.A.

Additional context
N.A.

@davidberenstein1957 davidberenstein1957 added enhancement New feature or request good first issue Good for newcomers labels Jun 5, 2024
@gabrielmbmb
Copy link
Member

There is an add_raw_output flag that since 1.2.0 is going to have a default value of True. This will add a raw_output in the distilabel_metadata dictionary.

For the raw_input, we can do the same, add a add_raw_input flag.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good first issue Good for newcomers
Projects
Status: Done
3 participants