seed & temperature?

[hrehfeld]

How can I specify seed & temperature for my requests?

[hrehfeld]

#471 might be relevant here. does this work for e.g. openai?

[hrehfeld]

(setq gptel--openai
        ;; copied
        (gptel-make-openai
            "ChatGPT"
          :key 'gptel-api-key
          :stream t
          :models gptel--openai-models
          :request-params '(:seed 1 :temperature 0.2)))

[hrehfeld]

Hmm, ideally, it would be possible to set this per request/org-thread/file in some variable so it's easily changeable.

[karthink]

See gptel-temperature. You can turn on gptel-expert-commands and set the temperature from the transient menu. You can set it globally, per buffer, per request (flip the "scope" switch) or in your file (just save your chat buffer). There's no UI option for setting the seed. Yes, #471 works for all backends. You can use it to specify any request parameter you want, per backend and per model.

…

On Mon, Jan 6, 2025, 8:58 AM Hauke Rehfeld ***@***.***> wrote: #471 <#471> might be relevant here. does this work for e.g. openai? — Reply to this email directly, view it on GitHub <#549 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ACBVOLA5DYVCTOB75CAB5ST2JKYZ7AVCNFSM6AAAAABUV7NAXSVHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTCNZVGE2DKMY> . You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>

[hrehfeld]

Oh, awesome, sorry for completely missing this before! (I was just searching for seed and adding temperature last minute after I posted)

And adding request-params actually worked as well ❤️

Thanks so much!

[hrehfeld]

to set the seed

  (setf (gptel-backend-request-params gptel--openai) '(:seed 1))