Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ability to configure attachment support for models in extra-openai-models.yaml #602

Open
NightMachinery opened this issue Nov 3, 2024 · 1 comment
Labels
attachments enhancement New feature or request

Comments

@NightMachinery
Copy link

NightMachinery commented Nov 3, 2024

In ~/Library/Application Support/io.datasette.llm/extra-openai-models.yaml, I have this:

- model_id: or:c35s
  model_name: anthropic/claude-3.5-sonnet:beta
  api_base: "https://openrouter.ai/api/v1"
  api_key_name: openrouter

When I try to use -a some_image.png, I get:

Error: This model does not support attachments, but some were provided
❯ llm --version
llm, version 0.17.1

PS: It works with gemini-1.5-pro-latest accessed directly from Google. The problem is probably with the OpenRouter indirection.

@simonw simonw changed the title OpenRouter Claude does not support images Ability to configure attachment support for models in extra-openai-models.yaml Nov 7, 2024
@simonw simonw added enhancement New feature or request attachments labels Nov 7, 2024
@simonw
Copy link
Owner

simonw commented Nov 7, 2024

From #593:

I added custom gpt-4o azure model through extra-openai-models.yaml and Api proxy config is

- model_id: 4o-azure
  model_name: azure-gpt4o
  api_base: "http://10.41.9.156:4000/"
  api_key_name: azure-gpt4o

then command returns

"describe this image" \
      -a IMG_20240908_161441.jpg
Error: This model does not support attachments, but some were provided

Is there option to extra models that indicate model supports attachments or any other function?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
attachments enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants