Diff streaming error ("Input should be a valid list") when using GPT-4o

[tomasz-stefaniak]

Before submitting your bug report

• I believe this is a bug. I'll try to join the Continue Discord for questions
• I'm not able to find an open issue that reports the same bug
• I've seen the troubleshooting guide on the Continue Docs

Relevant environment info

- OS: MacOS
- Continue version: v0.9.248 (and likely the release version too)
- IDE version: VSCode 1.95.3 (Universal)
- Model: GPT-4o
- config.json:
  
    {
      "title": "GPT-4o",
      "provider": "openai",
      "model": "chatgpt-4o-latest",
      "apiKey": "<my-key>",
    }

Description

A 400 error appears when using GPT-4o with command + I.

Error streaming diff: Error: HTTP 400 Bad Request from https://api.openai.com/v1/completions

{
  "error": {
    "message": "[{'type': 'list_type', 'loc': ('body', 'prompt', 'list[list[dict[str,any]]]'), 'msg': 'Input should be a valid list', 'input': 'The user has requested a section of code in a file to be rewritten.\\n\\nThis is the prefix of the file:"}]
    "type": "invalid_request_error",
    "param": null,
    "code": null
  }
}

To reproduce

1. Select a piece of code and press cmd + I
2. Ensure that you are using a local config.json and that GPT-4o is selected
3. Write a prompt
4. Submit message
5. Receive error

Also, please refer to this Discord thread for more info: https://discord.com/channels/1108621136150929458/1318712983676911679/1318712983676911679