VertexAi Codestral autocompletion response undefined

[eqinox76]

Before submitting your bug report

• I believe this is a bug. I'll try to join the Continue Discord for questions
• I'm not able to find an open issue that reports the same bug
• I've seen the troubleshooting guide on the Continue Docs

Relevant environment info

- OS: Ubuntu 24.02 (WSL on win 11)
- Continue version: 0.8.66
- IDE version: vscode 1.96.2
- Model: Codestral
- config.json:
  
  "tabAutocompleteModel": {
    "title": "Codestral (Vertex AI)",
    "provider": "vertexai",
    "model": "codestral",
    "projectId": "project",
    "region": "europe-west4"
  },

Description

Setup is working but it seems the autocomplete answer from gcp is mangled.

To reproduce

Use autocomplete with the given settings.

Log output

##### Completion options #####
{
  "contextLength": 32768,
  "model": "codestral",
  "maxTokens": 4096,
  "temperature": 0.01,
  "stop": [
    "[PREFIX]",
    "[SUFFIX]",
    "/src/",
    "#- coding: utf-8",
    ""
  ],
  "raw": true
}

##### Prompt #####
[SUFFIX]
[PREFIX]diff --git a/.gitignore b/.gitignore
index c724ece..e1d9af3 100644
--- a/.gitignore
+++ b/.gitignore
@@ -16,3 +16,5 @@ gin-bin
 *.out
 
+
+.codegpt
\ No newline at end of file

==========================================================================
==========================================================================
Completion:
undefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefined