-
Notifications
You must be signed in to change notification settings - Fork 145
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[BUG] #75
Comments
@gitkitian this is a very interesting error as it worked for the first few steps of the plan then something happened seemingly in relation to conversation management in openai library. Is there a way for me to try this LLM? I tried hosting it on my mac, but I do not have enough memory. |
In the absence of an access point that has 70B, I tried this with qwen2 7B running locally and I get as far as github is opened but nothing else. The key issue is that the model does not adhere to instructions and does not return the termination string requested. So we just sit there and do nothing. If I try this in openai gpt4, I get something like this:
Notice At this point we do not have a fix quite yet. If you have ideas on a different way to determine termination please share or make a PR. Meanwhile we are going to think about this. |
Thanks for your attention and response. I am using the latest version of agent-e. You can reproduce this bug with the following LLM parameters configuration. |
@gitkitian I removed your key. You can't put an API key like this in a public forum. It would have been better to share it in a direct message in Discord. I tried what you gave and I get an error from that endpoint. I do not know much about that service so I can't debug it. I suspect some parameters are missing. Here is the error:
|
Title
openai.BadRequestError: Error code: 400 - {'error': {'code': 'invalid_type', 'param': 'messages[0].content', 'message': "Invalid type for 'messages[0].content': expected one of a string or array of objects, but got an object instead.", 'type': 'invalid_request_error'}}
Description
(Agent-E) D:\Platform\Agent-E>python -m ae.main
Execute the user task "open https://github.com/ and search agent-e" Current Page: https://www.baidu.com/
planner_agent (to user):
{"plan": "1. Navigate to https://github.com/.
2. Confirm that you are on the github homepage.
3. Use the search bar on github to search for agent-e.",
"next_step": "Navigate to https://github.com/.",
"terminate":"no"}
WARNING:ae.utils.logger:LLM response was not properly formed JSON. Will try to use it as is. LLM response: "{"plan": "1. Navigate to https://github.com/.
2. Confirm that you are on the github homepage.
3. Use the search bar on github to search for agent-e.",
"next_step": "Navigate to https://github.com/.",
"terminate":"no"}". Error: Invalid control character at: line 1 column 46 (char 45)
WARNING:ae.utils.logger:LLM response was not properly formed JSON. Will try to use it as is. LLM response: "{"plan": "1. Navigate to https://github.com/.
2. Confirm that you are on the github homepage.
3. Use the search bar on github to search for agent-e.",
"next_step": "Navigate to https://github.com/.",
"terminate":"no"}". Error: Invalid control character at: line 1 column 46 (char 45)
Adding system message: "Plan:\n\n 1. Navigate to https://github.com/.2. Confirm that you are on the github homepage.3. Use the search bar on github to search for agent-e."
Adding system message: "Next step: Navigate to https://github.com/."
WARNING:ae.utils.logger:LLM response was not properly formed JSON. Will try to use it as is. LLM response: "{"plan": "1. Navigate to https://github.com/.
2. Confirm that you are on the github homepage.
3. Use the search bar on github to search for agent-e.",
"next_step": "Navigate to https://github.com/.",
"terminate":"no"}". Error: Invalid control character at: line 1 column 46 (char 45)
Starting a new chat....
browser_nav_executor (to browser_navigation_agent):
: Navigate to https://github.com/., Current Page: https://www.baidu.com/,
***** Suggested tool call (): openurl *****
Arguments:
{"url": "https://github.com/"}
Adding system message: "Opened URL: https://github.com/"
browser_nav_executor (to browser_navigation_agent):
browser_nav_executor (to browser_navigation_agent):
***** Response from calling tool () *****
Page loaded: https://github.com/, Title: GitHub: Let’s build from here · GitHub
The text was updated successfully, but these errors were encountered: