Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The backend is currently unavailable. and all server is started. #431

Open
ratel-hu opened this issue Sep 11, 2023 · 8 comments
Open

The backend is currently unavailable. and all server is started. #431

ratel-hu opened this issue Sep 11, 2023 · 8 comments

Comments

@ratel-hu
Copy link

image

show the notice:The backend is currently unavailable. and all server is started.

who can give me some advice

@skylight-f
Copy link

这个问题有没有解决方法的,我也有这个问题?

Is there a solution to this problem? I have the same problem?

@GuillaumeDeWin
Copy link

Same for me. Couldn't find a fix yet

@ratel-hu
Copy link
Author

you should find the logs, and confirm if the api_server started

@ratel-hu
Copy link
Author

in my deployment, the server is always restart.
image

@xhaaix
Copy link

xhaaix commented Oct 28, 2023

Have the same issue following the steps in the Quickstart guide. The error is different however:

  File "/usr/local/lib/python3.11/site-packages/requests/adapters.py", line 519, in send
    raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPConnectionPool(host='index', port=19071): Max retries exceeded with url: /application/v2/tenant/default/prepareandactivate (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f93b642f890>: Failed to establish a new connection: [Errno -5] No address associated with hostname'))

ERROR:    Application startup failed. Exiting.
INFO  [alembic.runtime.migration] Context impl PostgresqlImpl.
INFO  [alembic.runtime.migration] Will assume transactional DDL.
Starting Danswer Api Server

One can see in the log above that API could not connect to the index container which is a Vespa instance.
As turned out the latest version (and some versions before it) of this image is broken and could not be initialized:
/usr/local/bin/start-container.sh: line 67: 10 Illegal instruction /opt/vespa/bin/vespa-start-configserver

I solved the problem by downgrading to vespaengine/vespa:8.217.46 which appears to be working (for now :))

@stemae
Copy link

stemae commented Nov 23, 2023

in my deployment, the server is always restart. image

works on my mac with docker, but I get the same problem when using podman. The api server is constantly restarting.. anyone any clue?

@andreer
Copy link

andreer commented Mar 8, 2024

One can see in the log above that API could not connect to the index container which is a Vespa instance. As turned out the latest version (and some versions before it) of this image is broken and could not be initialized: /usr/local/bin/start-container.sh: line 67: 10 Illegal instruction /opt/vespa/bin/vespa-start-configserver

I solved the problem by downgrading to vespaengine/vespa:8.217.46 which appears to be working (for now :))

What is happening in this specific case is that Vespa requires a newer CPU - your CPU is too old to run the latest versions of Vespa, which are highly optimized for CPUs produced in the last 10 years.

See https://hub.docker.com/r/vespaengine/vespa-generic-intel-x86_64/tags for a special docker image that is slower, but works on older CPUs.

@radiogena
Copy link

confirmed cpu needs to be changed in proxmox to v4 and everything started as expected

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

7 participants