Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

UCX CQ failure report during initialization (Power) #551

Closed
shamisp opened this issue Jan 13, 2016 · 6 comments
Closed

UCX CQ failure report during initialization (Power) #551

shamisp opened this issue Jan 13, 2016 · 6 comments
Assignees
@yosefe
Labels
Bug
Milestone
v1.1

Comments

@shamisp
Copy link
Contributor

shamisp commented Jan 13, 2016

The following error reported during UCX initialization on power.

--------------------------------------------------------------------------
Failed to create a completion queue (CQ):

Hostname: XXXX
Requested CQE: 16384
Error:    Cannot allocate memory

Check the CQE attribute.
--------------------------------------------------------------------------
@shamisp shamisp added the Bug label Jan 13, 2016
@shamisp shamisp added this to the v1.1 milestone Jan 13, 2016
@yosefe
Copy link
Contributor

yosefe commented Jan 13, 2016

This does not seem like UCX error message. Where is this coming from?

@shamisp
Copy link
Contributor Author

shamisp commented Jan 13, 2016

I would guess - verbs driver ?

@yosefe
Copy link
Contributor

yosefe commented Jan 13, 2016

no

@shamisp
Copy link
Contributor Author

shamisp commented Jan 13, 2016

hmmm…

@shamisp
Copy link
Contributor Author

shamisp commented Jan 13, 2016

Ok, this is a bug in OpenMPI.
They set CQE size without query and as a result it may not work on a certain platforms:
https://github.com/open-mpi/ompi/blob/master/orte/mca/oob/ud/oob_ud_qp.c#L53

@shamisp shamisp mentioned this issue Jan 13, 2016
Closed
@shamisp
Copy link
Contributor Author

shamisp commented Jan 13, 2016

I reported the issue to OMPI:
open-mpi/ompi#1301

@shamisp shamisp closed this as completed Jan 13, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@yosefe yosefe

Labels
Bug
Projects
None yet
Milestone
v1.1
Development

No branches or pull requests
2 participants
@shamisp @yosefe