Ivanchuk-2 docker image broken

[pertoft]

root@manageiq01:~# lsb_release -a No LSB modules are available. Distributor ID: Ubuntu Description: Ubuntu 18.04.4 LTS Release: 18.04 Codename: bionic root@manageiq01:~#

root@manageiq01:~# docker --version Docker version 19.03.6, build 369ce74a3c root@manageiq01:~#

root@manageiq01:~# docker run --restart alway --name manageiq01 run -d -p 443:443 manageiq/manageiq:ivanchuk-2

The container comes up first time and initializes, but after a reboot it gets stuck:

Error something seems wrong, we need at least two parameters to check service status == Checking MIQ database status == ** DB already initialized /usr/local/lib/ruby/gems/2.5.0/gems/dalli-2.7.6/lib/dalli/ring.rb:45:in server_for_key': No server available (Dalli::RingError)
from /usr/local/lib/ruby/gems/2.5.0/gems/dalli-2.7.6/lib/dalli/client.rb:236:in alive!' from /usr/local/lib/ruby/gems/2.5.0/gems/dalli-2.7.6/lib/rack/session/dalli.rb:19:in initialize'
from /usr/local/lib/ruby/gems/2.5.0/gems/actionpack-5.1.7/lib/action_dispatch/middleware/session/abstract_store.rb:21:in initialize' from /usr/local/lib/ruby/gems/2.5.0/gems/actionpack-5.1.7/lib/action_dispatch/middleware/session/mem_cache_store.rb:22:in initialize'
from /usr/local/lib/ruby/gems/2.5.0/gems/actionpack-5.1.7/lib/action_dispatch/middleware/stack.rb:35:in new' from /usr/local/lib/ruby/gems/2.5.0/gems/actionpack-5.1.7/lib/action_dispatch/middleware/stack.rb:35:in build'
from /usr/local/lib/ruby/gems/2.5.0/gems/actionpack-5.1.7/lib/action_dispatch/middleware/stack.rb:99:in block in build' from /usr/local/lib/ruby/gems/2.5.0/gems/actionpack-5.1.7/lib/action_dispatch/middleware/stack.rb:99:in each'
from /usr/local/lib/ruby/gems/2.5.0/gems/actionpack-5.1.7/lib/action_dispatch/middleware/stack.rb:99:in inject' from /usr/local/lib/ruby/gems/2.5.0/gems/actionpack-5.1.7/lib/action_dispatch/middleware/stack.rb:99:in build'
from /usr/local/lib/ruby/gems/2.5.0/gems/railties-5.1.7/lib/rails/engine.rb:508:in block in app' from /usr/local/lib/ruby/gems/2.5.0/gems/railties-5.1.7/lib/rails/engine.rb:504:in synchronize'
from /usr/local/lib/ruby/gems/2.5.0/gems/railties-5.1.7/lib/rails/engine.rb:504:in app' from /usr/local/lib/ruby/gems/2.5.0/gems/railties-5.1.7/lib/rails/application/finisher.rb:45:in block in module:Finisher'
from /usr/local/lib/ruby/gems/2.5.0/gems/railties-5.1.7/lib/rails/initializable.rb:30:in instance_exec' from /usr/local/lib/ruby/gems/2.5.0/gems/railties-5.1.7/lib/rails/initializable.rb:30:in run'
from /usr/local/lib/ruby/gems/2.5.0/gems/railties-5.1.7/lib/rails/initializable.rb:59:in block in run_initializers' from /usr/local/lib/ruby/2.5.0/tsort.rb:228:in block in tsort_each'
from /usr/local/lib/ruby/2.5.0/tsort.rb:350:in block (2 levels) in each_strongly_connected_component' from /usr/local/lib/ruby/2.5.0/tsort.rb:431:in each_strongly_connected_component_from'
from /usr/local/lib/ruby/2.5.0/tsort.rb:349:in block in each_strongly_connected_component' from /usr/local/lib/ruby/2.5.0/tsort.rb:347:in each'
from /usr/local/lib/ruby/2.5.0/tsort.rb:347:in call' from /usr/local/lib/ruby/2.5.0/tsort.rb:347:in each_strongly_connected_component'
from /usr/local/lib/ruby/2.5.0/tsort.rb:226:in tsort_each' from /usr/local/lib/ruby/2.5.0/tsort.rb:205:in tsort_each'
from /usr/local/lib/ruby/gems/2.5.0/gems/railties-5.1.7/lib/rails/initializable.rb:58:in run_initializers' from /usr/local/lib/ruby/gems/2.5.0/gems/railties-5.1.7/lib/rails/application.rb:353:in initialize!'
from /usr/local/lib/ruby/gems/2.5.0/gems/railties-5.1.7/lib/rails/railtie.rb:185:in public_send' from /usr/local/lib/ruby/gems/2.5.0/gems/railties-5.1.7/lib/rails/railtie.rb:185:in method_missing'
from /var/www/miq/vmdb/config/environment.rb:5:in <top (required)>' from /usr/local/lib/ruby/2.5.0/rubygems/core_ext/kernel_require.rb:59:in require'
from /usr/local/lib/ruby/2.5.0/rubygems/core_ext/kernel_require.rb:59:in require' from /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:1:in

'
{"@timestamp":"2020-02-27T06:22:31.390371 ","hostname":"c2cd3c5149dc","pid":7,"tid":"4545fc","level":"info","message":"MIQ(Vmdb::Loggers.apply_config) Log level for azure.log has been changed to [WARN]"}
{"@timestamp":"2020-02-27T06:22:31.390828 ","hostname":"c2cd3c5149dc","pid":7,"tid":"4545fc","level":"info","message":"MIQ(Vmdb::Loggers.apply_config) Log level for vim.log has been changed to [WARN]"}
{"@timestamp":"2020-02-27T06:22:31.579551 ","hostname":"c2cd3c5149dc","pid":7,"tid":"4545fc","level":"info","message":"MIQ(SessionStore) Using session_store: ActionDispatch::Session::MemCacheStore"}
{"@timestamp":"2020-02-27T06:22:31.731071 ","hostname":"c2cd3c5149dc","pid":7,"tid":"4545fc","level":"debug","message":"Dalli::Server#connect 127.0.0.1:11211"}
{"@timestamp":"2020-02-27T06:22:31.731679 ","hostname":"c2cd3c5149dc","pid":7,"tid":"4545fc","level":"warning","message":"127.0.0.1:11211 failed (count: 0) Errno::ECONNREFUSED: Connection refused - connect(2) for "127.0.0.1" port 11211"}
Error something seems wrong, we need at least two parameters to check service status
== Checking MIQ database status ==
** DB already initialized
/usr/local/lib/ruby/gems/2.5.0/gems/dalli-2.7.6/lib/dalli/ring.rb:45:in server_for_key': No server available (Dalli::RingError) from /usr/local/lib/ruby/gems/2.5.0/gems/dalli-2.7.6/lib/dalli/client.rb:236:in alive!'
from /usr/local/lib/ruby/gems/2.5.0/gems/dalli-2.7.6/lib/rack/session/dalli.rb:19:in initialize' from /usr/local/lib/ruby/gems/2.5.0/gems/actionpack-5.1.7/lib/action_dispatch/middleware/session/abstract_store.rb:21:in initialize'
from /usr/local/lib/ruby/gems/2.5.0/gems/actionpack-5.1.7/lib/action_dispatch/middleware/session/mem_cache_store.rb:22:in initialize' from /usr/local/lib/ruby/gems/2.5.0/gems/actionpack-5.1.7/lib/action_dispatch/middleware/stack.rb:35:in new'
from /usr/local/lib/ruby/gems/2.5.0/gems/actionpack-5.1.7/lib/action_dispatch/middleware/stack.rb:35:in build' from /usr/local/lib/ruby/gems/2.5.0/gems/actionpack-5.1.7/lib/action_dispatch/middleware/stack.rb:99:in block in build'
from /usr/local/lib/ruby/gems/2.5.0/gems/actionpack-5.1.7/lib/action_dispatch/middleware/stack.rb:99:in each' from /usr/local/lib/ruby/gems/2.5.0/gems/actionpack-5.1.7/lib/action_dispatch/middleware/stack.rb:99:in inject'
from /usr/local/lib/ruby/gems/2.5.0/gems/actionpack-5.1.7/lib/action_dispatch/middleware/stack.rb:99:in build' from /usr/local/lib/ruby/gems/2.5.0/gems/railties-5.1.7/lib/rails/engine.rb:508:in block in app'
from /usr/local/lib/ruby/gems/2.5.0/gems/railties-5.1.7/lib/rails/engine.rb:504:in synchronize' from /usr/local/lib/ruby/gems/2.5.0/gems/railties-5.1.7/lib/rails/engine.rb:504:in app'
from /usr/local/lib/ruby/gems/2.5.0/gems/railties-5.1.7/lib/rails/application/finisher.rb:45:in block in <module:Finisher>' from /usr/local/lib/ruby/gems/2.5.0/gems/railties-5.1.7/lib/rails/initializable.rb:30:in instance_exec'
from /usr/local/lib/ruby/gems/2.5.0/gems/railties-5.1.7/lib/rails/initializable.rb:30:in run' from /usr/local/lib/ruby/gems/2.5.0/gems/railties-5.1.7/lib/rails/initializable.rb:59:in block in run_initializers'
from /usr/local/lib/ruby/2.5.0/tsort.rb:228:in block in tsort_each' from /usr/local/lib/ruby/2.5.0/tsort.rb:350:in block (2 levels) in each_strongly_connected_component'
from /usr/local/lib/ruby/2.5.0/tsort.rb:431:in each_strongly_connected_component_from' from /usr/local/lib/ruby/2.5.0/tsort.rb:349:in block in each_strongly_connected_component'
from /usr/local/lib/ruby/2.5.0/tsort.rb:347:in each' from /usr/local/lib/ruby/2.5.0/tsort.rb:347:in call'
from /usr/local/lib/ruby/2.5.0/tsort.rb:347:in each_strongly_connected_component' from /usr/local/lib/ruby/2.5.0/tsort.rb:226:in tsort_each'
from /usr/local/lib/ruby/2.5.0/tsort.rb:205:in tsort_each' from /usr/local/lib/ruby/gems/2.5.0/gems/railties-5.1.7/lib/rails/initializable.rb:58:in run_initializers'
from /usr/local/lib/ruby/gems/2.5.0/gems/railties-5.1.7/lib/rails/application.rb:353:in initialize!' from /usr/local/lib/ruby/gems/2.5.0/gems/railties-5.1.7/lib/rails/railtie.rb:185:in public_send'
from /usr/local/lib/ruby/gems/2.5.0/gems/railties-5.1.7/lib/rails/railtie.rb:185:in method_missing' from /var/www/miq/vmdb/config/environment.rb:5:in <top (required)>'
from /usr/local/lib/ruby/2.5.0/rubygems/core_ext/kernel_require.rb:59:in require' from /usr/local/lib/ruby/2.5.0/rubygems/core_ext/kernel_require.rb:59:in require'
from /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:1:in <main>' {"@timestamp":"2020-02-27T06:22:50.846041 ","hostname":"c2cd3c5149dc","pid":6,"tid":"123e5f0","level":"info","message":"MIQ(Vmdb::Loggers.apply_config) Log level for azure.log has been changed to [WARN]"} {"@timestamp":"2020-02-27T06:22:50.846500 ","hostname":"c2cd3c5149dc","pid":6,"tid":"123e5f0","level":"info","message":"MIQ(Vmdb::Loggers.apply_config) Log level for vim.log has been changed to [WARN]"} {"@timestamp":"2020-02-27T06:22:51.031960 ","hostname":"c2cd3c5149dc","pid":6,"tid":"123e5f0","level":"info","message":"MIQ(SessionStore) Using session_store: ActionDispatch::Session::MemCacheStore"} {"@timestamp":"2020-02-27T06:22:51.178013 ","hostname":"c2cd3c5149dc","pid":6,"tid":"123e5f0","level":"debug","message":"Dalli::Server#connect 127.0.0.1:11211"} {"@timestamp":"2020-02-27T06:22:51.178536 ","hostname":"c2cd3c5149dc","pid":6,"tid":"123e5f0","level":"warning","message":"127.0.0.1:11211 failed (count: 0) Errno::ECONNREFUSED: Connection refused - connect(2) for \"127.0.0.1\" port 11211"} root@manageiq01:~#

[pertoft]

I shot a video of the problem: https://www.youtube.com/watch?v=xeNeZhZiP_o

[carbonin]

I think this is generally the same problem as #17274

I'll make an ivanchuk-specific PR to address it in the older image

[carbonin]

@pertoft this should be addressed by #19919