🎨 Rabbitmq/only listens to logs if needed

[sanderegg]

What do these changes do?

• when a project is opened by the frontend through a webserver instance, only that instance will start listening to the logs of that project vs all webserver instances listen to all logs of every projects/users
• when a project is closed the webserver instance stops listening to the project logs
• when a user disconnects (websocket connection lost), the webserver instance will also stop listening to the project logs

Bonuses:

• fix closing of webserver's rabbitmq client by closing the connection (this auto-closes the channels without error)
• add client name in close message of rabbitmq client
• fixed some tests missing mocks

IMPORTANT NOTE: currently this will work because we use sticky connections!!
NOTE2: The studies running through the oSparc API will not generate load on the webserver(s) anymore.
NOTE3: The studies running through one specific instance of the webserver will not load the other for nothing anymore.
NOTE4: Expected reduction of CPU load on the webservers.

Related issue/s

• requires ✨Rabbitmq: use TOPIC Exchange for logs #4166
• Dask backend: run 15600 sleepers #3991
• M1-12 Maintenance and DevOps osparc-issues#675

How to test

DevOps Checklist

[codecov]

Codecov Report

Merging #4180 (4345052) into master (ad4d076) will increase coverage by 18.4%.
The diff coverage is 100.0%.

@@            Coverage Diff            @@
##           master   #4180      +/-   ##
=========================================
+ Coverage    65.8%   84.3%   +18.4%     
=========================================
  Files         370     961     +591     
  Lines       19140   41640   +22500     
  Branches        0     955     +955     
=========================================
+ Hits        12605   35111   +22506     
+ Misses       6535    6325     -210     
- Partials        0     204     +204     

Flag	Coverage Δ
integrationtests	61.4% <91.4%> (-4.5%)	⬇️
unittests	82.3% <72.2%> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
...ackages/service-library/src/servicelib/rabbitmq.py	94.3% <100.0%> (ø)
...server/src/simcore_service_webserver/groups_api.py	95.9% <100.0%> (+40.1%)	⬆️
...core_service_webserver/notifications/_constants.py	100.0% <100.0%> (ø)
...ice_webserver/notifications/_rabbitmq_consumers.py	95.7% <100.0%> (+0.1%)	⬆️
...re_service_webserver/notifications/project_logs.py	100.0% <100.0%> (ø)
...core_service_webserver/projects/projects_events.py	100.0% <100.0%> (ø)
...re_service_webserver/projects/projects_handlers.py	91.2% <100.0%> (+42.3%)	⬆️

... and 805 files with indirect coverage changes

[GitHK]

👍

[pcrespov]

Great improvement! thx!

Regarding IMPORTANT NOTE: currently this will work because we use sticky connections!!
Is there a way to add a test that reminds us about this condition in case sometime is broken? For instance, just a test that checks "stickiness" and raises an error with this note!

[matusdrobuliak66]

👍

[codeclimate]

Code Climate has analyzed commit 4345052 and detected 0 issues on this pull request.

View more on Code Climate.

[sonarqubecloud]

Kudos, SonarCloud Quality Gate passed!   

0 Bugs
0 Vulnerabilities
0 Security Hotspots
0 Code Smells

No Coverage information
0.0% Duplication