⬆️ Maintenance/upgrade tools&tests requirements

[pcrespov]

What do these changes do?

Upgrades tests and tooling python dependencies for the entire repo

• Pytest-asyncio Constraint:

  • Added a constraint on pytest-asyncio due to known issues affecting the web-server's integration tests. For more details, refer to the release notes.
  • To reproduce the issue, I've created a test file: services/web/server/tests/integration/test__pytest_asyncio.py.

• Moto Upgrade:

  • moto was upgraded, which included changes to some fake data. As a result, certain tests in packages/aws-library were also upgraded to reflect these changes.

• Mypy Errors:

  • Encountered mypy errors due to the latest version of aiohttp.typedefs, which now defines Middleware. Adjustments were made to accommodate these changes.

Highlights on updated libraries (only updated libraries are included)

• #packages before ~ 69
• #packages after ~ 70

#	name	before	after	upgrade	count	packages
1	aio-pika	9.4.2	9.4.3		4	aws-library🧪 service-library🧪 simcore-sdk🧪 swarm-deploy🧪
2	aiohttp	3.9.5	3.10.5	minor	10	aws-library🧪 osparc-gateway-server🧪 public-api🧪 service-library🧪🧪🧪 simcore-sdk🧪🧪 swarm-deploy🧪 tests🧪
3	aiosmtplib	3.0.1	3.0.2		1	notifications-library🧪
4	antlr4-python3-runtime	4.13.1	4.13.2		8	autoscaling🧪 aws-library🧪 clusters-keeper🧪 dask-sidecar🧪 efs-guardian🧪 resource-usage-tracker🧪 simcore-sdk🧪 storage🧪
5	attrs	23.2.0	24.2.0	MAJOR	19	aws-library🧪🧪 dask-task-models-library🧪 migration🧪 models-library🧪🧪 notifications-library🧪 osparc-gateway-server🧪 postgres-database🧪 public-api🧪 service-integration🧪🧪 service-library🧪🧪🧪 simcore-sdk🧪🧪 swarm-deploy🧪 tests🧪
6	aws-sam-translator	1.89.0	1.91.0	minor	3	agent🧪 resource-usage-tracker🧪 storage🧪
7	black	24.4.2	24.8.0	minor	31	agent🔧 api-server🔧 autoscaling🔧 aws-library🔧 catalog🔧 clusters-keeper🔧 dask-sidecar🔧 dask-task-models-library🔧 datcore-adapter🔧 director-v2🔧 dynamic-scheduler🔧 dynamic-sidecar🔧 e2e-playwright🧪 efs-guardian🔧 invitations🔧 migration🔧 models-library🔧 notifications-library🔧 osparc-gateway-server🔧🧪 payments🔧 postgres-database🔧 public-api🧪 resource-usage-tracker🔧 service-integration🔧 service-library🔧 settings-library🔧 simcore-sdk🔧 storage🔧 swarm-deploy🧪 web🔧
8	bokeh	3.5.0	3.5.1		1	director-v2🧪
9	boto3	1.34.144	1.35.1	minor	1	api-server🧪
10	boto3-stubs	1.34.144, 1.34.149	1.35.1	minor	3	api-server🧪 aws-library🧪 datcore-adapter🧪
11	botocore	1.34.144	1.35.1	minor	1	api-server🧪
12	botocore-stubs	1.34.144, 1.34.149	1.35.1	minor	5	api-server🧪 aws-library🧪🧪 datcore-adapter🧪 simcore-sdk🧪
13	cffi	1.16.0	1.17.0	minor	10	agent🧪 autoscaling🧪 aws-library🧪 clusters-keeper🧪 dask-sidecar🧪 director-v2🧪 efs-guardian🧪 resource-usage-tracker🧪 simcore-sdk🧪 storage🧪
14	cfn-lint	1.8.0	1.10.3	minor	9	agent🧪 autoscaling🧪 aws-library🧪 clusters-keeper🧪 dask-sidecar🧪 efs-guardian🧪 resource-usage-tracker🧪 simcore-sdk🧪 storage🧪
15	coverage	7.6.0	7.6.1		29	agent🧪 api-server🧪 autoscaling🧪 aws-library🧪 catalog🧪 clusters-keeper🧪 dask-sidecar🧪 dask-task-models-library🧪 datcore-adapter🧪 director-v2🧪 dynamic-scheduler🧪 dynamic-sidecar🧪 efs-guardian🧪 invitations🧪 migration🧪 models-library🧪 notifications-library🧪 osparc-gateway-server🧪🧪 payments🧪 postgres-database🧪 resource-usage-tracker🧪 service-integration🧪 service-library🧪 settings-library🧪 simcore-sdk🧪 storage🧪 tests🧪 web🧪
16	cryptography	42.0.8	43.0.0	MAJOR	10	agent🧪 autoscaling🧪 aws-library🧪 clusters-keeper🧪 dask-sidecar🧪 director-v2🧪 efs-guardian🧪 resource-usage-tracker🧪 simcore-sdk🧪 storage🧪
17	dask	2024.7.0	2024.8.1	minor	1	dask-task-models-library🧪
18	debugpy	1.8.2	1.8.5		3	clusters-keeper🧪 efs-guardian🧪 osparc-gateway-server🧪
19	distributed	2024.7.0	2024.8.1	minor	1	dask-task-models-library🧪
20	faker	26.0.0	27.0.0	MAJOR	27	agent🧪 api-server🧪 autoscaling🧪 aws-library🧪 catalog🧪 clusters-keeper🧪 dask-sidecar🧪 dask-task-models-library🧪 datcore-adapter🧪 director-v2🧪 dynamic-scheduler🧪 dynamic-sidecar🧪 e2e-playwright🧪 efs-guardian🧪 invitations🧪 models-library🧪 notifications-library🧪 osparc-gateway-server🧪🧪 payments🧪 postgres-database🧪 public-api🧪 resource-usage-tracker🧪 service-library🧪 settings-library🧪 simcore-sdk🧪 storage🧪
21	fakeredis	2.23.3	2.23.5		5	autoscaling🧪 clusters-keeper🧪 efs-guardian🧪 resource-usage-tracker🧪 storage🧪
22	fast-depends	2.4.6	2.4.8		4	aws-library🧪 service-library🧪 simcore-sdk🧪 swarm-deploy🧪
23	faststream	0.5.14	0.5.18		4	aws-library🧪 service-library🧪 simcore-sdk🧪 swarm-deploy🧪
24	hypothesis	6.108.2	6.111.1	minor	1	invitations🧪
25	importlib-metadata	8.0.0	8.3.0	minor	1	dask-task-models-library🧪
26	jsondiff	2.1.2	2.2.0	minor	10	agent🧪 api-server🧪 autoscaling🧪 aws-library🧪 clusters-keeper🧪 dask-sidecar🧪 efs-guardian🧪 resource-usage-tracker🧪 simcore-sdk🧪 storage🧪
27	more-itertools	10.3.0	10.4.0	minor	2	service-library🧪 tests🧪
28	moto	5.0.11	5.0.13		8	autoscaling🧪 aws-library🧪 clusters-keeper🧪 dask-sidecar🧪 efs-guardian🧪 resource-usage-tracker🧪 simcore-sdk🧪 storage🧪
29	mypy	1.11.0, 1.10.1	1.11.1		40	api-server🧪🔧 autoscaling🔧 aws-library🔧 catalog🧪🔧 clusters-keeper🔧 dask-sidecar🔧 dask-task-models-library🔧 datcore-adapter🔧 director-v2🧪🔧 dynamic-scheduler🔧 dynamic-sidecar🧪🔧 e2e-playwright🧪 efs-guardian🔧 invitations🔧 migration🧪🔧 models-library🔧 notifications-library🧪🔧 osparc-gateway-server🧪🔧🧪 postgres-database🧪🔧 public-api🧪 resource-usage-tracker🧪🔧 service-integration🔧 service-library🧪🔧 settings-library🔧 simcore-sdk🧪🔧 storage🧪🔧 swarm-deploy🧪
30	numpy	2.0.0	2.1.0	minor	1	storage🧪
31	openapi-core	0.19.2	0.19.3		2	service-library🧪 tests🧪
32	orjson	3.10.6	3.10.7		8	aws-library🧪 dask-task-models-library🧪 models-library🧪 notifications-library🧪 service-integration🧪 service-library🧪 simcore-sdk🧪 swarm-deploy🧪
33	pip	24.1.2	24.2	minor	30	agent🔧 api-server🔧 autoscaling🔧 aws-library🔧 catalog🔧 clusters-keeper🔧 dask-sidecar🔧 dask-task-models-library🔧 datcore-adapter🔧 director-v2🔧 dynamic-scheduler🔧 dynamic-sidecar🔧 e2e-playwright🧪 efs-guardian🔧 invitations🔧 migration🔧 models-library🔧 notifications-library🔧 osparc-gateway-server🔧🧪 postgres-database🔧 public-api🧪 resource-usage-tracker🔧 service-integration🔧 service-library🔧 settings-library🔧 simcore-sdk🔧 storage🔧 swarm-deploy🧪 web🔧
34	playwright	1.45.0	1.46.0	minor	1	e2e-playwright🧪
35	pre-commit	3.7.1	3.8.0	minor	30	agent🔧 api-server🔧 autoscaling🔧 aws-library🔧 catalog🔧 clusters-keeper🔧 dask-sidecar🔧 dask-task-models-library🔧 datcore-adapter🔧 director-v2🔧 dynamic-scheduler🔧 dynamic-sidecar🔧 e2e-playwright🧪 efs-guardian🔧 invitations🔧 migration🔧 models-library🔧 notifications-library🔧 osparc-gateway-server🔧🧪 postgres-database🔧 public-api🧪 resource-usage-tracker🔧 service-integration🔧 service-library🔧 settings-library🔧 simcore-sdk🔧 storage🔧 swarm-deploy🧪 web🔧
36	pyinstrument	4.6.2	4.7.2	minor	4	aws-library🧪 service-library🧪 simcore-sdk🧪 swarm-deploy🧪
37	pyopenssl	24.1.0	24.2.1	minor	1	dask-sidecar🧪
38	pytest	8.2.2	8.3.2	minor	33	agent🧪 api-server🧪 autoscaling🧪 aws-library🧪 catalog🧪 clusters-keeper🧪 dask-sidecar🧪 dask-task-models-library🧪 datcore-adapter🧪 director-v2🧪 dynamic-scheduler🧪 dynamic-sidecar🧪 e2e-playwright🧪 efs-guardian🧪 environment-setup🧪 invitations🧪 migration🧪 models-library🧪 notifications-library🧪 osparc-gateway-server🧪🧪 postgres-database🧪 public-api🧪 resource-usage-tracker🧪 service-integration🧪🧪 service-library🧪 settings-library🧪 simcore-sdk🧪 storage🧪 swarm-deploy🧪 tests🧪 web🧪
39	pytest-asyncio	0.21.2	0.23.8	minor	30	agent🧪 api-server🧪 autoscaling🧪 aws-library🧪 catalog🧪 clusters-keeper🧪 dask-sidecar🧪 dask-task-models-library🧪 datcore-adapter🧪 director-v2🧪 dynamic-scheduler🧪 dynamic-sidecar🧪 efs-guardian🧪 environment-setup🧪 invitations🧪 migration🧪 models-library🧪 notifications-library🧪 osparc-gateway-server🧪🧪 payments🧪 postgres-database🧪 public-api🧪 resource-usage-tracker🧪 service-library🧪 simcore-sdk🧪 storage🧪 swarm-deploy🧪 tests🧪 web🧪
40	pyyaml	6.0.1	6.0.2		35	agent🧪🔧 aws-library🧪🧪🔧 dask-task-models-library🧪🧪🔧 e2e-playwright🧪🧪 e2e🧪 environment-setup🧪 migration🧪🔧 models-library🧪🔧 notifications-library🧪🔧 postgres-database🧪🔧 public-api🧪🧪 service-integration🧪🔧 service-library🧪🧪🧪🔧 settings-library🔧 simcore-sdk🧪🧪🔧 swarm-deploy🧪🧪 tests🧪
41	redis	5.0.7	5.0.8		4	aws-library🧪 service-library🧪 simcore-sdk🧪 swarm-deploy🧪
42	regex	2024.5.15	2024.7.24	minor	8	agent🧪 autoscaling🧪 aws-library🧪 clusters-keeper🧪 dask-sidecar🧪 efs-guardian🧪 simcore-sdk🧪 storage🧪
43	rpds-py	0.19.0	0.20.0	minor	17	aws-library🧪🧪 dask-task-models-library🧪 migration🧪 models-library🧪🧪 notifications-library🧪 public-api🧪 service-integration🧪🧪 service-library🧪🧪🧪 simcore-sdk🧪🧪 swarm-deploy🧪 tests🧪
44	ruff	0.5.5	0.6.1	minor	31	agent🔧 api-server🔧 autoscaling🔧 aws-library🔧 catalog🔧 clusters-keeper🔧 dask-sidecar🔧 dask-task-models-library🔧 datcore-adapter🔧 director-v2🔧 dynamic-scheduler🔧 dynamic-sidecar🔧 e2e-playwright🧪 efs-guardian🔧 invitations🔧 migration🔧 models-library🔧 notifications-library🔧 osparc-gateway-server🔧🧪 payments🔧 postgres-database🔧 public-api🧪 resource-usage-tracker🔧 service-integration🔧 service-library🔧 settings-library🔧 simcore-sdk🔧 storage🔧 swarm-deploy🧪 web🔧
45	setuptools	72.1.0, 71.0.2, 71.1.0	73.0.0	MAJOR	36	autoscaling🧪🔧 aws-library🧪🔧 catalog🔧 clusters-keeper🧪🔧 dask-sidecar🧪🔧 dask-task-models-library🔧 datcore-adapter🔧 director-v2🔧 dynamic-scheduler🔧 dynamic-sidecar🔧 e2e-playwright🧪 efs-guardian🧪🔧 invitations🔧 migration🔧 models-library🔧 notifications-library🔧 osparc-gateway-server🔧🧪 payments🔧 postgres-database🔧 public-api🧪 resource-usage-tracker🧪🔧 service-integration🔧 service-library🔧 settings-library🔧 simcore-sdk🧪🔧 storage🧪🔧 swarm-deploy🧪
46	sqlalchemy	1.4.52	1.4.53		11	migration🧪 notifications-library🧪🧪 postgres-database🧪🧪🧪 service-library🧪🧪 simcore-sdk🧪🧪 swarm-deploy🧪
47	sympy	1.13.0	1.13.2		9	agent🧪 autoscaling🧪 aws-library🧪 clusters-keeper🧪 dask-sidecar🧪 efs-guardian🧪 resource-usage-tracker🧪 simcore-sdk🧪 storage🧪
48	tenacity	8.5.0	9.0.0	MAJOR	13	aws-library🧪 e2e-playwright🧪 e2e🧪 migration🧪 notifications-library🧪 osparc-gateway-server🧪🧪 postgres-database🧪 public-api🧪🧪 service-library🧪 simcore-sdk🧪 swarm-deploy🧪
49	tomlkit	0.13.0	0.13.2		31	agent🔧 api-server🔧 autoscaling🔧 aws-library🔧 catalog🔧 clusters-keeper🔧 dask-sidecar🔧 dask-task-models-library🔧 datcore-adapter🔧 director-v2🔧 dynamic-scheduler🔧 dynamic-sidecar🔧 e2e-playwright🧪 efs-guardian🔧 invitations🔧 migration🔧 models-library🔧 notifications-library🔧 osparc-gateway-server🔧🧪 payments🔧 postgres-database🔧 public-api🧪 resource-usage-tracker🔧 service-integration🔧 service-library🔧 settings-library🔧 simcore-sdk🔧 storage🔧 swarm-deploy🧪 web🔧
50	tqdm	4.66.4	4.66.5		5	aws-library🧪 public-api🧪 service-library🧪 simcore-sdk🧪 swarm-deploy🧪
51	typer	0.12.3	0.12.4		10	aws-library🧪 dask-task-models-library🧪 models-library🔧 notifications-library🧪 public-api🧪 service-integration🧪 service-library🧪 settings-library🧪 simcore-sdk🧪 swarm-deploy🧪
52	types-aiobotocore	2.13.1	2.13.2		3	aws-library🧪🧪 simcore-sdk🧪
53	types-aiobotocore-ec2	2.13.1	2.13.2		1	aws-library🧪
54	types-aiobotocore-iam	2.13.1	2.13.2		1	autoscaling🧪
55	types-aiobotocore-s3	2.13.1	2.13.2		3	aws-library🧪 dynamic-sidecar🧪 simcore-sdk🧪
56	types-aiobotocore-ssm	2.13.1	2.13.2		1	aws-library🧪
57	types-cachetools	5.4.0.20240717	5.5.0.20240820	minor	1	web🔧
58	types-docker	7.1.0.20240720	7.1.0.20240806		1	service-integration🧪
59	types-jsonschema	4.23.0.20240712	4.23.0.20240813		3	models-library🧪 service-integration🧪 web🧪
60	types-networkx	3.2.1.20240703	3.2.1.20240820		1	director-v2🧪
61	types-openpyxl	3.1.5.20240719	3.1.5.20240819		1	web🧪
62	types-passlib	1.7.7.20240327	1.7.7.20240819		1	web🧪
63	types-psycopg2	2.9.21.20240417	2.9.21.20240819		4	catalog🧪 director-v2🧪 postgres-database🧪 service-library🧪
64	types-pyyaml	6.0.12.20240724, 6.0.12.20240311	6.0.12.20240808		9	autoscaling🧪 catalog🧪 clusters-keeper🧪 director-v2🧪 dynamic-sidecar🧪 models-library🧪 payments🧪 service-integration🧪 web🧪
65	uvicorn	0.30.1	0.30.6		1	service-library🧪
66	watchdog	4.0.1	4.0.2		15	agent🔧 api-server🔧 autoscaling🔧 catalog🔧 clusters-keeper🔧 dask-sidecar🔧 datcore-adapter🔧 director-v2🔧 efs-guardian🔧 invitations🔧 migration🔧 osparc-gateway-server🔧 resource-usage-tracker🔧 storage🔧 swarm-deploy🧪
67	websockets	12.0	13.0	MAJOR	1	web🧪
68	wheel	0.43.0	0.44.0	minor	31	agent🔧 api-server🔧 autoscaling🔧 aws-library🔧 catalog🔧 clusters-keeper🔧 dask-sidecar🔧 dask-task-models-library🔧 datcore-adapter🔧 director-v2🔧 dynamic-scheduler🔧 dynamic-sidecar🔧 e2e-playwright🧪 efs-guardian🔧 invitations🔧 migration🔧 models-library🔧 notifications-library🔧 osparc-gateway-server🔧🧪 payments🔧 postgres-database🔧 public-api🧪 resource-usage-tracker🔧 service-integration🔧 service-library🔧 settings-library🔧 simcore-sdk🔧 storage🔧 swarm-deploy🧪 web🔧
69	zipp	3.19.2	3.20.0	minor	1	dask-task-models-library🧪

Legend:

• ⬆️ base dependency (only services because packages are floating)
• 🧪 test dependency
• 🔧 tool dependency

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 86.8%. Comparing base (cafbf96) to head (5009358).
Report is 459 commits behind head on master.

Additional details and impacted files

@@            Coverage Diff            @@
##           master   #6173      +/-   ##
=========================================
+ Coverage    84.5%   86.8%    +2.2%     
=========================================
  Files          10    1344    +1334     
  Lines         214   56293   +56079     
  Branches       25     960     +935     
=========================================
+ Hits          181   48894   +48713     
- Misses         23    7194    +7171     
- Partials       10     205     +195     

Flag	Coverage Δ
integrationtests	64.9% <ø> (?)
unittests	84.5% <ø> (-0.1%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

see 1295 files with indirect coverage changes

[giancarloromeo]

ok

[sonarqubecloud]

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarCloud