Assertion is not done on category

[mkathu]

I am using lighthouse ci github action of the latest version. My goal is to assert the following:

1. Metrics
2. Category (Performance)

I have configured the budget.json(desktop) and mob-budget.json(mobile) for validation of metrics and also I have separate config file for dekstop and mobile.

Below is budget.json

Below is the desktop config file:

Below is mob-budget.json

Below is the mobile config file

Below is the workflow using above mentioned files:

Expectation:
The lighthouse scan should be done for all pages mentioned in urls and it should asserted for metrics and categories for specified values.

Observed:
Only metrics is getting asserted and not category.

Link of one of the execution: https://github.com/mkathu/ul-witelabel-visual-test/runs/4042090535?check_suite_focus=true

Sharing the report of one of the page which does not match the configured performance value of 0.9 for desktop, but not getting asserted.

Any pointers would be greatly appreciated in making this work.

[mkathu]

any update?

[mkathu]

GoogleChrome/lighthouse-ci#731 (comment)

Any updated on this. I have also asked the same question in lighthouse ci GitHub.

[earlman]

also having this issue