Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Decrease error threshold for BadCapIDThreshold QTest #45602

Conversation

nothingface0
Copy link
Contributor

PR description:

As discussed with @DennRoy, This PR decreases the error threshold of the Hcal BadCapIDThreshold QTest, i.e., makes the test more tolerant to errors, allowing the up to any 3 bins to fail the test for the whole plot (which translates to ~99.9% error threshold for 60x42 bins that the plot contains).

A backport will also be created, to patch the DQM production CMSSW deployment.

@cmsbuild
Copy link
Contributor

cmsbuild commented Jul 31, 2024

cms-bot internal usage

@cmsbuild
Copy link
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-45602/41095

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @nothingface0 for master.

It involves the following packages:

  • DQM/HcalTasks (dqm)

@antoniovagnerini, @cmsbuild, @nothingface0, @rvenditti, @syuvivida, @tjavaid can you please review it and eventually sign? Thanks.
@DryRun, @abdoulline, @bsunanda this is something you requested to watch as well.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

Copy link
Contributor

@DryRun DryRun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for preparing the PR! I have one request: the tuned threshold is only valid for the 60*42 bin histogram, "Hcal/DigiTask/CapID/CapID_BadvsLSmod60", but the LINK wildcard also matches "Hcal/DigiTask/CapID/CapID_BadvsLS" (4000*42 bins; the mod60 histogram was created so that the alarm condition goes away after 60 LSes and stops sounding the alarm). The test should only be run on the former histogram, so the wildcard should be changed to *CapID_BadvsLSmod60*.

@nothingface0
Copy link
Contributor Author

nothingface0 commented Aug 1, 2024

Thanks for preparing the PR! I have one request: the tuned threshold is only valid for the 6042 bin histogram, "Hcal/DigiTask/CapID/CapID_BadvsLSmod60", but the LINK wildcard also matches "Hcal/DigiTask/CapID/CapID_BadvsLS" (400042 bins; the mod60 histogram was created so that the alarm condition goes away after 60 LSes and stops sounding the alarm). The test should only be run on the former histogram, so the wildcard should be changed to *CapID_BadvsLSmod60*.

Thanks for the catch, I updated the PR

Edit: I wonder if the LINK should still include the Hcal/DigiTask/CapID prefix?
Edit2: After testing, it seems it worked without it :)

@cmsbuild
Copy link
Contributor

cmsbuild commented Aug 1, 2024

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-45602/41115

@cmsbuild
Copy link
Contributor

cmsbuild commented Aug 1, 2024

Pull request #45602 was updated. @antoniovagnerini, @cmsbuild, @nothingface0, @rvenditti, @syuvivida, @tjavaid can you please check and sign again.

@cmsbuild
Copy link
Contributor

cmsbuild commented Aug 7, 2024

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-45602/41201

@cmsbuild
Copy link
Contributor

cmsbuild commented Aug 7, 2024

Pull request #45602 was updated. @antoniovagnerini, @cmsbuild, @nothingface0, @rvenditti, @syuvivida, @tjavaid can you please check and sign again.

@tjavaid
Copy link

tjavaid commented Aug 8, 2024

please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Aug 8, 2024

+1

Size: This PR adds an extra 12KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-f6560b/40827/summary.html
COMMIT: 6e1f4e5
CMSSW: CMSSW_14_1_X_2024-08-07-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/45602/40827/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

@nothingface0
Copy link
Contributor Author

Closing in favor of #45571

@nothingface0 nothingface0 deleted the from-CMSSW_14_1_X_2024-07-30-2300 branch August 20, 2024 12:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants