Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Opening files from "fileNames" in DAQ input source and a different output merging mode #13528

Merged

Conversation

smorovic
Copy link
Contributor

Changes:

  • special mode for FedRawDataInputSource where "fileNames" vstring parameter can be provided. Another parameter, "fileLIstMode" (boolean), can enable this behavior. Initialization order of services and modules is reorganized to allow setting run number from file names found by source.
  • option to disable reading back and merging output files at the end of lumisection (output module). In this case it is done by HLTD script when copying to BU output. This reduces used disk IO by 50% in HLT machines. (HLTD detects the change automatically.)
  • fix for a lumisection variable which was being re-initialized in a loop instead of before (source)
  • throw exception if "stat" returns -1, i.e. fails to find a file (source)

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @smorovic (Srecko Morovic) for CMSSW_8_0_X.

It involves the following packages:

EventFilter/Utilities

@cvuosalo, @emeschi, @cmsbuild, @slava77, @mommsen, @davidlange6 can you please review it and eventually sign? Thanks.
@Martin-Grunewald this is something you requested to watch as well.
@slava77, @Degano, @smuzaffar you are the release manager for this.

cms-bot commands are list here #13028

@slava77
Copy link
Contributor

slava77 commented Feb 29, 2016

@cmsbuild please test

@cmsbuild
Copy link
Contributor

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/11622/console

@cmsbuild
Copy link
Contributor

cmsbuild commented Mar 1, 2016

-1
Tested at: 2cc2c64
When I ran the RelVals I found an error in the following worklfows:
4.22 step1

DAS Error

you can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-13528/11622/summary.html

@cvuosalo
Copy link
Contributor

cvuosalo commented Mar 1, 2016

@cmsbuild please test
Try again hoping DAS error doesn't repeat

@cmsbuild
Copy link
Contributor

cmsbuild commented Mar 1, 2016

@cmsbuild
Copy link
Contributor

cmsbuild commented Mar 2, 2016

@cmsbuild
Copy link
Contributor

cmsbuild commented Mar 2, 2016

@mommsen
Copy link
Contributor

mommsen commented Mar 2, 2016

+1

davidlange6 added a commit that referenced this pull request Mar 3, 2016
Opening files from "fileNames" in DAQ input source and a different output merging mode
@davidlange6 davidlange6 merged commit 8fbf76e into cms-sw:CMSSW_8_0_X Mar 3, 2016
@smorovic smorovic deleted the fileNames-and-micromerge-80X branch February 13, 2019 11:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants