Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement new MessageLogger configuration #32138

Merged
merged 12 commits into from
Nov 19, 2020

Conversation

Dr15Jones
Copy link
Contributor

PR description:

This adds support for using the new MessageLogger configuration syntax. The old syntax is also supported. The decision on which format to apply is based on the presence or absence of key parameters for each implementation.

The discussion about the new format can be found here: #31910

The new code makes use of the ParameterSet validation system to enforce correctness.

The standard MessageLogger_cfi.py configuration has not been updated to use the new configuration at this point since it would cause too many non framework configurations to break. That migration will happen at a later stage.

PR validation:

All framework unit tests have been updated to use the new syntax and they all pass.

This removes the need for the statistics vstring as the specification of directing the statistics to a given destination is done via the 'enableStatistics' bool parameter.
-Both the old and new configuration APIs are supported. Having `categories` and `destinations` parameters being available trigger the old configuration handling.
-As much code as reasonably possible is shared between the two implementations.
-The ParameterSetValidation code is used for the new API but the fillDescriptions usage can not be implemented until all uses of the old configuration are removed.
Properly read the 'files' PSet
Set the correct default for lineLength
Make it so the 'default' PSet can properly set the values for destinations which do not explicitly set a parameter.
-Properly handle setting up statistics
-Set defaults to match original behavior
-Throw an exception if multiple destinations want to write to the same log file
Only the tests which explicitly created the Service were changed. Those that use the standard cfi.py file must wait until we are ready to change that file.
@cmsbuild
Copy link
Contributor

-code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-32138/19807

  • This PR adds an extra 220KB to repository

Code check has found code style and quality issues which could be resolved by applying following patch(s)

@cmsbuild
Copy link
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-32138/19808

  • This PR adds an extra 220KB to repository

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @Dr15Jones (Chris Jones) for master.

It involves the following packages:

FWCore/Framework
FWCore/MessageService
FWCore/ParameterSet

@makortel, @smuzaffar, @cmsbuild, @Dr15Jones can you please review it and eventually sign? Thanks.
@makortel, @wddgit this is something you requested to watch as well.
@silviodonato, @dpiparo, @qliphy you are the release manager for this.

cms-bot commands are listed here

@Dr15Jones
Copy link
Contributor Author

Please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 13, 2020

The tests are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-32138/19903

  • This PR adds an extra 164KB to repository

@cmsbuild
Copy link
Contributor

Pull request #32138 was updated. @makortel, @smuzaffar, @cmsbuild, @Dr15Jones can you please check and sign again.

@Dr15Jones
Copy link
Contributor Author

please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 18, 2020

The tests are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

+1
Tested at: cbec163
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-bfd43c/10848/summary.html
CMSSW: CMSSW_11_2_X_2020-11-18-1600
SCRAM_ARCH: slc7_amd64_gcc820

@cmsbuild
Copy link
Contributor

Comparison job queued.

@cmsbuild
Copy link
Contributor

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-bfd43c/10848/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 4 differences found in the comparisons
  • DQMHistoTests: Total files compared: 35
  • DQMHistoTests: Total histograms compared: 2529296
  • DQMHistoTests: Total failures: 7
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2529267
  • DQMHistoTests: Total skipped: 22
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 34 files compared)
  • Checked 148 log files, 34 edm output root files, 35 DQM output files

@makortel
Copy link
Contributor

+1

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @silviodonato, @dpiparo, @qliphy (and backports should be raised in the release meeting by the corresponding L2)

@silviodonato
Copy link
Contributor

+1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants