Nano gen dqm

[kdlong]

PR description:

This PR adds runTheMatrix support and DQM for the NanoGen workflow, addressing the first item of #31393. A few changes to the NanoGen configs are also made to fix small issues and to simplify the setup.

Only one validation workflow is added currently, starting with a GEN step. In principle a step with MiniAOD input would also be relevant.

As discussed previously, the inputs should be modified based on if the input event content is MiniAOD-like or GEN-like. In the cmsDriver implementation, this is just decided by seeing if the GEN step is run in the cmsDriver command. If a GEN file is input and only one step is run, it expects Mini. Maybe there is a better way to detect this, but for now I just called the customize command for GEN input explicitly.

PR validation:

I checked that ./runTheMatrix.py -l 595 runs and gives sensible output. The DQM workflow also runs, but I didn't actually check that the plots are produced correctly. Is there an easy tool to see all the plots it creates?

[cmsbuild]

The code-checks are being triggered in jenkins.

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-31591/18644

• This PR adds an extra 64KB to repository

• There are other open Pull requests which might conflict with changes you have proposed:

  • File DQMOffline/Configuration/python/DQMOffline_cff.py modified in PR(s): Squash all Patatrack developments on top of CMSSW_11_3_0_pre5 #27983

[cmsbuild]

A new Pull Request was created by @kdlong (Kenneth Long) for master.

It involves the following packages:

Configuration/PyReleaseValidation
DQMOffline/Configuration
PhysicsTools/NanoAOD

@andrius-k, @gouskos, @jordan-martins, @chayanit, @wajidalikhan, @ErnestaP, @kpedro88, @cmsbuild, @kmaeshima, @jfernan2, @fgolf, @fioriNTU, @mariadalfonso, @santocch, @peruzzim can you please review it and eventually sign? Thanks.
@makortel, @Martin-Grunewald, @gpetruc, @threus, @fabiocos, @slomeo, @rociovilar this is something you requested to watch as well.
@silviodonato, @dpiparo, @qliphy you are the release manager for this.

cms-bot commands are listed here

[cmsbuild]

The code-checks are being triggered in jenkins.

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-31591/18645

• This PR adds an extra 68KB to repository

• There are other open Pull requests which might conflict with changes you have proposed:

  • File DQMOffline/Configuration/python/DQMOffline_cff.py modified in PR(s): Squash all Patatrack developments on top of CMSSW_11_3_0_pre5 #27983

[cmsbuild]

Pull request #31591 was updated. @andrius-k, @gouskos, @jordan-martins, @chayanit, @wajidalikhan, @ErnestaP, @kpedro88, @cmsbuild, @kmaeshima, @jfernan2, @fgolf, @fioriNTU, @mariadalfonso, @santocch, @peruzzim can you please check and sign again.

[mariadalfonso]

please test workflow 595

[cmsbuild]

The tests are being triggered in jenkins.
Test Parameters:

• MATRIX_EXTRAS = 595
• CMSSW_11_2_X_2020-09-26-1100/slc7_amd64_gcc820: https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/9594/console Started: 2020/09/26 19:21

[agrohsje]

+1

[santocch]

+1

[silviodonato]

@kpedro88 ?

[silviodonato]

urgent

[kpedro88]

+upgrade

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @silviodonato, @dpiparo, @qliphy (and backports should be raised in the release meeting by the corresponding L2)

[silviodonato]

+1