Segmentation violation in recasting mode

[manuelkunkel]

System Settings

• Ubuntu 22.04
• Python 3.9.2
• g++ 10.2.1
• MadAnalysis5 1.10.12
• Root 6.24.06
• Delphes 3.5.0
• Fastjet 3.4.1

Describe the bug

When running in recasting mode, some but not all analyses cause a segmentation violation independently of which events I analyze.
This is the case for: atlas_conf_2020_002, atlas_exot_2016_25, cms_b2g_17_014, cms_exo_16_010, cms_exo_17_009, cms_exo_17_015, cms_sus_16_052, cms_sus_17_001, cms_top_17_009, cms_top_18_003

To Reproduce

set main.recast=on
import mgevents/Events/run_01/tag_1_pythia8_events.hepmc.gz
set defaultset.xsection=0.078935
set main.recast.card_path=../../../input/recasting_card.dat
submit madanalysis
exit

Run with bin/ma5 -R -d -s ma.txt

Expected behaviour

No response

Log files

Console output (same error message for all searches):

MA5: ma5>submit madanalysis
MA5-DEBUG (interpreter_base.precmd() in interpreter_base.py::L166): ['submit', 'madanalysis']
MA5-DEBUG (cmd_submit.do_submit() in cmd_submit.py::L198): Launching SampleAnalyzer ...
MA5: Creating folder 'madanalysis'...
MA5: Checking the recasting card...
MA5-DEBUG (run_recast.init() in run_recast.py::L62): Inviting the user to edit the recasting card...
MA5: Getting the list of delphes simulation to be performed...
MA5-DEBUG (run_recast.fastsim_single() in run_recast.py::L188): Launch a bunch of fastsim with the delphes card: delphes_card_cms_exo_16_010.tcl
MA5: **********************************************************
MA5: v1.2+ detector simulations
MA5: **********************************************************
MA5-DEBUG (run_recast.fastsim_single() in run_recast.py::L195): Activating the detector (switch delphes/delphesMA5tune)
MA5-DEBUG (run_recast.fastsim_single() in run_recast.py::L203): Loop over the datasets...
MA5-DEBUG (run_recast.fastsim_single() in run_recast.py::L212): - applying fastsim and producing /scratch/runarea/my_scan/runarea/13TeV/0000/madanalysis/Output/SAF/defaultset/RecoEvents/RecoEvents_v1x2_delphes_card_cms_exo_16_010.root...
MA5: Creating folder 'madanalysis_RecastRun'...
MA5: Copying 'SampleAnalyzer' source files...
MA5: Inserting your selection into 'SampleAnalyzer'...
MA5-DEBUG (job_execute.WriteSelection() in job_execute.py::L468): --------------------------------------------
MA5: Writing the list of datasets...
MA5: Creating Makefiles...
MA5-DEBUG (run_recast.run_delphes() in run_recast.py::L263): Fixing the pileup path...
MA5-DEBUG (run_recast.fix_pileup() in run_recast.py::L944): delphes card is here: /scratch/runarea/my_scan/runarea/13TeV/0000/madanalysis_RecastRun/Input/delphes_card_cms_exo_16_010.tcl
MA5-DEBUG (run_recast.fix_pileup() in run_recast.py::L983): 1 pile-up samples has been declared
MA5: Compiling 'SampleAnalyzer'...
MA5: Linking 'SampleAnalyzer'...
MA5: Running 'SampleAnalyzer' over dataset 'defaultset'...
MA5: *******************************************************
* SampleAnalyzer for MadAnalysis 5 - Welcome.
* Initializing all components
- version: 1.10.12 (2023/09/13)
- general: everything is default.
- extracting the list of event samples...
- analyzer 'MadAnalysis5job'
- fast-simulation package 'delphes'
#--------------------------------------------------------------------------
# FastJet release 3.4.1
# M. Cacciari, G.P. Salam and G. Soyez
# A software package for jet finding and analysis at colliders
# http://fastjet.fr
#
# Please cite EPJC72(2012)1896 [arXiv:1111.6097] if you use this package
# for scientific work and optionally PLB641(2006)57 [hep-ph/0512210].
#
# FastJet is provided without warranty under the GNU GPL v2 or higher.
# It uses T. Chan's closest pair algorithm, S. Fortune's Voronoi code
# and 3rd party plugin jet algorithms. See COPYING file for details.
#--------------------------------------------------------------------------

*** Break *** segmentation violation
Generating stack trace...
0x00007fabb391f788 in FastJetFinder::Init() + 0xae8 from /scratch/runarea/my_scan/runarea/13TeV/0000/madanalysis5/tools/SampleAnalyzer/ExternalSymLink/Lib/libDelphes.so
0x00007fabb4bd5f7f in TTask::ExecuteTasks(char const*) + 0x27f from /scratch/programs/root_build/lib/libCore.so
0x00007fabb4bd61a7 in TTask::ExecuteTask(char const*) + 0x107 from /scratch/programs/root_build/lib/libCore.so
0x00007fabb43f9470 in MA5::DetectorDelphes::Initialize(std::__cxx11::basic_string<char, std::char_traits, std::allocator > const&, std::map<std::__cxx11::basic_string<char, std::char_traits, std::allocator >, std::__cxx11::basic_string<char, std::char_traits, std::allocator >, std::less<std::__cxx11::basic_string<char, std::char_traits, std::allocator > >, std::allocator<std::pair<std::__cxx11::basic_string<char, std::char_traits, std::allocator > const, std::__cxx11::basic_string<char, std::char_traits, std::allocator > > > > const&) + 0x1b60 from /scratch/runarea/my_scan/runarea/13TeV/0000/madanalysis5/tools/SampleAnalyzer/Lib/libdelphes_for_ma5.so
0x00007fabb4f3eb10 in MA5::SampleAnalyzer::InitializeDetector(std::__cxx11::basic_string<char, std::char_traits, std::allocator > const&, std::__cxx11::basic_string<char, std::char_traits, std::allocator > const&, std::map<std::__cxx11::basic_string<char, std::char_traits, std::allocator >, std::__cxx11::basic_string<char, std::char_traits, std::allocator >, std::less<std::__cxx11::basic_string<char, std::char_traits, std::allocator > >, std::allocator<std::pair<std::__cxx11::basic_string<char, std::char_traits, std::allocator > const, std::__cxx11::basic_string<char, std::char_traits, std::allocator > > > > const&) + 0xad0 from /scratch/runarea/my_scan/runarea/13TeV/0000/madanalysis5/tools/SampleAnalyzer/Lib/libprocess_for_ma5.so
0x00005588d725ab13 in main + 0x463 from ./MadAnalysis5job
0x00007fabb4479d0a in __libc_start_main + 0xea from /lib/x86_64-linux-gnu/libc.so.6
0x00005588d725b48a in _start + 0x2a from ./MadAnalysis5job
MA5-ERROR: run over 'defaultset' aborted.
MA5: *******************************************************
MA5: **********************************************************
MA5: v1.2 running of the PAD on events generated with
MA5: delphes_card_cms_exo_16_010.tcl
MA5: **********************************************************
MA5: Writing the PAD analyses
MA5: Compiling the PAD located in /scratch/runarea/my_scan/runarea/13TeV/0000/madanalysis_RecastRun
MA5: How many cores for the compiling? default = max = 16
MA5: => Number of cores used for the compilation = 16
* SampleAnalyzer for MadAnalysis 5 - Welcome.
* Initializing all components
- version: 1.10.12 (2023/09/13)
- general: everything is default.
- extracting the list of event samples...
- analyzer 'cms_exo_16_010'
<><><><><><><><><><><><><><><><><><><><><><><><><>
<> Analysis: CMS-EXO-16-010, arXiv:1701.02042 <>
<> (mono Z-boson) <>
<> Recaster: Benjamin Fuks <>
<> Contact: [email protected] <>
<> Based on MadAnalysis 5 v1.6 <>
<> DOI: XX.YYYY/ZZZ <>
<> Please cite arXiv:1709.nnnnn [hep-ph] <>
<><><><><><><><><><><><><><><><><><><><><><><><><>
* Running over files ...
* 1/1 /scratch/runarea/my_scan/runarea/13TeV/0000/madanalysis/Output/SAF/defaultset/RecoEvents/RecoEvents_v1x2_delphes_card_cms_exo_16_010.root
ERROR: The input file seems to have not the Delphes ROOT format
* Finalizing all components ...
* Total number of processed events: 0.
* Goodbye.
MA5-DEBUG (run_recast.analysis_single() in run_recast.py::L584): Compute CLs exclusion for defaultset
MA5-DEBUG (run_recast.check_xml_scipy_methods() in run_recast.py::L909): cannot import name 'ET' from 'lxml' (/usr/local/lib/python3.9/dist-packages/lxml/init.py)
MA5: Calculation of the exclusion CLs for a lumi of default
MA5-DEBUG (run_recast.compute_cls() in run_recast.py::L786): Running CLs exclusion calculation for cms_exo_16_010
MA5-DEBUG (run_recast.header_info_file() in run_recast.py::L993): Reading info from the file related to cms_exo_16_010...
MA5-DEBUG (run_recast.header_info_file() in run_recast.py::L1018): {}
MA5-DEBUG (run_recast.header_info_file() in run_recast.py::L1037): The luminosity of cms_exo_16_010 is 2.3 fb-1.
MA5-DEBUG (run_recast.compute_cls() in run_recast.py::L789): lumi = 2.3
MA5-DEBUG (run_recast.compute_cls() in run_recast.py::L790): regions = ['ee', 'mumu']
MA5-DEBUG (run_recast.compute_cls() in run_recast.py::L791): regiondata = {'ee': {'nobs': 22.0, 'nb': 28.9, 'deltanb': 5.53}, 'mumu': {'nobs': 44.0, 'nb': 45.0, 'deltanb': 7.15}}
MA5-DEBUG (run_recast.read_cutflows() in run_recast.py::L1323): Read the cutflow from the files:
MA5-DEBUG (run_recast.read_cutflows() in run_recast.py::L1335): + /scratch/runarea/my_scan/runarea/13TeV/0000/madanalysis/Output/SAF/defaultset/cms_exo_16_010/Cutflows/ee.saf
MA5-WARNING: Invalid cutflow for the region ee(ee) in /scratch/runarea/my_scan/runarea/13TeV/0000/madanalysis/Output/SAF/defaultset/cms_exo_16_010/Cutflows
MA5-WARNING: Skipping the CLs calculation.
MA5-WARNING: Info file for cms_exo_16_010 corrupted. Skipping the CLs calculation.
MA5-ERROR: job submission aborted.
MA5: ma5>exit

Please let me know if you need more information.

Additional information

No response

[manuelkunkel]

This crash also occurs in v1.10.10, but not in v1.10.9_beta

[BFuks]

Hi Manuel,

I am currently attending a workshop, but will address the issue as soon as I will be back to Paris.

Cheers,

Benjamin

[BFuks]

Hello Manuel,

This is really weird. I have tried to reproduce the bug with this sample and a recasting card including cms_top_18_003 and atlas_exot_2016_25, but without any success (everything goes through without any problem). Note that I am using root v6.26/10, ma5 v1.10.13 and running the code on macos. Could this be the difference?

Cheers,

Benjamin

[manuelkunkel]

Hi Benjamin,

I just tried again with your sample, the same analyses and same root version and it still crashed. I don't have a mac to test it on, but I will ask around for a colleague with a mac.
You said you used ma5 v1.10.13, but in the releases I can only find up to v1.10.12. Did you mean 1.10.12 or am I missing something?

Best
Manuel

[BFuks]

Hi Manuel, V.10.13 can be obtained directly from GitHub sources, but this should not affect the issue. Cheers, Benjamin

…

On 10 Jan 2024, at 12:33, manuelkunkel ***@***.***> wrote: Hi Benjamin, I just tried again with your sample, the same analyses and same root version and it still crashed. I don't have a mac to test it on, but I will ask around for a colleague with a mac. You said you used ma5 v1.10.13, but in the releases <https://github.com/MadAnalysis/madanalysis5/releases> I can only find up to v1.10.12. Did you mean 1.10.12 or am I missing something? Best Manuel — Reply to this email directly, view it on GitHub <#232 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AIWJNJ2XJDM7XK3N2ESYQYDYNZ373AVCNFSM6AAAAABBLCJPGCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBUGY3TMMZQHE>. You are receiving this because you were assigned.