Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

esm_master stores available config files and crashes due to outdated pickle file, in case one is removed #1227

Open
hajlaci opened this issue Sep 30, 2024 · 1 comment
Assignees
Labels
bug Something isn't working

Comments

@hajlaci
Copy link

hajlaci commented Sep 30, 2024

Error message:

esm_master
Traceback (most recent call last):
  File "/home/a/a270270/.local/bin/esm_master", line 33, in <module>
    sys.exit(load_entry_point('esm-tools', 'console_scripts', 'esm_master')())
  File "/home/a/a270270/esm_tools/src/esm_master/cli.py", line 103, in main
    main_flow(parsed_args, target)
  File "/home/a/a270270/esm_tools/src/esm_master/esm_master.py", line 30, in main_flow
    setups2models = setup_and_model_infos(vcs, main_infos, parsed_args)
  File "/home/a/a270270/esm_tools/src/esm_master/compile_info.py", line 348, in __init__
    self.config, self.relevant_entries = combine_components_yaml(parsed_args)
  File "/home/a/a270270/esm_tools/src/esm_master/compile_info.py", line 92, in combine_components_yaml
    asyncio.get_event_loop().run_until_complete(
  File "/sw/spack-levante/mambaforge-22.9.0-2-Linux-x86_64-kptncg/lib/python3.10/asyncio/base_events.py", line 649, in run_until_complete
    return future.result()
  File "/home/a/a270270/esm_tools/src/esm_master/compile_info.py", line 147, in get_all_package_info
    await asyncio.gather(*tasks, return_exceptions=False)
  File "/home/a/a270270/esm_tools/src/esm_master/compile_info.py", line 177, in get_one_package_info
    comp_config = esm_parser.yaml_file_to_dict(default_file)
  File "/home/a/a270270/esm_tools/src/esm_parser/yaml_to_dict.py", line 237, in yaml_file_to_dict
    raise FileNotFoundError(
FileNotFoundError: All file extensions tried and none worked for /home/a/a270270/esm_tools/configs//components/lpj-guess/lpj-guess.yaml

remove the pickle file under config esm_software/esm_master did not help

@hajlaci hajlaci added the bug Something isn't working label Sep 30, 2024
@mandresm
Copy link
Contributor

Hi!

I think I found the problem, ESM-Tools expects that each folder in the components has at least one file called like the component itself followed by .yaml. You guys have removed the yaml file but not the directory (configs//components/lpj-guess), and hence the error.

I'll be fixing this hopefully this week, esm_master should not crash in this instance if the directory is empty, it should simply not list this component.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants