Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug] mon_data_space.py won't load ps data files #194

Closed
EdwardSafford-NOAA opened this issue Jun 24, 2024 · 1 comment
Closed

[Bug] mon_data_space.py won't load ps data files #194

EdwardSafford-NOAA opened this issue Jun 24, 2024 · 1 comment
Assignees
@EdwardSafford-NOAA
Labels
bug Something is not working

Comments

@EdwardSafford-NOAA
Copy link
Contributor

Current behavior (describe the bug)

Legacy DA monitor conventional data files all load and plot except for PS files. When running the time-series plot (conTime.yaml) the xarray.dataset merge operation in load_dset() fails with the error ValueError: dimension 'Level' already exists as a scalar variable.

PS files have a Level dimension of 1 which is likely the source of the error. Some of the monitor data needs to treat 1 as None, and I suspect that's what's erroneously happening here.
@EdwardSafford-NOAA EdwardSafford-NOAA added the bug Something is not working label Jun 24, 2024
@EdwardSafford-NOAA EdwardSafford-NOAA self-assigned this Jun 24, 2024
@EdwardSafford-NOAA EdwardSafford-NOAA mentioned this issue Jun 25, 2024
Merged
EdwardSafford-NOAA added a commit to NOAA-EMC/obs-monitor that referenced this issue Jun 26, 2024
@EdwardSafford-NOAA
Port obs-monitor to wcoss2 (#34)
4a414a4 
This release allows obs-monitor to run on wcoss2. The strategy is to
split the model level yaml plot file into lots of pieces and submitted
as a single serial job with one node per piece (plot job). Satellite
plots (rad and ozn) are broken down by instrument, for iasi and cris
down to instrument/plot_type. The minimization and conventional plots
are submitted as two plot jobs without breaking them down further.

There are some caveats:

- Surface pressure plots are not working on either wcoss2 or hera. This
is a problem in eva (`mon_data_space.py`), and issue
[#194](JCSDA-internal/eva#194) has been opened
to address it.
- `Logos `and `tight layout` options have been temporarily commented out
of the yaml plot tempates. These features fail on wcoss2 and seem to be
issues in emcpy. Issue
[#142](NOAA-EMC/emcpy#142) has been opened to
address the problem.
- Some of the plots in `parm/gfs/gfs_plots.yaml` have been commented out
owing to what seems to be file corruption issues in my test data suite
(probably hera stmp space issues).

Testing has been conducted on wcoss2 and hera, and all plots work on
both machines within the stated caveats.
EdwardSafford-NOAA added a commit that referenced this issue Jun 27, 2024
@EdwardSafford-NOAA
Ref #194
8e6ecd3 
Fixed.
@EdwardSafford-NOAA EdwardSafford-NOAA mentioned this issue Jun 27, 2024
Closed
EdwardSafford-NOAA added a commit that referenced this issue Jun 27, 2024
@EdwardSafford-NOAA
Ref #194
1beac33 
Maybe fix CI error.
EdwardSafford-NOAA added a commit that referenced this issue Jun 27, 2024
@EdwardSafford-NOAA
Ref #194
37058c2 
Maybe fix CI issues now.
EdwardSafford-NOAA added a commit that referenced this issue Jun 27, 2024
@EdwardSafford-NOAA
Ref #194
de46c3a 
Retry CI fix.
EdwardSafford-NOAA added a commit to EdwardSafford-NOAA/eva that referenced this issue Jul 12, 2024
@EdwardSafford-NOAA
Ref JCSDA-internal#194
6fab33c 
Merge branch 'develop' into bug/level-194
@EdwardSafford-NOAA
Copy link
Contributor Author

Closed with PR #195

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@EdwardSafford-NOAA EdwardSafford-NOAA

Labels
bug Something is not working
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix Level issue JCSDA-internal/eva
1 participant
@EdwardSafford-NOAA