Simplified data loader

[theHenks]

Included read_ldata function to simplify data loading for a single DataTier and ChannelId including fast flattening and concatenation of tables and arrays.
The following functionality is implemented:
Example (requires a $LEGEND_DATA_CONFIG environment variable pointing to a legend data-config file):

using LegendDataManagement, LegendHDF5IO
l200 = LegendData(:l200)
filekeys = search_dsik(FileKey, l200.tier[:jldsp, :cal, :p03, :r000])

chinfo = channelinfo(l200, (:p03, :r000, :cal); system=:geds, only_processable=true)

ch = chinfo[1].channel

dsp = read_ldata(l200, :jldsp, first(filekeys), ch)
dsp = read_ldata(l200, :jldsp, :cal, :p03, :r000, ch)
dsp = read_ldata((:e_cusp, :e_trap, :blmean, :blslope), l200, :jldsp, :cal, :p03, :r000, ch)

read_ldata automitcally loads LEGEND data for a specific DataTier and data selection like e.g. a FileKey or a run-selection based for a given ChannelId. The search_disk function allows the user to search for available DataTier and FileKey on disk. The first argument can be either a selection of keys in form of a NTuple of Symbol or a PropertyFunction which will be applied during loading.
It is also possible to load whole a DataPartition or DataPeriod for a given ChannelId ch:

dsp = read_ldata(l200, :jldsp, :cal, DataPartition(1), ch)
dsp = read_ldata(l200, :jldsp, :cal, DataPeriod(3), ch)

In additon, it is possible to load a random selection of n_evts events randomly selected from each loaded file:

dsp = read_ldata(l200, :jldsp, :cal, :p03, :r000, ch; n_evts=1000)

For simplicity, the ch can also be given as a DetectorID which will be converted internally to a ChannelId:

det = chinfo[1].detector
dsp = read_ldata(l200, :jldsp, :cal, :p03, :r000, det)

[codecov]

Codecov Report

Attention: Patch coverage is 46.58041% with 289 lines in your changes missing coverage. Please review.

Project coverage is 36.40%. Comparing base (469a00e) to head (8be0c18).
Report is 56 commits behind head on main.

Files with missing lines	Patch %	Lines
ext/LegendDataManagementLegendHDF5IOExt.jl	0.00%	99 Missing ⚠️
ext/LegendDataManagementSolidStateDetectorsExt.jl	73.82%	39 Missing ⚠️
src/calibration_functions.jl	0.00%	31 Missing ⚠️
src/active_volume.jl	74.22%	25 Missing ⚠️
src/evt_functions.jl	0.00%	24 Missing ⚠️
src/dataprod_config.jl	0.00%	23 Missing ⚠️
src/utils/pars_utils.jl	0.00%	16 Missing ⚠️
src/legend_data.jl	81.70%	15 Missing ⚠️
src/data_io.jl	0.00%	10 Missing ⚠️
src/utils/data_utils.jl	0.00%	4 Missing ⚠️
... and 2 more

Additional details and impacted files

@@            Coverage Diff             @@
##             main      #59      +/-   ##
==========================================
+ Coverage   33.00%   36.40%   +3.40%     
==========================================
  Files          27       28       +1     
  Lines        1618     2104     +486     
==========================================
+ Hits          534      766     +232     
- Misses       1084     1338     +254     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[oschulz]

This is still in progress, right?

[theHenks]

I need some final checks, than it is ready. But the core is in principle ready to be merged.

[fhagemann]

@theHenks I merged all PRs on dev and resolved the merge conflicts,
meaning that it is up to date with main and should be good to go.

[oschulz]

Is dev ready to be merged into main then?