Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CDF document updates #1179

Open
wants to merge 3 commits into
base: dev
Choose a base branch
from

Conversation

tech3371
Copy link
Contributor

Change Summary

closes #1178

Overview

Updated CDF documentation.

Updated Files

  • docs/source/external-tools/cdf/cdf_introduction.rst
    • minor updates
  • docs/source/external-tools/cdf/cdf_requirements.rst
    • Added sections to list required attributes for different data types by using existing documentation.
    • Added metadata section

@tech3371 tech3371 added enhancement New feature or request CDF Related to CDF files labels Nov 21, 2024
@tech3371 tech3371 self-assigned this Nov 21, 2024
Copy link
Contributor

@maxinelasp maxinelasp left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, thanks for making these updates!

Copy link
Contributor

@lacoak21 lacoak21 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great Tenzin!

******************************************
Required Attributes of CDF File Components
******************************************
CDF files are composed of these main components: Global Attributes, Data Variables, Support Data Variables, and Metadata Variables. Each of these components has a set of required attributes that must be included in the CDF file.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe change the header to 'Required Attributes of ISTP Compliant CDF File Components' for more clarity?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Totally! I appreciate wording feedback as well.

* Data_type - (e.g. the mode, data level, and descriptor)
* Data_type - (e.g. data level, and descriptor)

These three attributes can be ordered in different ways based on the user's filename convention. SPDF uses default naming conventions of ``source_datatype_descriptor_yyyyMMdd`` but IMAP uses this convention, ``source_descriptor_datatype_yyyyMMdd_vNNN``.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I wonder if you could add an example which shows the format the instrument (descriptor) takes in the string, because I could imagine it being the shorter name (e.g. 'MAG') the longer name ('Magnetometer') or the full instrument name above ('MAG>Magnetometer').

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Descriptor is already described in the naming convention doc, so I'd prefer to link to that document rather than rewriting it here

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I did think about including example but didn't know if I should. I was afraid it may cause confusion. If we think it will help, I am happy to include it.

For example, source_datatype_descriptor_yyyyMMdd would result in filename convention like this imap_l1a_norm-raw_mag_20241122 whereas source_descriptor_datatype_yyyyMMdd_vNNN would result in this filename convention imap_mag_l1a_norm-raw_20241122_v001. If you guys can suggested a good wording to say that, that may be helpful.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@maxinelasp A link is fine too!

I suppose I had figured anyone referring to the documentation here would want to use the IMAP convention, but maybe that's not a safe assumption.

Copy link
Contributor Author

@tech3371 tech3371 Nov 22, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A quick summary and example may be helpful still. I added both. I will fix the format but let me know what you both think?

Suggested change
These three attributes can be ordered in different ways based on the user's filename convention. SPDF uses default naming conventions of ``source_datatype_descriptor_yyyyMMdd`` but IMAP uses this convention, ``source_descriptor_datatype_yyyyMMdd_vNNN``.
These three attributes can be ordered in different ways based on the user's filename convention. SPDF uses default naming conventions of ``source_datatype_descriptor_yyyyMMdd`` but IMAP uses this convention, ``source_descriptor_datatype_yyyyMMdd_vNNN``. For example, ``source_datatype_descriptor_yyyyMMdd`` would result in filename convention like this, ``imap_l1a_norm-raw_mag_20241122``, whereas ``source_descriptor_datatype_yyyyMMdd_vNNN`` would result in filename convention like this, ``imap_mag_l1a_norm-raw_20241122_v001``. See <https://imap-processing--1179.org.readthedocs.build/en/1179/development-guide/style-guide/naming-conventions.html#> for more details of IMAP filename convention.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm happy with this! I'm still looking for a bit of clarification as to whether anyone working on IMAP would expect anything except for the IMAP format?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

On IMAP, no. We all use that source_descriptor_datatype_yyyyMMdd_vNNN convention.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CDF Related to CDF files enhancement New feature or request
Projects
Status: No status
Development

Successfully merging this pull request may close these issues.

Update CDF documentation
4 participants