Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refine headings #183

Open
wants to merge 9 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 4 additions & 2 deletions _quarto.yml
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,9 @@ website:
- section: NASA VEDA Platform
contents:
- nasa-veda-platform/about/index.qmd
- nasa-veda-platform/dashboard/index.qmd
- section: nasa-veda-platform/dashboard/index.qmd
contents:
- nasa-veda-platform/dashboard/design-principles.qmd
- section: nasa-veda-platform/data-services/index.qmd
contents:
- nasa-veda-platform/data-services/data-store.qmd
Expand Down Expand Up @@ -111,7 +113,7 @@ website:
- text: "---"
- section: open-source-ecosystem/index.qmd
contents:
- open-source-ecosystem/why.qmd
- open-source-ecosystem/yet-another-platform.qmd
- open-source-ecosystem/architecture.qmd
- open-source-ecosystem/repositories.qmd
- open-source-ecosystem/external-resources.qmd
Expand Down
13 changes: 8 additions & 5 deletions nasa-veda-platform/about/index.qmd
Original file line number Diff line number Diff line change
Expand Up @@ -3,25 +3,28 @@ title: "About the VEDA project"
subtitle: "Background and vision of the VEDA project"
---

## About
## Project Context

Visualization Exploration and Data Analysis (VEDA) is an ecosystem of tools and services built with the goal to provide a redeployable and unified open-source science cyberinfrastructure for data processing, visualization, exploration, and GIS capabilities with NASA data on the cloud.

Developed through a collaboration between [NASA IMPACT](https://impact.earthdata.nasa.gov/), [Development Seed](https://developmentseed.org/), [University of Alabama in Huntsville](https://www.uah.edu/), [Element 84](https://www.element84.com/), [Indiana University](https://www.indiana.edu/), [International Interactive Computing Collaboration (2i2c)](https://2i2c.org), [Earth Science Data and Information System (ESDIS) Project](https://www.earthdata.nasa.gov/esdis), [NASA Science Managed Cloud Environment (SMCE)](https://smce.nasa.gov/), and NASA Mission Cloud Platform (MCP), VEDA significantly reduces the barriers to accessing Earth science data and the computational resources needed for exploring and processing the petabyte-scale Earth data archives in the cloud. VEDA’s achievement exemplifies the core principles of NASA’s Open-Source Science Initiative (OSSI), showcasing commitment to promoting transparent, accessible, and collaborative scientific research.
Developed through a collaboration between [NASA IMPACT](https://impact.earthdata.nasa.gov/), [Development Seed](https://developmentseed.org/), [University of Alabama in Huntsville](https://www.uah.edu/), [Element 84](https://www.element84.com/), [Georgia Tech](https://www.gatech.edu/), [International Interactive Computing Collaboration (2i2c)](https://2i2c.org), [Earth Science Data and Information System (ESDIS) Project](https://www.earthdata.nasa.gov/esdis), [NASA Science Managed Cloud Environment (SMCE)](https://smce.nasa.gov/), and NASA Mission Cloud Platform (MCP), VEDA significantly reduces the barriers to accessing Earth science data and the computational resources needed for exploring and processing the petabyte-scale Earth data archives in the cloud. VEDA’s achievement exemplifies the core principles of NASA’s Open-Source Science Initiative (OSSI), showcasing commitment to promoting transparent, accessible, and collaborative scientific research.

Read more about the history of VEDA in [this blog post](https://impactunofficial.medium.com/introducing-veda-an-open-science-platform-to-accelerate-earth-science-research-and-application-2c7339640514).

## Goals
* Leverage existing open source components (NASA-MAAP, Dashboard, Cumulus, Pangeo, STAC, etc) to assemble interoperable ecosystem of tools

## Project Goals

* Leverage existing open source components (NASA-MAAP, Cumulus, Pangeo, STAC, etc) to assemble interoperable ecosystem of tools
* Maximize the capabilities offered by data and compute on the cloud
* Provide services for future mission data processing
* Provide a platform for new priorities and directives: NASA’s Earth Action, NASA’s Earth Science Data Systems (ESDS) Program, and other priority initiatives

### Stakeholder Benefits

* General Public: Interactive stories
* Scientist: scientific (visual) analysis and communication
* Data producers/Researchers: processing and self publishing
* TOPS: summer schools and competitions
* TOPS: platform for summer schools and competitions
* Applied science/Decision makers: geospatial analysis and communication
* Communication: Interactive storytelling

Expand Down
66 changes: 66 additions & 0 deletions nasa-veda-platform/dashboard/design-principles.qmd
Original file line number Diff line number Diff line change
@@ -0,0 +1,66 @@
---
title: Design Principles
subtitle: 10 Things to Know About the VEDA Dashboard
aliases:
- /services/dashboard.html
---

## Guiding principles

### 1. Science teams need a way to show their work
- Science teams often need a web presence to show their research program, findings, and methods and data to their stakeholders, colleagues, and other audiences
- Modern data-driven science is not only presented through papers, posters, and lectures to fellow scientists and through reports to decision makers, but also through up-to-date interactive online tools and blogs that are available directly to either audience.
Web and cloud platforms can enable scientists to publish contents in these interactive ways.
- Often, science programs will want to put their information into a specific context and make it discoverable via their name, which is also important for credibility and attribution.
- VEDA UI helps science teams combine the two - program-specific websites with interactive data visualization and standardized access.

### 2. The VEDA Dashboard visualizes Earth science data in a way that a CMS can't
- In order to include interactive data exploration and analysis tools into sites built with traditional CMS tools, you often need to manually embed third-party services into your website, losing any reference to the original data.
- Otherwise, you have to rely on a highly customized and expensive service.
- The VEDA Dashboard set of tools allows you to visualize spatio-temporal data assets within your website, maintaining an interoperable reference to the source data. At the same time, it is completely open source, customizable, and comes without a subscription.

### 3. It enables science workflows AND communicates to stakeholders in one platform
- We show that, with cloud-optimized data, we can achieve multiple purposes without considerable additional effort or duplicating data sources
- Data visualization in web interfaces often relies on copies of original data that were prepared for visualization (even scalable visualization services like NASA WorldView rely on statically produced rendered replicas). Linking the visualization back to original source data, as required for (re)producing scientific analysis, is often not possible or requires connecting a lot of dots.
- VEDA visualizes data directly off a single authoritative reference that contains data optimized for visualization as well as direct access, avoiding the issue of missing links between source and rendered data. The data a user sees in VEDA has a direct reference to source data (often via STAC).
Another benefit of dynamic tiling is that users are able to adjust viewing parameters such as color map and value range to focus on, to study details of their interest.

### 4. Features are optimized for Earth science data but other spatio-temporal applications might find them useful
- Spatio-temporal data often comes from Earth observations or Earth system models. However, the principle of integrating dynamically rendered data into a website is valuable for many branches of data-intensive science, such as heliophysics or astrophysics

### 5. The VEDA Dashboard is completely open-source
- The code is open and accessible, and the tool itself proliferates the use of open standards and reproducible data access for open science
Community involvement will become important to the long-term success of VEDA

### 6. Each science team can create their own VEDA Dashboard with different content, data, and features
Existing VEDA instances:

- Template
- Earthdata
- Greenhouse Gas Center Portal
- earth.gov

Planned VEDA instances:

- Air Quality Portal

### 7. Each science team will customize their VEDA Dashboard to meet the needs of their audience
![Dashboard audiences](images/VEDA Engagement.jpeg)

### 8. There is a template for science teams to see features and a potential layout
- The Dashboard is NOT a replicable white-label website/dashboard, or even a single website
- Each science team will make their own instance of the Dashboard, and a template instance will provide some guidance and a starting point, if the teams need it
- However, each team can decide how to use the features available

### 9. Utilizing an integrated STAC, a VEDA Dashboard can show data from a variety of sources
There are different ways to integrate data, such as:
- Using platform storage, catalog, and data access services
- Catalog externally stored data, serve through platform services (e.g. cloud-optimized GeoTIFF in DAAC S3; TiTiler and TiTiler-Xarray)
- Rely on external storage and catalog, serve through platform services (e.g. TiTiler-CMR)
- Integrate third-party data services (ArcGIS ImageServer etc., WorldView WMS)
While open source cloud-native geospatial data services are preferred, we should also avoid making copies of data and instead rely on existing, authoritative services.

### 10. There are other frontends for VEDA
- The VEDA Dashboard is just one frontend for VEDA, and should integrate well with other frontend options for users
- The virtue of open-standard, open-access data services is that many interfaces can connect to them (interoperability).
- Within the VEDA project, we promote the use of STAC Browser to browse the VEDA catalog, interactive code notebooks for finding and loading data (VEDA JupyterHub), and multiple data websites to use the same services (ESA/NASA/JAXA EO Dashboard, Earth.gov, …).
68 changes: 16 additions & 52 deletions nasa-veda-platform/dashboard/index.qmd
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The 10 things to know about VEDA is meant to serve as an overview of the Dashboard and its value proposition, it doesn't really cover design principles. If there are some pieces missing, we can work to incorporate those, but I wouldn't categorize them like this

Original file line number Diff line number Diff line change
@@ -1,75 +1,39 @@
---
title: VEDA Dashboard
subtitle: 10 Things to Know About the VEDA Dashboard
subtitle: Science presentation and entrypoint
aliases:
- /services/dashboard.html
---

The VEDA Dashboard is an open-source set of configurable tools and pages that enable you and your team to visualize, analyze, and communicate science data.
## Goals

Learn more about the principles the VEDA Dashboard is designed around below.
The VEDA Dashboard is a modular, flexible white-label web application that enable scientific programs and their contributors to visualize, analyze, and communicate scientific data and results.

If you would like to learn more about how to create your own instance of the VEDA Dashboard, visit the [VEDA UI docs](https://github.com/NASA-IMPACT/veda-ui/blob/main/docs/development/SETUP.md).

### 1. Science teams need a way to show their work
- Science teams often need a web presence to show their research program, findings, and methods and data to their stakeholders, colleagues, and other audiences
- Modern data-driven science is not only presented through papers, posters, and lectures to fellow scientists and through reports to decision makers, but also through up-to-date interactive online tools and blogs that are available directly to either audience.
Web and cloud platforms can enable scientists to publish contents in these interactive ways.
- Often, science programs will want to put their information into a specific context and make it discoverable via their name, which is also important for credibility and attribution.
- VEDA UI helps science teams combine the two - program-specific websites with interactive data visualization and standardized access.
The ReactJS library offers powerful abstractions for defining and describing data sources (datasets), visualizing them, and exposing them throughout the application in interactive storytelling and data exploration tools.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a bit jargon-ey, I am hoping to avoid this for a top level description of the VEDA Dashboard, wherever possible. I think it's essentially covered by the first two sections of 10 things to know about VEDA Dashboard


### 2. The VEDA Dashboard visualizes Earth science data in a way that a CMS can't
- In order to include interactive data exploration and analysis tools into sites built with traditional CMS tools, you often need to manually embed third-party services into your website, losing any reference to the original data.
- Otherwise, you have to rely on a highly customized and expensive service.
- The VEDA Dashboard set of tools allows you to visualize spatio-temporal data assets within your website, maintaining an interoperable reference to the source data. At the same time, it is completely open source, customizable, and comes without a subscription.
VEDA Dashboards can serve as the main representation of scientific programs and organizations, putting the data and results in the context of the program, while using open community standards for data access, such that results become directly reproducible and the data access interoperable with other tools such as GIS software or computing environments.

### 3. It enables science workflows AND communicates to stakeholders in one platform
- We show that, with cloud-optimized data, we can achieve multiple purposes without considerable additional effort or duplicating data sources
- Data visualization in web interfaces often relies on copies of original data that were prepared for visualization (even scalable visualization services like NASA WorldView rely on statically produced rendered replicas). Linking the visualization back to original source data, as required for (re)producing scientific analysis, is often not possible or requires connecting a lot of dots.
- VEDA visualizes data directly off a single authoritative reference that contains data optimized for visualization as well as direct access, avoiding the issue of missing links between source and rendered data. The data a user sees in VEDA has a direct reference to source data (often via STAC).
Another benefit of dynamic tiling is that users are able to adjust viewing parameters such as color map and value range to focus on, to study details of their interest.
The VEDA Dashboard powers several platforms, most prominently the [U.S. Greenhouse Gas Center](https://earth.gov/ghgcenter) and [Earth.gov](https://earth.gov), with more platform instances underway.

### 4. Features are optimized for Earth science data but other spatio-temporal applications might find them useful
- Spatio-temporal data often comes from Earth observations or Earth system models. However, the principle of integrating dynamically rendered data into a website is valuable for many branches of data-intensive science, such as heliophysics or astrophysics
See also this detailed list of [principles the VEDA Dashboard is designed around](./design-principles.qmd).

### 5. The VEDA Dashboard is completely open-source
- The code is open and accessible, and the tool itself proliferates the use of open standards and reproducible data access for open science
Community involvement will become important to the long-term success of VEDA

### 6. Each science team can create their own VEDA Dashboard with different content, data, and features
Existing VEDA instances:
## Made for reuse

- Template
- Earthdata
- Greenhouse Gas Center Portal
- earth.gov

Planned VEDA instances:
If you would like to learn more about how to create your own instance of the VEDA Dashboard, visit the [VEDA UI docs](https://github.com/NASA-IMPACT/veda-ui/blob/main/docs/development/SETUP.md).
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Very soon I will want to send them to another page in veda-docs, working on it with this PR: #182


- Air Quality Portal

### 7. Each science team will customize their VEDA Dashboard to meet the needs of their audience
![Dashboard audiences](images/VEDA Engagement.jpeg)
::: {.callout-note title="Ongoing VEDA Dashboard refactor"}
We are currently changing the way VEDA Dashboard applications are composed and configured to better accommodate the needs of different science programs that adopted it.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think this is worth describing at this level. For stakeholders that need to know, like Brian and Alex, we can describe this in other places.

Unless we want this be more of a knowledge repository for all things VEDA, to live alongside GDrive. In that case, though, I'd suggest this as a sub-page somewhere, not on the top level description. For anybody new to VEDA, they'll get the refactored version.


### 8. There is a template for science teams to see features and a potential layout
- The Dashboard is NOT a replicable white-label website/dashboard, or even a single website
- Each science team will make their own instance of the Dashboard, and a template instance will provide some guidance and a starting point, if the teams need it
- However, each team can decide how to use the features available
In Version 1, the application had a pre-defined structure (homepage, catalog, data explorer, about), routing, and page layout, that was configurable through Markdown and YAML (MDX) and where features could be overridden, if need be.

### 9. Utilizing an integrated STAC, a VEDA Dashboard can show data from a variety of sources
There are different ways to integrate data, such as:
- Using platform storage, catalog, and data access services
- Catalog externally stored data, serve through platform services (e.g. cloud-optimized GeoTIFF in DAAC S3; TiTiler and TiTiler-Xarray)
- Rely on external storage and catalog, serve through platform services (e.g. TiTiler-CMR)
- Integrate third-party data services (ArcGIS ImageServer etc., WorldView WMS)
While open source cloud-native geospatial data services are preferred, we should also avoid making copies of data and instead rely on existing, authoritative services.
In Version 2 (expected in production by mid 2025), the features are broken out into more modular React components and separated from pages and state management, such that they can be composed flexibly and science programs can implement the content organization, routing logic, and selection of features that best fits their audience.

### 10. There are other frontends for VEDA
- The VEDA Dashboard is just one frontend for VEDA, and should integrate well with other frontend options for users
- The virtue of open-standard, open-access data services is that many interfaces can connect to them (interoperability).
- Within the VEDA project, we promote the use of STAC Browser to browse the VEDA catalog, interactive code notebooks for finding and loading data (VEDA JupyterHub), and multiple data websites to use the same services (ESA/NASA/JAXA EO Dashboard, Earth.gov, …).
Read more about the rationale and principles for the change in our [Architecture Decision Record](https://github.com/NASA-IMPACT/veda-ui/tree/main/docs/adr/002-application-architecture-for-configurability.md).
:::


## Configuration

Please see our docs on [Dashboard Configuration](../adding-content/dashboard-configuration/index.qmd).
Please see our docs on [Dashboard Configuration](../adding-content/dashboard-configuration/index.qmd).
4 changes: 3 additions & 1 deletion nasa-veda-platform/data-services/index.qmd
Original file line number Diff line number Diff line change
Expand Up @@ -3,14 +3,16 @@ title: Data Services
subtitle: Providing standard tooling, Application Programming Interfaces (APIs), and access to persistent, discoverable Earth science datasets
---

## Data Services
## Goals

The goal of VEDA Data Services is to support open science through community standard tooling, Application Programming Interfaces (APIs), and providing access to persistent, discoverable Earth science datasets. This approach includes:

1. Hosting and making available key datasets in analysis-optimized formats
2. Tying together VEDA products by providing access to hosted data, existing third-party geospatial datasets, and new datasets produced within the VEDA ecosystem
4. Making data Findable, Accessible, Interoperable, and Reusable (FAIR), within and also beyond VEDA

## Services

The Data Services hosts a suite of services that make these pointers possible.

Some of them include:
Expand Down
Loading
Loading