OSDF Examples: Reference Computational Workflows for Earth System Data Streaming via PelicanFS
Hampapura, Harsha R.; Conroy, Riley P.; Turetsky, Emma T.; Sears, Mya;
OSDF Examples: Reference Computational Workflows for Earth System Data Streaming via PelicanFS
A collection of Jupyter notebooks that stream Earth System Science data from Open Science Data Federation (OSDF) origins using PelicanFS, and run analysis on a variety of HPC and cloud platforms (NCAR Casper, TACC Stampede3, Indiana Jetstream2, OSPool, laptop). Notebooks demonstrate bias correction, climatology, equilibrium climate sensitivity, machine learning, and benchmarking against datasets including CESM2 LENS, ERA5, CMIP6, NA-CORDEX, CONUS404, JRA-3Q, DART, HRRR, HadISST, NOAA SONAR, and Sentinel-2. Rendered site: https://ncar.github.io/osdf-examples/