Filters: Tags: Source Code (X) > partyWithName: Richard A Erickson (X)

Filters Date Range Past year (0) Past month (0) Past week (0) Past day (0) Custom range... To   Search Extensions Project (2) Contacts Community for Data Integration - CDI Categories Project (2) Tag Types CMS Topics (2) CMS Themes (2) CMS Keywords (1) CMS Status (2) Tag Schemes https://www.sciencebase.gov/vocab/category/WRET/CMS_Topics/CDI_CMS_Topics (2) https://www.sciencebase.gov/vocab/category/WRET/CMS_Themes/CDI_CMS_Themes (2) View Results as: JSON ATOM CSV

Flocks of a feather dock together: Using Docker and HTCondor to link high-throughput computing across the USGS USGS scientists often face computationally intensive tasks that require high-throughput computing capabilities. Several USGS facilities use HTCondor to run their computational pools but are not necessarily connected to the larger USGS pool. This project demonstrated how to connect HTCondor pools by flocking, or coordinating, within the USGS. In addition to flocking the Upper Midwest Environmental Science Center and the Wisconsin Water Science Center, we have flocked with the USGS Advanced Research Computing Yeti supercomputing cluster and other water science centers. We also developed tutorials on how to sandbox code using Docker within the USGS environment for use with high-throughput computing. A main accomplishment... Categories: Project; Tags: 2017, All Funded Projects, Completed, Computational Tools and Services, Docker, All tags... HTCondor, High-Throughput Computing (HTC), Software, Source Code, Fewer tags Using Jupyter Notebooks to tell data stories and create reproducible workflows Increasingly, USGS scientists seek to share and collaborate while working on data and code. Furthermore, these scientists often require advanced computing resources. Jupyter Notebooks are one such tool for creating these workflows. The files are interactive, code “notebooks” which allow users to combine code and text in one document, enabling scientists to share the stories held within their data. Recently, USGS launched an instance of Pangeo—a community platform for Big Data geoscience—as a tool for internally hosting and executing these notebooks. Few examples exist on how to use Pangeo and no formal documentation exists for USGS scientists to use Pangeo. We will create and curate examples of using Jupyter Notebooks... Categories: Project; Tags: 2020, All Funded Projects, Best Practices, Completed, Computational Tools and Services, All tags... Guidance Document, Source Code, Fewer tags