Software#

To assist users in building a hub, we have developed a software suite with specific functions and uses outlined below. These tools are designed to support common modeling hub tasks, like loading model output data, plotting the model output data, building ensembles using the data, and, in some cases, evaluating the predictions made by different models.

hubverse#

hubverse is a collection of packages that enables collaborative modeling exercises through a unified framework for aggregating, visualizing, and evaluating forecasts. Installing hubverse also installs all the other packages listed below. It is designed to make it easy to install and load multiple hubverse packages in a single step.

hubAdmin#

hubAdmin is an R package that provides utility functions for administering hubs, specifically for creating and validating hub configuration files.

hubCI#

hubCI is an R package that provides functionality for setting up hubverse continuous integration workflows.

hubData#

hubData is an R package that provides tools for connecting to, interacting with, and manipulating hub data.

hubEnsembles#

hubEnsembles is an R package that provides functionality for creating ensembles from model output data. Supported ensemble methods include weighted averages, quantile averages, and linear pools.

hubEvals#

hubEvals is an R package that provides tools for evaluating infectious disease model outputs.

hubExamples#

hubExamples is an R package that provides example data for forecasting and scenario modeling hubs in the hubverse format.

hubUtils#

hubUtils is a lightweight R package containing general utilities imported by other hubverse packages. Previously, hubUtils was a larger package with more functions, but most were moved and split across hubData and hubAdmin.

hubValidations#

hubValidations is an R package that facilitates the implementation of general validation rules enforced on submissions in the form of pull requests to hub repositories.

hubVis#

hubVis is an R package that provides plotting methods for hub model outputs to synthesize and visualize model submissions.