Skip to content
This repository has been archived by the owner on Nov 24, 2021. It is now read-only.

Add ability to compare the inputs and outputs between two runs #40

Open
aeisenberg opened this issue May 26, 2020 · 0 comments
Open

Add ability to compare the inputs and outputs between two runs #40

aeisenberg opened this issue May 26, 2020 · 0 comments
Assignees

Comments

@aeisenberg
Copy link
Contributor

In order to track changes over time, it will be useful to have some sort of mechanism to compare the inputs and outputs of two runs. Initial thoughts are that it will look something like this:

  1. select two runs to compare
  2. download the model inputs and model outputs for both runs
  3. compare the inputs:
  • pre params
  • params
  • input.json from the UI (just to make sure we are not accidentally comparing different runs)
  1. compare the outputs:
  • total deaths
  • total cases
  • peak daily deaths date
  • peak daily cases date
  • (if easy) number of peaks
  • what else??

Notes:

  • maybe a textual compare between the inputs is good enough, but need to sort them first
  • maybe we want to end the run in an error if there is more than X% difference between the outputs
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants