Feature request: Pass/fail reporting

[ablwr]

Users would like a high-level overview of groups of files that determine whether something has failed and which files have failed. Dashboard should reveal all files that are failing. Should also be able to click thru to identify further. “Your thing failed, go look at it!”

[kgrons]

Use Case: user opens SignalServer daily(?) following automated tests. Dashboard summarizes failures for manual investigation + remediation.

Functional:

• test date, thresholds failed, list of files failed per threshold per date, ability to navigate to problem files in QCTools environment (direct link or some type of path?)

UI:
Could be specified further by collapsed summary starting with test date and clicking to open lists individual failures and files:
-[Date of test]
-+ FAILED | [summary of failed threshold]
-- FAILED | [summary of failed threshold]
---file [click to open in QCTools or click thru for source file path or something]

Possible improvement: Ability to export the summary and details (CSV?), e.g., for long term deck monitoring and/or collection/batch-level stats.

[ablwr]

Thanks so much @kgrons 🎉