Analyze Results

The correctness of judgments along with the question frequencies can then be used to plot precision and ROC curves.

generate precision and ROC curve:

themis analyze plot precision <collate_agree.csv> --draw
themis analyze plot roc <collate_agree.csv> --draw

here collate_agree.csv is the collated file with all systems.

This command will draw precision curve and roc curve based on the collate_agree.csv file. This command can take more than one file systems to be ploted against each other. This will also create plot data files which can be used to plot separately with other applications.