This repository provides our scripts that were used to run experiments in our paper, A Comparative Multidimensional Analysis of Empathetic Systems.
To measure specificity, see scripts/specificity.py
To measure emotional intensity, valence, and arousal, see scripts/vad.py.
To measure PAIR, see here.
To measure diversity, see scripts/ngrams.py, scripts/tree.py, and scripts/gather_tree_stats.py.