Key points are not available for this paper at this time.
This work-in-progress paper provides probabilistic expressions of existing measures of over-reliance on AI-based decision support systems, mostly for binary classification, facilitating direct comparison and a clearer understanding of what each measure captures. We calculate all measures on the same synthetic dataset, visualise their relationships and provide complementary measures for evaluating the unwanted effects of mitigation strategies. The aim of this short paper is to provide researchers and designers with an informed framework for selecting appropriate measures when evaluating human-AI decision-making systems.
Mikhaylova et al. (Mon,) studied this question.