Effective Performance Metrics for Evaluating Activity Recognition Methods

Conference: ARCS 2011 - 24th International Conference on Architecture of Computing Systems
02/22/2011 - 02/23/2011 at Como, Italy

Proceedings: ARCS 2011

Pages: 10Language: englishTyp: PDF

Personal VDE Members are entitled to a 10% discount on this title

Kasteren, T. L. M. van; Alemdar, Hande; Ersoy, Cem (Bo?aziçi University, Istanbul, Turkey)

In this paper, we present several novel metrics for evaluating the recognition performance of activity recognition methods. Traditional methods of evaluation are insufficient for activity recognition because they do not take into account class imbalance and do not account for errors specific to temporal data problems. We present several metrics that do take these issues into account. The effectiveness of our approach is shown by comparing the recognition performance of two closely related probabilistic models on three real world datasets.