Article

Metrics for Supervisory Control System Evaluation

Mary L. Cummings and Birsen Donmez

in The Oxford Handbook of Cognitive Engineering

Published in print February 2013 | ISBN: 9780199757183
Published online May 2013 | | DOI: http://dx.doi.org/10.1093/oxfordhb/9780199757183.013.0024

Series: Oxford Library of Psychology

 Metrics for Supervisory Control System             Evaluation

Show Summary Details

Preview

Little formal guidance exists on how to select a set of meaningful metrics for a human supervisory control system, which is inherently complex with significant embedded autonomy. With the increasing reliance on automation in these complex settings, it is critical that key performance metrics be identified to indicate not only operator and automation performance, but integrated human-system performance as well. To this end, this chapter will describe a supervisory control metric taxonomy that classifies different metric classes across supervisory control systems, and provide example metrics, how they relate, and how this taxonomy can be used to identify a robust set of metrics. In addition, we discuss selection of a parsimonious set of metrics based on a cost-benefit analysis approach, which ultimately depends on the overarching objectives of the researcher or practitioner.

Keywords: supervisory control; metrics; human-systems integration; evaluation; automation; cost-benefit analysis

Article.  6725 words. 

Subjects: Psychology ; Cognitive Psychology

Full text: subscription required

How to subscribe Recommend to my Librarian

Buy this work at Oxford University Press »

Users without a subscription are not able to see the full content. Please, subscribe or login to access all content.