On meaningful menus for measurement: Disentangling evaluative issues in system design

摘要

This essay argues that system evaluation should be viewed in the broader context of measurement. Seven measurement issues are discussed, including testing, verification, demonstration, evaluation, validation, acceptance and viability. These issues are discussed from the perspectives of both system designers and users. It is proposed that a comprehensive approach to measurement should involve planning and execution of four phases of measurement including naturalist, marketing, engineering and sales and services phases. The prerequisites to the success of this approach are discussed.