Model management system for IRT-based test construction decision support system

摘要

Decision support system (DSS) has become widespread for some specific domains in recent years. However, DSS for IRT-based (item response theory) test construction has not yet been developed. This domain basically imposes a semi-structured or unstructured decision and, therefore, involves a very complex modeling process. This study develops a model management system (MMS) architecture to assist a non-expert user in manipulating test construction process efficiently and effectively. This architecture consists of four components: problem analysis, model type selection, model formulation and solver. The model type selection subsystem is further organized into three levels of hierarchy, i.e., environment, structure and parameter. A prototype is presented to demonstrate the feasibility of this architecture. The results indicate that this approach can be applied for providing an integrated, flexible and user-friendly DSS environment for producing better quality of results in less solution time.