A brief review of the literature is presented that tracks the development of systems evaluation methods from focusing on user goals to user satisfaction and system usage. The conclusion from the literature review is that user satisfaction and system usage are necessary but not sufficient criteria to establish system effectiveness or success. A new method of system evaluation is present that focuses on the impact the system has on the data series that was the reason for the system. Called outcomes based evaluation, this method of evaluation uses the concept of intervention analysis and the methods of interrupted time series design to determine the impact a system has on the variables that alerted the managers to the need of the systems. Case studies are presented that demonstrate and further elucidate this evaluation method. The value of this tool for managers is discussed as a means to sift through the many items of technology marketed as solutions to perhaps non-existent problems.
|Number of pages
|Journal of Computer Information Systems
|Published - Dec 1998