White Rose University Consortium logo
University of Leeds logo University of Sheffield logo York University logo

Information systems evaluation methodologies

Chen, S., Osman, N.M., Nunes, J.M.B. and Peng, G.C. (2011) Information systems evaluation methodologies. In: Proceedings of the IADIS International Workshop on Information Systems Research Trends, Approaches and Methodologies. IADIS International Workshop on Information Systems Research Trends, Approaches and Methodologies 2011, 20 July 2011, Rome, Italy. .


Download (128Kb)


Due to the prevalent use of Information Systems (IS) in modern organisations nowadays, evaluation research in this field is becoming more and more important. In light of this, a set of rigorous methodologies were developed and used by IS researchers and practitioners to evaluate the increasingly complex IS implementation used. Moreover, different types of IS and different focusing perspectives of the evaluation require the selection and use of different evaluation approaches and methodologies. This paper aims to identify, explore, investigate and discuss the various key methodologies that can be used in IS evaluation from different perspectives, namely in nature (e.g. summative vs. formative evaluation) and in strategy (e.g. goal-based, goal-free and criteria-based evaluation). The paper concludes that evaluation methodologies should be selected depending on the nature of the IS and the specific goals and objectives of the evaluation. Nonetheless, it is also proposed that formative criteria-based evaluation and summative criteria-based evaluation are currently among the most and more widely used in IS research. The authors suggest that the combines used of one or more of these approaches can be applied at different stages of the IS life cycle in order to generate more rigorous and reliable evaluation outcomes.

Item Type: Proceedings Paper
Copyright, Publisher and Additional Information: An extended version of this paper has been published as a book chapter in the book entitled "Information Systems Research and Exploring Social Artifacts: Approaches and Methodologies". This book chapter can be purchased from: http://www.igi-global.com/chapter/information-systems-evaluation/70723
Keywords: Information systems evaluation, methodology, formative, summative, criteria-based evaluation, goal-based evaluation
Institution: The University of Sheffield
Academic Units: The University of Sheffield > Faculty of Social Sciences (Sheffield) > Information School (Sheffield)
Depositing User: Dr Guo Chao Peng
Date Deposited: 16 Nov 2012 12:03
Last Modified: 05 Jun 2014 19:54
Status: Published
Refereed: Yes
URI: http://eprints.whiterose.ac.uk/id/eprint/74740

Actions (repository staff only: login required)