THE LONG-RUNNING ISSUE OF REVIEW QUALITY – FINDINGS FROM AN EMPIRICAL STUDY AMONGST INTERNATIONAL REVIEWERS
DS 60: Proceedings of DESIGN 2010, the 11th International Design Conference, Dubrovnik, Croatia
Year: 2010
Editor: Marjanovic D., Storga M., Pavkovic N., Bojcetic N.
Author: Birkhofer, H.; Zhao, S.
Section: DESIGN THEORY AND RESEARCH METHODOLOGY
Page(s): 1-10
Abstract
This study was conducted in order to elaborate the degree of differing evaluations amongst reviewers by obtaining as many reviews as possible for one single paper which has been sent out to all potential referees. According to the findings, a strict objective evaluation of a scientific contribution seems to be not feasible. The review process is strongly affected by the character traits of the referee and his scientific imprint. In this sense, not the “bargaining” on the review criteria or the rating scales will be rewarding but the adequate consideration of the individuality of the reviewers.
Keywords: peer review, review quality, content and formal quality