This chapter commences with a review of research on the nature of rater thinking and
observer training. It describes the studies, observation protocols, data sets, and our analytic …

Rubrics are widely used in higher education to assess performance in project-based
learning environments. To date, the sources of error that may affect their reliability have not …

This is not a history book in the strictest sense of the term. None of the authors are historians.
We are instead participants in much of the history covered in this book and as such are likely …

This study aimed to investigate the change in teacher candidates' oral presentation skills
over time through self, peer, and teacher assessments using the rater drift method. A …

While significant attention has been given to test equating to ensure score comparability,
limited research has explored equating methods for rater‐mediated assessments, where …

Purpose Systematic differences among raters' approaches to student assessment may result
in leniency or stringency of assessment scores. This study examines the generalizability of …

Generalizability (G) is a theory that is principally associated with behavioral measurements—
particularly their sources of error. As such G theory is intimately related to reliability and …

A latent variable modeling method for evaluation of interrater agreement is outlined. The
procedure is useful for point and interval estimation of the degree of agreement among a …

The oral examination, sometimes known as a viva voce, is characterized by a face-to-face
interaction between an examinee and one or more examiners. The purpose of an oral …

Establishing test marks and reporting them to students is a difficult task for key medical
educators. Failing a test is usually an unpleasant experience for any student. Therefore …