Peer and Teacher Assessments of Oral Presentation Skills: how reliable are they? Magin, Douglas en_US Helmore, Phillip en_US 2021-11-25T13:00:56Z 2021-11-25T13:00:56Z 2001 en_US
dc.description.abstract This article reports findings on the reliabilities of peer and teacher summative assessments of engineering students’ oral presentation skills in a fourth year communications subject. The context of the study is unusual, in that each oral presentation was subject to multiple ratings by teams of students and teams of academic staff. Analysis of variance procedures were used to provide separate estimates of inter-rater reliability of assessments by peers and teachers for classes in four succeeding years. Teacher ratings were found to have substantially higher levels of inter-rater agreement than peer ratings. Generalising over the four years, it would require the averaging of between two and four peer ratings to match the reliability of single teacher assessments. However, the estimates of individual rater reliability for teachers, based on the intra-class correlation coefficient, were moderately low (0.40 to 0.53). It is concluded that the reliability of summative assessments of oral presentations can be improved by combining teacher marks with the averaged marks obtained from multiple peer ratings. en_US
dc.identifier.issn 0307-5079 en_US
dc.language English
dc.language.iso EN en_US
dc.rights CC BY-NC-ND 3.0 en_US
dc.rights.uri en_US
dc.source Legacy MARC en_US
dc.subject.other oral presentation en_US
dc.subject.other peer assessment en_US
dc.subject.other teacher assessment en_US
dc.title Peer and Teacher Assessments of Oral Presentation Skills: how reliable are they? en_US
dc.type Journal Article en
dcterms.accessRights metadata only access
dspace.entity.type Publication en_US
unsw.identifier.doiPublisher en_US
unsw.relation.faculty Engineering
unsw.relation.ispartofissue 3 en_US
unsw.relation.ispartofjournal Studies in Higher Education en_US
unsw.relation.ispartofpagefrompageto 287-298 en_US
unsw.relation.ispartofvolume 26 en_US
unsw.relation.originalPublicationAffiliation Magin, Douglas, Faculty of Engineering, UNSW en_US
unsw.relation.originalPublicationAffiliation Helmore, Phillip, Mechanical & Manufacturing Engineering, Faculty of Engineering, UNSW en_US School of Mechanical and Manufacturing Engineering *
Resource type