Statistical Outlier Detection for Jury Based Grading Systems

Mary Kathryn Thompson, Line Katrine Harder Clemmensen, Harvey Rosas

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

293 Downloads (Pure)

Abstract

This paper presents an algorithm that was developed to identify statistical outliers from the scores of grading jury members in a large project-based first year design course. The background and requirements for the outlier detection system are presented. The outlier detection algorithm and the follow-up procedures for score validation and appeals are described in detail. Finally, the impact of various elements of the outlier detection algorithm, their interactions, and the sensitivity of their numerical values are investigated. It is shown that the difference in the mean score produced by a grading jury before and after a suspected outlier is removed from the mean is the single most effective criterion for identifying potential outliers but that all of the criteria included in the algorithm have an effect on the outlier detection process.
Original languageEnglish
Title of host publication120th ASEE Annual Conference and Exhibition
Number of pages13
PublisherAmerican Society for Engineering Education
Publication date2013
Publication statusPublished - 2013
Event120th ASEE Annual Conference and Exhibition - Atlanta, GA, United States
Duration: 23 Jun 201326 Jun 2013

Conference

Conference120th ASEE Annual Conference and Exhibition
CountryUnited States
CityAtlanta, GA
Period23/06/201326/06/2013

Fingerprint Dive into the research topics of 'Statistical Outlier Detection for Jury Based Grading Systems'. Together they form a unique fingerprint.

Cite this