Department of Educational Foundations and Leadership

Title

State-Of-The-Art Automated Essay Scoring: Competition, Results, and Future Directions from a United States Demonstration

Document Type

Article

Publication Date

Summer 4-2014

Abstract

This article summarizes the highlights of two studies: a national demonstration that contrasted commercial vendors' performance on automated essay scoring (AES) with that of human raters: and an international competition to match or exceed commercial vendor performance benchmarks. In these studies, the automated essay scoring engines performed well on five of seven measures and approximated human rater performance on the other two. With additional validity studies, it appears that automated essay scoring holds the potential to play a viable role in high-stakes writing assessments. (C) 2013 Elsevier Ltd. All rights reserved.

Publication Title

Assessing Writing

Volume

20

First Page

53

Last Page

76