Handbook of Automated Scoring

Theory into Practice

Duanli Yan (Redaktør) ; Andre A. Rupp (Redaktør) ; Peter W. Foltz (Redaktør)

"Automated scoring engines [...] require a careful balancing of the contributions of technology, NLP, psychometrics, artificial intelligence, and the learning sciences. The present handbook is evidence that the theories, methodologies, and underlying technology that surround automated scoring have reached maturity, and that there is a growing acceptance of these technologies among experts and the public. Les mer
Vår pris
2025,-

(Innbundet) Fri frakt!
Leveringstid: Sendes innen 21 dager
På grunn av Brexit-tilpasninger og tiltak for å begrense covid-19 kan det dessverre oppstå forsinket levering.

Innbundet
Legg i
Innbundet
Legg i
Vår pris: 2025,-

(Innbundet) Fri frakt!
Leveringstid: Sendes innen 21 dager
På grunn av Brexit-tilpasninger og tiltak for å begrense covid-19 kan det dessverre oppstå forsinket levering.

Om boka

"Automated scoring engines [...] require a careful balancing of the contributions of technology, NLP, psychometrics, artificial intelligence, and the learning sciences. The present handbook is evidence that the theories, methodologies, and underlying technology that surround automated scoring have reached maturity, and that there is a growing acceptance of these technologies among experts and the public."





From the Foreword by Alina von Davier, ACTNext Senior Vice President





Handbook of Automated Scoring: Theory into Practice provides a scientifically grounded overview of the key research efforts required to move automated scoring systems into operational practice. It examines the field of automated scoring from the viewpoint of related scientific fields serving as its foundation, the latest developments of computational methodologies utilized in automated scoring, and several large-scale real-world applications of automated scoring for complex learning and assessment systems. The book is organized into three parts that cover (1) theoretical foundations, (2) operational methodologies, and (3) practical illustrations, each with a commentary. In addition, the handbook includes an introduction and synthesis chapter as well as a cross-chapter glossary.

Fakta

Innholdsfortegnelse

Contents


Foreword..................................................................................................................xi


1 The Past, Present, and Future of Automated Scoring..............................1


Peter W. Foltz, Duanli Yan, and Andre A. Rupp


Part I: Theoretical Foundations


2 Cognitive Foundations of Automated Scoring........................................ 13


Malcolm I. Bauer and Diego Zapata-Rivera


3 Assessment Design with Automated Scoring in Mind.........................29


Kristen DiCerbo, Emily Lai, and Matthew Ventura


4 Human Scoring with Automated Scoring in Mind................................49


Edward W. Wolfe


5 Natural Language Processing for Writing and Speaking..................... 69


Aoife Cahill and Keelan Evanini


6 Multimodal Analytics for Automated Assessment................................93


Sidney K. D'Mello


7 International Applications of Automated Essay Scoring.................... 113


Mark D. Shermis


8 Public Perception and Communication around Automated


Essay Scoring................................................................................................ 133


Scott W. Wood


9 An Evidentiary-Reasoning Perspective on Automated Scoring:


Commentary on Part I................................................................................ 151


Robert J. Mislevy


Part II: Operational Methodologies


10 Operational Human Scoring at Scale...................................................... 171


Kathryn L. Ricker-Pedley, Susan Hines, and Carolyn Connelly


11 System Architecture Design for Scoring and Delivery....................... 195


Sue Lottridge and Nick Hoefer


12 Design and Implementation for Automated


Scoring Systems........................................................................................... 217


Christina Schneider and Michelle Boyer


13 Quality Control for Automated Scoring in Large-Scale


Assessment.................................................................................................... 241


Dan Shaw, Brad Bolender, and Rick Meisner


14 A Seamless Integration of Human and Automated Scoring..............263


Kyle Habermehl, Aditya Nagarajan, and Scott Dooley


15 Deep Learning Networks for Automated Scoring Applications.......283


Saad M. Khan and Yuchi Huang


16 Validation of Automated Scoring Systems............................................ 297


Duanli Yan and Brent Bridgeman


17 Operational Considerations for Automated Scoring Systems:


Commentary on Part II............................................................................... 319


David M. Williamson


Part III: Practical Illustrations


18 Expanding Aut

Om forfatteren