Registration is closed.
What is this webinar about?
Writing assessments increasingly incorporate shorter, more efficient task formats, raising important questions about the evidence underlying score interpretation. In this webinar, we examine one such task that was designed to elicit evidence of academic English writing ability in a relatively brief testing time. After introducing the task and explaining the rationale behind its design, we highlight findings from our research that analyzed learners' writing processes, such as cognitive activities, writing behaviors, and language uses, using computer algorithms and technologies for eye-tracking, keystroke logging, and NLP-based linguistic features. These research techniques allowed us to compare the new task with more traditional, extended, argumentative writing tasks, and to strengthen our understanding of what modern writing assessments measure.
*This webinar is part of Quality perspectives on language assessment seminar series.
Webinar #1 : Large-Scale Language Tests in the Age of AI : Purpose, Design, and Change
Webinar #2 : Assessing Speaking with Efficient and Communicative Tasks
Webinar #3 : Assessing Writing in New Ways: Task Design and Score Meaning
...and more forthcoming.
November 11th, 2026 12:00~12:50 (JST)
Registration is closed.
Presenters

Principal Research Scientist Dr. John M. Norris
John M. Norris (Ph.D., University of Hawaii) is Principal Research Scientist at ETS Japan, where he conducts research and outreach related to language teaching, learning, and assessment. From 2016-2022 he was Senior Research Director of the Center for Language Education and Assessment Research at Educational Testing Service in the US, with primary responsibilities for overseeing research on the TOEFL and TOEIC testing programs. John's research focuses on task-based language teaching, assessment, program evaluation, and research methods. His most recent book publications are Assessing academic English for higher education admissions (with Xiaoming Xi), winner of the Sage/ILTA best book on language testing in 2022, and Challenges and innovations in speaking assessment (with Larry Davis).

Senior Measurement Scientist Dr. Ching-Ni Hsieh
Ching-Ni Hsieh (Ph.D., Michigan State University) is Senior Measurement Scientist at ETS. Her research expertise lies in validity and test validation, with a particular emphasis on assessing speaking and writing skills and young language learners. Her work has appeared in leading academic journals, including TESOL Quarterly, Language Testing, and Language Assessment Quarterly. Before joining ETS, Ching-Ni had extensive experience in test development, teaching English as a foreign language, teacher training, and curriculum development. She has given plenary talks and numerous seminars and presentations on assessing young language learners, test validation, and task design for international audiences.

Senior Research Project Manager Dr. Renka Ohta
Renka Ohta (Ph.D., University of Iowa) is Senior Research Project Manager at ETS. She manages research projects for the TOEFL and TOEIC programs and has helped develop and deliver short online professional development courses for English language teachers around the world. Before joining ETS, she taught English as a foreign language to high school students in Japan and English as a second language to college students in the U.S. She earned her PhD in Foreign Language and ESL Education from the University of Iowa in 2018. Her research interests include teacher education, writing assessment, and test validation.
Registration is closed.