Handley, Zoe Louise orcid.org/0000-0002-4732-3443 and Wang, Haiping (2023) What do the Measures of Utterance Fluency Employed in Automatic Speech Evaluation (ASE) Tell Us about Oral Proficiency? Language Assessment Quarterly. ISSN 1543-4311
Abstract
This paper explores what the measures of utterance fluency typically employed in Automatic Speech Evaluation (ASE), i.e. automated speaking assessments, tell us about oral proficiency. 60 Chinese learners of English completed the second part of the speaking section of IELTS and six tasks designed to measure the linguistic knowledge and processing assumed to underpin second language speech production. A sample of eight native speakers rated the learners’ oral productions for functional adequacy. Analyses of the data confirm: (1) articulation rate, mid-clause pause frequency, and repetition frequency predict functional adequacy, (2) breadth of lexical knowledge is the main predictor of articulation rate as well as functional adequacy, (3) speed of syntactic processing predicts end-clause pause duration and speed of lexical processing predicts mid-clause pause duration, and (4) measures of utterance fluency together account for 60% of the variation in functional adequacy scores. These findings suggest that articulation rate best reflects overall functional adequacy. Moreover, other measures of utterance fluency reflect different areas of underlying knowledge and processing, opening up the possibility of automating diagnostic speaking tests.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © 2023 The Author(s). |
Dates: |
|
Institution: | The University of York |
Academic Units: | The University of York > Faculty of Social Sciences (York) > Education (York) |
Depositing User: | Pure (York) |
Date Deposited: | 29 Nov 2023 10:30 |
Last Modified: | 13 Mar 2025 05:29 |
Published Version: | https://doi.org/10.1080/15434303.2023.2283839 |
Status: | Published online |
Refereed: | Yes |
Identification Number: | 10.1080/15434303.2023.2283839 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:206035 |
Download
Description: What Do the Measures of Utterance Fluency Employed in Automatic Speech Evaluation ASE Tell Us About Oral Proficiency
Licence: CC-BY-NC-ND 2.5