A comparative study of the effects of a computerized English oral proficiency test format and a conventional SPEAK test format

Bibliographic Details
Main Author: Yu, Eunjyu
Language:English
Published: The Ohio State University / OhioLINK 2006
Subjects:
Online Access:http://rave.ohiolink.edu/etdc/view?acc_num=osu1164601340
id ndltd-OhioLink-oai-etd.ohiolink.edu-osu1164601340
record_format oai_dc
spelling ndltd-OhioLink-oai-etd.ohiolink.edu-osu11646013402021-08-03T05:51:34Z A comparative study of the effects of a computerized English oral proficiency test format and a conventional SPEAK test format Yu, Eunjyu Language testing CALL Oral proficiency assessment Communicative approach Test taker characteristics Validity Despite the increasing use of computer technology in language testing, limited research literature is available about the validity, reliability, and nature of computerized spoken language tests. To date, only mixed results about interactions between test taker characteristics and computerized language test format have been reported. To add to the body of research on this topic, this study explored the relationship between test taker characteristics and test delivery format during spoken English proficiency assessments. A total of 210 international students whose native language was not English were recruited at a U.S. university in autumn 2005. The main data sources included the results of a computerized spoken English test, an audio-taped SPEAK test, and replies to a questionnaire. For data analysis, this study utilized a 2×2×2 mixed factorial research design with random assignment. This study found that an interaction among all three independent variables (i.e., self-reported years of English study, self-reported computer use, and test delivery format) was not significant. Self-reported years of English language study and test delivery format, however, cooperatively produced a significant influence on test scores for the spoken English test. Specifically, the computerized speaking test, not the audio-taped SPEAK test, seemed to affect test results more for the group that self-reported less English study than for the group that self-reported greater English study. In addition, self-reported computer use did not significantly affect test results during oral proficiency assessments. Although this study was limited in terms of a single research site, a single test, and self-reported data, the study has corroborated previous research that emphasized the appropriate use of different test delivery formats according to the purposes of the tests and the characteristics of test takers. Thus, this study called for further study to ensure that a test functions fairly across various types of test takers regardless of their backgrounds. Also, this study suggested sharing ownership of testing among test makers, test takers, and test users, which might allow all interested parties to receive the benefits of testing. Finally, the findings will be useful to understand both the benefits and disadvantages of using technology in language testing. 2006-11-30 English text The Ohio State University / OhioLINK http://rave.ohiolink.edu/etdc/view?acc_num=osu1164601340 http://rave.ohiolink.edu/etdc/view?acc_num=osu1164601340 unrestricted This thesis or dissertation is protected by copyright: all rights reserved. It may not be copied or redistributed beyond the terms of applicable copyright laws.
collection NDLTD
language English
sources NDLTD
topic Language testing
CALL
Oral proficiency assessment
Communicative approach
Test taker characteristics
Validity
spellingShingle Language testing
CALL
Oral proficiency assessment
Communicative approach
Test taker characteristics
Validity
Yu, Eunjyu
A comparative study of the effects of a computerized English oral proficiency test format and a conventional SPEAK test format
author Yu, Eunjyu
author_facet Yu, Eunjyu
author_sort Yu, Eunjyu
title A comparative study of the effects of a computerized English oral proficiency test format and a conventional SPEAK test format
title_short A comparative study of the effects of a computerized English oral proficiency test format and a conventional SPEAK test format
title_full A comparative study of the effects of a computerized English oral proficiency test format and a conventional SPEAK test format
title_fullStr A comparative study of the effects of a computerized English oral proficiency test format and a conventional SPEAK test format
title_full_unstemmed A comparative study of the effects of a computerized English oral proficiency test format and a conventional SPEAK test format
title_sort comparative study of the effects of a computerized english oral proficiency test format and a conventional speak test format
publisher The Ohio State University / OhioLINK
publishDate 2006
url http://rave.ohiolink.edu/etdc/view?acc_num=osu1164601340
work_keys_str_mv AT yueunjyu acomparativestudyoftheeffectsofacomputerizedenglishoralproficiencytestformatandaconventionalspeaktestformat
AT yueunjyu comparativestudyoftheeffectsofacomputerizedenglishoralproficiencytestformatandaconventionalspeaktestformat
_version_ 1719426716622913536