Language testing and international intelligibility : a Hong Kong case study

Andrew SEWELL*

*Corresponding author for this work

Research output: Journal PublicationsJournal Article (refereed)Researchpeer-review

6 Citations (Scopus)

Abstract

A central issue in language testing is the choice of norms, and the need to reconcile notions of “standard” English with local language norms and features. Data from studies of international intelligibility indicate that some features of “standard” language descriptions, based on native-speaker language use, are not essential for successful communication. A specific question in test design is thus the extent to which descriptors and rater decisions reflect native-speaker, as opposed to local, language norms. This article takes a case study approach by focusing on a speaking test used in Hong Kong. It analyses published examiner comments from 12 examination sessions between 2003 and 2011 and compares them with criteria for international intelligibility. It also analyses the distribution of the comments among various segmental and suprasegmental phonological categories and relates this to intelligibility research and to theoretical considerations. The study critically evaluates the concept of “intelligibility” and considers its relevance for language testing, and revisits certain aspects of the “local norms” debate. The findings of the study suggest that what examiners notice is generally also what is important for international intelligibility, although the importance of certain suprasegmental features is questionable from an intelligibility standpoint.
Original languageEnglish
Pages (from-to)423-443
Number of pages21
JournalLanguage Assessment Quarterly
Volume10
Issue number4
Early online date11 Dec 2013
DOIs
Publication statusPublished - 2013

Fingerprint

Hong Kong
language
examiner
standard language
speaking
Intelligibility
Language Testing
examination
communication
Native Speaker
Local Language

Cite this

@article{85f0ab2075a047369edf02e2839b48c4,
title = "Language testing and international intelligibility : a Hong Kong case study",
abstract = "A central issue in language testing is the choice of norms, and the need to reconcile notions of “standard” English with local language norms and features. Data from studies of international intelligibility indicate that some features of “standard” language descriptions, based on native-speaker language use, are not essential for successful communication. A specific question in test design is thus the extent to which descriptors and rater decisions reflect native-speaker, as opposed to local, language norms. This article takes a case study approach by focusing on a speaking test used in Hong Kong. It analyses published examiner comments from 12 examination sessions between 2003 and 2011 and compares them with criteria for international intelligibility. It also analyses the distribution of the comments among various segmental and suprasegmental phonological categories and relates this to intelligibility research and to theoretical considerations. The study critically evaluates the concept of “intelligibility” and considers its relevance for language testing, and revisits certain aspects of the “local norms” debate. The findings of the study suggest that what examiners notice is generally also what is important for international intelligibility, although the importance of certain suprasegmental features is questionable from an intelligibility standpoint.",
author = "Andrew SEWELL",
year = "2013",
doi = "10.1080/15434303.2013.824974",
language = "English",
volume = "10",
pages = "423--443",
journal = "Language Assessment Quarterly",
issn = "1543-4303",
publisher = "Routledge",
number = "4",

}

Language testing and international intelligibility : a Hong Kong case study. / SEWELL, Andrew.

In: Language Assessment Quarterly, Vol. 10, No. 4, 2013, p. 423-443.

Research output: Journal PublicationsJournal Article (refereed)Researchpeer-review

TY - JOUR

T1 - Language testing and international intelligibility : a Hong Kong case study

AU - SEWELL, Andrew

PY - 2013

Y1 - 2013

N2 - A central issue in language testing is the choice of norms, and the need to reconcile notions of “standard” English with local language norms and features. Data from studies of international intelligibility indicate that some features of “standard” language descriptions, based on native-speaker language use, are not essential for successful communication. A specific question in test design is thus the extent to which descriptors and rater decisions reflect native-speaker, as opposed to local, language norms. This article takes a case study approach by focusing on a speaking test used in Hong Kong. It analyses published examiner comments from 12 examination sessions between 2003 and 2011 and compares them with criteria for international intelligibility. It also analyses the distribution of the comments among various segmental and suprasegmental phonological categories and relates this to intelligibility research and to theoretical considerations. The study critically evaluates the concept of “intelligibility” and considers its relevance for language testing, and revisits certain aspects of the “local norms” debate. The findings of the study suggest that what examiners notice is generally also what is important for international intelligibility, although the importance of certain suprasegmental features is questionable from an intelligibility standpoint.

AB - A central issue in language testing is the choice of norms, and the need to reconcile notions of “standard” English with local language norms and features. Data from studies of international intelligibility indicate that some features of “standard” language descriptions, based on native-speaker language use, are not essential for successful communication. A specific question in test design is thus the extent to which descriptors and rater decisions reflect native-speaker, as opposed to local, language norms. This article takes a case study approach by focusing on a speaking test used in Hong Kong. It analyses published examiner comments from 12 examination sessions between 2003 and 2011 and compares them with criteria for international intelligibility. It also analyses the distribution of the comments among various segmental and suprasegmental phonological categories and relates this to intelligibility research and to theoretical considerations. The study critically evaluates the concept of “intelligibility” and considers its relevance for language testing, and revisits certain aspects of the “local norms” debate. The findings of the study suggest that what examiners notice is generally also what is important for international intelligibility, although the importance of certain suprasegmental features is questionable from an intelligibility standpoint.

UR - http://commons.ln.edu.hk/sw_master/5608

UR - https://www.scopus.com/inward/record.uri?eid=2-s2.0-84890898461&doi=10.1080%2f15434303.2013.824974&partnerID=40&md5=097d19853c005f1f366919fc0dca5f7e

U2 - 10.1080/15434303.2013.824974

DO - 10.1080/15434303.2013.824974

M3 - Journal Article (refereed)

VL - 10

SP - 423

EP - 443

JO - Language Assessment Quarterly

JF - Language Assessment Quarterly

SN - 1543-4303

IS - 4

ER -