Abstract
该研究通过回顾分析CATTI口译考试二十年的评分员培训实践,借鉴语言测试学的相关研究成果,为大规模、高风险的口译资格考试提出了一个贯穿评分全过程的评分员培训机制。首先,评前培训应坚持标准化流程,确保评分员对评分标准和评分量表理解准确,并就评分细则和参考译文达成共识。其次,评中培训应采取具体化措施,通过实时监督和再培训及时纠正评分误差,提高评分员评分的信度。此外,文章建议开展常态化的评后培训,及时巩固评分员的评分能力,保证评分信度的可持续性和评分质量的延续性。该研究旨在提升CATTI口译考试的评分信度和评分质量,为科学、公正的翻译人才评价提供有力支持。
By reviewing and analyzing twenty years of rater training practices for the CATTI Test for Interpreters and drawing on relevant research findings in language testing, this study proposed a comprehensive rater training mechanism for large-scale, high-stakes interpreting accreditation examinations. Firstly, standardized procedures should be followed in pre-rating training to ensure raters have a clear understanding of the rating criteria, scales, and rubrics, and reach a consensus on reference translations. Secondly, concrete measures should be implemented in the while-rating training to enhance rater reliability by promptly correcting rating errors through real-time monitoring and retraining. Additionally, regular post-rating training is recommended to reinforce raters' rating abilities, ensuring the long-term reliability and quality of the ratings. The objective of this study is to improve the rating reliability and quality of the CATTI Test for Interpreters, providing robust support for fair and objective evaluation of translation talents.
By reviewing and analyzing twenty years of rater training practices for the CATTI Test for Interpreters and drawing on relevant research findings in language testing, this study proposed a comprehensive rater training mechanism for large-scale, high-stakes interpreting accreditation examinations. Firstly, standardized procedures should be followed in pre-rating training to ensure raters have a clear understanding of the rating criteria, scales, and rubrics, and reach a consensus on reference translations. Secondly, concrete measures should be implemented in the while-rating training to enhance rater reliability by promptly correcting rating errors through real-time monitoring and retraining. Additionally, regular post-rating training is recommended to reinforce raters' rating abilities, ensuring the long-term reliability and quality of the ratings. The objective of this study is to improve the rating reliability and quality of the CATTI Test for Interpreters, providing robust support for fair and objective evaluation of translation talents.
| Translated title of the contribution | Research on the Rater Training Mechanism of Interpreting Accreditation Examinations: A Retrospective Analysis of the CATTI Test in the Past 20 Years |
|---|---|
| Original language | Chinese (Simplified) |
| Pages (from-to) | 56-61, 116 |
| Number of pages | 7 |
| Journal | 外语电化教学 = Technology Enhanced Foreign Language Education |
| Volume | 2024 |
| Issue number | 3 |
| DOIs | |
| Publication status | Published - 20 Jun 2024 |
| Externally published | Yes |
Funding
基金项目:国家留学基金委青年骨干教师出国研修项目“翻译职业化与翻译资格考试研究” (项目编号:202106275016) 的阶段性成果
Keywords
- 全国翻译专业资格(水平)考试
- 口译资格考试
- 评分信度
- 评分员培训
- 回顾式分析
- China Accreditation Test for Trans- lators and Interpreters (CATTI)
- Interpreting Accreditation Examination
- Rating Reliability
- Rater Training
- Retrospective Analysis