Exploring Listening Assessment in a Colombian EFL Context: A Case Study

Main Article Content

Ana Gutiérrez-Rojas
https://orcid.org/0000-0003-3950-4487
Nayibe Rosado-Mendinueta
https://orcid.org/0000-0003-1865-2464

Abstract

Listening comprehension is a crucial skill in English as a Foreign Language education, yet listening assessment still needs to be explored. This study aims to understand how listening is assessed in a Colombian private language institution and its potential connection to students' underperformance in listening proficiency tests. We characterize the listening assessment used in B1-level classes through a descriptive case study. Utilizing a rubric, we analyzed fourteen listening tasks from various sources, including course materials and a mock PET exam. Our analysis had two primary objectives: (a) to uncover the rationale behind test design and its alignment with the curriculum, and (b) to evaluate the knowledge types targeted and the forms of listening assessment employed using categorization. Our findings reveal that despite the curriculum's holistic listening development goals, assessments predominantly focus on phonological knowledge through dictation tests, in which students primarily engage with audio media and recordings. These findings suggest a misalignment in the way listening is approached during the whole course, the examinations used to assess listening during the B1 level, and the use of an external standardized test as the exit exam. This study holds potential implications for curriculum alignment and the enhancement of language assessment literacy within our context, shedding light on potential factors contributing to students' underperformance in listening comprehension.




Article Details

How to Cite
Gutiérrez-Rojas, A., & Rosado-Mendinueta, N. (2024). Exploring Listening Assessment in a Colombian EFL Context: A Case Study. HOW, 31(1), 37–66. https://doi.org/10.19183/how.31.1.694 (Original work published March 4, 2024)
Section
Research Reports
Author Biographies

Ana Gutiérrez-Rojas, Universidad del Norte

She is an English teacher and a master student at Universidad del Norte in Colombia. Her research interests include L2 Listening comprehension and assessment.

Nayibe Rosado-Mendinueta, Universidad del Norte

She is a language teacher and teacher educator at Universidad del Norte in Colombia. Her research interests reside in the intersection of students and teacher learning and how language affects the construction of reality in contexts such as classrooms and in other institutions that surround us.  

References

Alderson, C., & Wall, D. (1993). Does washback exist? Applied Linguistics, 14(2), 115–129. https://doi.org/10.1093/applin/14.2.115

Bachman, L. F., & Palmer, A. S. (1996). Language testing in practice: Designing and developing useful language tests. Oxford University Press.

Ballesteros-Muñoz, L., & Tutistar-Jojoa, S. (2014). How setting goals enhances learners’ self-efficacy beliefs in listening comprehension. HOW Journal, 21(1), 42-61. https://doi.org/10.19183/how.21.1.14

Bhattacharya, K. (2009). Othering Research, Researching the Other: De/Colonizing Approaches to Qualitative Inquiry. In J. c. Smart (Eds.), Higher education: handbook of theory and research. higher education (Vol. 24, pp, 105-150). Springer, Dordrecht. https://doi.org/10.1007/978-1-4020-9628-0_3

Brown, H. D. (2004). Language Assessment: Principles and Classroom Practices. Longman.

Brown, H. D., & Abeywickrama, P. (2010). Language assessment: Principles and classroom practices (2nd ed.). Pearson Education.

Buck, G. (2001). Assessing listening. Cambridge University Press.

Cárcamo-Morales, B. (2018). Types of listening comprehension developed in the Chilean EFL textbook Global English. Colombian Applied Linguistics Journal, 20(1), 49-61. https://doi.org/10.14483/22487085.12313

Córdoba-Zúñiga, E., & Rangel-Gutiérrez, E. (2018). Promoting listening fluency in pre-intermediate EFL learners through meaningful oral tasks. Profile: Issues in Teachers’ Professional Development, 20(2), 161-177. https://doi.org/10.15446/profile.v20n2.62938

Council of Europe. (2001). Common European Framework of Reference for Languages: Learning, Teaching, Assessment (1st ed.). Cambridge University Press.

Field, J. (2003). Promoting perception: Lexical segmentation in L2 listening. ELT Journal, 57(4), 325-334.

Gamboa-Mena, R., & Sevilla-Morales, H. (2015). The impact of teacher training on the assessment of listening skills. LETRAS, (57), 77-102.

Giraldo, F. (2018). Language assessment literacy: Implications for language teachers. Profile: Issues in Teachers’ Professional Development, 20(1), 179-195. https://doi.org/10.15446/profile.v20n1.62089

Giraldo, F. (2021a). Language assessment literacy and teachers’ professional development: A review of the literature. Profile: Issues in Teachers’ Professional Development, 23(2), 265–279. https://doi.org/10.15446/profile.v23n2.90533

Giraldo, F. (2021b). Language assessment literacy: Insights for educating English language teachers through assessment. HOW Journal, 28(3), 78–92. https://doi.org/10.19183/how.28.3.673

Giraldo, F., Escalante-Villa, D., & Isaza-Palacio, D. (2023). English teachers’ perceptions of a language assessment literacy course. HOW Journal, 30(2), 70–91. https://doi.org/10.19183/how.30.2.750

Giraldo, F., & Murcia, D. (2018). Language assessment literacy for pre-service teachers: Course expectations from different stakeholders. GiST: Education and Learning Research Journal, 16, 56-77. https://doi.org/10.26817/16925777.425

Giraldo, F., & Murcia, D. (2019). Language assessment literacy and the professional development of pre-service language teachers. Colombian Applied Linguistics Journal, 21(2), pp. 243-259. https://doi.org/10.14483/22487085.14514

Green, R. (2019). Designing Listening Tests. Palgrave Macmillan.

Hernández-Ocampo, S. P., & Vargas, M. C. (2013). Encouraging students to enhance their listening performance. Profile Issues in Teachers’ Professional Development, 15(2), 199-214.

Hughes, A. (2003). Testing for language teachers (2nd ed.). Cambridge University Press.

Islam, M. A., & Aldaihani, F. M. F. (2022). Justification for adopting qualitative research method, research approaches, sampling strategy, sample size, interview method, saturation, and data analysis. Journal of International Business and Management, 5(1), 01-11.

Jiménez, M., Rodríguez, C., & Rey Paba, L. (2017). Standardized test results: An opportunity for English program improvement. HOW Journal, 24(2), 121-140. http://dx.doi.org/10.19183/how.24.2.335

Latimer, D. G. (2009). Washback effects of the Cambridge Preliminary English Test at an Argentinean bilingual school [Doctoral dissertation]. University of Georgia.

McKinley, J., & Thompson, G. (2018). Washback effect in teaching English as an international language. The TESOL Encyclopedia of English Language Teaching, 1–12. https://doi.org/10.1002/9781118784235.eelt0656

Mayora, C. A. (2017). Extensive listening in a Colombian university: Process, product, and perceptions. HOW Journal, 24(1), 101-121. https://doi.org/10.19183/how.24.1.311

Malone, M. (2011). Assessment literacy for language educators. CALDigest, October, 1-2.

Merifield, S., Holmes, L., Walker, S., Wyatt, R., & Walter, C. (2015). Navigate: Pre-intermediate B1: Teacher’s Guide with Teacher’s Support and Resource Disc. Oxford University Press.

Merriam, S. (1988). Case study research in education: A qualitative approach. Jossey-Bass.

Morales, A., & Beltrán, A. M. (2006). Developing listening through the use of authentic material. HOW Journal, 13(1), 101-124. https://www.howjournalcolombia.org/index.php/how/article/view/110

Mousavi, S. A. (2009). An encyclopedic dictionary of language testing (4th ed.). Rahnama Publications.

Preliminary English Test: Handbook. (2005). University of Cambridge ESOL Examinations.

Rost, M. (2011). Teaching and researching listening (2nd ed.). Longman.

Stake, R. E. (2005). Qualitative Case Studies. In N. K. Denzin & Y. S. Lincoln (Eds.), The Sage Handbook of qualitative research (pp. 443–466). Sage Publications Ltd.

Sevilla-Morales, H., & Chaves-Fernandez, L. (2019). Authentic assessment in the listening comprehension classroom: Benefits and implications. GIST – Education and Learning Research Journal, (19), 6-30. https://doi.org/10.26817/16925777.704

Worthington, D. L., & Bodie, G. D. (2017). The sourcebook of listening research: Methodology and measures. John Wiley & Sons.

Yin, R. K. (2013). Case study research: Design and methods (5th). Sage.