Exploring EFL Views about the Value of Test Preparation Exam for TOEFL

Ockey Stansfield; Saehu Abas

doi:10.61227/iltt.v1i1.180

Authors

Ockey Stansfield University of Western Ontario, Canada
Saehu Abas Islamic University of Bunga Bangsa, Cirebon

DOI:

https://doi.org/10.61227/iltt.v1i1.180

Keywords:

Scriven’ model, Task Demands, Test Preparation Exam, TOEFL

Abstract

Test preparation for high-stakes English language tests has attracted growing research attention in the language assessment scope. However, little is known about what aspects of test preparation learners attend to and value. While theoretical and empirical research has focused on test-takers' attitudes toward test preparation and test-taking strategies, adequate attention to broader socio-political and ethical issues remains insufficient. Additionally, there exists a gap between achieving required test scores and actual academic communication abilities. Objective: This study aims to investigate EFL learners' views about the value of TOEFL test preparation courses based on Scriven's (1998, 2007) model that conceptualizes value as merit (intrinsic qualities), worth (contextual cost-effectiveness), and significance (assigned importance). Method: This descriptive study involved in 40 EFL learners enrolled in various academic programs at a University in Canada. The research subjects were students who had successfully gained admission to educational institutions after completing TOEFL preparation and achieving required scores. Results: Findings revealed that quality (merit) was linked to instructor characteristics and teaching methods, benefit (worth) was evaluated through effectiveness and adaptation to TOEFL and English skill development, while importance (significance) included participation in learning communities and motivation to study. Conclusion and Implications: This research provides educational insights for EAP program instructors at a University in Canada to understand students' experiences and perceptions of appropriate and effective English language learning support. The findings are also important given the increasing number of international students who require additional language competencies for academic success.

References

Ahearn, S. (2009). Like cars or breakfast cereal: IELTS and the trade in education and immigration. TESOL in Context, 19(1), 39–51.

Alderson, J. C. & Hamp-Lyons, L. (1996). TOEFL preparation courses: A study of washback. Language Testing, 13(3), 280-297.

Brown, G. T. L. & Hirschfeld, G. H. F. (2008). Students’ conceptions of assessment:

Links to outcomes. Assessment in Education, 15(1), 3-17.

Cheng, L., & Fox, J. (2008). Towards a better understanding of academic acculturation: Second language students in Canadian universities. Canadian Modern Language Review, 65, 307- 333.

Chau, M. (2008). Learning to write essays or teaching to crack tests: An empirical study

investigating the washback and impact of TOEFL test-preparation in China. Paper

presented at the Language Testing Research Colloquium, Hangzhou, China.

Cheng, L., & DeLuca, C. (2011). Voices from test-takers: Further evidence for language assessment validation and use. Educational Assessment, 16(2), 104–122.

Cole, N. (1982). The implications of coaching for ability testing. In A. K. Wigdor & W. R. Garner (Eds.), Ability Testing: Uses, Consequences, and Controversies.

Washington DC: National Academy Press.

Corbin, J., & Strauss, A. (2008). Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory (3rd ed.). Thousand Oaks, CA: Sage.

Deygers, B. (2017). Juts testing: Applying theories of justice to high-stakes language tests. ITL- International Journal of Applied Linguistics, 168(2), 143–163.

Doe, C. & Fox, J. (2011). Exploring the testing process: Three test takers’ observed and reported strategy use over time and testing contexts. Canadian Modern Language Review, 67, 29- 54.

Ferman, I. (2004). The washback effect of an EFL national oral matriculation test to teaching and learning. In L. Cheng, Y. Watanabe, & A. Curtis (Eds.), Washback in language testing: Research contexts and methods. Mahwah, NJ: Lawrence Erlbaum.

Fox, J., & Curtis, A. (2009). International English language testing system. In L. Cheng & A. Curtis (Eds.), English language assessment and the Chinese learner. New York: Routledge, Taylor & Francis Group.

Gan, Z. (2009). IELTS preparation course and student IELTS performance: A case study in Hong Kong. RELC Journal: A Journal of Language Teaching and Research, 40(1), 23- 41.

Hamp-Lyons, L. (1998). Ethical test preparation practices: The case of the TOEFL. TESOL Quarterly, 32(2), 329-337. https://doi.org/10.2307/3587587

Green, A. (2006a). Washback for learners: Learner and teacher perspectives on IELTS preparation course expectations and outcomes. Assessing Writing, 11(2), 113-134.

He, S, Sénécal, A.M., & Suvorov, R. (2025). A scoping review of research on second language test preparation. Language Testing, 42(1) 11–47.

Karjo, C. H. & Ronaldo, D. (2019). The validity of TOEFL as entry and exit college

requirements: Students’ perception. In Proceedings of the Eleventh Conference on Applied Linguistics (CONAPLIN 2018). Atlantis Press.

Lincoln, Y., & Guba, E. G. (1980). The distinction between merit and worth in evaluation. Educational Evaluation and Policy Analysis, 2(4), 61-71.

Liu, O. (2014). Investigating the relationship between test preparation and TOEFL iBT

performance (Report No. RR-14-15). Retrieved from Educational Testing Service: http://onlinelibrary. wiley.com/doi/10.1002/ets2.12016/epdf

Ma, J. (2013). Test preparation for high-stakes English language tests in China. Test

Preparation Research Newsletter, Volume 5. Retrieved from Faculty of Education,

Queen’s University.

Montgomery, P., & Lilly, J. (2012). Systematic reviews of the effects of preparatory courses on university entrance examinations in high school-age students. International Journal of Social Welfare, 21(1), 3-12.

Mickan, P., & Motteram, J. (2009). The preparation practices of IELTS candidates: Case studies (IELTS Research Report, Vol. 10.) Retrieved from

https://www.ielts.org/~/media/research-reports/ ielts_rr_volume10_report5.ashx

Matoush, M. M., & Fu, D. (2012). Tests of English language as significant thresholds for

collegebound Chinese and the washback of test-preparation. Changing English, 19, 111–121.

Im, G.-H. & Cheng, L. (2019). The test of English for international communication (TOEIC®). Language Testing, 36(2), 315-324.

Ranta, L., & Meckelborg, A. (2013). How much exposure to English do international graduate students really get? Measuring language use in a naturalistic setting. Canadian Modern Language Review, 69, 1-33.

Razavipour, K., Gooniband Shoushtari, Z. & Mansoori, M. (2018). The structural invariance of a model of washback to test takers’ perceptions and preparation: The moderating role of institutions. Journal of Teaching Language Skills, 36(4), 171-201.

Samaie, M. & Mohammadi, S. (2017). On the development and validation of a scale of test impact on test takers (TITT). International Journal of Language Testing, 7(2), 155-177.

https://cdn.ov2.com/content/ijlte_1_ov2_com/wp content_138/uploads/2019/07/456- 2017-7-2.pdf

Scriven, M. (2007). The logic of evaluation. In H.V. Hansen, C. W. Tindale, J.A. Blair, R.H. Johnson, & D. M. Godden (Eds.), Dissensus and the search for common ground (Proceedings of the 7th OSSA Conference), CD-ROM (pp. 1-16). Windsor, ON: Ontario Society for the Study of Argumentation.

Smith, C. D., Worsfold, K., Davies, L., Fisher, R. & McPhail, R. (2013). Assessment literacy and student learning: The case for explicitly developing students ‘assessment literacy’. Assessment & Evaluation in Higher Education, 38(1), 44-60.

Scriven, M. (2007). The logic of evaluation. In H.V. Hansen, C. W. Tindale, J.A. Blair, R.H.

Johnson, & D. M. Godden (Eds.), Dissensus and the search for common ground (Proceedings ofthe 7th OSSA Conference), CD-ROM, Windsor, ON: Ontario Society for the Study of Argumentation.

Xie. Q. (2015). Do component weighting and testing method affect time management and approaches to test preparation? A study on the washback mechanism. System, 50(3), 56-68.

Xie, Q. (2011). Is test takers’ perception of assessment demand related to construct validity? International Journal of Testing, 11(4), 324-348.

Xie, Q. & Andrews, S. (2013). Do test design and uses influence test preparation? Testing a model of washback with structural equation modeling. Language Testing, 30(1), 49-70. https://doi.org/10.1177/0265532212442634

Wall, D. (1996). Introducing new tests into traditional systems: Insights from general

education and innovation theory. Language Testing, 13(3), 334-354. https://doi.org/10.1177/026553229601300307

Zareva, A. (2005). What is new in the new TOEFL iBT 2006 test format? Electronic Journal of Foreign Language Teaching, 2(2), 45-57.