Reading comprehension as a complex phenomenon. An approach based on assessment, inference, and foreign language
DOI:
https://doi.org/10.6092/issn.1970-2221/9401Keywords:
Multiple-choice Tests, Generalized Linear Mixed Models, Education, Logic, LinguisticsAbstract
As foreign language teachers, we have observed that reading comprehension is a complex phenomenon worth studying. Here, we address reading comprehension from the point of view of several disciplines: education (for assessment), logic (for inference), and linguistics (for foreign language), within an experimental framework. Our goal was to analyze and compare whether the properties of a test (say length, complexity, and inference) and the attributes of a test-taker (say test taking strategies, metacognitive awareness of reading strategies, and academic fields) have an effect on reading comprehension performance in native (Spanish) and foreign language (Italian). A quantitative cross-sectional study was performed on a sample of 35 students from a foreign languages centre; we used generalized linear mixed models to analyse the data. We found that the attributes of the test had an effect on performance in both languages, while the attributes of the test-takers had an effect only in foreign language.
References
Acquaroni, R. (2004). La comprensión lectora. In J. Sánchez Lobato & I. Santos Gargallo (Dirs.), Vademécum para la formación de profesores. Enseñar español como segunda lengua (L2)/lengua extranjera (LE) (pp. 943-964). Madrid: SGEL.
Adler, J. E., & Rips, L. J. (Eds.) (2008). Reasoning. Studies of Human Inference and Its Foundations. Cambridge: Cambridge University Press.
Alderson, J. C. (2000). Assessing reading. Cambridge: Cambridge University Press.
Alderson, J. C., & Urquhart, A. H. (1988). This test is unfair: I’m not an economist. In P. L. Carrell, J. Devine, D. E. Eskey. (Eds.), Interactive approaches to second language reading (pp. 168-182). Cambridge: Cambridge University Press.
Baghaei, P., & Carstensen, C. H. (2013). Fitting the Mixed Rasch Model to a Reading Comprehension Test: Identifying Reader Types. Practical Assessment, Research & Evaluation, 18(5), 1-13.
Bassetti, B., & Cook, V. J. (2011). Language and cognition: The second language user. In V. J. Cook & B. Bassetti (Eds.), Language and bilingual cognition (pp. 143-190). Prepublication. Hove, UK: Psychology Press.
Bates, D., Maechler, M., Bolker, B., Walker, S., Christensen, R.H.B., Singmann, H., Dai, B., Grothendieck, G., & Green, P. (2017). Package: lme4: Linear Mixed-Effects Models using ‘Eigen’ and S4. R package version 1.1–13. Retrieve from
https://CRAN.R-project.org/package=lme4
Bonvino, E., & Faone, S. (2016). Valutare le abilità ricettive, che cosa ci insegna la comprensione tra lingue affini. Italiano a stranieri, Rivista semestrale per l’insegnamento dell’italiano come lingua straniera/seconda, 21, 20-25.
Caçola, P. (2014) Using a Generalized Linear Mixed Model Approach to explore The Role of Age, Motor Proficiency, And Cognitive Styles in Children's Reach Estimation Accuracy. Perceptual & Motor Skills: Perception, 119(2), 530-549. https://doi.org/10.2466%2F27.10.PMS.119c21z0
Cook, R. T. (2009). A Dictionary of Philosophical Logic. Edinburgh: Edinburgh University Press.
Cohen, A. D. (1991). Testing linguistic and communicative proficiency: The case of reading comprehension. In M. E. McGroarty & C. J. Faltis (Eds.), Languages in school and society: Policy and pedagogy (pp. 383-408). Berlin: Mouton de Gruyter.
Cohen, A. D. (1994). Assessing Language Ability in the Classroom (2nd ed.). Boston: Heinle & Heinle Publishers.
Cohen, A. D. (1998). Strategies and processes in test taking and SLA. In L. F. Bachmann & A. D. Cohen (Eds.), Interfaces between second language acquisition and language testing research (pp. 90-111). Cambridge: Cambridge University Press.
Cohen, L., Manion, L. & Morrison, K. (2018). Research Methods in Education (8th ed.). Abingdon: Routledge.
Chujo, K., & Utiyama, M. (2005). Understanding the role of text length, sample size and vocabulary size in determining text coverage. Reading in a Foreign Language, 17(1), 1-22.
Daloiso, M. (2013). Le difficoltà di comprensione del testo scritto in lingua materna e straniera. Un quadro teorico per il recupero della competenza metastrategica. EL.LE, 2(1), 68-87.
Di Bari, M. (2008). ZeroRelativo. La community del baratto on line. Retrieved from http://www.viviconsapevole.it/articolo_stampa.php?id=8795
Douven, I. (2011). Abduction. In E. N. Zalta (Ed.), The Stanford Encyclopedia of Philosophy (Spring ed.). Retrieved from http://plato.stanford.edu/archives/spr2011/entries/abduction/
Ferrari, S. (2003). Comprensione e lettura in L2: uno studio sperimentale sugli effetti della modificazione testuale. In R. Grassi, A. Valentini, & R. Bozzone Costa. (Eds.), L'italiano per lo studio nella scuola plurilingue: tra semplificazione e facilitazione (pp. 85-110). Perugia: Guerra.
Fortus, R., Coriat, R., & Fund, S. (1997). Prediction of item difficulty in the English Subtest of Israel's Inter-university psychometric entrance test. Jerusalem: National Institute of Testing and Evaluation.
García Hernández, T. (1990). La comprensión lectora: la lectura como actividad didáctica. In P. Bello, A. Feria, J. M. Ferrán, T. García Hernández, P. Gómez, M. C. Guerrini, J. López Hernández, D. Martín Catalán, M. M. Martín Viaño, M. R. Martos, C. Mata Barreiro, A. Navarro, R. Palencia, M. Ravera, S. Salaberri, J. M. Sierra, & M. Verdú. Didáctica de las segundas lenguas. Estrategias y recursos básicos. Madrid: Aula XXI Santillana.
Gómez, A., Solaz, J. J., & Sanjosé, V. (2014). Competencia en lengua inglesa de estudiantes universitarios españoles en el contexto del EEES: nivel de dominio lingüístico, estrategias metacognitivas y hábitos lectores. Revista de Educación, 363, 154-183. doi: 10.4438/1988-592X-RE-2012-363-175
Grabe, W. (2009). Reading in a Second Language. Moving from Theory to Practice. New York: Cambridge University Press.
Grabe, W. (2010). Fluency in reading-Thirty-five years later. Reading in a Foreign Language, 22(1), 71-83.
Graffigna, M. L., Luna, A. E., Ortiz, A. M. M., Pelayes, S. A., Rodríguez Manzanares, M. E. & Varela, E. C. (2008). Lectura y comprensión de textos en el nivel superior: un desafío compartido entre alumnos y docentes. Revista Iberoamericana de Educación, 46(2), 2-15.
Guerra, E., & Mellado, G. (2017). A-Book: A Feedback-Based Adaptive System to Enhance Meta-Cognitive Skills during Reading. Frontiers in Human Neuroscience, 11, 98. https://doi.org/10.3389/fnhum.2017.00098
Guerra, J., & Guevara, C. Y. (2017). Variables académicas, comprensión lectora, estrategias y motivación en estudiantes universitarios. Revista Electrónica de Investigación Educativa, 19(2), 78-90. https://doi.org/10.24320/redie.2017.19.2.1125
Hale, G. A. (1988). The Interaction of Student Major-Field Group and Content in TOEFL Reading Comprehension. (TOEFL Research Rep. No. 25). Princeton, NJ: Educational Testing Service.
Hawthorne, J. (2014). Inductive Logic. In E. N. Zalta (Ed.), The Stanford Encyclopedia of Philosophy (Winter 2014 ed.). Retrieved from http://plato.stanford.edu/archives/win2014/entries/logic-inductive
Holmes, W., & Hernandez, M. E. (2016). Regularization Methods for Fitting Linear Models with Small Sample Sizes: Fitting the Lasso Estimator using R. Practical Assessment, Research & Evaluation, 21(7), 1-13. Retrieved from http://pareonline.net/getvn.asp?v=21&n=7
Kintsch, W., & van Dijk, T. A. (1978). Toward a Model of Text Comprehension and Production. Psychological Review, 85(5), 363-394. https://doi.org/10.1037/0033-295X.85.5.363
Korecky-Kröll, K., & Buchegger, L. (2018). Tagging spatial and temporal PPs with two-way prepositions in adult-child and adult-adult conversation in German in Austria. In A. U. Frank, C. Ivanovic, F. Mambrini, M. Passarotti, & C. Sporleder (Eds.), Proceedings of the Second Workshop on Corpus-based Research in the Humanities (CRH-2) (pp. 113-122).Viena: Department of Geoinformation.
Laufer, B. (1991). Similar lexical forms in interlanguage. Tübingen, Germany: Gunter Narr.
Linton, D. L., Pangle, W. M., Wyatt, K. H., Powell, K. N., & Sherwood, R. E. (2014). Identifying key features of effective active learning: the effects of writing and peer discussion. CBE Life Sciences Education, 13(3), 469-77.
López, A., Ropero, J., & Peralta, J. C. (2011). Estudio de validez del examen de Estado Saber 11 de inglés. Folios. Segunda época, 34, 77-91.
Lumbelli, L. (2007). Complex Connective Inference and a Possible Type of Implicature. Lingue e linguaggio, 1, 85-100. doi: 10.1418/24220
Macleod, C. (2018). John Stuart Mill, In E. N. Zalta (Ed.), The Stanford Encyclopedia of Philosophy (Fall 2018 ed.). Retrieved from https://plato.stanford.edu/archives/fall2018/entries/mill/
Mækelæ, J., & Pfuhl, G. (2019). Deliberate reasoning is not affected by language. PLOS ONE, 14(1), 1-13. https://doi.org/10.1371/journal.pone.0211428
Maggioni, V. (2010). L’influenza della L1 nell’apprendimento di lingue affini: analisi delle interferenze linguistiche di ispanofoni apprendenti l'italiano come lingua straniera. Italiano LinguaDue, 2(1), 17-34.
Mangen, A., Walgermo, B. R., & Brønnick, K. (2013). Reading linear texts on paper versus computer screen: Effects on reading comprehension. International Journal of Educational Research, 58, 61-68. https://doi.org/10.1016/j.ijer.2012.12.002
Marangon, G. (2009). Italiano y español: lenguas afines. Importancia de la L1 en el proceso de aprendizaje de la L2. Anacleta Malacitana. (AnMal Electrónica) 27, 185-194.
McMillan, J. (2008). Assessment Essentials for Standards-Based Education (2nd ed.). Thousand Oaks, CA: Corwin Press.
Morin, E. (1999). Seven complex lessons in education for the future. Paris, France: UNESCO. Retrieved from http://unesdoc.unesco.org/images/0011/001177/117740eo.pdf
Mortara Garavelli, B. (2001). Le parole della giustizia. Einaudi: Turin.
Mokhtari, K., & Reichard, C. (2002). Assessing Students’ Metacognitive Awareness of Reading Strategies. Journal of Educational Psychology, 94(2), 249-259. doi: 10.1037//0022-0663.94.2.249
Neldner, K., Crimston, D., Wilks, M., Redshaw, J., & Nielsen, M. (2018). The developmental origins of moral concern: An examination of moral boundary decision making throughout childhood. PLOS ONE, 13(5). https://doi.org/10.1371/journal.pone.0197819
Newell, W. H. (2001). A Theory of Interdisciplinary Studies. Issues in integrative studies. 19(1), 1-25. Retrieved from http://hdl.handle.net/10323/4378
Nicenboim, B., Vasishth, S., Gattei, C., Sigman, M., & Kliegl, R. (2015). Working memory differences in long-distance dependency resolution. Frontiers in Psychology, 6, 312. https://doi.org/10.3389/fpsyg.2015.00312
Paradis, J., Rice, M. L., Crago, M., & Marquis, J. (2008). The Acquisition of Tense in English: Distinguishing child second language from first language and specific language impairment. Applied psycholinguistics, 29(4), 689-722.
Pearson, P. D., & Cervetti, G. N. (2017). The Roots of Reading Comprehension Instruction. In S. E. Israel. (Ed), Handbook of Research on Reading Comprehension (2nd ed., pp. 12-56). New York: The Guilford Press.
Pérez Zorrilla, M. J. (2005). Evaluación de la comprensión lectora: dificultades y limitaciones. Revista de Educación, num. Extraordinario, 121-138.
Pietarinen, A. V., & Bellucci, F. (2016). The Iconic Moment. Towards a Peircean Theory of Diagrammatic Imagination. In J. Redmond, P. Martins, & N. Fernández (Eds.), Epistemology, Knowledge and the Impact of Interaction. Logic, Epistemology, and the Unity of Science, (vol. 38, pp. 463-481). https://doi.org/10.1007/978-3-319-26506-3_21
Pinheiro, H. P., Rodrigues-Motta, M., & Franco, G. (2014). Modelling performance of students with generalized linear mixed models. In T. Kneib, F. Sobotka, J. Fahrenholz, & H. Irmer (Eds.). Proceedings of the 29th International Workshop on Statistical Modelling, (vol. 2, pp. 133-136).
Platas-García, A., Castro-Manzano, J. M., & Reyes-Meza, V. (2016). Razonamiento y heurísticas en pruebas de comprensión lectora./Reasoning and heuristics in reading comprehension tests. Revista de Educación, 371, 157-187. doi: 10.4438/1988-592X-RE-2015-371-312.
Platas-García, A., Castro-Manzano, J. M., Reyes-Meza, V., & Gaona-Gordillo, I. (2018). Influencia de la Longitud, la Complejidad y la Inferencia en la Resolución de Pruebas de Comprensión Lectora Inferencial. Revista Iberoamericana de Evaluación Educativa, 11(1), 73-92. https://doi.org/10.15366/riee2018.11.1.006
R Core Team. (2017). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Retrieved from http://www.R-project.org/
Sabatini, F. (1999). “Rigidità-esplicitezza” vs “elasticità-implicitezza”: possibili parametri massimi per la tipologia dei testi. In G. Skytte & F. Sabatini (Eds.), Linguistica Testuale Comparativa (pp. 141-172).
Todd, P. M. & Gigerenzer, G. (2000). Précis of simple heuristics that make us smart. Behavioral & Brain Sciences, 23, 727-780.
Van Dijk, T. A. (1992). La ciencia del texto. Un enfoque interdisciplinario (3rd ed.). Barcelona: Paidós Comunicación.
Van Dijk, T. A., & Kintsch, W. (1983). Strategies of Discourse Comprehension. New York: Academic Press.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2020 Alejandra Platas-García, J. Martín Castro-Manzano, Verónica Reyes-Meza
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 Unported License.
