Navigating Readability Assessment: Exploring the Dynamics of Classical Formulas
DOI:
https://doi.org/10.59045/nalans.2025.87Keywords:
Audience, language analyser, literacy level, readability formulas, writing compositionsAbstract
Writers often simplify texts using various readability formulas to ensure clear communication with the audience. The idea that readability gauges how easily a text is understood and its accessibility to readers is essential in designing educational materials. In effect, readability indices classify texts in levels and align them with learners’ linguistic competence. This study compares three classic readability formulas: Flesch Reading Ease (FRE), Flesch-Kincaid Grade (FKG), and the Gunning Fog Index (GFI) to examine their applicability and text complexity. Text-Inspector and Complete Lextutor software online programs assess the readability and vocab-profile of (a) academic (b) non-academic, and (c) entertainment texts. Research outcomes report that the academic text was highly difficult (FRE=37.62), the non-academic text had a standard difficulty (FKG=68.11), and the entertainment text was easy to read (GFI=89.51). These results indicate that the three formulas show significant metric approximations, closely linked to intuitive text processing methods. In conclusion, the functionality of these readability formulas illustrates how readability metrics and vocab-profile indices, to some extent, categorized texts in advance, intermediate or elementary, conditioning readers’ comprehension and interpretation of the text. It also provides insights into the type of genre and level of the reader’s proficiency to whom the text is focused.
References
Adhariani, D., & Du Toit, E. (2020). Readability of sustainability reports: evidence from Indonesia. Journal of Accounting in Emerging Economies, 10(4), 621-636. https://doi.org/10.1108/JAEE-10-2019-0194
Allen, D. (2009). A study of the role of relative clauses in the simplification of news texts for learners of English. System, 37 (4), 585-599. https://doi.org/10.1016/j.system.2009.09.004
Asiatidou, K. (2021). Teaching writing to non-native English majors: A new sophistic approach to the purpose and syllabus of first-year writing. Journal of Narrative and Language Studies, 9(18), 397-41. https://nalans.com/index.php/nalans/article/view/401
Baker, J. (2021). Exploring How Rhetorical Organization Contributes to the Readability of Essays. Journal of Language and Education, 7(2), 78-92. https://doi.org/10.17323/jle.2021.11240
Bax, S. (2011). Text Inspector. Centre of Research in English Language Learning and Assessment (CRELLA). University of Bedforshire. https://textinspector.com/
Beier, S., Berlow, S., Boucaud, E., Bylinskii, Z., Cai, T., Cohn, J., Crowley, K., Day, S., Dingler, T., Dobres, J., Healey, J., Jain, R., Jordan, M., Kerr, B., Li, Q., Miller, D., Nobles, S., Papoutsaki, A., Qian, J., & Wolfe, B. (2022). Readability Research: An Interdisciplinary approach. Foundations and Trends in Human–Computer Interaction, 16(4), 214-324. https://doi.org/10.1561/1100000089
Biber, D., & Gray, B. (2016). Grammatical complexity in academic English: Linguistic change in writing. Cambridge University Pres. https://doi.org/10.1017/CBO9780511920776
Cárcamo, B. (2019). Readability and types of questions in Chilean EFL high school textbooks. TESOL Journal, 11(2). https://doi.org/10.1002/tesj.498
Chapman, W., Aronsky, D., Fiszman, M., & Haug, P. (2000). Contribution of a speech recognition system to a computerized pneumonia guideline in the emergency department. In Proceedings of the AMIA Symposium (pp. 131-135). https://pmc.ncbi.nlm.nih.gov/articles/PMC2244086
Cobb, T. (2006). Complete lexical tutor. http://www.lextutor.ca
Cortés, J. (2021). Journal titles and mission statements: Lexical structure, diversity, and readability. Journal of Information Science, 49(5), 1262-1276. https://doi.org/10.1177/01655515211043707
Crossley, S., Yang, H., & McNamara, D. (2014). What’s so simple about simplified texts? A computational and psycholinguistic investigation of text comprehension and text processing. Reading in a Foreign Language, 26(1), 92-113. https://doi.org/10125/66686
Crossley, S., Heintz, A., Choi, J., Batchelor, J., Karimi, M., & Malatinszky, A. (2023). A large-scaled corpus for assessing text readability. Behavior Research Methods, 55, 491-507. https://doi.org/10.3758/s13428-022-01802-x
Dmitrieva, A., Laposhina, A., & Lebedeva, M. (2021). A Comparative study of educational texts for native, foreign, and bilingual young speakers of Russian: Are simplified texts equally simple? Frontiers in Psychology, 12. https://doi.org/10.3389/fpsyg.2021.703690
de Oliveira, L. C., Smith, S. L., Axelrod, D., Diaz, E., & Vicentini, C. (2021). Supporting academic language development for multilingual learners across content areas through the identification of textual features. Journal of Narrative and Language Studies, 9(17), 227-24. https://nalans.com/index.php/nalans/article/view/431
Fitriansyah, N., & Miftah, M. (2020). Positive Connection of Extensive Reading and Writing Fluency in EFL Learning. Linguistics, Literature and English Teaching Journal, 10(2), 44-70. https://doi.org/10.18592/let.v10i2.4137
Flesch, R. (1948). A new readability yardstick. Journal of Applied Psychology, 32, 221-233.
Fulcher, G. (1997). Text difficulty and accessibility: Reading formulae and expert judgement. System, 25(4), 497-513. https://doi.org/10.1016/s0346-251x(97)00048-1
Gopal, R., Mahendran, M., Alhusna, N., Shukor, S. & Neelamegam, K (2021). Readability formulas: An analysis into reading index of prose forms. Studies in English Language and Education, 8(3), 972-985. https://doi.org/10.24815/siele.v8i3.2037
Gómez, P., & Sánchez, A. (2019). Readability indices for the assessment of textbooks: a feasibility study in the context of EFL. Vigo International Journal of Applied Linguistics, 16, 31-52. https://doi.org/10.35869/vial.v0i16.92
Goulart, L., Gray, B., Staples, S., Black, A., Shelton, A., Biber, D., Egbert, J., & Wizner, S. (2020). Linguistic perspectives on register. Annual Review of Linguistics, 6, 435-455. https://doi.org/10.1146/annurev-linguistics-011718-012644
Han, S., Song, D., Xu, L., Ye, Y., Yan, S., Shi, F., ... & Du, H. (2022). Behavior in public open spaces: A systematic review of studies with quantitative research methods. Building and Environment, 223, 109444. https://doi.org/10.1016/j.buildenv.2022.109444
Hidayatillah, N., & Zainil, Y. (2020). The readability of students’ textbook used in semantic and pragmatic course in English language education program of UNP. Journal of English Language Teaching, 9(1), 144-159. https://doi.org/10.24036/jelt.v9i1.107848
Hyland, K. (2021). Teaching and researching writing (4th ed.). New York: Routledge. https://doi.org/10.4324/9781003198451
Ibrahim, K. (2021). Harnessing the engagement of commercial digital games for L2 learning: A pedagogical framework for pre-service teacher training. Journal of Narrative and Language Studies, 9(17), 271-288. https://nalans.com/index.php/nalans/article/view/367
Kincaid, J., Fishburne, R., Rogers, R., & Chissom, B. (1975). Derivation of new readability formulas (Automated Readability Index, Fog Count and Flesch Reading Ease Formula) for Navy enlisted personnel, Research Branch Report 8-75, Millington, TN: Naval Technical Training, U. S. Naval Air Station, Memphis, TN.
Kiselnikov, A., Vakhitova, D., & Kazymova, T. (2020). Coh-metrix readability formulas for an academic text analysis. IOP Conference Series Materials Science and Engineering, 890(1), 012207. https://doi.org/10.1088/1757-899x/890/1/012207
Kiselnikov, A., Vakhitova, D., & Kazymova, T. (2021). Fundamentals of materials (text readability evaluation). E3S Web of Conferences, 274, 12006. https://doi.org/10.1051/e3sconf/202127412006
Kolahi, S. (2012). A comparative study of the readability of English textbooks of translation and their Persian translations. Macrothink Institute, 4(4), 344-361. http://dx.doi.org/10.5296/ijl.v4i4.2737
Kremzer, V. (2021). Academic reflective writing or anecdotal storytelling: a study on pre-service EFL teaching portfolios. European Journal of Teacher Education, 46(4), 580-604. https://doi.org/10.1080/02619768.2021.1961735
Lee, B., & Lee, H. (2023). Traditional readability formulas compared for English. Computer Science. https://arxiv.org/pdf/2301.02975
Lendo, N., Liando, N., & Olii, S. (2021). An Analysis of readability of reading texts on English national examination on junior high school. Journal of English Culture, Language, Literature and Education, 9 (2), 128-143. https://doi.org/10.53682/eclue.v9i2.3013
Luong, A., Nguyen, D., Dinh, D., & Bui, T. (2020). Assessing Vietnamese Text Readability using Multi-Level Linguistic Features. International Journal of Advanced Computer Science and Applications (IJACSA), 11(8), 100-111. https://doi.org/10.14569/ijacsa.2020.0110814
Martinc, M., Pollak, S., & Robnik-Šikonja, M. (2021). Supervised and unsupervised neural approaches to text readability. Computational Linguistics Journal, 47(1), 141-179. https://doi.org/10.1162/coli_a_00398
Morales, S., Álvarez, M., Mora, J. & Ramírez, E. (2020). The implication of age and use of technologies in reading comprehension on Ecuadorian A2 learners in tertiary education. Journal of Science and Research, 5, 518-531. https://doi.org/10.5281/zenodo.4415947
Nevo, E., Vaknin-Nusbaum, V., & Sarid, M. (2024). The transfer effect of vocabulary and morphological awareness intervention on narrative ability in kindergarteners. Early Childhood Education Journal, 52(2), 401-414. https://doi.org/10.1007/s10643-023-01445-3
Nkhobo T., & Chaka, Ch. (2023). Syntactic pattern density, connectives, text easability, and text readability indices in students’ written essays: A Coh-Metrix analysis. Research Papers in Language Teaching and Learning, 13(1), 121-136. https://rpltl.eap.gr/images/2023/RPLTL13.pdf
Ojha, P., Ismail, A., & Kundumani, K. (2021). Perusal of readability with focus on web content understandability. Journal of King Saud University - Computer and Information Sciences, 33(1), 1-10. https://doi.org/10.1016/j.jksuci.2018.03.007
Ortega, L. (2015). Syntactic complexity in L2 writing: Progress and expansion. Journal of Second Language Writing, 29, 82-94, https://doi.org/10.1016/j.jslw.2015.06.008
Rana, J., Gutierrez, P.L., & Oldroyd, J.C. (2021). Quantitative Methods. In: Farazmand, A. (eds) Global Encyclopedia of Public Administration, Public Policy, and Governance (pp. 1-6). Springer, Cham. https://doi.org/10.1007/978-3-319-31816-5_460-1
Ramadhani, R., Aulawi, H., & Ulfa, R.L. (2023). Readability of Reading Texts as Authentic Materials Issued by ChatGPT: A Systemic Functional Perspective. Indonesian Journal of English Language Teaching and Applied Linguistics, 8(2), 149-168. https://files.eric.ed.gov/fulltext/EJ1409206.pdf
Rahmawati, Y. (2014). The readability level of reading texts in the English language textbooks used by the tenth grade. Nama Jurnal, 1(1), 1-6. https://core.ac.uk/download/pdf/230772898.pdf
Romero, N. (2021). Lexical Richness and Readability of English Degree Student’s Writing. [Master dissertation, Technical University of Cotopaxi]. UTC Repository. http://repositorio.utc.edu.ec/handle/27000/8223
Salvador, K. (2010). Impact of extensive reading on Ecuadorian learners’ attitudes toward l2 reading: a qualitative research study. [Master dissertation, ESPOL]. ESPOL Repository. https://www.dspace.espol.edu.ec/retrieve/e1b7d3f5-9808-4cb5-9d62-714985a72d21/D-CSH122.pdf
Shah, R., Mahajan, J., Oydanich, M., & Khouri, A. S. (2022). A comprehensive evaluation of the quality, readability, and technical quality of online information on glaucoma. Ophthalmology Glaucoma, 6(1), 93-99. https://doi.org/10.1016/j.ogla.2022.07.007
Shen, Y. (2017). On improving text readability by creating a personal writing style. English Language Teaching, 10(3), 95. https://doi.org/10.5539/elt.v10n3p95
Siedlecki, L. (2020). Understanding descriptive research designs and methods. Clinical Nurse Specialist, 34(1), 8-12. https://doi.org/10.1097/NUR.0000000000000493
Skvorc, T., Krek, S., Pollak, S., Arhar, S., & Robnik-Sikonja, M. (2019). Predicting Slovene text complexity using readability measures. Digital Humanities and Language Technologies, 59(1), 198-220. https://doi.org/10.51663/pnz.59.1.10
Srisunakrua, T., & Chumworatayee, T. (2019). Readability of Reading Passages in English Textbooks and the Thai National Education English Test: A Comparative Study. Arab World English Journal, 10(2), 257–269. https://dx.doi.org/10.24093/awej/vol10no2.20
Tovar, R. (2022). Syntactic Complexity in Journal Research Article Abstracts Written in English. MEXTESOL, 46(2), 1-12. https://doi.org/10.61871/mj.v46n2-2
Wang, H., Hsiao, W., & Chang, S. (2020). Automatic paper writing based on a RNN and the TextRank algorithm. Applied Soft Computing, 97, 106767. https://doi.org/10.1016/j.asoc.2020.106767
Wang, S., Liu, X. & Zhou, J. (2022). Readability is decreasing in language and linguistics. Scientometrics, 127, 4697-4729. https://doi.org/10.1007/s11192-022-04427-1
Wang, L., Miller, M., Schmitt, M. & Wen, F. (2013). Assessing readability formula differences with written health information materials: Application, results, and recommendations. Research in Social and Administrative Pharmacy, 9: 503-516. http://dx.doi.org/10.1016/j.sapharm.2012.05.009
Yogesh et al. (2021). Setting the future of digital and social media marketing research: Perspectives and research propositions. International Journal of Information Management. 59, 1-37. https://doi.org/10.1016/j.ijinfomgt.2020.102168
Young, D. (1999). Linguistic Simplification of Second Language Reading Material: Effective Instructional Practice? The Modern Language Journal, 83 (3), 350-366. https://www.jstor.org/stable/330258
Yu, J. (2014). A readability study and its relevance to simplification on translations of Lun Yu. CSCanada: Studies in Literature and Language, 9(3), 47-57. https://doi.org/10.3968/5856
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Journal of Narrative and Language Studies
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
How to Cite
