Volume 14, Issue 3
  • ISSN 1871-1340
  • E-ISSN: 1871-1375
Buy:$35.00 + Taxes



This paper introduces a freely available and easy to use Java application for the collection and recording of Cloze probability ratings. Clozapp presents participants with text fragments of the researchers’ choice and collects guesses regarding upcoming words. It can also collect basic demographic information about participants. Available modes of data collection include elicitation of responses to a limited number of omitted words in a text or to all words in a text. Clozeapp can be customized to present instructions and experimental stimuli in any given language and to collect multiple types of demographic data. This paper presents the application by detailing the states and actions available, as well as descriptions of how to customize the app to fit different experimental needs including possible input and output details. The application manual is provided. As a proof of concept, we used Clozapp to conduct a replication study of two existing collections of Cloze probability norms. The Clozapp norms showed strong reliable correlations ( > 0.7) with both existing data sets, suggesting a high convergence between modes of data collection. The application provides an efficient and customizable way of collecting predictability norms for language research.


Article metrics loading...

Loading full text...

Full text loading...


  1. Altarriba, J., Kroll, J. F., Sholl, A., & Rayner, K.
    (1996) The influence of lexical and conceptual constraints on reading mixed-language sentences: Evidence from eye fixations and naming times. Memory & cognition, 24(4), 477–492. 10.3758/BF03200936
    https://doi.org/10.3758/BF03200936 [Google Scholar]
  2. Balota, D. A., Pollatsek, A., & Rayner, K.
    (1985) The interaction of contextual constraints and parafoveal visual information in reading. Cognitive psychology, 17(3), 364–390. 10.1016/0010‑0285(85)90013‑1
    https://doi.org/10.1016/0010-0285(85)90013-1 [Google Scholar]
  3. Bickley, A. C., Ellington, B. J., & Bickley, R. T.
    (1970) The cloze procedure: A conspectus. Journal of Reading Behavior, 2(3), 232–249. 10.1080/10862967009546900
    https://doi.org/10.1080/10862967009546900 [Google Scholar]
  4. Ehrlich, S. F., & Rayner, K.
    (1981) Contextual effects on word perception and eye movements during reading. Journal of verbal learning and verbal behavior, 20(6), 641–655. 10.1016/S0022‑5371(81)90220‑6
    https://doi.org/10.1016/S0022-5371(81)90220-6 [Google Scholar]
  5. Inhoff, A. W.
    (1984) Two stages of word processing during eye fixations in the reading of prose. Journal of verbal learning and verbal behavior, 23(5), 612–624. 10.1016/S0022‑5371(84)90382‑7
    https://doi.org/10.1016/S0022-5371(84)90382-7 [Google Scholar]
  6. Jonz, J.
    (1976) Improving on the basic egg: The M-C Cloze. Language Learning, 26(2), 255–265. 10.1111/j.1467‑1770.1976.tb00276.x
    https://doi.org/10.1111/j.1467-1770.1976.tb00276.x [Google Scholar]
  7. Jones, C. & McRoy, S.
    (2003) The Cloze Test Project User’s Manual. Retrieved from: dreuarchive.cra.org/2003/Jones/UserManual.html
  8. Klare, G. R., Sinaiko, H. W., & Stolurow, L. M.
    (1972) The cloze procedure: A convenient readability test for training materials and translations. Applied Psychology, 21(2), 77–105. 10.1111/j.1464‑0597.1972.tb00272.x
    https://doi.org/10.1111/j.1464-0597.1972.tb00272.x [Google Scholar]
  9. Rayner, K., & Well, A. D.
    (1996) Effects of contextual constraint on eye movements in reading: A further examination. Psychonomic Bulletin & Review, 3(4), 504–509. 10.3758/BF03214555
    https://doi.org/10.3758/BF03214555 [Google Scholar]
  10. Rayner, S.
    (1998) Educating Pupils with Emotional And Behaviour Difficulties: Pedagogy Is the Key!. Emotional and Behavioural Difficulties, 3(2), 39–47. 10.1080/1363275980030206
    https://doi.org/10.1080/1363275980030206 [Google Scholar]
  11. Reichle, E. D., Pollatsek, A., Fisher, D. L., & Rayner, K.
    (1998) Toward a model of eye movement control in reading. Psychological review, 105(1), 125. 10.1037/0033‑295X.105.1.125
    https://doi.org/10.1037/0033-295X.105.1.125 [Google Scholar]
  12. Schnoebelen, T., & Kuperman, V.
    (2010) Using Amazon mechanical turk for linguistic research. Psihologija, 43(4), 441–464. 10.2298/PSI1004441S
    https://doi.org/10.2298/PSI1004441S [Google Scholar]
  13. Schustack, M. W., Ehrlich, S. F., & Rayner, K.
    (1987) Local and global sources of contextual facilitation in reading. Journal of Memory and Language, 26(3), 322–340. 10.1016/0749‑596X(87)90117‑3
    https://doi.org/10.1016/0749-596X(87)90117-3 [Google Scholar]
  14. Smith, N. J., & Levy, R.
    (2013) The effect of word predictability on reading time is logarithmic. Cognition, 128(3), 302–319. 10.1016/j.cognition.2013.02.013
    https://doi.org/10.1016/j.cognition.2013.02.013 [Google Scholar]
  15. Staub, A.
    (2015) The effect of lexical predictability on eye movements in reading: Critical review and theoretical interpretation. Language and Linguistics Compass, 9(8), 311–327. 10.1111/lnc3.12151
    https://doi.org/10.1111/lnc3.12151 [Google Scholar]
  16. Staub, A., Grant, M., Astheimer, L., & Cohen, A.
    (2015) The influence of cloze probability and item constraint on cloze task response time. Journal of Memory and Language, 82, 1–17. 10.1016/j.jml.2015.02.004
    https://doi.org/10.1016/j.jml.2015.02.004 [Google Scholar]
  17. Taylor, W. L.
    (1956) Recent developments in the use of “Cloze Procedure”. Journalism Quarterly, 33(1), 42–99. 10.1177/107769905603300106
    https://doi.org/10.1177/107769905603300106 [Google Scholar]
  18. Zola, D.
    (1984) Redundancy and word perception during reading. Perception & Psychophysics, 36(3), 277–284. 10.3758/BF03206369
    https://doi.org/10.3758/BF03206369 [Google Scholar]

Data & Media loading...

  • Article Type: Research Article
Keyword(s): Cloze probability; manual; predictability; software application
This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error