1887
  1. Home
  2. e-Journals
  3. The Mental Lexicon
  4. Volume 18, Issue 3
  5. Article
Volume 18, Issue 3
  • ISSN 1871-1340
  • E-ISSN: 1871-1375
USD
Buy:$35.00 + Taxes

Abstract

Abstract

The present paper investigates the interaction between eye movements, voice articulation and the movements of the index finger dynamically pointing to a text line in oral of Italian. During finger-point reading, the finger appears to be ahead of the voice most of the times, by a margin that is significantly modulated by the distribution of phrasal and prosodic units in the reading text. Eye movements replicate the same effects on a different time scale. The eye is ahead of both voice and finger by a wide margin (confirming evidence observed for English and German sentence reading), while showing a tendency to re-synchronise with voice articulation at the right edge of strong prosodic units (sentence boundaries). Our evidence suggests a multicomponent view of the time span between the eye/finger and the voice. The span is shown to be the dynamic outcome of an reading strategy, resulting from the interaction between individual decoding skills, the reader’s phonological buffer capacity, and the structural complexity of a reading text. Proficient readers modulate their span to compensate for the different timing between word fixation and word articulation, read faster, and dynamically adjust their processing window to the meaningful, prosodic units of a text.

© John Benjamins Publishing Company
Loading

Article metrics loading...

/content/journals/10.1075/ml.00025.nad
2024-03-12
2024-12-14

  • From This Site

    /content/journals/10.1075/ml.00025.nad
    dcterms_title,dcterms_subject,pub_keyword
    -contentType:Journal -contentType:Contributor -contentType:Concept -contentType:Institution
    10
    5
Loading full text...

Full text loading...

References

  1. Abney, S. P.
    (1991) Parsing by chunks. InR. C. Berwick (Ed.), Principle-based parsing (pp.257–278). Springer. 10.1007/978‑94‑011‑3474‑3_10
     https://doi.org/10.1007/978-94-011-3474-3_10 [Google Scholar]
  2. Attardi, G.
    (2006) Experiments with a multilanguage non-projective dependency parser. InThe 10th International Conference on Computational Natural Language Learning (CoNLL-X2006) (pp.166–170). New York.
     [Google Scholar]
  3. Baddeley, A.
    (2007) Working memory, thought, and action (Vol.451). OuP Oxford. 10.1093/acprof:oso/9780198528012.001.0001
     https://doi.org/10.1093/acprof:oso/9780198528012.001.0001 [Google Scholar]
  4. Bates, D., Maechler, M., Bolker, B., Walker, S., Christensen, R. H. B., Singmann, H.
    , … others (2009) Package ‘lme4’. r-pro ject.org.
     [Google Scholar]
  5. Brainard, D. H.
    (1997) The psychophysics toolbox. Spatial vision, 10 (4), 433–436. 10.1163/156856897X00357
     https://doi.org/10.1163/156856897X00357 [Google Scholar]
  6. Breen, M.
    (2014) Empirical investigations of the role of implicit prosody in sentence processing. Language and Linguistics Compass, 8 (2), 37–50. 10.1111/lnc3.12061
     https://doi.org/10.1111/lnc3.12061 [Google Scholar]
  7. Breen, M., Kaswer, L., Van Dyke, J. A., Krivokapić, J., & Landi, N.
    (2016) Imitated prosodic fluency predicts reading comprehension ability in good and poor high school readers. Frontiers in psychology, 71, 1026. 10.3389/fpsyg.2016.01026
     https://doi.org/10.3389/fpsyg.2016.01026 [Google Scholar]
  8. Brysbaert, M., & Stevens, M.
    (2018) Power analysis and effect size in mixed effects models: A tutorial. Journal of cognition, 1 (1). 10.5334/joc.10
     https://doi.org/10.5334/joc.10 [Google Scholar]
  9. Buswell, G. T.
    (1920) An experimental study of the eye-voice span in reading. Journal of Educational Psychology, 4 (12), 217–227.
     [Google Scholar]
  10. (1921) The relationship between eye-perception and voice-response in reading. Journal of Educational Psychology, 12 (4), 217–227. 10.1037/h0070548
     https://doi.org/10.1037/h0070548 [Google Scholar]
  11. Carr, J. W., Pescuma, V. N., Furlan, M., Ktori, M., & Crepaldi, D.
    (2021) Algorithms for the automated correction of vertical drift in eye-tracking data. Behavior Research Methods, 1–24.
     [Google Scholar]
  12. Cohen, J. D., Servan-Schreiber, D., & McClelland, J. L.
    (1992) A parallel distributed processing approach to automaticity. The American journal of psychology, 239–269. 10.2307/1423029
     https://doi.org/10.2307/1423029 [Google Scholar]
  13. Crepaldi, D., Ferro, M., Marzi, C., Nadalini, A., Pirrelli, V., & Taxitari, L.
    (2022) Finger movements and eye movements during adults’ silent and oral reading. InR. Levie, A. Bar-On, O. Ashkenazi, E. Dattner, & G. Brandes (Eds.), Developing Language and Literacy: Studies in Honor of Dorit Diskin Ravid (pp.443–471). Springer International Publishing. 10.1007/978‑3‑030‑99891‑2_17
     https://doi.org/10.1007/978-3-030-99891-2_17 [Google Scholar]
  14. Dell’Orletta, F., Federico, M., Lenci, A., Montemagni, S., & Pirrelli, V.
    (2007) Maximum Entropy for Italian PoS Tagging. Intelligenza Artificiale, 4 (2).
     [Google Scholar]
  15. Dell’Orletta, F., Montemagni, S., & Venturi, G.
    (2011) READ-IT: Assessing readability of Italian texts with a view to text simplification. InProceedings of the second workshop on Speech and Language Processing for Assistive Technologies (pp.73–83).
     [Google Scholar]
  16. De Luca, M., Pontillo, M., Primativo, S., Spinelli, D., & Zoccolotti, P.
    (2013) The eye-voice lead during oral reading in developmental dyslexia. Frontiers in human neuroscience, 71, 696. 10.3389/fnhum.2013.00696
     https://doi.org/10.3389/fnhum.2013.00696 [Google Scholar]
  17. Drieghe, D., Rayner, K., & Pollatsek, A.
    (2008) Mislocated fixations can account for parafoveal-on-foveal effects in eye movements during reading. Quarterly Journal of Experimental Psychology, 61 (8), 1239–1249. 10.1080/17470210701467953
     https://doi.org/10.1080/17470210701467953 [Google Scholar]
  18. Federici, S., Montemagni, S., & Pirrelli, V.
    (1996) Shallow Parsing and Text Chunking: a View on Underspecification in Syntax. Proceedings of ESSLLI’96 Workshop on Robust Parsing, 35–44.
     [Google Scholar]
  19. Ferro, M., Cappa, C., Giulivi, S., Marzi, C., Nahli, O., Cardillo, F. A., & Pirrelli, V.
    (2018) Readlet: Reading for understanding. InProceedings of 5th IEEE Congress on Information Science & Technology (IEEE CiST’18). Marrakech, Morocco. 10.1109/CIST.2018.8596412
     https://doi.org/10.1109/CIST.2018.8596412 [Google Scholar]
  20. Fuchs, L. S., Fuchs, D., Hosp, M. K., & Jenkins, J. R.
    (2001) Oral reading fluency as an indicator of reading competence: A theoretical, empirical, and historical analysis. Scientific studies of reading, 5(3), 239–256. 10.1207/S1532799XSSR0503_3
     https://doi.org/10.1207/S1532799XSSR0503_3 [Google Scholar]
  21. Gathercole, S. E.
    (2006) Nonword repetition and word learning: The nature of the relationship. Applied psycholinguistics, 27 (4), 513–543. 10.1017/S0142716406060383
     https://doi.org/10.1017/S0142716406060383 [Google Scholar]
  22. Grabe, W., & Stoller, F. L.
    (2019) Teaching and researching reading (3rd ed.). Routledge. 10.4324/9781315726274
     https://doi.org/10.4324/9781315726274 [Google Scholar]
  23. Hughes, B., McClelland, A., & Henare, D.
    (2014) On the nonsmooth, nonconstant velocity of braille reading and reversals. Scientific Studies of Reading, 18 (2), 94–113. 10.1080/10888438.2013.802203
     https://doi.org/10.1080/10888438.2013.802203 [Google Scholar]
  24. Huovinen, E., Ylitalo, A.-K., & Puurtinen, M.
    (2018) Early attraction in temporally controlled sight reading of music. Journal of Eye Movement Research, 11 (2), 1–30. 10.16910/jemr.11.2.3
     https://doi.org/10.16910/jemr.11.2.3 [Google Scholar]
  25. Hyönä, J., & Bertram, R.
    (2004) Do frequency characteristics of nonfixated words influence the processing of fixated words during reading?European Journal of Cognitive Psychology, 16 (1–2), 104–127. 10.1080/09541440340000132
     https://doi.org/10.1080/09541440340000132 [Google Scholar]
  26. Inhoff, A. W., Solomon, M., Radach, R., & Seymour, B. A.
    (2011) Temporal dynamics of the eyevoice span and eye movement control during oral reading. Journal of Cognitive Psychology, 23 (5), 543–558. 10.1080/20445911.2011.546782
     https://doi.org/10.1080/20445911.2011.546782 [Google Scholar]
  27. Inhoff, A. W., Starr, M., & Shindler, K. L.
    (2000) Is the processing of words during eye fixations in reading strictly serial?Perception & Psychophysics, 62 (7), 1474–1484. 10.3758/BF03212147
     https://doi.org/10.3758/BF03212147 [Google Scholar]
  28. Kentner, G., & Vasishth, S.
    (2016) Prosodic focus marking in silent reading: effects of discourse context and rhythm. Frontiers in Psychology, 71, 319. 10.3389/fpsyg.2016.00319
     https://doi.org/10.3389/fpsyg.2016.00319 [Google Scholar]
  29. Kliegl, R., Nuthmann, A., & Engbert, R.
    (2006) Tracking the mind during reading: The influence of past, present, and future words on fixation durations. Journal of experimental psychology: General, 135 (1), 12. 10.1037/0096‑3445.135.1.12
     https://doi.org/10.1037/0096-3445.135.1.12 [Google Scholar]
  30. Kumle, L., Võ, M. L.-H., & Draschkow, D.
    (2021) Estimating power in (generalized) linear mixed models: An open introduction and tutorial in r. Behavior research methods, 53 (6), 2528–2543. 10.3758/s13428‑021‑01546‑0
     https://doi.org/10.3758/s13428-021-01546-0 [Google Scholar]
  31. Laubrock, J., & Kliegl, R.
    (2015) The eye-voice span during reading aloud. Frontiers in psychology, 61, 1432. 10.3389/fpsyg.2015.01432
     https://doi.org/10.3389/fpsyg.2015.01432 [Google Scholar]
  32. Lawson, E. A.
    (1961) A note on the influence of different orders of approximation to the english language upon eye-voice span. Quarterly Journal of Experimental Psychology, 13 (1), 53–55. 10.1080/17470216108416469
     https://doi.org/10.1080/17470216108416469 [Google Scholar]
  33. Lenci, A., Montemagni, S., & Pirrelli, V.
    (2003) “Chunk-it”. An Italian Shallow Parser for Robust Syntactic Annotation. Linguistica Computazionale, XVIII–XIX1, 353–386.
     [Google Scholar]
  34. Levin, H., & Cohn, J. A.
    (1968) Effects of instruction on the eye-voice span. InH. Levin, E. J. Gibson, & J. J. Gibson (Eds.), The analysis of reading skills: A program of basic and applied research. final report (pp.254–283). Ithaca, New York: Cornell University.
     [Google Scholar]
  35. Levin, H., & Turner, E. A.
    (1968) Sentence structure and the eye-voice span. InH. Levin, E. J. Gibson, & J. J. Gibson (Eds.), The analysis of reading skills: A program of basic and applied research. final report (pp.196–220). Ithaca, New York: Cornell University.
     [Google Scholar]
  36. Lim, Y., Park, J. M., Rhyu, S.-Y., Chung, C. K., Kim, Y., & Yi, S. W.
    (2019) Eye-hand span is not an indicator of but a strategy for proficient sight-reading in piano performance. Scientific Reports, 9 (1), 1–11. 10.1038/s41598‑019‑54364‑y
     https://doi.org/10.1038/s41598-019-54364-y [Google Scholar]
  37. Lio, G., Fadda, R., Doneddu, G., Duhamel, J.-R., & Sirigu, A.
    (2019) Digit-tracking as a new tactile interface for visual perception analysis. Nature Communications, 10 (5392), 1–13.
     [Google Scholar]
  38. Lyding, V., Stemle, E., Borghetti, C., Brunello, M., Castagnoli, S., Dell’ Orletta, F., … Pirrelli, V.
    (2014) The Paisa corpus of Italian web texts. InF. Bildhauer & R. Schäfer (Eds.), (p.36–43). Gothenburg, Sweden: Association for Computational Linguistics.
     [Google Scholar]
  39. Maffei, L.
    (2018) Elogio della parola. Bologna: il Mulino.
     [Google Scholar]
  40. Marzi, C., Rodella, A., Nadalini, A., Taxitari, L., & Pirrelli, V.
    (2020) Does finger-tracking point to child reading strategies?InJ. Monti, F. Dell’Orletta, & F. Tamburini (Eds.), Proceedings of 7th Italian Conference on Computational Linguistics (Vol.27691). Bologna. 10.4000/books.aaccademia.8695
     https://doi.org/10.4000/books.aaccademia.8695 [Google Scholar]
  41. Mesmer, H. A. E., & Lake, K.
    (2010) The role of syllable awareness and syllable-controlled text in the development of finger-point reading. Reading Psychology, 31 (2), 176–201. 10.1080/02702710902754341
     https://doi.org/10.1080/02702710902754341 [Google Scholar]
  42. Mesmer, H. A. E., & Williams, T. O.
    (2015) Examining the role of syllable awareness in a model of concept of word: Findings from preschoolers. Reading Research Quarterly, 50 (4), 483–497. 10.1002/rrq.111
     https://doi.org/10.1002/rrq.111 [Google Scholar]
  43. Moors, A.
    (2016) Automaticity: Componential, causal, and mechanistic explanations. Annual review of psychology, 671, 263–287. 10.1146/annurev‑psych‑122414‑033550
     https://doi.org/10.1146/annurev-psych-122414-033550 [Google Scholar]
  44. Morton, J.
    (1964a) The effects of context upon speed of reading, eye movements and eye-voice span. Quarterly Journal of Experimental Psychology, 16 (4), 340–354. 10.1080/17470216408416390
     https://doi.org/10.1080/17470216408416390 [Google Scholar]
  45. (1964b) A model for continuous language behaviour. Language and Speech, 7(1), 40–70. 10.1177/002383096400700105
     https://doi.org/10.1177/002383096400700105 [Google Scholar]
  46. Nonaka, T., Ito, K., & Stoffregen, T. A.
    (2021) Structure of variability in scanning movement predicts braille reading performance in children. Scientific reports, 11 (1), 1–12. 10.1038/s41598‑021‑86674‑5
     https://doi.org/10.1038/s41598-021-86674-5 [Google Scholar]
  47. Paap, K. R., & Noel, R. W.
    (1991) Dual-route models of print to sound: Still a good horse race. Psychological research, 53 (1), 13–24. 10.1007/BF00867328
     https://doi.org/10.1007/BF00867328 [Google Scholar]
  48. Pate, J. K., & Goldwater, S.
    (2011) Unsupervised syntactic chunking with acoustic cues: computational models for prosodic bootstrapping. InProceedings of the 2nd Workshop on Cognitive Modeling and Computational Linguistics (pp.20–29).
     [Google Scholar]
  49. Pollatsek, A., & Treiman, R.
    (2015) The oxford handbook of reading. Oxford University Press. 10.1093/oxfordhb/9780199324576.001.0001
     https://doi.org/10.1093/oxfordhb/9780199324576.001.0001 [Google Scholar]
  50. Povey, D., Ghoshal, A., Boulianne, G., Burget, L., Glembek, O., Goel, N., … Vesely, K.
    (2011) The Kaldi Speech Recognition Toolkit. InIEEE 2011 Workshop on Automatic Speech Recognition and Understanding. IEEE Signal Processing Society. (IEEE Catalog No.: CFP11SRW-USB)
     [Google Scholar]
  51. Protopapas, A., Altani, A., & Georgiou, G. K.
    (2013) Development of serial processing in reading and rapid naming. Journal of Experimental Child Psychology, 116 (4), 914–929. 10.1016/j.jecp.2013.08.004
     https://doi.org/10.1016/j.jecp.2013.08.004 [Google Scholar]
  52. R Core Team
    R Core Team (2023) R: A language and environment for statistical computing. https://www.R-project.org/. Vienna, Austria: R Foundation for Statistical Computing.
     [Google Scholar]
  53. Reichle, E. D.
    (2021) Computational models of reading: A handbook. Oxford University Press. 10.1093/oso/9780195370669.001.0001
     https://doi.org/10.1093/oso/9780195370669.001.0001 [Google Scholar]
  54. Sakoe, H., & Chiba, S.
    (1978) Dynamic programming algorithm optimization for spoken word recognition. IEEE Transactions on Acoustics, Speech, and Signal Processing, 26 (1), 43–49. 10.1109/TASSP.1978.1163055
     https://doi.org/10.1109/TASSP.1978.1163055 [Google Scholar]
  55. Schilling, S. G., Carlisle, J. F., Scott, S. E., & Zeng, J.
    (2007) Are fluency measures accurate predictors of reading achievement?The Elementary School Journal, 107 (5), 429–448. 10.1086/518622
     https://doi.org/10.1086/518622 [Google Scholar]
  56. Shmyrev, N. V., & Vosk Core Team
    (2020) Vosk Speech Recognition Toolkit: Offline speech recognition API for Android, iOS, Raspberry Pi and servers with Python, Java, C# and Node. https://github.com/alphacep/vosk-api. GitHub repository.
     [Google Scholar]
  57. Silva, S., Reis, A., Casaca, L., Petersson, K. M., & Faísca, L.
    (2016) When the Eyes no longer lead: Familiarity and Length Effects on Eye-Voice Span. Frontiers in Psychology, 71. 10.3389/fp‑syg.2016.01720
     https://doi.org/10.3389/fp-syg.2016.01720 [Google Scholar]
  58. Taxitari, L., Cappa, C., Ferro, M., Marzi, C., Nadalini, A., & Pirrelli, V.
    (2021) Using mobile technology for reading assessment. InProceedings of 6th IEEE Congress on Information Science & Technology (IEEE CiST’20). Agadir, Morocco.
     [Google Scholar]
  59. Uhry, J. K.
    (1999) Invented spelling in kindergarten: The relationship with finger-point reading. Reading and Writing, 111, 441–464. 10.1023/A:1008032502132
     https://doi.org/10.1023/A:1008032502132 [Google Scholar]
  60. (2002) Finger-point reading in kindergarten: The role of phonemic awareness, one-to-one correspondence, and rapid serial naming. Scientific Studies of Reading, 6 (4), 319–342. 10.1207/S1532799XSSR0604_02
     https://doi.org/10.1207/S1532799XSSR0604_02 [Google Scholar]
  61. Vihman, M. M.
    (2022) The developmental origins of phonological memory. Psychological review, 129 (6), 1495–1508. 10.1037/rev0000354
     https://doi.org/10.1037/rev0000354 [Google Scholar]
/content/journals/10.1075/ml.00025.nad
Loading
Eye-voice and finger-voice spans in adults’ oral reading of connected texts*
The Mental Lexicon 18, 366 (2023); https://doi.org/10.1075/ml.00025.nad
/content/journals/10.1075/ml.00025.nad
/content/journals/10.1075/ml.00025.nad
Loading

Data & Media loading...

  • Article Type: Research Article
Keyword(s): adaptive reading; eye-finger coordination; eye-tracking; eye-voice span; finger-point reading; finger-tracking; finger-voice span; parallel processing; phonological buffer; working memory

Most Cited

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error