1887
  1. Home
  2. e-Journals
  3. Study Abroad Research in Second Language Acquisition and International Education
  4. Volume 9, Issue 2
  5. Article
Volume 9, Issue 2
  • ISSN 2405-5522
  • E-ISSN: 2405-5530
USD
Buy:$35.00 + Taxes

Abstract

Abstract

This report presents regression discontinuity design (RDD) as a powerful analytical tool for use in applied linguistics showcased through our study of the impact of Japanese government study-abroad (SA) scholarships. RDD enables the estimation of causal effects in scenarios where a true experiment is not feasible by exploiting a naturally occurring cutoff point for treatment assignment. Because RDD may be novel to most readers in applied linguistics, this report provides a detailed step-by-step explanation of the standard RDD procedures our study exemplifies. The results section is crafted to reflect the conventional presentation style of RDD findings. Furthermore, the report’s concluding segment suggests scenarios within SA-related language learning research that could benefit from RDD application by enhancing the nuanced and precise interpretation of data in applied linguistics contexts.

© John Benjamins Publishing Company
Loading

Article metrics loading...

/content/journals/10.1075/sar.21020.sas
2024-05-13
2025-02-11

  • From This Site

    /content/journals/10.1075/sar.21020.sas
    dcterms_title,dcterms_subject,pub_keyword
    -contentType:Journal -contentType:Contributor -contentType:Concept -contentType:Institution
    10
    5
Loading full text...

Full text loading...

References

  1. Angrist, J. D., & Pischke, J. S.
    (2010) The credibility revolution in empirical economics: How better research design is taking the con out of econometrics. Journal of Economic Perspectives, 24(2), 3–30. 10.1257/jep.24.2.3
     https://doi.org/10.1257/jep.24.2.3 [Google Scholar]
  2. Bachman, L. F.
    (1990) Fundamental considerations in language testing. Oxford University Press.
     [Google Scholar]
  3. Calonico, S., Cattaneo, M. D., & Titiunik, R.
    (2014) Robust nonparametric confidence intervals for regression-discontinuity designs. Econometrica, 82(4), 2295–2326. 10.3982/ECTA11757
     https://doi.org/10.3982/ECTA11757 [Google Scholar]
  4. Cattaneo, M. D., Idrobo, N., & Titiunik, R.
    (2019) A practical introduction to regression discontinuity designs: Foundations. Cambridge University Press. 10.1017/9781108684606
     https://doi.org/10.1017/9781108684606 [Google Scholar]
  5. De Poli, S., Vergolini, L., & Zanini, N.
    (2018) The impact of a study abroad program on learning abilities and personality traits: Evidence from a randomization. Applied Economics Letters, 25(8), 562–566. 10.1080/13504851.2017.1346354
     https://doi.org/10.1080/13504851.2017.1346354 [Google Scholar]
  6. Di Pietro, G. D.
    (2015) Do study abroad programs enhance the employability of graduates?Education Finance and Policy, 10(2), 223–243. 10.1162/EDFP_a_00159
     https://doi.org/10.1162/EDFP_a_00159 [Google Scholar]
  7. Dörnyei, Z.
    (2014) Researching complex dynamic systems: Retrodictive qualitative modeling in the language classroom. Language Teaching, 47(1), 80–91. 10.1017/S0261444811000516
     https://doi.org/10.1017/S0261444811000516 [Google Scholar]
  8. Freed, B. F.
    (1995) Second language acquisition in a study abroad context. John Benjamins. 10.1075/sibil.9
     https://doi.org/10.1075/sibil.9 [Google Scholar]
  9. Geeslin, K. L., & Schmidt, L. B.
    (2018) Study abroad and L2 learner attitudes. InC. Sanz & A. Morales-Font (Eds.), The Routledge handbook of study abroad research and practice (pp.387–405). Routledge. 10.4324/9781315639970‑26
     https://doi.org/10.4324/9781315639970-26 [Google Scholar]
  10. Gelman, A., & Imbens, G.
    (2019) Why high-order polynomials should not be used in regression discontinuity designs. Journal of Business & Economic Statistics, 37(3), 447–456. 10.1080/07350015.2017.1366909
     https://doi.org/10.1080/07350015.2017.1366909 [Google Scholar]
  11. Gertler, P. J., Martínez, S., Premand, P., Rawlings, L. B., & Vermeersch, C. M. J.
    (2016) Impact evaluation in practice (2nd ed.). World Bank Group.
     [Google Scholar]
  12. Grey, S.
    (2018) Quantitative approaches for study abroad research. InC. Sanz & A. Morales-Font (Eds.), The Routledge handbook of study abroad research and practice (pp.48–57). Routledge. 10.4324/9781315639970‑3
     https://doi.org/10.4324/9781315639970-3 [Google Scholar]
  13. Higuchi, Y., Nakamuro, M., Roever, C., Sasaki, M., & Yashima, T.
    (2023) Impact of studying abroad on language skill development: Regression discontinuity evidence from Japanese university students. Journal of the Japanese and International Economies, 701, 101284. 10.1016/j.jjie.2023.101284
     https://doi.org/10.1016/j.jjie.2023.101284 [Google Scholar]
  14. Imbens, G. W., & Kalyanaraman, K.
    (2012) Optimal bandwidth choice for the regression discontinuity estimator. Review of Economic Studies, 79(3), 933–959. 10.1093/restud/rdr043
     https://doi.org/10.1093/restud/rdr043 [Google Scholar]
  15. Imbens, G. W. & Lemieux, T.
    (2008) Regression discontinuity designs: A guide to practice. Journal of Econometrics, 142(2), 615–635. 10.1016/j.jeconom.2007.05.001
     https://doi.org/10.1016/j.jeconom.2007.05.001 [Google Scholar]
  16. Kato, M., & Suzuki, K.
    (2019) Effective or self-selective: Random assignment demonstrates short-term study abroad effectively encourages further study abroad. Journal of Studies in International Education, 23(4), 411–428. 10.1177/1028315318803713
     https://doi.org/10.1177/1028315318803713 [Google Scholar]
  17. Kawaguchi, D.
    (2016) Fewer school days, more inequality. Journal of the Japanese and International Economies, 391, 35–52. 10.1016/j.jjie.2016.01.001
     https://doi.org/10.1016/j.jjie.2016.01.001 [Google Scholar]
  18. Lee, D. S., & Lemieux, T.
    (2010) Regression discontinuity designs in economics. Journal of Economic Literature, 48(2), 281–355. 10.1257/jel.48.2.281
     https://doi.org/10.1257/jel.48.2.281 [Google Scholar]
  19. MacIntyre, P. D., & Charos, C.
    (1996) Personality, attitudes, and affect as predictors of second language communication. Journal of Language and Social Psychology, 15(1), 3–26. 10.1177/0261927X960151001
     https://doi.org/10.1177/0261927X960151001 [Google Scholar]
  20. McCrary, J.
    (2008) Manipulation of the running variable in the regression discontinuity design: A density test. Journal of Econometrics, 142(2), 698–714. 10.1016/j.jeconom.2007.05.005
     https://doi.org/10.1016/j.jeconom.2007.05.005 [Google Scholar]
  21. Ministry of Education, Culture, Sports, Science, and Technology, Japan (MEXT)
    Ministry of Education, Culture, Sports, Science, and Technology, Japan (MEXT) (2022a) About Tobitate! [Leap for Tomorrow] Study Abroad Initiative. RetrievedFebruary 24, 2022, from https://tobitate.mext.go.jp/about/english.html
  22. Ministry of Education, Culture, Sports, Science, and Technology, Japan (MEXT)
    Ministry of Education, Culture, Sports, Science, and Technology, Japan (MEXT) (2022b) Tobitate! [Leap for Tomorrow] Ryugaku [Study Abroad] Japan. RetrievedFebruary 24, 2022, from https://tobitate.mext.go.jp
  23. Oosterbeek, H., & Webbink, D.
    (2011) Does studying abroad induce a brain drain?Economica, 78(310), 347–366. 10.1111/j.1468‑0335.2009.00818.x
     https://doi.org/10.1111/j.1468-0335.2009.00818.x [Google Scholar]
  24. Parey, M., & Waldinger, F.
    (2010) Studying abroad and the effect on international labor market mobility: Evidence from the introduction of ERASMUS. Economic Journal, 121(551), 194–222. 10.1111/j.1468‑0297.2010.02369.x
     https://doi.org/10.1111/j.1468-0297.2010.02369.x [Google Scholar]
  25. Robinson, J. P.
    (2011) Evaluating criteria for English learner reclassification: A causal-effects approach using a binding-score regression discontinuity design with instrumental variables. Educational Evaluation and Policy Analysis, 33(3), 267–292. 10.3102/0162373711407912
     https://doi.org/10.3102/0162373711407912 [Google Scholar]
  26. Sanz, C. & Morales-Front, A.
    (2018) Issues in study abroad research and practice. InC. Sanz & A. Morales-Font (Eds.), The Routledge handbook of study abroad research and practice (pp.1–16). Routledge. 10.4324/9781315639970
     https://doi.org/10.4324/9781315639970 [Google Scholar]
  27. Shadish, W. R., Cook, T. D., & Campbell, D. T.
    (2002) Experimental and quasi-experimental designs for generalized causal inference. Houghton Mifflin.
     [Google Scholar]
  28. Taguchi, N.
    (2008) The role of the learning environment in the development of pragmatic comprehension: A comparison of gains between EFL and ESL learners. Studies in Second Language Acquisition, 30(4), 423–452. 10.1017/S0272263108080716
     https://doi.org/10.1017/S0272263108080716 [Google Scholar]
  29. Thistlethwaite, D. L., & Campbell, D. T.
    (1960) Regression-discontinuity analysis: An alternative to the ex post facto experiment. Journal of Educational Psychology, 51(6), 309–317. 10.1037/h0044319
     https://doi.org/10.1037/h0044319 [Google Scholar]
  30. Tullock, B., & Ortega, L.
    (2017) Fluency and multilingualism in study abroad: Lessons from a scoping review. System, 711, 7–21. 10.1016/j.system.2017.09.019
     https://doi.org/10.1016/j.system.2017.09.019 [Google Scholar]
  31. Urquiola, M., & Verhoogen, E.
    (2009) Class-size caps, sorting, and the regression discontinuity design. American Economic Review, 99(1), 179–215. 10.1257/aer.99.1.179
     https://doi.org/10.1257/aer.99.1.179 [Google Scholar]
  32. Waibel, S., Rüger, H., Ette, A., & Sauer, L.
    (2017) Career consequences of transnational educational mobility: A systematic literature review. Educational Research Review, 201, 81–98. 10.1016/j.edurev.2016.12.001
     https://doi.org/10.1016/j.edurev.2016.12.001 [Google Scholar]
  33. Xiao, F.
    (2015) Adult second language learners’ pragmatic development in the study-abroad context: A review. Frontiers: The Interdisciplinary Journal of Study Abroad, 25(1), 132–149. 10.36366/frontiers.v25i1.349
     https://doi.org/10.36366/frontiers.v25i1.349 [Google Scholar]
  34. Xu, Y.
    (2019) Changes in interlanguage complexity during study abroad: A meta-analysis. System, 801, 199–211. 10.1016/j.system.2018.11.008
     https://doi.org/10.1016/j.system.2018.11.008 [Google Scholar]
  35. Yashima, T.
    (2002) Willingness to communicate in a second language: The Japanese EFL context. The Modern Language Journal, 86(1), 54–66. 10.1111/1540‑4781.00136
     https://doi.org/10.1111/1540-4781.00136 [Google Scholar]
  36. (2009) International posture and the ideal L2 self in the Japanese EFL context. InZ. Dörnyei, & E. Ushioda (Eds.), Motivation, language identity, and the L2 self (pp.144–163). Multilingual Matters. 10.21832/9781847691293‑008
     https://doi.org/10.21832/9781847691293-008 [Google Scholar]
  37. Yashima, T., & Zenuk-Nishide, L.
    (2008) The impact of learning contexts on proficiency, attitudes, and L2 communication: Creating an imagined international community. System, 36(4), 566–585. 10.1016/j.system.2008.03.006
     https://doi.org/10.1016/j.system.2008.03.006 [Google Scholar]
/content/journals/10.1075/sar.21020.sas
Loading
Introducing regression discontinuity design to applied linguistics
Study Abroad Research in Second Language Acquisition and International Education 9, 217 (2024); https://doi.org/10.1075/sar.21020.sas
/content/journals/10.1075/sar.21020.sas
/content/journals/10.1075/sar.21020.sas
Loading

Data & Media loading...

  • Article Type: Research Article
Keyword(s): between-group design; high school students; Regression discontinuity design; study-abroad scholarships; within-group design

Most Cited

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error