1887
Volume 9, Issue 2
  • ISSN 2405-5522
  • E-ISSN: 2405-5530
USD
Buy:$35.00 + Taxes

Abstract

Abstract

This report presents regression discontinuity design (RDD) as a powerful analytical tool for use in applied linguistics showcased through our study of the impact of Japanese government study-abroad (SA) scholarships. RDD enables the estimation of causal effects in scenarios where a true experiment is not feasible by exploiting a naturally occurring cutoff point for treatment assignment. Because RDD may be novel to most readers in applied linguistics, this report provides a detailed step-by-step explanation of the standard RDD procedures our study exemplifies. The results section is crafted to reflect the conventional presentation style of RDD findings. Furthermore, the report’s concluding segment suggests scenarios within SA-related language learning research that could benefit from RDD application by enhancing the nuanced and precise interpretation of data in applied linguistics contexts.

Loading

Article metrics loading...

/content/journals/10.1075/sar.21020.sas
2024-05-13
2024-06-19
Loading full text...

Full text loading...

References

  1. Angrist, J. D., & Pischke, J. S.
    (2010) The credibility revolution in empirical economics: How better research design is taking the con out of econometrics. Journal of Economic Perspectives, 24(2), 3–30. 10.1257/jep.24.2.3
    https://doi.org/10.1257/jep.24.2.3 [Google Scholar]
  2. Bachman, L. F.
    (1990) Fundamental considerations in language testing. Oxford University Press.
    [Google Scholar]
  3. Calonico, S., Cattaneo, M. D., & Titiunik, R.
    (2014) Robust nonparametric confidence intervals for regression-discontinuity designs. Econometrica, 82(4), 2295–2326. 10.3982/ECTA11757
    https://doi.org/10.3982/ECTA11757 [Google Scholar]
  4. Cattaneo, M. D., Idrobo, N., & Titiunik, R.
    (2019) A practical introduction to regression discontinuity designs: Foundations. Cambridge University Press. 10.1017/9781108684606
    https://doi.org/10.1017/9781108684606 [Google Scholar]
  5. De Poli, S., Vergolini, L., & Zanini, N.
    (2018) The impact of a study abroad program on learning abilities and personality traits: Evidence from a randomization. Applied Economics Letters, 25(8), 562–566. 10.1080/13504851.2017.1346354
    https://doi.org/10.1080/13504851.2017.1346354 [Google Scholar]
  6. Di Pietro, G. D.
    (2015) Do study abroad programs enhance the employability of graduates?Education Finance and Policy, 10(2), 223–243. 10.1162/EDFP_a_00159
    https://doi.org/10.1162/EDFP_a_00159 [Google Scholar]
  7. Dörnyei, Z.
    (2014) Researching complex dynamic systems: Retrodictive qualitative modeling in the language classroom. Language Teaching, 47(1), 80–91. 10.1017/S0261444811000516
    https://doi.org/10.1017/S0261444811000516 [Google Scholar]
  8. Freed, B. F.
    (1995) Second language acquisition in a study abroad context. John Benjamins. 10.1075/sibil.9
    https://doi.org/10.1075/sibil.9 [Google Scholar]
  9. Geeslin, K. L., & Schmidt, L. B.
    (2018) Study abroad and L2 learner attitudes. InC. Sanz & A. Morales-Font (Eds.), The Routledge handbook of study abroad research and practice (pp.387–405). Routledge. 10.4324/9781315639970‑26
    https://doi.org/10.4324/9781315639970-26 [Google Scholar]
  10. Gelman, A., & Imbens, G.
    (2019) Why high-order polynomials should not be used in regression discontinuity designs. Journal of Business & Economic Statistics, 37(3), 447–456. 10.1080/07350015.2017.1366909
    https://doi.org/10.1080/07350015.2017.1366909 [Google Scholar]
  11. Gertler, P. J., Martínez, S., Premand, P., Rawlings, L. B., & Vermeersch, C. M. J.
    (2016) Impact evaluation in practice (2nd ed.). World Bank Group.
    [Google Scholar]
  12. Grey, S.
    (2018) Quantitative approaches for study abroad research. InC. Sanz & A. Morales-Font (Eds.), The Routledge handbook of study abroad research and practice (pp.48–57). Routledge. 10.4324/9781315639970‑3
    https://doi.org/10.4324/9781315639970-3 [Google Scholar]
  13. Higuchi, Y., Nakamuro, M., Roever, C., Sasaki, M., & Yashima, T.
    (2023) Impact of studying abroad on language skill development: Regression discontinuity evidence from Japanese university students. Journal of the Japanese and International Economies, 701, 101284. 10.1016/j.jjie.2023.101284
    https://doi.org/10.1016/j.jjie.2023.101284 [Google Scholar]
  14. Imbens, G. W., & Kalyanaraman, K.
    (2012) Optimal bandwidth choice for the regression discontinuity estimator. Review of Economic Studies, 79(3), 933–959. 10.1093/restud/rdr043
    https://doi.org/10.1093/restud/rdr043 [Google Scholar]
  15. Imbens, G. W. & Lemieux, T.
    (2008) Regression discontinuity designs: A guide to practice. Journal of Econometrics, 142(2), 615–635. 10.1016/j.jeconom.2007.05.001
    https://doi.org/10.1016/j.jeconom.2007.05.001 [Google Scholar]
  16. Kato, M., & Suzuki, K.
    (2019) Effective or self-selective: Random assignment demonstrates short-term study abroad effectively encourages further study abroad. Journal of Studies in International Education, 23(4), 411–428. 10.1177/1028315318803713
    https://doi.org/10.1177/1028315318803713 [Google Scholar]
  17. Kawaguchi, D.
    (2016) Fewer school days, more inequality. Journal of the Japanese and International Economies, 391, 35–52. 10.1016/j.jjie.2016.01.001
    https://doi.org/10.1016/j.jjie.2016.01.001 [Google Scholar]
  18. Lee, D. S., & Lemieux, T.
    (2010) Regression discontinuity designs in economics. Journal of Economic Literature, 48(2), 281–355. 10.1257/jel.48.2.281
    https://doi.org/10.1257/jel.48.2.281 [Google Scholar]
  19. MacIntyre, P. D., & Charos, C.
    (1996) Personality, attitudes, and affect as predictors of second language communication. Journal of Language and Social Psychology, 15(1), 3–26. 10.1177/0261927X960151001
    https://doi.org/10.1177/0261927X960151001 [Google Scholar]
  20. McCrary, J.
    (2008) Manipulation of the running variable in the regression discontinuity design: A density test. Journal of Econometrics, 142(2), 698–714. 10.1016/j.jeconom.2007.05.005
    https://doi.org/10.1016/j.jeconom.2007.05.005 [Google Scholar]
  21. Ministry of Education, Culture, Sports, Science, and Technology, Japan (MEXT)
    Ministry of Education, Culture, Sports, Science, and Technology, Japan (MEXT) (2022a) About Tobitate! [Leap for Tomorrow] Study Abroad Initiative. RetrievedFebruary 24, 2022, from https://tobitate.mext.go.jp/about/english.html
  22. Ministry of Education, Culture, Sports, Science, and Technology, Japan (MEXT)
    Ministry of Education, Culture, Sports, Science, and Technology, Japan (MEXT) (2022b) Tobitate! [Leap for Tomorrow] Ryugaku [Study Abroad] Japan. RetrievedFebruary 24, 2022, from https://tobitate.mext.go.jp
  23. Oosterbeek, H., & Webbink, D.
    (2011) Does studying abroad induce a brain drain?Economica, 78(310), 347–366. 10.1111/j.1468‑0335.2009.00818.x
    https://doi.org/10.1111/j.1468-0335.2009.00818.x [Google Scholar]
  24. Parey, M., & Waldinger, F.
    (2010) Studying abroad and the effect on international labor market mobility: Evidence from the introduction of ERASMUS. Economic Journal, 121(551), 194–222. 10.1111/j.1468‑0297.2010.02369.x
    https://doi.org/10.1111/j.1468-0297.2010.02369.x [Google Scholar]
  25. Robinson, J. P.
    (2011) Evaluating criteria for English learner reclassification: A causal-effects approach using a binding-score regression discontinuity design with instrumental variables. Educational Evaluation and Policy Analysis, 33(3), 267–292. 10.3102/0162373711407912
    https://doi.org/10.3102/0162373711407912 [Google Scholar]
  26. Sanz, C. & Morales-Front, A.
    (2018) Issues in study abroad research and practice. InC. Sanz & A. Morales-Font (Eds.), The Routledge handbook of study abroad research and practice (pp.1–16). Routledge. 10.4324/9781315639970
    https://doi.org/10.4324/9781315639970 [Google Scholar]
  27. Shadish, W. R., Cook, T. D., & Campbell, D. T.
    (2002) Experimental and quasi-experimental designs for generalized causal inference. Houghton Mifflin.
    [Google Scholar]
  28. Taguchi, N.
    (2008) The role of the learning environment in the development of pragmatic comprehension: A comparison of gains between EFL and ESL learners. Studies in Second Language Acquisition, 30(4), 423–452. 10.1017/S0272263108080716
    https://doi.org/10.1017/S0272263108080716 [Google Scholar]
  29. Thistlethwaite, D. L., & Campbell, D. T.
    (1960) Regression-discontinuity analysis: An alternative to the ex post facto experiment. Journal of Educational Psychology, 51(6), 309–317. 10.1037/h0044319
    https://doi.org/10.1037/h0044319 [Google Scholar]
  30. Tullock, B., & Ortega, L.
    (2017) Fluency and multilingualism in study abroad: Lessons from a scoping review. System, 711, 7–21. 10.1016/j.system.2017.09.019
    https://doi.org/10.1016/j.system.2017.09.019 [Google Scholar]
  31. Urquiola, M., & Verhoogen, E.
    (2009) Class-size caps, sorting, and the regression discontinuity design. American Economic Review, 99(1), 179–215. 10.1257/aer.99.1.179
    https://doi.org/10.1257/aer.99.1.179 [Google Scholar]
  32. Waibel, S., Rüger, H., Ette, A., & Sauer, L.
    (2017) Career consequences of transnational educational mobility: A systematic literature review. Educational Research Review, 201, 81–98. 10.1016/j.edurev.2016.12.001
    https://doi.org/10.1016/j.edurev.2016.12.001 [Google Scholar]
  33. Xiao, F.
    (2015) Adult second language learners’ pragmatic development in the study-abroad context: A review. Frontiers: The Interdisciplinary Journal of Study Abroad, 25(1), 132–149. 10.36366/frontiers.v25i1.349
    https://doi.org/10.36366/frontiers.v25i1.349 [Google Scholar]
  34. Xu, Y.
    (2019) Changes in interlanguage complexity during study abroad: A meta-analysis. System, 801, 199–211. 10.1016/j.system.2018.11.008
    https://doi.org/10.1016/j.system.2018.11.008 [Google Scholar]
  35. Yashima, T.
    (2002) Willingness to communicate in a second language: The Japanese EFL context. The Modern Language Journal, 86(1), 54–66. 10.1111/1540‑4781.00136
    https://doi.org/10.1111/1540-4781.00136 [Google Scholar]
  36. (2009) International posture and the ideal L2 self in the Japanese EFL context. InZ. Dörnyei, & E. Ushioda (Eds.), Motivation, language identity, and the L2 self (pp.144–163). Multilingual Matters. 10.21832/9781847691293‑008
    https://doi.org/10.21832/9781847691293-008 [Google Scholar]
  37. Yashima, T., & Zenuk-Nishide, L.
    (2008) The impact of learning contexts on proficiency, attitudes, and L2 communication: Creating an imagined international community. System, 36(4), 566–585. 10.1016/j.system.2008.03.006
    https://doi.org/10.1016/j.system.2008.03.006 [Google Scholar]
http://instance.metastore.ingenta.com/content/journals/10.1075/sar.21020.sas
Loading
/content/journals/10.1075/sar.21020.sas
Loading

Data & Media loading...

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error