Skip to main content
Online ISSN: 2622-5506
Articles

Project-based learning in vocational schools: A meta-analysis study

Nuryani Dwi Astuti (1), Yuli Prihatni (2), Ari Setiawan (3), Heri Retnawati (4), Risky Setiawan (5), Dita Surwanti (6), Joko Supriyanto (7)
(1) Universitas Sarjanawiyata Tamansiswa, Indonesia (2) Universitas Sarjanawiyata Tamansiswa, Indonesia (3) Universitas Sarjanawiyata Tamansiswa, Indonesia (4) Universitas Negeri Yogyakarta, Indonesia (5) Universitas Negeri Yogyakarta, Indonesia (6) Utrecht University, Netherlands (7) Sekolah Menengah Kejuruan Muhammadiyah 1 Yogyakarta, Indonesia
DOI: https://doi.org/10.33292/petier.v8i2.299

Keywords

Project-Based Learning Meta-Analysis JASP High School

Abstract

Project-Based Learning (PBL) have shown significant results in increasing students’ mathematical skill. In a meta-analysis involving 17 studies, the results show that PBL significantly increases the students’ mathematical skills. The results of the fixed and random effects analysis show that the overall coefficient model and the residual heterogeneity are significant. The coefficient estimation for the intercept within the model is 71.872, which shows that when all independent variables are worth to zero, the dependent variable is worth estimated to 71.872. A very small p-value (< 0.001) indicates that the results are statistically very significant. The models have a good fit with the observational data, but it could not explain the variation between studies. There is a high level of heterogeneity among studies and there is not any indication of publication bias in the analysis. Thus, the results show that PBL basically can increase the students’ mathematical skills. However, it is necessary to consider other factors that can influence the results.

References

  1. Agussuryani, Q., Sudarmin, S., Sumarni, W., Cahyono, E., & Ellianawati, E. (2022). STEM literacy in growing vocational school student HOTS in science learning: A meta-analysis. International Journal of Evaluation and Research in Education, 11(1), 51–60. https://doi.org/10.11591/ijere.v11i1.21647
  2. Ahmad, S. T., Watrianthos, R., Samala, A. D., Muskhir, M., & Dogara, G. (2023). Project-based Learning in Vocational Education: A Bibliometric Approach. International Journal of Modern Education and Computer Science, 15(4), 43–56. https://doi.org/10.5815/ijmecs.2023.04.04
  3. Akyıldız, P., Aktaş, F. N., Dede, Y., & Hacıömeroğlu, G. (2021). Mathematics teachers’ values about teaching mathematics. Studies in Educational Evaluation, 68. https://doi.org/10.1016/j.stueduc.2020.100954
  4. Anwas, E. O. M., Arlinwibowo, J., Nur, I., Susanto, J., Shah, I., Miswanto, M., & Aziz, A. R. A. (2025). Quranic mushaf use and religious character: A meta-analysis. Psychology, Evaluation, and Technology in Educational Research, 8(1). https://doi.org/10.33292/petier.v8i1.292
  5. Arlinwibowo, J., Retnawati, H., & Kartowagiran, B. (2022). The impact of ICT utilization to improve the learning outcome: A meta-analysis. International Journal of Evaluation and Research in Education, 11(2), 522–531. https://doi.org/10.11591/ijere.v11i2.22112
  6. Arnold, J. (2022). Prioritising students in Assessment for Learning: A scoping review of research on students’ classroom experience. Review of Education, 10(3). https://doi.org/10.1002/rev3.3366
  7. Benita, M., Matos, L., & Cerna, Y. (2022). The effect of mastery goal-complexes on mathematics grades and engagement: The case of Low-SES Peruvian students. Learning and Instruction, 80. https://doi.org/10.1016/j.learninstruc.2021.101558
  8. Brockett, R. G., & Hiemstra, R. (2020). Self-direction in adult learning: Perspectives on theory, research, and practice. Routledge.
  9. Capron Puozzo, I., & Audrin, C. (2021). Improving self-efficacy and creative self-efficacy to foster creativity and learning in schools. Thinking Skills and Creativity, 42. https://doi.org/10.1016/j.tsc.2021.100966
  10. Craig, S. D., Schroeder, N. L., & Roscoe, R. D. (2020). Distribution Statement A Science of Learning and Readiness State-of-the-Art Report.
  11. Creswell, J. W., & Clark, V. L. P. (2011). Choosing a mixed methods design. In Designing and Conducting Mixed Methods Research (pp. 53–106). Sage Publications, Inc.
  12. Czwikla, G. , Boen, F. , Cook, D. G. , de Jong, J. , Harris, T. , Hilz, L. K. , Iliffe, S. , Lechner, L. , Morris, R. W. , Muellmann, S. , Peels, D. A. , Pischke, C. R. , Schüz, B. , Stevens, M. , Telkmann, K. , van Lenthe, F. J. , Vanderlinden, J. , & Bolte, G. (2021). Equity-specific effects of interventions to promote physical activity among middle-aged and older adults: results from applying a novel equity-specific re-analysis strategy. The International Journal of Behavioral Nutrition and Physical Activity, 18.
  13. Datu, J. A. D., & Yuen, M. (2020). Students’ connectedness is linked to higher gratitude and self-efficacy outcomes. Children and Youth Services Review, 116. https://doi.org/10.1016/j.childyouth.2020.105210
  14. Decristan, J., Jansen, N. C., & Fauth, B. (2023). Student participation in whole-class discourse: individual conditions and consequences for student learning in primary and secondary school. Learning and Instruction, 86. https://doi.org/10.1016/j.learninstruc.2023.101748
  15. Duan, R. , Piao, J. , Marks-Anglin, A. , Tong, J. , Lin, L. , Chu, H. , Ning, J. , &, & Chen, Y. (2020). Testing for publication bias in meta-analysis under copas selection model. arXiv: Methodology.
  16. Estabrooks, L. B., & Couch, S. R. (2018). Failure as an active agent in the development of creative and inventive mindsets. Thinking Skills and Creativity, 30, 103–115. https://doi.org/10.1016/j.tsc.2018.02.015
  17. Fraenkel, J. R., Wallen, N. E., & Hyun, H. H. (2012). How to design and evaluate research in education. McGraw-Hill.
  18. Geng, S., Law, K. M. Y., & Niu, B. (2019). Investigating self-directed learning and technology readiness in blending learning environment. International Journal of Educational Technology in Higher Education, 16(17), 1–22. https://doi.org/10.1186/s41239-019-0147-0
  19. Greisen, M., Georges, C., Hornung, C., Sonnleitner, P., & Schiltz, C. (2021). Learning mathematics with shackles: How lower reading comprehension in the language of mathematics instruction accounts for lower mathematics achievement in speakers of different home languages. Acta Psychologica, 221. https://doi.org/10.1016/j.actpsy.2021.103456
  20. Hafeez, M. (2021). Project-Based Versus Traditional Lecture Teaching Methods. EDUTEC : Journal of Education And Technology.
  21. Henny, N., & Tambingon, T. F. (2022). The Role of Vocational Higher Educations Personnel in Preparing Professional. Ismart Edu: Jurnal Pendidikan Teknologi Informasi .
  22. Hidayatullah, R. S., Ariyanto, S. R., Muhaji, Mubarok, H., & Yohannes, A. (2020). Collaborative Problem-based Learning: An Analysis of Problem-Solving Skills in Vocational Schools. IJORER : International Journal of Recent Educational Research, 1(3), 209–217. https://doi.org/10.46245/ijorer.v1i3.62
  23. Hiemstra, R., & Brockett, R. G. (2012). Reframing the Meaning of Self-Directed Learning: An Updated Modeltt. Adult Education Research Conference Proceedings, 155–161.
  24. Honey, M., & Marshall, D. (2003). The impact of on-line muti-choice questions on undergraduate student nurses’ learning. Proceedings of the 20th Annual Conference of the Australasian Society for Computers in Learning in Tertiary Education (ASCILITE), 236–243.
  25. Ioannidis, J. P. , & Trikalinos, T. A. (2007). The appropriateness of asymmetry tests for publication bias in meta-analyses: a large survey. . Canadian Medical Association Journal, 176, 1091–1096.
  26. Ismawati, E., Ki Hajar Dewantara, J., Utara, K., Klaten, K., & Tengah, J. (2018). Nationalism in Indonesian Literature as Active Learning Material. In International Journal of Active Learning (Vol. 3, Number 1). http://journal.unnes.ac.id/nju/index.php/ijal
  27. Ismayilova, K., & M.Klassen, R. (2019). Research and teaching self-efficacy of university faculty: Relations with job satisfaction. International Journal of Educational Research, 98, 55–66. https://doi.org/10.1016/j.ijer.2019.08.012
  28. Jeon, H. O. , Chae, M. , & Kim, A. (2022). Effects of medication adherence interventions for older adults with chronic illnesses: a systematic review and meta-analysis. Osong Public Health and Research Perspectives, 13, 328–340.
  29. Kamil, N., Sultan, H., & Ramadhan, S. (2023). Bibliometric study: Project-based learning in education on learning outcomes Scopus publication 2021-2023. Jurnal Inovasi Dan Teknologi Pembelajaran, 10(2), 201. https://doi.org/10.17977/um031v10i22023p201
  30. Kanters, S. (2022). Fixed- and Random-Effects Models. Methods in Molecular Biology, 23(45), 41–65.
  31. Kesumawati, N., Fuadiah, N. F., Lusiana, L., & Octaria, D. (2023). Teaching Materials for Algebra and Linear Programs Based on Pancasila Student Profiles. Jurnal Riset Pendidikan Matematika, 10(1), 65–77. https://doi.org/10.21831/jrpm.v10i1.55392
  32. Kirsch, C., & Vaiouli, P. (2023). Students’ perspectives on their academic achievement during the Covid-19 pandemic: Learner autonomy, school satisfaction and adult support. Social Sciences and Humanities Open, 7(1). https://doi.org/10.1016/j.ssaho.2023.100433
  33. Kleij, F. M. van der. (2019). Comparison of teacher and student perceptions of formative assessment feedback practices and association with individual student characteristics. Teaching and Teacher Education, 85(1), 175–189.
  34. Krueger, R. A., & Casey, M. A. (2015). Focus groups: A practical guide for applied research. Sage Publications, Inc.
  35. Levitt, G. , & Grubaugh, S. (2023). Teacher-centered or student-centered teaching methods and stu-dent outcomes in secondary schools: lecture/discussion and pro-ject-based learning/inquiry pros and cons. EIKI Journal of Effective Teaching Methods.
  36. Li, Z. , & Begg, C. B. (1994). Random effects models for combining results from controlled and uncontrolled studies in a meta-analysis. Journal of the American Statistical Association, 89, 1523–1527.
  37. Lumbantoruan, J. H. (2023). Evaluation of Students’ Difficulties in Learning Mathematics in Complex Variable Material. Journal of Education Research and Evaluation, 7(3), 443–454. https://doi.org/10.23887/jere.v7i3.60532
  38. Magill, M. , & Ray, L. A. (2009). Cognitive-behavioral treatment with adult alcohol and illicit drug users: a meta-analysis of randomized controlled trials. Journal of Studies on Alcohol and Drugs, 70(4), 516–527.
  39. Mahvelati, E. H. (2021). Learners’ perceptions and performance under peer versus teacher corrective feedback conditions. Studies in Educational Evaluation, 70. https://doi.org/10.1016/j.stueduc.2021.100995
  40. Mariah, S. , & Sari, A. (2019). Revitalizing the role of teachers in practice learning to increase vocational students readiness. Journal of Physics: Conference Series, 1273.
  41. Maritsa, A., Hanifah Salsabila, U., Wafiq, M., Rahma Anindya, P., & Azhar Ma’shum, M. (2021). Pengaruh Teknologi Dalam Dunia Pendidikan. Al-Mutharahah: Jurnal Penelitian Dan Kajian Sosial Keagamaan, 18(2), 91–100. https://doi.org/10.46781/al-mutharahah.v18i2.303
  42. Martínez Agudo, J. de D. (2019). Which instructional programme (EFL or CLIL)results in better oral communicative competence? Updated empirical evidence from a monolingual context. Linguistics and Education, 51, 69–78. https://doi.org/10.1016/j.linged.2019.04.008
  43. Nafia, Z. I. , Hidayati, D. , & Sulisworo, D. (2023). The application of the technology readiness acceptance model on education. Journal of Novel Engineering Science and Technology.
  44. Ndijuye, L. G., & Rao, N. (2019). Early reading and mathematics attainments of children of self-settled recently naturalized refugees in Tanzania. International Journal of Educational Development, 65, 183–193. https://doi.org/10.1016/j.ijedudev.2018.08.002
  45. Noto, M. S., Priatna, N., & Dahlan, J. A. (2019). Mathematical proof: the learning obstacles of pre-service mathematics teachers on transformation geometry. Journal on Mathematics Education, 10(1), 117–126.
  46. Oswald, F. L. (2009). Publication bias in meta-analysis: Prevention, assessment and adjustments. Applied Psychological Measurement, 33, 74–76.
  47. Ren, L., Wu, H., Fan, J., & Li, L. (2023). Behavioral regulation and approaches to learning: Moderators of the association between extracurricular involvement and academic readiness. Journal of School Psychology, 101. https://doi.org/10.1016/j.jsp.2023.101250
  48. Retnawati, H., Apino, E., Kartianom, Djidu, H. , & Anazifa, R. D. (2018). Pengantar analisis meta (Pertama). Parama Publishing.
  49. Russo, M. W., & Russo, M. (2007). How to review a meta-analysis. Gastroenterology & Hepatology, 3(8).
  50. Ruzek, E., Aldrup, K., & Lüdtke, O. (2022). Assessing the effects of student perceptions of instructional quality: A cross-subject within-student design. Contemporary Educational Psychology, 70. https://doi.org/10.1016/j.cedpsych.2022.102085
  51. Seo, Y. , Yong, S. Y. , Choi, W. W. , & Kim, S. H. (2024). Meta-analysis of studies on the effects of digital therapeutics. Journal of Personalized Medicine, 14.
  52. Shchyrba, V. , Motsyk, R. , & Furtel, O. (2022). STEM-Education in the Innovative Processes of Forming a Modern Physical and Technological Specialist. Collection of Scientific Papers Kamianets-Podilsky Ivan Ohienko National University Pedagogical Series.
  53. Siangphoe, U. , & Archer, K. J. (2016). Estimation of random effects and identifying heterogeneous genes in meta-analysis of gene expression studies. Briefings in Bioinformatics, 18, 602–618.
  54. Soika, I. (2014). Development of students ’ career management competency in vocational secondary schools. The Proceedings of the International Scientific Conference Engineering for Rural Development, 13, pp. 511-516.
  55. Straub, R., Kulin, S., & Ehmke, T. (2021). A transdisciplinary evaluation framework for the assessment of integration in boundary-crossing collaborations in teacher education. Studies in Educational Evaluation, 68. https://doi.org/10.1016/j.stueduc.2020.100952
  56. Sumarni, W., Faizah, Z., Subali, B., Wiyanto, W., & Ellianawati. (2020). The urgency of religious and cultural science in stem education: A meta data analysis. International Journal of Evaluation and Research in Education, 9(4), 1045–1054. https://doi.org/10.11591/ijere.v9i4.20462
  57. Surry, D. W. (2008). Innovations in learning technology. In Encyclopedia of information technology curriculum integration (pp. 413-417). IGI Global Scientific Publishing.
  58. Usmeldi, U., & Amini, R. (2022). Creative project-based learning model to increase creativity of vocational high school students. International Journal of Evaluation and Research in Education, 11(4), 2155–2164. https://doi.org/10.11591/ijere.v11i4.21214
  59. van Aert, R. C. , Wicherts, J. M. , & van Assen, M. A. (2019). Publication bias examined in meta-analyses from psychology and medicine: A meta-meta-analysis. PLoS ONE, 14.
  60. Vieluf, S., & Göbel, K. (2019). Making intercultural learning in EFL lessons interesting – The role of teaching processes and individual learning prerequisites and their interactions. Teaching and Teacher Education, 79, 1–16. https://doi.org/10.1016/j.tate.2018.11.019
  61. Wang, Y. (2022). A Comparative Study on the Effectiveness of Traditional and Modern Teaching Methods. In Proceedings of the 2022 5th International Conference on Humanities Education and Social Sciences (ICHESS 2022) (pp. 270–277). Atlantis Press SARL. https://doi.org/10.2991/978-2-494069-89-3_32
  62. Wieduwilt, N., Lehrl, S., & Anders, Y. (2023). Preschool teachers’ language-related pedagogical beliefs and their relation to observed classroom quality. Early Childhood Research Quarterly, 62, 175–185. https://doi.org/10.1016/j.ecresq.2022.08.001
  63. Xiao-ling, L. (2010). Necessity for students of vocational education to participate in appraisal of occupational skill.
  64. Yotyodying, S., & Wild, E. (2019). Effective family–school communication for students with learning disabilities: Associations with parental involvement at home and in school. Learning, Culture and Social Interaction, 22. https://doi.org/10.1016/j.lcsi.2019.100317
  65. Youyou, L., & Kit, A. C. (2024). Practical research on Project-Based Learning (PBL) in film and television production in Xiamen Vocational Education. Theory and Practice, 2024(5), 203–221. https://doi.org/10.53555/kuey.v30i5.2831
  66. Yusof, Y., Roddin, R., & Awang, H. (2015). What students need, and what teacher did: the impact of teacher’s teaching approaches to the development of students’ generic competences. Procedia - Social and Behavioral Sciences, 204, 36–44. https://doi.org/10.1016/j.sbspro.2015.08.107