Abdul Rahman (1), Yayat Suharyat (2), Tomi Apra Santosa (3), Efendi Abdullah (4), Pahmi Rizal (5)
Please Many studies have described meta-analysis on the overall effect of e-learning influence in learning. However, there has been no meta-analysis of the overall effect of STEM-based e-learning on Higher Order Thinking Skills (HOTS). The purpose of this study investigates the effect of STEM-based e-learning on students' critical thinking skills in Indonesia. This type of research is a Systematic Literature Review (SL) and meta-analysis. Data sources came from 12 national and international journals published in 2018-2023. The process of searching for data sources through Google Scholar, ScienceDirect, Wiley, Eric, and Springer. Data analysis used the Hedge formula to calculate effect size with the help of the JSAP application. The findings show that the effect size value (ES = 0.84) is very high. This explains that STEM-based e-learning provides a very high positive impact and is effective in improving students' Higher Order Thinking Skills (HOTS). Furthermore, HOTS characteristics do not cause heterogeneity in the results of STEM-based e-learning research on students' Higher Order Thinking Skills. The findings suggest that educators should choose STEM-based e-learning as one of the learning models to improve students' Higher Order Thinking skills in Indonesia
Department of Social Education, Faculty of Teacher Training and Education, Universitas Sebelas Maret
Department of Islamic Religious Education, Faculty of Teacher Training and Education, Universitas Islam 45 Bekasi
Department of Science Education, Akademi Teknik Adikarya
Department of Education Science, Faculty of Engineering Technology, Universiti Teknikal Malaysia Melaka
Universiti Brunei Darussalam
Akatsuka, Y. (2019). Awareness of critical thinking attitudes and English language skills: The effects of questions involving higher-order thinking. Journal of Pan-Pacific Association of Applied Linguistics, 23(1), 59–84. https://doi.org/10.25256/PAAL.23.2.4
Aköz, O., Çeliker, H. D., & Genç, H. (2022). A course content designed in accordance with the 5E teaching model within the scope of STEM learning approach in environmental education course: My smart greenhouse. European Journal of Education Studies, 9(4), 274–295. https://doi.org/10.46827/ejes.v9i4.4263
Aljaser, A. M. (2019). The effectiveness of e-learning environment in developing academic achievement and the attitude to learn English among primary students. Turkish Online Journal of Distance Education, 20(2), 176–194. https://doi.org/10.17718/tojde.557862
Alsowat, H. (2016). An EFL flipped classroom teaching model: effects on English language higher-order thinking skills, student engagement and satisfaction. Journal of Education and Practice, 7(9), 108–121. https://www.learntechlib.org/p/195067/
Aurora, A., & Effendi, H. (2019). Pengaruh Penggunaan Media Pembelajaran E-learning terhadap Motivasi Belajar Mahasiswa di Universitas Negeri Padang. JTEV (JURNAL TEKNIK ELEKTRO DAN VOKASIONAL, 05(02), 11–16.
Azid, N., Ali, R. M., El Khuluqo, I., Purwanto, S. E., & Susanti, E. N. (2022). Higher order thinking skills, school-based assessment and students’ mathematics achievement: Understanding teachers’ thoughts. International Journal of Evaluation and Research in Education (IJERE), 11(1), 290. https://doi.org/10.11591/ijere.v11i1.22030
Baji, F., Azadeh, F., Sabaghinejad, Z., & Zalpour, A. (2022). Determinants of e-learning acceptance amongst Iranian postgraduate students. Journal of Global Education and Research, 6(2), 181–191. https://doi.org/10.5038/2577-509X.6.2.1089
Bakarman, A., & Almezeini, N. (2021). Factors influencing students ’ acceptance of e-learning platforms in primary and secondary schools in Saudi Arabia. International Conference E-Learning, 20, 23–33.
Berestova, A., Burdina, G., Lobuteva, L., & Lobuteva, A. (2022). Academic motivation of university students and the factors that influence it in an e-learning environment. Electronic Journal of E-Learning, 20(2), pp201-210. https://doi.org/10.34190/ejel.20.2.2272
Bismala, L., Manurung, Y. H., & Siregar, G. (2022). The impact of e-learning quality and students ’ self -efficacy toward the satisfaction in the using of e-learning. Malaysian Online Journal of Educational Technology, 10(2), 141–150.
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to meta-analysis (2nd ed.). Wiley.
Çalişir, E. Ç. (2022). Reflections of metaverse-based education on e-learning. EJERCongress 2022 Conference Proceedings Internet, 103–115.
Caratiquit, L. J., & Caratiquit, K. (2022). Influence of technical support on technology acceptance model to examine the project PAIR e-learning system in distance learning modality. Participatory Educational Research, 9(5), 467–485. https://doi.org/10.17275/per.22.124.9.5
Choirunissa, L. (2016). Pengaruh pembelajaran e-learning terhadap hasil belajar mata kuliah statistics Mahasiswa Tadris Bahasa Inggris Fakultas Tarbiyah IAIN Walisongo. Phenomenon : Jurnal Pendidikan MIPA, 2(1), 7. https://doi.org/10.21580/phen.2012.2.1.416
Dabiriyan-tehrani, H., & Yamini, S. (2021). Systematic review and meta-analysis of Altruistic and Game-playing love. Studies in Psychology, 42(1), 1–46. https://doi.org/10.1080/02109395.2020.1857596
Dewi, K. A. I. D., Suarsana, I. M., & Juniantari, M. (2020). Pengaruh e-learning berbasis rumah belajar terhadap kemampuan berpikir kritis matematika siswa. Wahana Matematika Dan Sains: Jurnal Matematika, Sains, Dan Pembelajarannya, 14(1), 65–77.
El-Aasar, S. A., & Farghali, G. (2022). Predictive study of the factors and challenges affecting the usability of e-learning platforms in the light of COVID-19. International Journal of Education in Mathematics, Science and Technology, 10(3), 568–589. https://doi.org/10.46328/ijemst.2428
Eroğlu, S., & Bektaş, O. (2021). High school students’ views on the 5E-based STEM learning strategies. Acta Didactica Napocensia, 14(2), 203–215. https://doi.org/10.24193/adn.14.2.15
Fadlelmula, F. K., Sellami, A., & Le, K. (2022). STEM learning during the COVID-19 pandemic in Qatar: Secondary school students’ and teachers’ perspectives. EURASIA Journal of Mathematics, Science and Technology Education, 18(6), 1–13. https://doi.org/10.29333/ejmste/12102
Ferdyan, R., Vauzia, V., Zulyusri, Z., Santosa, T. A., & Razak, A. (2021). Model pendidikan lingkungan hidup: Kegiatan pembelajaran pada siswa sebagai bagian dari lingkungan di era new normal. Natural Science: Jurnal Penelitian Bidang IPA Dan Pendidikan IPA, 7(1), 51–61. https://doi.org/10.15548/nsc.v7i1.2453
Ferry, D., Santosa, T., & Kamil, D. (2020). Pengetahuan mahasiswa Institut Agama Islam Negeri Kerinci tentang teori asal usul manusia. BIOEDUCA : Journal of Biology Education, 1(1), 11. https://doi.org/10.21580/bioeduca.v1i1.4945
Fitri, H., Wahyuni, A., & Mustafa, M. (2018). Pengaruh model problrm based learning (PBL) terhadap kemampuan penyelesaian soal-soal higher order thinking skills (HOTS) pada materi gelombang bunyi di SMA Negeri 1 Darul Imarah. Jurnal Ilmiah Mahasiswa (JIM) Pendidikan Fisika, 3(1), 19–23. https://jim.usk.ac.id/pendidikan-fisika/article/view/18613
Friedensen, R., Lauterbach, A., Kimball, E., & Mwangi, C. G. (2018). Students with high-incidence disabilities in STEM: Barriers encountered in postsecondary learning environments. Journal of Postsecondary Education and Disability, 34(1), 77–90.
Gustria, A., & Fauzi, A. (2020). Efektifitas e-modul pembelajaran fisika berbasis stem education terintegrasi materi perubahan iklim terhadap kompetensi peserta didik. Jurnal Pendidikan Fisika, 9(2), 105–111. https://doi.org/10.22611/jpf.v9i2.15803
Hamad, A. L., Abouelnaga, H. M., Metwally, A. B. mohamed, Shan, H. S., & Moawad, N. F. (2022). The importance of e-learning to the students and teachers. Journal of Language and Linguistic Studies, 18(2), 952–968. https://www.jlls.org/index.php/jlls/article/view/4598
Hasibuan, M. P., Sari, R. P., Syahputra, R. A., & Nahadi, N. (2022). Application of Integrated Project-based and STEM-based e-learning tools to improve students’ creative thinking and self-regulation skills. Jurnal Penelitian Pendidikan IPA, 8(1), 51–56. https://doi.org/10.29303/jppipa.v8i1.1050
Hidayah, R. N., Wiyono, K., & Ismet, I. (2022). Effectiveness of using e-learning at STEM-based sound-wave materials to improve collaboration skills of high school students. Berkala Ilmiah Pendidikan Fisika, 10(3), 331. https://doi.org/10.20527/bipf.v10i3.13850
Hodiyanto, H. (2018). Pengaruh model problem based learning terhadap higher order thingking skills (HOTS) matematis siswa. Buana Matematika: Jurnal Ilmiah Matematika Dan Pendidikan Matematika, 8(2), 101–108. https://doi.org/10.36456/buanamatematika.v8i2:.1750
How, R. P. T. K., Zulnaidi, H., & Rahim, S. S. A. (2021). HOTS in quadratic equations: Teaching style preferences and challenges faced by Malaysian teachers. European Journal of Science and Mathematics Education, 10(1), 15–33. https://doi.org/10.30935/scimath/11382
Ibrahim, D. S., & Suardiman, S. P. (2014). Pengaruh penggunaan e-learning terhadap motivasi dan prestasi belajar matematika siswa SD Negeri Tahunan Yogyakarta. Jurnal Prima Edukasia, 2(1), 66. https://doi.org/10.21831/jpe.v2i1.2645
Ichsan, I., Sofianora, A., Desy, D., Suharyat, Y., Santosa, T. A., & Supriyadi, A. (2023). Pengaruh profesionalitas guru matematika dalam meningkatkan kompetensi siswa era revolusi industri 5.0 di Indonesia: Sebuah meta-analisis. Jurnal Math-UMB.EDU, 10(2), 49–58. https://doi.org/10.36085/mathumbedu.v10i2.4868
Ichsan, I., Suharyat, Y., Santosa, T. A., & Satria, E. (2023). Effectiveness of STEM-based learning in teaching 21 st century skills in generation Z student in science learning: A meta-analysis. Jurnal Penelitian Pendidikan IPA, 9(1), 150–166. https://doi.org/10.29303/jppipa.v9i1.2517
Kahar, M. S., Syahputra, R., Arsyad, R. Bin, Nursetiawan, N., & Mujiarto, M. (2021). Design of student worksheets oriented to higher order thinking skills (HOTS) in physics learning. Eurasian Journal of Educational Research, 21(96), 14–29. https://doi.org/10.14689/ejer.2021.96.2
Kareem, A. (2022). Higher-order thinking skills and scientific attitudes components as predictors of scientific creativity among preservice biology teachers. International Journal of Progressive Education, 18(4), 21–30. https://doi.org/10.29329/ijpe.2022.459.2
Karim, M., Antoni, S., Oktarina, K., & Santosa, T. A. (2023). The effect of teacher professionalism in islamic religious education in the era of society 5.0 in Indonesia: A meta-analysis. Jurnal Pendidikan Dan Konseling, 5(2), 1349–1358. https://doi.org/10.31004/jpdk.v5i2.13129
Kim, N. J., Belland, B. R., & Walker, A. E. (2018). Effectiveness of computer-based scaffolding in the context of problem-based learning for STEM education: Bayesian meta-analysis. Educational Psychology Review, 30(2), 397–429. https://doi.org/10.1007/s10648-017-9419-1
Krasodomska, J., Godawska, J., & Krasodomska, J. (2021). E-learning in accounting education : the influence of students ’ characteristics on their engagement and performance characteristics on their engagement and performance. Accounting Education, 4(2), 22–40. https://doi.org/10.1080/09639284.2020.1867874
Kusuma, L., Sukarmin, S., & Supriyanto, A. (2020). The perceptions of teacher and student in senior high school to the needs of STEM-based e-learning in physics learning process. Proceedings of the 4th International Conference on Learning Innovation and Quality Education, 1–7. https://doi.org/10.1145/3452144.3453757
Kusumantara, K. S. (2017). Pengaruh e-learning schoology terhadap hasil belajar simulasi digital dengan model pembelajaran Savi. Jurnal Pendidikan Teknologi Dan Kejuruan, 14(2), 126–135. https://doi.org/10.23887/jptk-undiksha.v14i2.10387
Lee, R., Looi, K. H., Faulkner, M., & Neale, L. (2021). The moderating influence of environment factors in an extended community of inquiry model of e-learning. Asia Pacific Journal of Education, 41(1), 1–15. https://doi.org/10.1080/02188791.2020.1758032
Makhmudah, S., Suyitno, H., & Rusilowati, A. (2021). Mathematics critical thinking ability reviewing from gender and independent learning students in STEM problem-based learning assisted by web e learning school. Unnes Journal of Mathematics Education Research, 10(2), 211–219. https://journal.unnes.ac.id/sju/index.php/ujmer/article/view/49310
Martínez-Torres, M. R., Marín, S. L. T., García, F. B., Vázquez, S. G., Oliva, M. A., & Torres, T. (2008). A technological acceptance of e-learning tools used in practical and laboratory teaching, according to the European higher education area. Behaviour & Information Technology, 27(6), 495–505. https://doi.org/10.1080/01449290600958965
Milner-Bolotin, M., & Marotto, C. C. F. (2018). Parental engagement in children’s STEM education. Part I: Meta-analysis of the literature. Lumat: International Journal of Math, Science and Technology Education, 6(1), 1–10. https://doi.org/10.31129/LUMAT.6.1.292
Mufida, S. N., Sigit, D. V., & Ristanto, R. H. (2020). Integrated project-based e-learning with science, technology, engineering, arts, and mathematics (PjBeL-STEAM): its effect on science process skills. Biosfer, 13(2), 183–200. https://doi.org/10.21009/biosferjpb.v13n2.183-200
Mujib, M., Mardiyah, M., & Suherman, S. (2020). STEM : Pengaruhnya terhadap literasi matematis dan kecerdasan multiple intelligences. Indonesian Journal of Science and Mathematics Education, 3(1), 66–73. https://doi.org/10.24042/ijsme.v3i1.5448
Murthy, C. S. H. N., & Mathur, G. (2008). Designing e-learning programs for rural social transformation and poverty reduction. Turkish Online Journal of Distance Education, 9(1), 169–179. https://dergipark.org.tr/en/pub/tojde/issue/16915/176484
Musna, R. R., Juandi, D., & Jupri, A. (2021). A meta-analysis study of the effect of problem-based learning model on students’ mathematical problem solving skills. Journal of Physics: Conference Series, 1882(1), 012090. https://doi.org/10.1088/1742-6596/1882/1/012090
Noor, M. E., Hardyanto, W., & Wibawanto, H. (2017). Penggunaan E-learning dalam pembelajaran berbasis proyek di SMA Negeri 1 Jepara. Innovative Journal of Curriculum and Educational Technology, 6(1), 17–26. https://doi.org/10.15294/IJCET.V6I1.15572
Noviyani, A., Maison, M., & Syaiful, S. (2022). The influence of PJBL-Stem and PBL-based on the learning motivation of the students on the mathematical creative thinking skills. Psychology, Evaluation, and Technology in Educational Research, 4(1), 25–35. https://doi.org/10.33292/petier.v4i1.115
Nudin, F. A., Rufi’i, R., & Walujo, D. A. (2021). Pengaruh e-learning, pembelajaran langsung, dan faktor gaya kognitif terhadap hasil belajar prakarya kewirausahaan. Edcomtech: Jurnal Kajian Teknologi Pendidikan, 6(2), 222–235. https://doi.org/10.17977/um039v6i12021p222
Nurochman, R., & Diniya, D. (2022). Pengaruh penerapan model pembelajaran problem based learning (PBL) dengan pendekatan blended learning terhadap higher order thinking skill (HOTS) siswa SMP/MTs pada materi sistem gerak manusia. Journal of Natural Science Learning, 1(1), 61–67. https://jom.uin-suska.ac.id/index.php/JNSL/article/view/14
Nuryatin, A., Mukhibad, H., & Tusyanah, T. (2022). Effectiveness of online learning at universities: Do sociocultural differences matter? European Journal of Educational Research, 11(4), 2153–2166. https://doi.org/10.12973/eu-jer.11.4.2153
Oktarina, K., Suhaimi, S., Santosa, T. A., Razak, A., Irdawati, I., Ahda, Y., Lufri, L., & Putri, D. H. (2021). Meta-analysis: The effectiveness of using blended learning on multiple intelligences and student character education during the Covid-19 period. IJECA (International Journal of Education and Curriculum Application), 4(3), 184–192. https://doi.org/10.31764/ijeca.v4i3.5505
Putranta, H., Supahar, S., Dwandaru, W. S. B., Warsono, W., & Abdulfattah, A. (2021). The effect of smartphone usage intensity on high school students’ higher order thinking skills in physics learning. Journal of Turkish Science Education, 18(3), 421–438. https://www.tused.org/index.php/tused/article/view/836
Rahman, A., Santosa, T. A., Suharyat, Y., Aprilisia, S., & Suhaimi, S. (2023). The effectiveness of AI-based blended learning on student scientific literacy. LITERACY : International Scientific Journals Of Social, Education and Humaniora, 2(1), 141–150. https://doi.org/10.56910/literacy.v2i1.542
Razak, A., Santosa, T. A., Lufri, L., & Zulyusri, Z. (2021). Meta-analisis: Pengaruh soal HOTS (higher order thinking skill) terhadap kemampuan literasi sains dan lesson study siswa pada materi ekologi dan lingkungan pada masa pandemi Covid-19. Bioedusiana: Jurnal Pendidikan Biologi, 6(1), 79–87. https://doi.org/10.37058/bioed.v6i1.2930
Rintayati, P., Lukitasari, H., & Syawaludin, A. (2021). Development of two-tier multiple choice test to assess indonesian elementary students’ higher-order thinking skills. International Journal of Instruction, 14(1), 555–566. https://doi.org/10.29333/iji.2021.14133a
Riyanti, R. (2020). Efektivitas penggunaan perangkat pembelajaran project based learning (PjBL) terintegrasi STEM berbasis e-learning untuk meningkatkan kemampuan berpikir kreatif. DWIJA CENDEKIA: Jurnal Riset Pedagogik, 4(2), 206. https://doi.org/10.20961/jdc.v4i2.45276
Saepuzaman, D., Retnawati, H., Istiyono, E., & Haryanto, H. (2021). Can innovative learning affect students’ HOTS achievements? A meta-analysis study. Pegem Journal of Education and Instruction, 11(4), 290–305. https://doi.org/10.47750/pegegog.11.04.28
Saleem, M., Kamarudin, S., Shoaib, H. M., & Nasar, A. (2023). Influence of augmented reality app on intention towards e-learning amidst COVID-19 pandemic. Interactive Learning Environments, 31(5), 3083–3097. https://doi.org/10.1080/10494820.2021.1919147
Santosa, T. A., Razak, A., Lufri, L., Zulyusri, Z., Fradila, E., & Arsih, F. (2021). Meta-analisis: Pengaruh bahan ajar berbasis pendekatan STEM pada pembelajaran ekologi. Journal of Digital Learning and Education, 1(01), 1–9. https://doi.org/10.52562/jdle.v1i01.24
Santosa, T. A., Sepriyani, E. M., & Razak, A. (2021). Analisis e-learning dalam pembelajaran evolusi mahasiswa pendidikan biologi selama pandemi Covid-19. Jurnal Edumaspul, 5(1), 66–70. https://ummaspul.e-journal.id/maspuljr/article/view/1027
Saraç, H. (2018). The effect of science, technology, engineering and mathematics-STEM educational practices on students’ learning outcomes: A meta-analysis study. Turkish Online Journal of Educational Technology - TOJET, 17(2), 125–142. http://www.tojet.net/volumes/v17i2.pdf#page=135
Sari, I. P., Rahmah, P. J., & Arifah, M. N. (2021). Pengaruh e-learning terhadap HOTS (higher order thinking skills) mahasiswa Universitas Islam Indonesia. At-Thullab : Jurnal Mahasiswa Studi Islam, 2(2), 455–468. https://doi.org/10.20885/tullab.vol2.iss2.art6
Saryanto, S., Sumiharsono, R., Ramadhan, S., & Suprapto, E. (2020). The analysis of instrument quality to measure the students higher order thinking skill in physics learning. Turkish Journal of Science Education, 17(4), 520–527. https://doi.org/10.36681/tused.2020.42
Shanti, M. R. S., Istiyono, E., & Munadi, S. (2022). The effectiveness of learning to improve students’ higher-order thinking skills. Cypriot Journal of Educational Sciences, 17(5), 1576–1587. https://doi.org/10.18844/cjes.v17i5.7220
Sigit, D. V., Ristanto, R. H., & Mufida, S. N. (2022). Integration of project-based e-learning with STEAM: An innovative solution to learn ecological concept. International Journal of Instruction, 15(3), 23–40. https://doi.org/10.29333/iji.2022.1532a
Suharyat, Y., Ichsan, I., Satria, E., Santosa, T. A., & Amalia, K. N. (2022). Meta-analisis Penerapan model pembelajaran problem based learning untuk meningkatkan ketrampilan abad-21 siswa dalam pembelajaran IPA Universitas Pahlawan Tuanku Tambusai. Jurnal Pendidikan Dan Konseling, 4(5), 5081–5088. https://doi.org/10.31004/jpdk.v4i5.7455
Suherman, Prananda, M. R., Proboningrum, D. I., Pratama, E. R., Laksono, P., & Amiruddin. (2020). Improving higher order thinking skills (HOTS) with project based learning (PjBL) model assisted by Geogebra. Journal of Physics: Conference Series, 1467(1), 012027. https://doi.org/10.1088/1742-6596/1467/1/012027
Suparman, S., Yohannes, Y., & Arifin, N. (2021). Enhancing mathematical problem-solving skills of indonesian junior high school students through problem-based learning : A systematic review and meta-analysis. Al-Jabar: Jurnal Pendidikan Matematika, 12(1), 1–16. https://ejournal.radenintan.ac.id/index.php/al-jabar/article/view/8036
Supriyadi, A., Desy, D., Suharyat, Y., Santosa, T. A., & Sofianora, A. (2023). The effectiveness of STEM-integrated blended learning on Indonesia student scientific literacy: A meta-analysis. International Journal of Education and Literature, 2(1), 41–48. https://doi.org/10.55606/ijel.v2i1.53
Sury, K., Wiyono, K., & Siahaan, S. M. (2022). Effectiveness of using e-learning at STEM-based physics learning to improve communication skills of high school students. Jurnal Ilmiah Pendidikan Fisika, 6(3), 539. https://doi.org/10.20527/jipf.v6i3.5781
Syafryadin, S., Wardhana, D. E. C., Noermanzah, N., Agus, R., & Awaluddin, A. (2022). Students’ perspective and problems in implementing higher order thinking skill (HOTS) in speaking for presentation class. Journal of Language and Linguistic Studies, 18(1), 477–487. https://doi.org/10.52462/jlls.196
Takiddin, T., Jalal, F., & Neolaka, A. (2020). Improving higher order thinking skills through project-based learning in primary schools. TARBIYA: Journal of Education in Muslim Society, 7(1), 16–28. https://doi.org/10.15408/tjems.v7i1.14052
Tsaparlis, G. (2020). Higher and lower-order thinking skills: The case of chemistry revisited. Journal of Baltic Science Education, 19(3), 467–483. https://doi.org/10.33225/jbse/20.19.467
Tyas, M. A., Nurkamto, J., & Marmanto, S. (2020). Cultivating students’ higher-order thinking skills in efl classes: The role of the teacher and the textbook. International Online Journal of Education and Teaching (IOJET), 7(1), 267–276. https://iojet.org/index.php/IOJET/article/view/773
Wardani, N. E., Kurwidaria, F., & Supriyadi, F. (2020). Higher order thinking skills dalam pembelajaran Bahasa dan Sastra Indonesia di sekolah menengah pertama Kota Madiun. Lingua Didaktika: Jurnal Bahasa Dan Pembelajaran Bahasa, 14(1), 29. https://doi.org/10.24036/ld.v14i1.108330
Widyaningsih, S. W., Yusuf, I., Prasetyo, Z. K., & Istiyono, E. (2021). The development of the HOTS test of physics based on modern test theory: Question modeling through e-learning of Moodle LMS. International Journal of Instruction, 14(4), 51–68. https://doi.org/10.29333/iji.2021.1444a
Wijayanto, T., Supriadi, B., & Nuraini, L. (2020). Pengaruh model pembelajaran project based learning dengan pendekatan STEM terhadap hasil belajar siswa SMA. Jurnal Pembelajaran Fisika, 9(3), 113. https://doi.org/10.19184/jpf.v9i3.18561
Wiyono, K., Sury, K., Hidayah, R. N., Nazhifah, N., Ismet, I., & Sudirman, S. (2022). STEM-based e-learning: implementation and effect on communication and collaboration skills on wave topic. Jurnal Penelitian & Pengembangan Pendidikan Fisika, 8(2), 259–270. https://doi.org/10.21009/1.08208
Yaniawati, R. P. (2013). Pengaruh e-learning untuk meningkatkan daya matematik mahasiswa. Jurnal Cakrawala Pendidikan, 31(3), 381–393. https://doi.org/10.21831/cp.v0i3.1137
Yusoff, W. M. W., & Seman, S. C. (2018). Teachers’ Knowledge of higher order thinking and questioning skills: A case study at a primary school in Terengganu, Malaysia. International Journal of Academic Research in Progressive Education and Development, 7(2). https://doi.org/10.6007/IJARPED/v7-i2/4120
Zeng, Z., Yao, J., Gu, H., & Przybylski, R. (2018). A meta-analysis on the effects of STEM education on students’ abilities. Science Insights Education Frontiers, 1(1), 3–16. https://doi.org/10.15354/sief.18.re005
Zulkifli, Z., Supriyadi, A., Satria, E., & Santosa, T. A. (2022). Meta-analysis: The effectiveness of the integrated STEM technology pedagogical content knowledge learning model on the 21st century skills of high school students in the science department. International Journal of Education and Literature, 1(2), 68–76. https://doi.org/10.55606/ijel.v1i2.32
Zulyusri, Z., Desy, D., Santosa, T. A., & Yulianti, S. (2022). Meta-analysis: The effect of the technological pedagogical content knowledge (TPACK) model through online learning on biology learning outcomes, learning effectiveness, and 21st century competencies of post-COVID-19 students and teachers. International Journal of Progressive Sciences and Technologies, 34(2), 285. https://doi.org/10.52155/ijpsat.v34.2.4631
Zulyusri, Z., Elfira, I., Lufri, L., & Santosa, T. A. (2023). Literature study: utilization of the PjBL model in science education to improve creativity and critical thinking skills. Jurnal Penelitian Pendidikan IPA, 9(1), 133–143. https://doi.org/10.29303/jppipa.v9i1.2555
Zulyusri, Z., Santosa, T. A., Festiyed, F., Yerimadesi, Y., Yohandri, Y., Razak, A., & Sofianora, A. (2023). Effectiveness of STEM learning based on design thinking in improving critical thinking skills in science learning: A meta-analysis. Jurnal Penelitian Pendidikan IPA, 9(6), 112–119. https://doi.org/10.29303/jppipa.v9i6.3709