Development of instruments for DIVAYANA evaluation model
##plugins.themes.bootstrap3.article.main##
Abstract
The purpose of this research showed a valid DIVAYANA evaluation model instruments were used to evaluate the implementation of e-learning. This research approach was the development of evaluation instruments. The evaluation instruments developed were in the form of interview guides and questionnaires. The interview guidelines that resulted were related to several DIVAYANA evaluation components, included: the Description component, Input component, Verification component, and Yack component. Questionnaires were generated on several DIVAYANA evaluation components, included: the Verification component, Action component, and Yack component. The subjects involved in the content validity test of the interview guidelines were two experts, including an informatics education expert and an educational evaluation expert. The content validity tests of questionnaires were conducted by six experts, including three education evaluation experts and three informatics education experts. The content validity calculation process of the interview guidelines used the Gregory formula, while the content validity of the questionnaires used Lawshe’s CVR formula. The content validity average of interview guidelines on the Description, Input, Verification, and Yack components was 0.882 so it was included in the very good category. The content validity average of questionnaires on the Verification, Action, and Yack components was 0.774 so it was in a good category. The implication of this research is the realization of valid measuring instruments that can be used in evaluating the implementation of e-learning.
Aldapit, E., & Suharjana, S. (2019). CIPP evaluation model for the coaching program of running athletes. Psychology, Evaluation, and Technology in Educational Research, 1(2). https://doi.org/10.33292/petier.v1i2.10
Ardi, Z., Syahril, S., & Anwar, M. (2020). Evaluation of digital simulation learning based e-learning in SMK Negeri 2 Padang. International Journal of Educational Dynamics, 2(1), 188–198. https://doi.org/10.24036/ijeds.v2i1.245
Arifin, Z., Kartono, K., & Supriyadi, S. (2018). Development of authentic assessment instrument for performance in learning mathematics in linear program. Journal of Research and Educational Research Evaluation, 7(2), 154–162. https://doi.org/10.15294/jere.v7i2.24884
Barteit, S., Guzek, D., Jahn, A., Bärnighausen, T., Jorge, M. M., & Neuhann, F. (2020). Evaluation of e-learning for medical education in low- and middle-income countries: A systematic review. Computers & Education, 145, 103726. https://doi.org/10.1016/j.compedu.2019.103726
Divayana, D. G. H. (2020). Utilization of DIVAYANA formula in evaluating of suitable platforms for online learning in the social distancing. International Journal of Interactive Mobile Technologies (IJIM), 14(20), 50. https://doi.org/10.3991/ijim.v14i20.15787
Erfan, M., Maulyda, M. A., Ermiana, I., Hidayati, V. R., & Widodo, A. (2020). Validity and reliability of cognitive tests study and development of elementary curriculum using Rasch model. Psychology, Evaluation, and Technology in Educational Research, 3(1). https://doi.org/10.33292/petier.v3i1.51
Fitriyanto, J. N., Widjanarko, D., & Khumaedi, M. K. (2019). Validity and reliability test of assessment instrument of the suitability of electric power steering media. Journal of Vocational and Career Education, 4(1). https://doi.org/10.15294/jvce.v4i1.22186
Ghazali, N. H. M. (2016). A reliability and validity of an instrument to evaluate the school-based assessment system: A pilot study. International Journal of Evaluation and Research in Education (IJERE), 5(2), 148–157. https://doi.org/http://dx.doi.org/10.11591/ijere.v5i2.4533
Ghazali, N., Nordin, M. S., Hashim, S., & Hussein, S. (2018). Measuring content validity: Studentsr self-efficacy and meaningful learning in massive open online course (MOOC) scale. Proceedings of the International Conference on Education in Muslim Society (ICEMS 2017). https://doi.org/10.2991/icems-17.2018.25
Guspatni, G., & Kurniawati, Y. (2018). Validity and reliability testing of an e-learning questionnaire for chemistry instruction. IOP Conference Series: Materials Science and Engineering, 335, 012102. https://doi.org/10.1088/1757-899X/335/1/012102
Hapsari, S. I., Sugiyarto, K. H., & Kosaka, N. (2018). An evaluation of application of information technology and communication of learning science with the theme of solar system. Psychology, Evaluation, and Technology in Educational Research, 1(1), 41. https://doi.org/10.33292/petier.v1i1.18
Hung, J.-L., & Yang, D. (2015). The validation of an instrument for evaluating the effectiveness of professional development program on teaching online. Journal of Educational Technology Development and Exchange, 8(1). https://doi.org/10.18785/jetde.0801.02
Ismanto, I. (2016). Aspect of language on a qualitative analysis of student’s evaluation instrument. QIJIS (Qudus International Journal of Islamic Studies), 4(2), 218. https://doi.org/10.21043/qijis.v4i2.1788
Kadir, J. S., Zaim, M., & Refnaldi, R. (2019). Developing instruments for evaluating validity, practicality, and effectiveness of the authentic assessment for speaking skill at junior high school. Proceedings of the Sixth of International Conference on English Language and Teaching (ICOELT 2018). https://doi.org/10.2991/icoelt-18.2019.14
Mahendra, I. W. E., Jayantika, I. G. N. A. T., Sumandya, I. W., Suarni, N. M., Ariawati, N. W., Sugiharni, G. A. D., & Divayana, D. G. H. (2020). Design of digital test using wondershare in supporting the blended learning with kelase platform. Universal Journal of Educational Research, 8(3), 953–959. https://doi.org/10.13189/ujer.2020.080330
Mahmoudian, A., Torabi Chafjiri, R., Alipour, A., Shamsalinia, A., & Ghaffari, F. (2018). The design and evaluation of psychometric properties for a questionnaire on elderly abuse by family caregivers among older adults on hemodialysis. Clinical Interventions in Aging, Volume 13, 555–563. https://doi.org/10.2147/CIA.S149338
Ngadiarti, I., Jauhari, A., El Jannah, S., Sulistyo, J., & Dwirahmadi, F. (2020). Quality validation of learning outcomes test instrument of core courses in Polytechnics Health Jakarta II, Indonesia. Annals of Tropical Medicine and Public Health, 23(08). https://doi.org/10.36295/ASRO.2020.23811
Nuruhidin, A., Putra, F., Pamungkas, O. I., Ardiyanto, H., & Saputro, D. P. (2018). An evaluation of powerlifting and weightlifting development program. Psychology, Evaluation, and Technology in Educational Research, 1(1), 1–8. https://doi.org/10.33292/petier.v1i1.19
Panyajamorn, T., Suanmali, S., Kohda, Y., Chongphaisal, P., & Supnithi, T. (2018). Effectiveness of elearning design and affecting variables in Thai public schools. Malaysian Journal of Learning and Instruction, 15(1), 1–34.
Quintas, C., Silva, I. F., & Teixeira, A. (2017). Assessing an e-learning and b-learning model — A study of perceived satisfaction. International Journal of Information and Education Technology, 7(4), 265–268. https://doi.org/10.18178/ijiet.2017.7.4.878
Rachman, T., & Napitupulu, D. B. (2017). Rasch model for validation a user acceptance instrument for evaluating e-learning system. CommIT (Communication and Information Technology) Journal, 11(1), 9. https://doi.org/10.21512/commit.v11i1.2042
Ramadani, M., Supahar, S., & Rosana, D. (2017). Validity of evaluation instrument on the implementation of performance assessment to measure science process skills. Jurnal Inovasi Pendidikan IPA, 3(2), 180. https://doi.org/10.21831/jipi.v3i2.15534
Retnawati, H. (2016). Proving content validity of self-regulated learning scale (The comparison of Aiken index and expanded Gregory index). 2(2). https://doi.org/10.21831/reid.v2i2.11029
Santoso, B., Marchira, C. R., & Sumarni, P. (2017). Development and validity and reliability tests of professionalism assessment instrument in psychiatry residents. Jurnal Pendidikan Kedokteran Indonesia: The Indonesian Journal of Medical Education, 6(1), 60. https://doi.org/10.22146/jpki.25369
Setiawan, R., & Munajah, R. (2020). Evaluation of the application of online learning in Indonesian Universities. TEM Journal, 9(3), 1194–1199. https://doi.org/10.18421/TEM93-46
Shrotryia, V. K., & Dhanda, U. (2019). Content validity of assessment instrument for employee engagement. SAGE Open, 9(1), 215824401882175. https://doi.org/10.1177/2158244018821751
Singh, U. G., & De Villiers, M. R. (2017). An evaluation framework and instrument for evaluating e-assessment tools. The International Review of Research in Open and Distributed Learning, 18(6). https://doi.org/10.19173/irrodl.v18i6.2804
Sugiharni, G. A. D., Setiasih, N. W., Mahendra, I., Ardana, I., & Divayana, D. G. H. (2018). Development of alkin model instruments as evaluation tools of blended learning implementation in discrete mathematics course on STIKOM Bali. Journal of Theoretical and Applied Information Technology, 96(17), 5803–5818. http://www.jatit.org/volumes/Vol96No17/15Vol96No17.pdf
Suryaman, H., Kusnan, K., & Mubarok, H. (2020). Profile of online learning in building engineering education study program during the Covid-19 pandemic. IJORER : International Journal of Recent Educational Research, 1(2), 63–77. https://doi.org/10.46245/ijorer.v1i2.42
Sutrisna, I. P. E., Ratminingsih, N. M., & Artini, L. P. (2018). Mall-based English instruction. JPI (Jurnal Pendidikan Indonesia), 7(1), 30–40. https://doi.org/10.23887/jpi-undiksha.v7i1.13191
Taherdoost, H. (2016). Validity and reliability of the research instrument; how to test the validation of a questionnaire/survey in a research. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.3205040
Torkian, S., Shahesmaeili, A., Malekmohammadi, N., & Khosravi, V. (2020). Content validity and test-retest reliability of a questionnaire to measure virtual social network addiction among students. International Journal of High Risk Behaviors and Addiction, 9(1). https://doi.org/10.5812/ijhrba.92353
Vakili, M. M., & Jahangiri, N. (2018). Content validity and reliability of the measurement tools in educational, behavioral, and health sciences research. Journal of Medical Education Development, 10(28), 106–118. https://doi.org/10.29252/edcj.10.28.106
Widiharti, W., Tola, B., & Supriyat, Y. (2019). Evaluation of principal partnership programs in the directorate of education management - The application of Kirkpartick and countenance stake evaluation model. Universal Journal of Educational Research, 7(9A), 71–77. https://doi.org/10.13189/ujer.2019.071609
Yudiana, Y., Hidayat, Y., Hambali, B., & Slamat, S. (2017). Content validity estimation of assessment instrument based on volleyball information system of volleyball learning: field research. IOP Conference Series: Materials Science and Engineering, 180, 012230. https://doi.org/10.1088/1757-899X/180/1/012230
Zamanzadeh, V., Ghahramanian, A., Rassouli, M., Abbaszadeh, A., Alavi-Majd, H., & Nikanfar, A.-R. (2015). Design and implementation content validity study: development of an instrument for measuring patient-centered communication. Journal of Caring Sciences, 4(2), 165–178. https://doi.org/10.15171/jcs.2015.017
##plugins.themes.bootstrap3.article.details##
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
The Authors submitting a manuscript do so on the understanding that if accepted for publication, copyright publishing of the article shall be assigned to Psychology, Evaluation, and Technology in Educational Research
Psychology, Evaluation, and Technology in Educational Research is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.