Development of instruments for DIVAYANA evaluation model

Dewa Gede Hendra Divayana(1*), P Wayan Arta Suyasa(2), Ni Ketut Widiartini(3),

(1) Universitas Pendidikan Ganesha
(2) Universitas Pendidikan Ganesha
(3) Universitas Pendidikan Ganesha
(*) Corresponding Author

Abstract


The purpose of this research showed a valid DIVAYANA evaluation model instruments were used to evaluate the implementation of e-learning. This research approach was the development of evaluation instruments. The evaluation instruments developed were in the form of interview guides and questionnaires. The interview guidelines that resulted were related to several DIVAYANA evaluation components, included: the Description component, Input component, Verification component, and Yack component. Questionnaires were generated on several DIVAYANA evaluation components, included: the Verification component, Action component, and Yack component. The subjects involved in the content validity test of the interview guidelines were two experts, including an informatics education expert and an educational evaluation expert. The content validity tests of questionnaires were conducted by six experts, including three education evaluation experts and three informatics education experts. The content validity calculation process of the interview guidelines used the Gregory formula, while the content validity of the questionnaires used Lawshe’s CVR formula. The content validity average of interview guidelines on the Description, Input, Verification, and Yack components was 0.882 so it was included in the very good category. The content validity average of questionnaires on the Verification, Action, and Yack components was 0.774 so it was in a good category. The implication of this research is the realization of valid measuring instruments that can be used in evaluating the implementation of e-learning.


Keywords


Instruments; Interview Guidelines; Questionnaires; Content Validity; DIVAYANA Model.

Full Text:

Fulltext PDF

References


Aldapit, E., & Suharjana, S. (2019). CIPP evaluation model for the coaching program of running athletes. Psychology, Evaluation, and Technology in Educational Research, 1(2). https://doi.org/10.33292/petier.v1i2.10

Ardi, Z., Syahril, S., & Anwar, M. (2020). Evaluation of digital simulation learning based e-learning in SMK Negeri 2 Padang. International Journal of Educational Dynamics, 2(1), 188–198. https://doi.org/10.24036/ijeds.v2i1.245

Arifin, Z., Kartono, K., & Supriyadi, S. (2018). Development of authentic assessment instrument for performance in learning mathematics in linear program. Journal of Research and Educational Research Evaluation, 7(2), 154–162. https://doi.org/10.15294/jere.v7i2.24884

Barteit, S., Guzek, D., Jahn, A., Bärnighausen, T., Jorge, M. M., & Neuhann, F. (2020). Evaluation of e-learning for medical education in low- and middle-income countries: A systematic review. Computers & Education, 145, 103726. https://doi.org/10.1016/j.compedu.2019.103726

Divayana, D. G. H. (2020). Utilization of DIVAYANA formula in evaluating of suitable platforms for online learning in the social distancing. International Journal of Interactive Mobile Technologies (IJIM), 14(20), 50. https://doi.org/10.3991/ijim.v14i20.15787

Erfan, M., Maulyda, M. A., Ermiana, I., Hidayati, V. R., & Widodo, A. (2020). Validity and reliability of cognitive tests study and development of elementary curriculum using Rasch model. Psychology, Evaluation, and Technology in Educational Research, 3(1). https://doi.org/10.33292/petier.v3i1.51

Fitriyanto, J. N., Widjanarko, D., & Khumaedi, M. K. (2019). Validity and reliability test of assessment instrument of the suitability of electric power steering media. Journal of Vocational and Career Education, 4(1). https://doi.org/10.15294/jvce.v4i1.22186

Ghazali, N. H. M. (2016). A reliability and validity of an instrument to evaluate the school-based assessment system: A pilot study. International Journal of Evaluation and Research in Education (IJERE), 5(2), 148–157. https://doi.org/http://dx.doi.org/10.11591/ijere.v5i2.4533

Ghazali, N., Nordin, M. S., Hashim, S., & Hussein, S. (2018). Measuring content validity: Studentsr self-efficacy and meaningful learning in massive open online course (MOOC) scale. Proceedings of the International Conference on Education in Muslim Society (ICEMS 2017). https://doi.org/10.2991/icems-17.2018.25

Guspatni, G., & Kurniawati, Y. (2018). Validity and reliability testing of an e-learning questionnaire for chemistry instruction. IOP Conference Series: Materials Science and Engineering, 335, 012102. https://doi.org/10.1088/1757-899X/335/1/012102

Hapsari, S. I., Sugiyarto, K. H., & Kosaka, N. (2018). An evaluation of application of information technology and communication of learning science with the theme of solar system. Psychology, Evaluation, and Technology in Educational Research, 1(1), 41. https://doi.org/10.33292/petier.v1i1.18

Hung, J.-L., & Yang, D. (2015). The validation of an instrument for evaluating the effectiveness of professional development program on teaching online. Journal of Educational Technology Development and Exchange, 8(1). https://doi.org/10.18785/jetde.0801.02

Ismanto, I. (2016). Aspect of language on a qualitative analysis of student’s evaluation instrument. QIJIS (Qudus International Journal of Islamic Studies), 4(2), 218. https://doi.org/10.21043/qijis.v4i2.1788

Kadir, J. S., Zaim, M., & Refnaldi, R. (2019). Developing instruments for evaluating validity, practicality, and effectiveness of the authentic assessment for speaking skill at junior high school. Proceedings of the Sixth of International Conference on English Language and Teaching (ICOELT 2018). https://doi.org/10.2991/icoelt-18.2019.14

Mahendra, I. W. E., Jayantika, I. G. N. A. T., Sumandya, I. W., Suarni, N. M., Ariawati, N. W., Sugiharni, G. A. D., & Divayana, D. G. H. (2020). Design of digital test using wondershare in supporting the blended learning with kelase platform. Universal Journal of Educational Research, 8(3), 953–959. https://doi.org/10.13189/ujer.2020.080330

Mahmoudian, A., Torabi Chafjiri, R., Alipour, A., Shamsalinia, A., & Ghaffari, F. (2018). The design and evaluation of psychometric properties for a questionnaire on elderly abuse by family caregivers among older adults on hemodialysis. Clinical Interventions in Aging, Volume 13, 555–563. https://doi.org/10.2147/CIA.S149338

Ngadiarti, I., Jauhari, A., El Jannah, S., Sulistyo, J., & Dwirahmadi, F. (2020). Quality validation of learning outcomes test instrument of core courses in Polytechnics Health Jakarta II, Indonesia. Annals of Tropical Medicine and Public Health, 23(08). https://doi.org/10.36295/ASRO.2020.23811

Nuruhidin, A., Putra, F., Pamungkas, O. I., Ardiyanto, H., & Saputro, D. P. (2018). An evaluation of powerlifting and weightlifting development program. Psychology, Evaluation, and Technology in Educational Research, 1(1), 1–8. https://doi.org/10.33292/petier.v1i1.19

Panyajamorn, T., Suanmali, S., Kohda, Y., Chongphaisal, P., & Supnithi, T. (2018). Effectiveness of elearning design and affecting variables in Thai public schools. Malaysian Journal of Learning and Instruction, 15(1), 1–34.

Quintas, C., Silva, I. F., & Teixeira, A. (2017). Assessing an e-learning and b-learning model — A study of perceived satisfaction. International Journal of Information and Education Technology, 7(4), 265–268. https://doi.org/10.18178/ijiet.2017.7.4.878

Rachman, T., & Napitupulu, D. B. (2017). Rasch model for validation a user acceptance instrument for evaluating e-learning system. CommIT (Communication and Information Technology) Journal, 11(1), 9. https://doi.org/10.21512/commit.v11i1.2042

Ramadani, M., Supahar, S., & Rosana, D. (2017). Validity of evaluation instrument on the implementation of performance assessment to measure science process skills. Jurnal Inovasi Pendidikan IPA, 3(2), 180. https://doi.org/10.21831/jipi.v3i2.15534

Retnawati, H. (2016). Proving content validity of self-regulated learning scale (The comparison of Aiken index and expanded Gregory index). 2(2). https://doi.org/10.21831/reid.v2i2.11029

Santoso, B., Marchira, C. R., & Sumarni, P. (2017). Development and validity and reliability tests of professionalism assessment instrument in psychiatry residents. Jurnal Pendidikan Kedokteran Indonesia: The Indonesian Journal of Medical Education, 6(1), 60. https://doi.org/10.22146/jpki.25369

Setiawan, R., & Munajah, R. (2020). Evaluation of the application of online learning in Indonesian Universities. TEM Journal, 9(3), 1194–1199. https://doi.org/10.18421/TEM93-46

Shrotryia, V. K., & Dhanda, U. (2019). Content validity of assessment instrument for employee engagement. SAGE Open, 9(1), 215824401882175. https://doi.org/10.1177/2158244018821751

Singh, U. G., & De Villiers, M. R. (2017). An evaluation framework and instrument for evaluating e-assessment tools. The International Review of Research in Open and Distributed Learning, 18(6). https://doi.org/10.19173/irrodl.v18i6.2804

Sugiharni, G. A. D., Setiasih, N. W., Mahendra, I., Ardana, I., & Divayana, D. G. H. (2018). Development of alkin model instruments as evaluation tools of blended learning implementation in discrete mathematics course on STIKOM Bali. Journal of Theoretical and Applied Information Technology, 96(17), 5803–5818. http://www.jatit.org/volumes/Vol96No17/15Vol96No17.pdf

Suryaman, H., Kusnan, K., & Mubarok, H. (2020). Profile of online learning in building engineering education study program during the Covid-19 pandemic. IJORER : International Journal of Recent Educational Research, 1(2), 63–77. https://doi.org/10.46245/ijorer.v1i2.42

Sutrisna, I. P. E., Ratminingsih, N. M., & Artini, L. P. (2018). Mall-based English instruction. JPI (Jurnal Pendidikan Indonesia), 7(1), 30–40. https://doi.org/10.23887/jpi-undiksha.v7i1.13191

Taherdoost, H. (2016). Validity and reliability of the research instrument; how to test the validation of a questionnaire/survey in a research. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.3205040

Torkian, S., Shahesmaeili, A., Malekmohammadi, N., & Khosravi, V. (2020). Content validity and test-retest reliability of a questionnaire to measure virtual social network addiction among students. International Journal of High Risk Behaviors and Addiction, 9(1). https://doi.org/10.5812/ijhrba.92353

Vakili, M. M., & Jahangiri, N. (2018). Content validity and reliability of the measurement tools in educational, behavioral, and health sciences research. Journal of Medical Education Development, 10(28), 106–118. https://doi.org/10.29252/edcj.10.28.106

Widiharti, W., Tola, B., & Supriyat, Y. (2019). Evaluation of principal partnership programs in the directorate of education management - The application of Kirkpartick and countenance stake evaluation model. Universal Journal of Educational Research, 7(9A), 71–77. https://doi.org/10.13189/ujer.2019.071609

Yudiana, Y., Hidayat, Y., Hambali, B., & Slamat, S. (2017). Content validity estimation of assessment instrument based on volleyball information system of volleyball learning: field research. IOP Conference Series: Materials Science and Engineering, 180, 012230. https://doi.org/10.1088/1757-899X/180/1/012230

Zamanzadeh, V., Ghahramanian, A., Rassouli, M., Abbaszadeh, A., Alavi-Majd, H., & Nikanfar, A.-R. (2015). Design and implementation content validity study: development of an instrument for measuring patient-centered communication. Journal of Caring Sciences, 4(2), 165–178. https://doi.org/10.15171/jcs.2015.017




DOI: http://dx.doi.org/10.33292/petier.v3i2.68

Article Metrics

Abstract view : 201 times
Fulltext PDF - 40 times

Refbacks

  • There are currently no refbacks.


Copyright (c) 2021 Psychology, Evaluation, and Technology in Educational Research

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Our Journal indexed by:

Psychology, Evaluation, and Technology in Educational Research
ISSN: 2622-5506

Creative Commons License
Psychology, Evaluation, and Technology in Educational Research is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. Based on a work at http://petier.org/index.php/PETIER.

 

PETiER Stats