The Development of a Guideline in Assessing Students’ Creation Video-Based Project in Programming Subject
Keywords:assessment; guideline; video-based assessment; programming subject
Currently, many video-based assessments of students’ practical and clinical works in several subjects, especially in the medical field, have been widely studied. However, studies that focus on such assessments of student learning of programming subject are seriously lacking. To make matters worse, there are no guidelines for teachers to implement such an assessment. Premised in this context, this research was conducted to develop a guideline for assessing students’ video-based creation in programming subject. This study was based on a qualitative methodology comprising two phases. In the first phase, a structured interview involving ten computer science (ASK) teachers, who were randomly selected from a Malaysian public school, was carried out to help determine the essential components and subcomponents of the guideline. The results of the first phase were reviewed and refined during the second phase, which involved a focus-group discussion with seven experts from four relevant fields: computer science, information technology education and assessment, educational technology, and assessment, and multimedia. The five previously identified components were validated based on their expert judgement, and a number of new subcomponents were also identified, bringing the total number of subcomponents for the proposed implementation guideline up to 21. In practical terms, programming teachers can utilise this new guideline to evaluate their students' learning performance in programming subject based on their video creations in programming classes.
Abujaja, A. M., & Abukari, A. (2019). Editorials : Using effective assessment to improve teaching and learning. Journal for Researching Education Practice and Theory (JREPT), 2(1), 1–3. https://bspace.buid.ac.ae/bitstream/handle/1234/1437/Editorials -
Adila, R., Hartono, Y., Indaryanti, Scristia, & Yusup, M. (2020). The effect of creative problem-solving models on students’ higher level thinking skills in linear programming. Journal of Physics: Conference Series, 1480(1), 1–5. https://doi.org/10.1088/1742-6596/1480/1/012047
Al-Mahrooqi, R., & Denman, C. (2018). Alternative Assessment. In J. I. Liontas (Ed.), The TESOL Encyclopedia of English Language Teaching (1st ed., Vol. 8, pp. 4851–4856). John Wiley & Sons, Inc. https://doi.org/10.1002/9781118784235.eelt0325
Amin, H. A., Khalil, H., Khaled, D., Mahdi, M., Fathelbab, M., & Gaber, D. A. (2021). Case item creation and video case presentation as summative assessment tools for distance learning in the pandemic era. Med J Armed Forces India, 77(2), S466-S474. https://doi.org/10.14293/S2199-1006.1.SOR-.PPKTXZI.v1
Baleni, Z. G. (2015). Online formative assessment in higher education: Its pros and cons. The Electronic Journal of E-Learning, 13(4), 228–236. https://files.eric.ed.gov/fulltext/EJ1062122.pdf
B?rdule, K. (2021). E-learning tools for the flipped learning in elementary school. Baltic J. Modern Computing, 9(4), 453–465. https://doi.org/10.22364/bjmc.2021.9.4.05
Bergmann, J., & Sams, A. (2012). Flip your classroom: Reach every student in every class every day (1st ed.). International Society for Technology in Education, 2012.
Brame, C. J. (2016). Effective educational videos: Principles and guidelines for maximizing student learning from video content. CBE Life Sciences Education, 15(6), 1–2. https://doi.org/10.1187/cbe.16-03-0125
Caratozzolo, P., Lara-Prieto, V., Hosseini, S., & Membrillo-Hernández, J. (2022). The use of video essays and podcasts to enhance creativity and critical thinking in engineering. International Journal on Interactive Design and Manufacturing (IJIDeM), 16(3), 1231–1251. https://doi.org/10.1007/s12008-022-00952-8
Chakraverty, S., & Chakraborty, P. (2020). Tools and Techniques for Teaching Computer Programming: A Review. Journal of Educational Technology Systems, 1–29. https://doi.org/10.1177/0047239520926971
Chowdhury, F. (2019). Application of rubrics in the classroom: A Vital tool for improvement in assessment, feedback and Learning. International Education Studies, 12(1), 61–68. https://doi.org/10.5539/ies.v12n1p61
Cipriano, B. P., Fachada, N., & Alves, P. (2022). Drop Project: An automatic assessment tool for programming assignments. In SoftwareX (Vol. 18, pp. 1–7). https://doi.org/https://doi.org/10.1016/j.softx.2022.101079
Codreanu, E., Sommerhoff, D., Huber, S., Ufer, S., & Seidel, T. (2020). Between authenticity and cognitive demand: Finding a balance in designing a video-based simulation in the context of mathematics teacher education. Teaching and Teacher Education Journal, 95, 1–12. https://doi.org/10.1016/j.tate.2020.103146
Cresswell, J. W., & Plano, V. C. (2017). Designing and Conducting Mixed Method Research (2nd ed.). SAGE Publications, Inc.
de Lange, T., Møystad, A., & Torgersen, G. (2020). How can video-based assignments integrate practical and conceptual knowledge in summative assessment? Student experiences from a longitudinal experiment. British Educational Research Journal, 46(6), 1279–1299. https://doi.org/10.1002/berj.3632
Efecan, C. F., Sendag, S., & Gedik, N. (2020). Pioneers on the case for promoting motivation to teach text-based programming. Journal of Educational Computing Research, 1–17. https://doi.org/10.1177/0735633120966048
Febriani, I., & Abdullah, M. I. (2018). A systematic review of formative Assessment tools in the blended learning environment. International Journal of Engineering & Technology, 4(11), 33–39. https://doi.org/10.14419/ijet.v7i4.11.20684
Gama, E., & Barroso, M. F. (2013). Student ’s video production as formative assessment. International Conference on Physics Education, Prague. Submitted for Publication in the Annals of ICPE.
Gläser-Zikuda, M., Hagenauer, G., & Stephan, M. (2020). The potential of qualitative content analysis for empirical educational research. 21(1), 1–20. https://doi.org/https://doi.org/10.17169/fqs-21.1.3443
Golafshani, N. (2003). Understanding reliability and validity in qualitative research. The Qualitative Report, 8(4), 597–607. https://doi.org/10.46743/2160-3715/2003.1870
Hafidzul Hilmi, M. N. (2020). Belajar dalam talian hingga 31 Disember. My Metro. https://www.hmetro.com.my/mutakhir/2020/05/583080/belajar-dalam-talian-hingga-31-disember
Huang, S., Jeng, Y., & Lai, C.-F. (2021). Note-Taking Learning System: The use of the learning style theory and the peer learning method on computer programming Course. Journal of Educational Computing Research, 1–26. https://doi.org/10.1177/0735633120985235
Jamilah, H., Saira Banu, O. K., Zafirah, M. A., & Ummu Salmah, M. H. (2022). Improving college students’ learning performance in computer programming: The Case of Using the Polya Model. Central Asia and The Caucasus, 23(1), 3052–3070. https://doi.org/https://doi.org/10.37178/ca-c.21.5.081
Johnson, R. B., & Christense, L. (2014). Quantitative, Qualitative, and Mixed Approaches. In Educational Research (5th ed.). SAGE Publications, Inc.
Kapsalis, G., Ferrari, A., Collado, A., Hotulainen, R., Rama, I., Nyman, L., Oinas, S., & Ilsley, P. (2019). Evidence of innovative assessment: Literature review and case studies. https://doi.org/10.2760/552774
Kiersey, R. A., Devitt, A., & Brady, M. (2018). Staff use of technology- enhanced assessment in higher education : A systematic review.
Kurikulum, B. P. (2016). Asas Sains Komputer (pp. 1–48). Kementerian Pelajaran Malaysia.
Lewis, P., Hunt, L., Ramjan, L. M., Daly, M., O’Reilly, R., & Salamonson, Y. (2020). Factors contributing to undergraduate nursing students’ satisfaction with a video assessment of clinical skills. Nurse Educ Today, 84(104244). https://doi.org/10.1016/j.nedt.2019.104244
Malik, S. I., & Coldwell-neilson, J. (2017). Impact of a new teaching and learning approach in an Introductory Programming Course. Journal of Educational Computing Research, 1–31. https://doi.org/10.1177/0735633116685852
Malisius, E. (2018). Academic Rigour and Video Technology: A Case Study on Digital Storytelling in Graduate-level Assignments. In A. Altmann, B. Ebersberger, C. Mössenlechner, & D. Wieser (Eds.), The Disruptive Power of Online Education:Challenges, Opportunities, Responses (pp. 167–184). Emerald Publishing. https://doi.org/10.1108/9781787543256
Mat Tahir, M. F., Khamis, N. K., Mohammad Rasani, M. R., & Mohd Sabri, M. A. (2019). Perception of student attributes towards short video presentation assignment in machine component analysis subject. International Journal of Innovation, Creativity and Change, 9(6), 303–315.
Mishra, L. (2016). Focus group discussion in qualitative research. TechnoLEARN Vol., 6(1), 1–5. https://doi.org/10.5958/2249-5223.2016.00001.2
Morgan, H. (2013). Technology in the classroom: Creating videos can lead students to many academic benefits creating videos can lead students to many academic benefits. Childhood Education, 89(1), 51–53. https://doi.org/10.1080/00094056.2013.757534
Namin, A., Ketron, S. C., Kaltcheva, V. D., & Winsor, R. D. (2021). Improving student presentation skills using asynchronous video-based projects. Journal of Management Education, 1–24. https://doi.org/10.1177/1052562920978805
Neumann, M. M., Anthony, J. L., Erazo, N. A., & Neumann, D. L. (2019). Assessment and technology: Mapping future directions in the early childhood classroom. Frontiers in Education, 4(October), 1–13. https://doi.org/10.3389/feduc.2019.00116
Pentaksiran Bilik Darjah (PBD). (2022). Ministry of Education Malaysia. https://www.moe.gov.my/en/soalan-lazim-menu/kurikulum/kurikulum
Rivera, J. E., & Heinrich, W. F. (2016). Assessing Multiple Dimensions of Significant Learning. In L. A. Wankel & C. Wankel (Eds.), Integrating Curricular and Co-Curricular Endeavors to Enhance Student Outcomes (1st ed., pp. 418–450). Emerald Publishing Limited. https://doi.org/10.1108/9781786350633
Súilleabháin, G. Ó., & Cronin, S. (2017). Better Assessment Through Video: The Development of an Assessment Productivity App Formative assessment. In G. B. Teh & S. C. Choy (Eds.), Empowering 21st Century Learners Through Holistic and Enterprising Learning. (pp. 21–29). https://doi.org/10.1007/978-981-10-4241-6
Timmis, S., Broadfoot, P., Sutherland, R., & Oldfield, A. (2016). Rethinking assessment in a digital age: Opportunities, challenges, and risks. Educational Research Journal, 42(3), 454–476. https://doi.org/10.1002/berj.3215/abstract.
Tumpa, R. J., Skaik, S., Ham, M., & Chaudhry, G. (2022a). A holistic overview of studies to improve group-based assessments in higher education: A systematic literature review. Sustainability, 14(9638), 1–23. https://doi.org/10.3390/su14159638
Tumpa, R. J., Skaik, S., Ham, M., & Chaudhry, G. (2022b). Authentic design and administration of group-based assessments to improve the job-readiness of project management graduates. Sustainability, 14(9679), 1–23. https://doi.org/10.3390/su14159679
Wiens, P. D., Beck, J. S., Lunsmann, C. J., Wiens, P. D., Beck, J. S., Assessing, C. J. L., & Beck, J. S. (2020). Assessing teacher pedagogical knowledge: The video assessment of teacher knowledge (VATK). Educational Studies, 1–17. https://doi.org/10.1080/03055698.2020.1750350
Copyright (c) 2022 Jamilah Hamid, Haslinda Hashim, Saira Banu Omar Khan, Nor Hasbiah Ubaidullah
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
All articles published by IJLTER are licensed under a Creative Commons Attribution Non-Commercial No-Derivatives 4.0 International License (CCBY-NC-ND4.0).