Conceptual Framework of Evaluation Model on 4 C'S-Based Learning Supervision

Authors

  • Eny Winaryati
  • Mardiana
  • Muhamad Taufik Hidayat

Keywords:

Conceptualization framework; Evaluation model; Learning supervision; 4C’s-based

Abstract

The 21st-century learning requires the implementation of 4 character skills, including (1) Critical Thinking and Problem Solving, (2) Creativity and Innovation, (3) Collaboration, and (4) Communication (4Cs) (MESp 4C's). This framework was used to evaluate the achievement of supervision on 4Cs learning by teachers. The research method used was Grounded theory, which focuses on building a conceptual framework through the inductive analysis of various data, phenomena, information, and theories, using several systematic procedures. MESp 4C's was built in 5 stages. The first is based on the relevance of the learning stages (planning, learning, and assessment processes) with the learning supervision stages (pre-observation, observation, and post-observation) and the evaluation stages of the Stake model (antecedent, transaction, outcomes). Second, it is necessary to modify the Stake evaluation model with other evaluation models through the Organizational Elements Model (OEM). The OEM is a stage for evaluators to determine the appropriate evaluation model to use. Proper modification of the evaluation model was obtained, namely The Discrepancy Evaluation Models (DEM). The Interim Product stage was more appropriate to use than the outcome so that the evaluation model stages became Antecedent, Transaction, and Interim Product (ATIp). Third, every step of the supervision implementation of 4C's will always be evaluated. Fourth, there were feedback activities (self, peer, superior) to produce continuous learning evaluation-supervision activities, based on the 360o feedback theory. Five, MESp 4C's was built as an evaluation model with a modified six-cell Stake model. MESp 4C's was equipped with the data on the suitability of descriptions between instances and observations, assessment data between observations and standards, data on contingencies and congruence, and feedback activities. This study's recommendation is the need for the design and testing of MESp 4 in several schools.

https://doi.org/10.26803/ijlter.19.8.10

References

Ajasan, N. (2016). Efektivitas pelaksanaan supervisi akademik oleh kepala sekolah dalam meningkatkan kinerja guru di SMK negeri 1 Meulaboh [The effectiveness of the implementation of academic supervision by the principal in improving the performance of teachers at Meulaboh State Vocational School]. Jurnal Administrasi Pendidikan Program Pascasarjana Unsyiah, 4(3). http://jurnal.unsyiah.ac.id/JAP/article/view/4795

Attwel, G. (2006). Evaluating e-learning A guide to the evaluation of e-learning No Title. Evaluate Europe Handbook Series, 2, 5–46. http://pontydysgu.org/wp-content/uploads/2007/11/eva_europe_vol2_prefinal.pdf

Bacharach, S.B. (1989). Organizational theories: Some criteria for evaluation. Academy of Management Review (14:4), pp. 496-515 https://gent.uab.cat/diego_prior/sites/gent.uab.cat.diego_prior/files/Bacharach_AMR_1989_14_4.pdf

Bafadal, I. (1992). Supervisi pengajaran: teori dan aplikasinya dalam membina profesional guru [Teaching supervision: theory and its application in fostering teacher professionalism]. Jakarta: Bumi Aksara

Bahri, S. (2014). Supervisi akademik dalam peningkatan profesionalisme guru [Academic supervision in improving teacher professionalism]. Visipena Jurnal, 1(1), 100–112. https://visipena.stkipgetsempena.ac.id/?journal=home&page=article&op=view&path%5B%5D=74

Bambling, M., & King, R. (2014). Supervisor social skill and supervision outcome. Counseling and Psychotherapy Research, 14(4), 256–262. https://doi.org/10.1080/14733145.2013.835849

Charmaz, K. (2009). Shifting the grounds: constructivist grounded theory methods for the

Cormack, C. L., Jensen, E., Durham, C. O., Smith, G., & Dumas, B. (2018). The 360-degree evaluation model: A method for assessing competency in graduate nursing students. A pilot research study. Nurse Education Today, 64, 132–137. doi:10.1016/j.nedt.2018.01.027

Chyung, y. (2005). Improve the motivational appeal of online instruction for adult learners: what's in it for me?. Instructional & Performance Technology. Boise State University.

Daresh, J.C. (1989). Supervision as a Proactive Process. White Plains, NY: Longman.

Darto. (2014). Supervisi akademik terprogram dalam peningkatan kompetensi guru pada pelaksanaan pembelajaran [Programmed academic supervision in improving teacher competence in the implementation of learning]. Jurnal Penelitian Tindakan Sekolah Dan Kepengawasan, 1(1). http://www.i-rpp.com/index.php/jptsk/article/view/75/74

Daud, Y., Dali, P. D., Khalid, R., & Fauzee, M. S. O. (2018). Teaching and learning supervision, teachers' attitudes towards classroom supervision, and students' participation. International Journal of Instruction, 11(4), 513–526. https://doi.org/10.12973/iji.2018.11432a

Fernandes, H.J.X. (1984). Evaluation of educational program. Jakarta: National Education Planning Evaluation and Curriculum Development.

Framework, A C. (2009). A Conceptual framework and examples of country practices. Evaluation, (December).

Gioia, D.A., & Pitre, E. (1990). Multiparadigm perspectives on theory building. Academy of Management Review (15:4), pp. 584-602 https://journals.aom.org/doi/abs/10.5465/amr.1990.4310758?journalCode=amr

Glickman, C.D. (1981). Developmental supervision: alternative practices for helping teachers improve instruction. Association for supervision and curriculum development. Alexandria https://files.eric.ed.gov/fulltext/ED208487.pdf

Gregor, S. (2006). The Nature of theory in information systems, MIS Quarterly (30:3), pp. 611-642 https://misq.org/skin/frontend/default/misq/pdf/TheoryReview/Gregor.pdf

Griffin, P., McGaw, B., & Care, E. (2012). Assessment and teaching of 21st-century skills. (Vol. 9789400723245, pp. 1–345). Springer Netherlands. https://doi.org/10.1007/978-94-007-2324-5

Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research.

Jaccard, J. & Jacoby, J. (2009). Theory construction and model building skills, (1. Ed.). New York , NY, USA: The Guilford Press.

Kaufman, R. (2006). Defining and delivering measurable value: a mega thinking and planning primer. Performance Improvement Quarterly, 18(3) pp. 6-16. Florida State University. 10.1111/j.1937-8327.2005.tb00337.x

Kemendikbud. (2017). Panduan supervisi akademik. Jakarta: Kemendikbud

Khoso, P.A. (2019). What are the differences between conceptual framework and theoretical framework? Universiti Kebangsaan Malaysia. Scool of Social, Development & Environmental. SOSDES

Kilminster, S., at.al. (2007). AMEE Guide No. 27: Effective educational and clinical supervision. Medical Teacher. https://pubmed.ncbi.nlm.nih.gov/17538823/

Madaus, G. F., Scriven, M. S. & Stufflebeam. (1983). The Cipp model for program evaluation. Evaluation Models (pp. 117–141). Springer Netherlands. https://doi.org/10.1007/978-94-009-6675-8_7

Maralih. (2014). Peranan supervisi dalam peningkatan kualitas pendidikan. Jurnal Qathruna, 1(1), 179–192. Retrieved from http://jurnal.uinbanten.ac.id/index.php/qathruna/article/view/251

Masías, R. (2005). Prólogo a la llamada investigación cualitativa en ciencias sociales [Foreword to so-called qualitative research in the social sciences] Colombia Internacional, núm. 62, julio-diciembre, 2005, pp. 120 - 131 Universidad de Los Andes Bogotá, D.C., Colombia https://dialnet.unirioja.es/descarga/articulo/5622519.pdf

Maxwell, J A. (1996). Qualitative research design, an interactive a half roach. California: Sage Publications, Inc

Nunnally & Bernstein, I.H. (1994). Psychometric theory. third edition. New York: McGraw Hill.

OECD (2005). Teacher matter: Attracting, developing, and retraining effective teacher. Paris: OECD

OECD (2009a), OECD Review on Evaluation and Assessment for Improving School Outcomes: Design and Implementation Plan for the Review. Paris: OECD [OLIS Document EDU/EDPC(2009)3/REV1].

OECD (2009b), Creating effective teaching and learning environments: first results from TALIS. Paris: OECD

Ola, A F & Palaniappan, S. (2013). A framework of an improved model for the evaluation of instructors' performance in higher institutions of learning. IOSR Journal of Research & Method in Education (IOSR-JRME) e-ISSN: 2320–7388,p-ISSN: 2320–737X 3:2 (Sep. –Oct. 2013), PP 64-69 https://www.semanticscholar.org/paper/A-Framework-of-an-Improved-Model-for-Evaluation-of-Ola-Palaniappan/ce84d9550cf55f207f796f2009fdd11bc7d9efdd

Owston, R. (2008). Models and methods for evaluation. Toronto Canada: York University.

Partnership. (2015). P21 Partnership for 21st Century Learning. Partnership for 21st Century Learning, 9. Retrieved from http://www.p21.org/documents/P21_Framework_Definitions.pdf

Peirce, C.S. (1998). On the Logic of drawing history from ancient documents. The Essential Peirce (Vol. 2), C.S. Peirce (ed.). Bloomington, IL, USA: Indiana University Press, pp. 75-11

Popham, W J. (1993). Educational evaluation. Boston: Allyn and Bacon.

Porter, C. (2005). Week 1: Job technology: hard & soft. Retrieved August 19, from IPT 536 4158/4159 course database.

Prabowo, S., & Yoga, D. S. (2016). Supervisi kunjungan kelas sebagai upaya membina profesional guru SLTP/SLTA. Jurnal Sosial Humaniora, 9(1), 96. https://doi.org/10.12962/j24433527.v9i1.1281

Provus, M. (1969). The discrepancy evaluation models. An approach to local program improvement and development. .Pittsburgh: Public School.

Sabandi, A. (2013). Supervisi pendidikan untuk pengembangan profesionalitas guru berkelanjutan. Jurnal Ilmiah Ilmu Pendidikan, XIII(2), 1–9.

Scott, C. L. (2015). The Futures of Learning 3: what kind of pedagogies for the 21st century?. Education Research and Foresight (pp. 1–21).

Searcy, D & J.T. Mentzer. (2003). A Framework for Conducting and Evaluating Research. Journal of Accounting Literature. 22 (130-167) https://search.proquest.com/openview/57795fd99db05acb093900bce161c56c/1?pq-origsite=gscholar&cbl=31366

Selvi, K. (2010). Teachers’ competencies. Cultura. International Journal of Philosophy of Culture and Axiology. Philosophy Documentation Center. https://doi.org/10.5840/cultura20107133

Sergiovanni, T. J., & Starratt, R. J. (1998). Supervision: A re-definition (6th ed.). Boston.

Shute, V. J. (2008). Focus on formative feedback. Review of Educational Research, 78(1), 153–189. https://doi.org/10.3102/0034654307313795

Stake, RE. (1977). The countenance of educational evaluation. In A.A.Ballack & H/M. Kliebard Eds). Curriculum and evaluation (pp 372-390). Berkeley CA: McCutchan.

Stake, RE. (2000). Program evaluation, particularly responsive evaluation. Evaluation models viewpoints on educational and human services evaluation 2th Ed (pp 340-362). Newyork: Kluwer Academic Publisher.

Steinmetz, A. (2000). The discrepancy evaluation model. Evaluation Models Viewpoints on Educational and Human Services Evaluation Second Edition. New York: Kluwer Academic Publishers.

Stufflebeam, D.L. (1966). Evaluation under Title I of the element Act of 1967. Addt=ress delivered at the Title I Evaluation Conference sp Departement of Education, Lansing.

Suddaby, R. (2010). Construct clarity in theories of management and organization. Academy of Management Review (35:3), pp. 346-357.

Tang, S. Y. F., & Chow, A. W. K. (2007). Communicating feedback in teaching practice supervision in a learning-oriented field experience assessment framework. Teaching and Teacher Education, 23(7), 1066–1085. doi:10.1016/j.tate.2006.07.013

Wheeler, K. (2019). What is the difference between a theory and a concept?. Faculty sponsor for Alpha Chi Honor Society, Tennessee Delta Chapter.

Whetten, D.A. (1989). What Constitutes a Theoretical Contribution?. Academy of Management Review (14:4), pp. 490-495. http://cmsdev.aom.org/uploadedFiles/Publications/AMR/WhettenWhatconstitutes.pdf

Winaryati, E. (2012). Kompetensi kepala sekolah sebagai supervisor pada pembelajaran IPA SMP di kota Semarang [Principal's competence as a supervisor in junior high school science learning in the city of Semarang]. Prosiding Univ. Muhammadiyah Semarang. Univ Muhammadiyah Semarang. ISSN: 978-602-18809-0-6 http://jurnal.unimus.ac.id/index.php/psn.

Wolters, C. (2010). Self-Regulated Learning and the 21 st Century Competencies. USA University of Houston, (May), 27. Retrieved from http://www.hewlett.org/uploads/Self_Regulated_Learning__21st_Century_Competencies.pdf

Wood, B.B. (2001). Stake’s countenance model: evaluating an environmental education professional development course. The Journal of Environmental Education, Vol. 32 No. 2 18-27. 10.1080/00958960109599134

Youngstrom, M. J., & Gentile, P. A. (2018). Supervision. In Willard and Spackmans Occupational Therapy, 13th Edition (pp. 1134–1155). Wolters Kluwer Health. https://doi.org/10.12968/hmed.2009.70.4.41628

Yunus, G. A., Lestari, W., & Raharjo, T. J. (2016). Pengembangan Model Supervisi Akademik Berbasis Evaluasi Diri Bagi Guru SMA. Educational Management, 5(1), 12–22. Retrieved from http://journal.unnes.ac.id/sju/index.php/eduman

Zhou, Z. H. (2018). A brief introduction to weakly supervised learning. National Science Review. Oxford University Press. https://doi.org/10.1093/nsr/nwx106

Downloads

Published

2020-08-31