Isaac Scientific Publishing

Journal of Advances in Education Research

Analysis of Peer Evaluation Essay in Problem-Based Learning

Download PDF (285.4 KB) PP. 13 - 19 Pub. Date: November 8, 2016

DOI: 10.22606/jaer.2016.11002

Author(s)

  • Shin-Il Han*
    Department of Education, Sungkyunkwan University, Seoul, Korea

Abstract

The purpose of this study is to analyze peer evaluation essays to determine what college students consider important when evaluating their peers in a PBL class. Discovering and comparing students’ comments regarding high achievers and low achievers during peer evaluation are the specific study objectives. Eleven students taking a class that utilized PBL participated in this study. The participants were tasked with submitting peer evaluation essays after the completion of PBL group activities. Each student was asked to first rank his or her peers and then to explain in essay form the reasons why he or she ranked them in that order. The analytic process for the peer evaluation essay involved qualitative research methods comprised of (1) examining every sentence in the students’ essays and classifying similar words or phrases into a provisional concept, (2) a review by an external educational expert, (3) and member-checking by participating students. Triangulation and member-checking were used for the validation of the study. Upon grouping the sentences in the peer evaluation essays according to similar meanings, words, or concepts, a convergence on 6 to 8 common factors emerged. Eight factors (participation, cognition, preparation, communication, leadership, responsibility, affectivity, skills) were observed when the criteria for the high achievers at peer evaluation were examined. Six factors (participation, cognition, preparation, communication, diligence, cooperation) were identified when the criteria for the low achievers at peer evaluation were analyzed. In addition, factors of cognition, leadership, and participation were most frequently and positively mentioned by students when evaluating high achievers within their groups, while participation and diligence were most frequently and negatively mentioned when evaluating low achievers. Based on the findings, various subject matters are discussed.

Keywords

Peer evaluation essay, problem-based learning, qualitative research, higher education, cooperative learning.

References

[1] Albanese, M. A., & Dast, L. (2014). Problem-based learn?ing: Outcomes evidence from the health professions. Journal on Excellence in College Teaching, 25(3&4), 239-252.

[2] Carter, N., Bryant-Lukosius, D., DiCenso, A., Blythe, J., & Neville, A.J. (2014). The use of triangulation in qualitative research. Oncology Nursing Forum, 41(5), 545-547.

[3] Charmaz, K. (2006). Constructing grounded theory: A practical guide through qualitative analysis. London:Sage..

[4] Curran, E., Carlson, K., & Celotta, D.T. (2013). Journal of the Scholarship of Teaching and Learning, 13(2), 49-71.

[5] DeNisi, A.S., Randolph, W.A., & Blencoe, A.G. (1983). Potential problems with peer ratings. Academy of Management Journal, 26, 457-467.

[6] Denzin, N.K. (1978). Sociological methods: A sourcebook. New York, NY: McGraw-Hill.

[7] Doyle, S. (2007). Member checking with older women: A framework for negotiating meaning. Health Care for Women International, 28(10), 888-908.

[8] Duzer, E.V., & McMartin, F. (2000). Methods to improve the validity and sensitivity of a self/peer assessment instrument. IEEE Transactions on Education, 43(2), 153-158.

[9] Elder, A.D. (2009). Using a brief form of problem-based learning in a research methods class: Perspectives of instructor and students. Journal of University Teaching & Learning Practice. 12(1), 1-12.

[10] Felchikov, N. (1986). Product comparisons and process benefits of collaborative peer group and self-assessments. Assessment and Evaluation in Higher Education, 11, 146-166.

[11] Furman, B., & Robinson, W. (2003). Improving engineering report writing with Calibrated Peer Review. In D.Budny (Ed.), Proceedings of the 33rd Annual Frontiers in Education Conference. Piscataway, NJ: IEEE Digital Library.

[12] Goldfinch, J. (1994). Further developments in peer assessment of group projects. Assessment and Evaluation in Higher Education, 19, 29-35.

[13] Harvey, L. ( 2015). Beyond member-checking: a dialogic approach to the research interview. International Journal of Research & Method in Education, 38(1), 23-38.

[14] Higgitt, D.L. (1996). The effectiveness of student-authored field trails as a means of enhancing geomorphological interpretation symposium. Journal of Geography in Higher Education, 20(1), 35-44.

[15] Hmelo-Silver, C.E. (2004). Problem-based learning: What and how do students learn? Educational Psychology Review, 16(3), 235-266.

[16] Jabeen, T. (2013). Qualitative research methods in children related research. PUTAJ-Humanities and Social Sciences, 20, 103-110.

[17] Jeffery, D., Yankulov, K., Crerar, A., & Ritchie, K., (2016). How to achieve accurate peer assessment for high value written assignments in a senior undergraduate course. Assessment & Evaluation in Higher Education. 41(1),127-140.

[18] Kaufman, D.B., Felder, R.M., & Fuller, H. (2000). Accounting for individual effort in cooperative learning teams.Journal of Engineering Education, 89(2), 133-140.

[19] Kramer, J.F. (1990). Perceived similarity and accuracy of peer ratings. Journal of Educational Psychology, 82, 213-218.

[20] Lee, H.-J., & Lim, C. (2012). Peer Evaluation in Blended Team Project-Based Learning: What Do Students Find Important? Educational Technology & Society, 15 (4), 214–224.

[21] Ohland, M.W., Laton, R.A., Loughry, M.L., & Yuhasz, A.G. (2005). Effects of behavioral anchors on peer evaluation reliability. Journal of Engineering Education, 94(3), 319-326.

[22] Patton, M. Q. (1999). Enhancing the quality and credibility of qualitative analysis. Health Science Research, 34,1189-1208.

[23] Segers, M., & Dochy, F. (2001). New assessment forms in problem-based learning: the value-added of the students’ perspective. Studies in Higher Education, 26(3), 327-343.

[24] Strachan, I.B., & Wilcox, S. (1996). Peer and self-assessment of group work: Developing an effective response to increased enrollment in a third-year course in microclimatology. Journal of Geography in Higher Education, 20,343-353.