Supporting Cognitive and Emotional Empathic Writing of Students
T. Wambsganss, C. Niklaus, M. Söllner, S. Handschuh, und J. Leimeister. Joint Conference of the Annual Meeting of the Association for Computational Linguistics and International Joint Conference on Natural Language Processing (ACL-IJCNLP), (August 2021)
Zusammenfassung
We present an annotation approach to capturing emotional and cognitive empathy in student-written peer reviews on business models in German. We propose an annotation scheme that allows us to model emotional and cognitive empathy scores based on three types of review components. Also, we conducted an annotation study with three annotators based on 92 student essays to evaluate our annotation scheme. The obtained inter-rater agreement of alpha=0.79 for the components and the multi-pi=0.41 for the empathy scores indicate that the proposed annotation scheme successfully guides annotators to a substantial to moderate agreement. Moreover, we trained predictive models to detect the annotated empathy structures and embedded them in an adaptive writing support system for students to receive individual empathy feedback independent of an instructor, time, and location. We evaluated our tool in a peer learning exercise with 58 students and found promising results for perceived empathy skill learning, perceived feedback accuracy, and intention to use. Finally, we present our freely available corpus of 500 empathy-annotated, student-written peer reviews on business models and our annotation guidelines to encourage future research on the design and development of empathy support systems.
Joint Conference of the Annual Meeting of the Association for Computational Linguistics and International Joint Conference on Natural Language Processing (ACL-IJCNLP)
Jahr
2021
Monat
aug
eventtitle
Joint Conference of the Annual Meeting of the Association for Computational Linguistics and International Joint Conference on Natural Language Processing (ACL-IJCNLP)
%0 Conference Paper
%1 ls_leimeister
%A Wambsganss, Thiemo
%A Niklaus, Christina
%A Söllner, Matthias
%A Handschuh, Siegfried
%A Leimeister, Jan Marco
%B Joint Conference of the Annual Meeting of the Association for Computational Linguistics and International Joint Conference on Natural Language Processing (ACL-IJCNLP)
%D 2021
%K itegpub pub_jml pub_msö pub_wise-kassel
%T Supporting Cognitive and Emotional Empathic Writing of Students
%U http://pubs.wi-kassel.de/wp-content/uploads/2021/08/JML_834.pdf
%X We present an annotation approach to capturing emotional and cognitive empathy in student-written peer reviews on business models in German. We propose an annotation scheme that allows us to model emotional and cognitive empathy scores based on three types of review components. Also, we conducted an annotation study with three annotators based on 92 student essays to evaluate our annotation scheme. The obtained inter-rater agreement of alpha=0.79 for the components and the multi-pi=0.41 for the empathy scores indicate that the proposed annotation scheme successfully guides annotators to a substantial to moderate agreement. Moreover, we trained predictive models to detect the annotated empathy structures and embedded them in an adaptive writing support system for students to receive individual empathy feedback independent of an instructor, time, and location. We evaluated our tool in a peer learning exercise with 58 students and found promising results for perceived empathy skill learning, perceived feedback accuracy, and intention to use. Finally, we present our freely available corpus of 500 empathy-annotated, student-written peer reviews on business models and our annotation guidelines to encourage future research on the design and development of empathy support systems.
@inproceedings{ls_leimeister,
abstract = {We present an annotation approach to capturing emotional and cognitive empathy in student-written peer reviews on business models in German. We propose an annotation scheme that allows us to model emotional and cognitive empathy scores based on three types of review components. Also, we conducted an annotation study with three annotators based on 92 student essays to evaluate our annotation scheme. The obtained inter-rater agreement of alpha=0.79 for the components and the multi-pi=0.41 for the empathy scores indicate that the proposed annotation scheme successfully guides annotators to a substantial to moderate agreement. Moreover, we trained predictive models to detect the annotated empathy structures and embedded them in an adaptive writing support system for students to receive individual empathy feedback independent of an instructor, time, and location. We evaluated our tool in a peer learning exercise with 58 students and found promising results for perceived empathy skill learning, perceived feedback accuracy, and intention to use. Finally, we present our freely available corpus of 500 empathy-annotated, student-written peer reviews on business models and our annotation guidelines to encourage future research on the design and development of empathy support systems. },
added-at = {2021-07-13T15:49:55.000+0200},
author = {Wambsganss, Thiemo and Niklaus, Christina and Söllner, Matthias and Handschuh, Siegfried and Leimeister, Jan Marco},
biburl = {https://www.bibsonomy.org/bibtex/2b3225f152b0031793c9579a39862a430/ls_leimeister},
booktitle = {Joint Conference of the Annual Meeting of the Association for Computational Linguistics and International Joint Conference on Natural Language Processing (ACL-IJCNLP)},
eventdate = {August 1-6, 2021},
eventtitle = {Joint Conference of the Annual Meeting of the Association for Computational Linguistics and International Joint Conference on Natural Language Processing (ACL-IJCNLP)},
interhash = {224958fad53194bf7c274a3714d7d0c4},
intrahash = {b3225f152b0031793c9579a39862a430},
keywords = {itegpub pub_jml pub_msö pub_wise-kassel},
month = aug,
timestamp = {2021-08-10T11:39:33.000+0200},
title = {Supporting Cognitive and Emotional Empathic Writing of Students},
url = {http://pubs.wi-kassel.de/wp-content/uploads/2021/08/JML_834.pdf},
venue = {Bangkok, Thailand},
year = 2021
}