Faces are a source of rich information about individual identity, and also about mood and mental state, being accessible windows into the mechanisms governing our emotions. Studies reveal that the most expressive way humans display emotions is through facial expressions. Facial expressions are the primary source of information, next to words, in determining an individual’s internal feelings. All people thus certainly lecturers and students use facial expressions to form impressions of another. It has been observed that the facial expressions of the lecturers kept the students motivated and interested during the lectures. A lecturer can also use student’s facial expressions as valuable sources of feedback. While delivering a lecture, a Lecturer should use student’s expressions to determine whether or not to slow down, speed up, or in some other way modify his presentation. The basic strategy of optimizing the classroom behaviour is that the teachers must have the capability to feel student’s minds changing; they must be good at observing student’s facial expressions, every action and movement. This helps the lecturers to understand their own weakness and to change it. Lecturers should be highly skilled in understanding the emotions in order to identify the comprehension of the students from their facial expressions themselves. If the lecturers are not able to identify the significance in the facial expressions it will undermine the understanding of the students, thereby, create a negative impact on student’s learning.
The aim of this project is to examine whether the facial expressions of the participants in videoconferencing can measure the engagement and interpret comprehension. Our goal is to identify physical behaviours of the face that are linked to emotional states and then to identify how these emotional states are linked to participant’s engagement and comprehension. In this work, we will focus on the case study of student and teacher online classroom environment. The effectiveness of a student’s facial expressions in non-verbal communication in a virtual pedagogical environment will be investigated first. Next, the specific elements of the learner’s behaviour for the different emotional states and the relevant facial expressions signalled by the action units will be interpreted. Finally, it will focus on finding the impact of the relevant facial expression on the student’s comprehension. Engagement of participants in the online sessions will be measured into three categories highly attentive, partially attentive and not attentive, considering the facial expression in the spatial and temporal domain along with other cues such as gaze direction, head movement, hand and upper body movement.