School of Electronic Information Engineering, Changchun University of Science and Technology, Changchun 130022, China.
Sensors (Basel). 2023 Feb 23;23(5):2455. doi: 10.3390/s23052455.
In recent years, the rapid development of sensors and information technology has made it possible for machines to recognize and analyze human emotions. Emotion recognition is an important research direction in various fields. Human emotions have many manifestations. Therefore, emotion recognition can be realized by analyzing facial expressions, speech, behavior, or physiological signals. These signals are collected by different sensors. Correct recognition of human emotions can promote the development of affective computing. Most existing emotion recognition surveys only focus on a single sensor. Therefore, it is more important to compare different sensors or unimodality and multimodality. In this survey, we collect and review more than 200 papers on emotion recognition by literature research methods. We categorize these papers according to different innovations. These articles mainly focus on the methods and datasets used for emotion recognition with different sensors. This survey also provides application examples and developments in emotion recognition. Furthermore, this survey compares the advantages and disadvantages of different sensors for emotion recognition. The proposed survey can help researchers gain a better understanding of existing emotion recognition systems, thus facilitating the selection of suitable sensors, algorithms, and datasets.
近年来,传感器和信息技术的飞速发展使得机器能够识别和分析人类的情绪。情绪识别是各个领域的重要研究方向。人类的情绪有多种表现形式,因此,可以通过分析面部表情、语音、行为或生理信号来实现情绪识别。这些信号由不同的传感器采集。正确识别人类的情绪可以促进情感计算的发展。大多数现有的情绪识别调查仅关注单一传感器。因此,比较不同的传感器或单模态和多模态更为重要。在本次调查中,我们通过文献研究方法收集并回顾了 200 多篇关于情绪识别的论文。我们根据不同的创新对这些论文进行了分类。这些文章主要关注使用不同传感器进行情绪识别的方法和数据集。本调查还提供了情绪识别的应用实例和发展。此外,本调查还比较了不同传感器在情绪识别方面的优缺点。提出的调查可以帮助研究人员更好地了解现有的情绪识别系统,从而有助于选择合适的传感器、算法和数据集。