LGI: Label-Graph Inference Multi-Benchmark Emotion Detection Transformer Framework for Intelligent Chatbots
Abstract
Six datasets were used in order to assess the framework: DAIR Emotion, achieved an macro-F1 to 89.10%. TweetEval Emotion is the second dataset reached an macro-F1 is 81.56%. DailyDialog, the macro-F1 arrived to 58.62%. GoEmotions, got micro-F1 about 60.03%. Empathetic Context dataset reached to 85.80% Top-3 accuracy and macro-F1 is 85.69% on the 32-class task. Lastly EmoWOZ is the most important dataset because it contains real conversation between human-machine has an accuracy about 92.86%, macro-F1 to 59.95% and AUC to 94.97%.
The results demonstrate that the significant value and usefulness of relational inference at the classification level for emotion-based chatbot systems.
Keywords
Full Text:
PDFReferences
S. Kusal, S. Patil, J. Choudrie, K. Kotecha, D. Vora, and I. Pappas, "A Systematic Review of Applications of Natural Language Processing and Future Challenges with Special Emphasis in Text-based Emotion Detection", Artificial Intelligence Review, Vol. 56, No. 12, pp. 15129-15215, 2023, DOI: 10.1007/s10462-023-10509-0.
F. A. Acheampong, H. Nunoo-Mensah, and W. Chen, "Transformer Models for Text-based Emotion Detection: A Review of BERT-based Approaches". Artificial Intelligence Review, Vol. 54, No. 8, pp. 5789-5829, 2021, DOI: 10.1007/s10462-021-09958-2.
P. Thakur, D.R. Shrivastava, and A. DR, "A Review on Text based Emotion Recognition System", International Journal of Advanced Trends in Computer Science and Engineering, Vol. 7, No. 5, 2018.[Online]. Available: http://www.warse.org/IJATCSE/static/pdf/file/ijatcse01752018.pdf.
X. Qiu, T. Sun, Y. Xu, Y. Shao, N. Dai, and X. Huang, "Pre-Trained Models for Natural Language Processing: A Survey", Science China Technological Sciences, Vol. 63, No. 10, pp. 1872-1897, 2020, DOI: 10.1007/s11431-020-1647-3.
N. M. Gardazi, A. Daud, M. K. Malik, A. Bukhari, T. Alsahfi, and B. Alshemaimri, "BERT Applications in Natural Language Processing: A Review", Artificial Intelligence Review, Vol. 58 No. 6, Art. No. 166, 2025, DOI: 10.1007/s10462-025-11162-5.
M. A. K. Raiaan, M. S. H. Mukta, K. Fatema, N. M. Fahad, S. Sakib, M. M. J. Mim, and S. Azam, "A Review on Large Language Models: Architectures, Applications, Taxonomies, Open Issues and Challenges", IEEE Access, Vol. 12, pp. 26839-26874, 2024, DOI: 10.1109/ACCESS.2024.3365742.
A. Al Maruf, F. Khanam, M. M. Haque, Z. M. Jiyad, M. F. Mridha, and Z. Aung, "Challenges and Opportunities of Text-based Emotion Detection: A Survey", IEEE Access, Vol. 12, pp. 18416-18450, 2024, DOI: 10.1109/ACCESS.2024.3356357.
U. Frevert, M. Scheer, and A. Schmidt, "Emotional Lexicons: Continuity and Change in the Vocabulary of Feeling 1700-2000", Oxford Unversity Prees, 2014. [Online]. Avalabile: https://reviews.history.ac.uk/review/1682.
M. V. Mäntylä, D. Graziotin, and M. Kuutila,"The Evolution of Sentiment Analysis—A Review of Research Topics, Venues, and Top Cited Papers", Computer Science Review, Vol. 27, pp 16-32, 2018, DOI: 10.1016/j.cosrev.2017.10.002.
S. Jaiswal, and G. C. Nandi, "Robust Real-Time Emotion Detection System using CNN Architecture", Neural Computing and Applications, Vol. 32, No. 15, pp. 11253-11262, 2020, DOI: 10.1007/s00521-019-04564-4.
A. Akula, , G. Budha, G. Bingi, U. Chanda, A. R. Borra, D. B. Yadav, and M. Saravanan, "Emotion Recognition from Facial Expressions using CNNs", International Journal of Engineering & Extended Technologies Research (IJEETR), Vol. 8, No. 1, pp. 120-125, 2026, DOI: doi.org/10.15662/IJEETR.2026.0801013.
C. Yerukonda, "Multimodal Context-Aware Emotion Recognition using Transformer-based Fusion of Facial and Speech Cues", In 7th International Conference on Intelligent Communication Technologies and Virtual Mobile Networks (ICICV), pp. 1782-179, IEEE, 2026, DOI: 10.1109/ICICV68925.2026.11554829.
Y. Ghafoor, S. Jinping, F. H. Calderon, Y. H. Huang, K. T. Chen, and Y. S. Chen, "TERMS: Textual Emotion Recognition in Multidimensional Space", Applied Intelligence, Vol. 53, No. 3, pp. 2673-2693, 2023, DOI: 10.1007/s10489-022-03567-4.
Z. Ye, T. Zuo, W. Chen, Y. Li, and Z. Lu, "Textual Emotion Recognition Method based on ALBERT-BiLSTM Model and SVM-NB Classification", Soft Computing, Vol. 27,No. 8, pp. 5063-5075, 2023, DOI: 10.1016/j.specom.2022.03.002.
J. K. Rout, K. K. R. Choo, A. K. Dash, S. Bakshi, S. K. Jena, and K. L. Williams, "A Model for Sentiment and Emotion Analysis of Unstructured Social Media Text", Electronic Commerce Research, Vol. 18, pp. 181-199, 2018, DOI: 10.1007/s10660-017-9257-8.






