Multi-modal emotional analysis in customer relation management and enhancing communication through integrated affective computing.

Journal: Scientific reports
Published Date:

Abstract

An important part of customer relationship management (CRM) is being able to read emails for emotional cues; this helps with both communication and keeping customers satisfied. This study aims to improve email emotion identification by creating a system combining visual clues, aural signals, and textual information. To analyze text and emoji, the system uses advanced affective computing techniques such as Robustly Optimized Bidirectional Encoder Representations from Transformers Approach (RoBERTa), Convolutional Neural Networks (CNN) for images, Bidirectional Convolutional Long Short-Term Memory (BiConvLSTM) for video, and Cross-Modal BERT for audio. Together, they enable a wider variety of emotional signals to be extracted and understood from email content, yielding more insightful results than text-based analysis could on its own. By facilitating better two-way communication and customer satisfaction, the technology intends to improve CRM by providing actionable information that firms can use to personalize responses. This research delves into the possible uses of multi-modal emotional analysis across different businesses dealing with customers and builds a strong foundation.

Authors

  • W Gracy Theresa
    Department of Artificial Intelligence and Data Science, Panimalar Engineering College, Chennai, India. sunphin14@gmail.com.
  • C Pabitha
    Department of Computer Science and Engineering, SRM Valliammai Engineering College, Chennai, India.
  • K Revathi
    Department of Information Technology, SRM Valliammai Engineering College, Chennai, India.
  • Pornpimol Chawengsaksopark
    Honorary Research Fellow, Faculty of Engineering, Shinawatra University, Bang Toei, Thailand.
  • Mithilesh Sathyanarayanan
    Honorary Research Fellow, Faculty of Engineering, Shinawatra University, Bang Toei, Thailand.