Decoding Digital Discourse Through Multimodal Text and Image Machine Learning Models to Classify Sentiment and Detect Hate Speech in Race- and Lesbian, Gay, Bisexual, Transgender, Queer, Intersex, and Asexual Community-Related Posts on Social Media: Quantitative Study.

Journal: Journal of medical Internet research
PMID:

Abstract

BACKGROUND: A major challenge in sentiment analysis on social media is the increasing prevalence of image-based content, which integrates text and visuals to convey nuanced messages. Traditional text-based approaches have been widely used to assess public attitudes and beliefs; however, they often fail to fully capture the meaning of multimodal content where cultural, contextual, and visual elements play a significant role.

Authors

  • Thu T Nguyen
    Department of Epidemiology and Biostatistics, University of Maryland, College Park, College Park, MD, United States.
  • Xiaohe Yue
    Department of Epidemiology and Biostatistics, University of Maryland School of Public Health, College Park, MD, USA.
  • Heran Mane
    Department of Epidemiology and Biostatistics, University of Maryland, College Park, College Park, MD, United States.
  • Kyle Seelman
    Department of Computer Science, University of Maryland, College Park, College Park, MD, United States.
  • Penchala Sai Priya Mullaputi
    Department of Epidemiology and Biostatistics, University of Maryland, College Park, College Park, MD, United States.
  • Elizabeth Dennard
    Department of Epidemiology and Biostatistics, University of Maryland, College Park, College Park, MD, United States.
  • Amrutha S Alibilli
    Department of Epidemiology and Biostatistics, University of Maryland, College Park, College Park, MD, United States.
  • Junaid S Merchant
    Department of Epidemiology and Biostatistics, University of Maryland, College Park, College Park, MD, United States.
  • Shaniece Criss
    Department of Health Sciences, Furman University, Greenville, United States.
  • Yulin Hswen
    Department of Epidemiology and Biostatistics, University of California, San Francisco, San Francisco, United States.
  • Quynh C Nguyen
    Department of Epidemiology and Biostatistics, University of Maryland, College Park, College Park, MD, United States.