Enhancing counterfactual detection in multilingual contexts using a few shot clue phrase approach.

Journal: Scientific reports
PMID:

Abstract

This research paper introduces an innovative counterfactual detection system, designed to tackle the complexities of identifying hypothetical statements that describe non-occurring events in diverse fields such as NLP, psychology, medicine, politics, and economics. Counterfactual statements, often encountered in product reviews, pose significant challenges in multilingual contexts due to the linguistic variations, and counterfactual statements are also less frequent in natural language texts. Our proposed system transcends these challenges by using a domain-independent, multilingual few-shot learning model, which significantly improves detection accuracy. Using clues as key innovation, the model demonstrates a 5-10% performance improvement over traditional few-shot techniques. Few-shot learning is a machine learning approach in which a model is trained to make accurate predictions with only a small amount of labeled data, which is particularly beneficial in counterfactual detection where annotated examples are scarce.The system's efficacy is further validated through extensive testing on multilingual and multidomain datasets, including SemEval2020-Task5, with results underscoring its superior adaptability and robustness in various linguistic scenarios. The incorporation of clue-phrases during training not only addresses the issue of limited data but also significantly boosts the model's capability in accurately identifying counterfactual statements, thereby offering a more effective solution in this challenging area of natural language processing.

Authors

  • Lekshmi Kalinathan
    School of Computing Science and Engineering, VIT University, Chennai Campus, Rajan Nagar, Kelambakkam-Vandalur Road, Chennai, Tamil Nadu, 600127, India. lekshmi.k@vit.ac.in.
  • Karthik Raja Anandan
    Computer Science and Engineering, Sri Sivasubramania Nadar College Of Engineering, Rajiv Gandhi Salai, Kalavakkkam, Chennai, Tamil Nadu, 603110, India.
  • Jagadish Ravichandran
    Computer Science and Engineering, Sri Sivasubramania Nadar College Of Engineering, Rajiv Gandhi Salai, Kalavakkkam, Chennai, Tamil Nadu, 603110, India.
  • K Devi
    School of Computing Science and Engineering, VIT University, Chennai Campus, Rajan Nagar, Kelambakkam-Vandalur Road, Chennai, Tamil Nadu, 600127, India.
  • S Benila
    School of Computing Science and Engineering, VIT University, Chennai Campus, Rajan Nagar, Kelambakkam-Vandalur Road, Chennai, Tamil Nadu, 600127, India.
  • Abithkumar Ravikumar
    Computer Science and Engineering, Sri Sivasubramania Nadar College Of Engineering, Rajiv Gandhi Salai, Kalavakkkam, Chennai, Tamil Nadu, 603110, India.