Large Language Models for Accessible Reporting of Bioinformatics Analyses in Interdisciplinary Contexts

Journal: bioRxiv
Published Date:

Abstract

Health and life scientists frequently rely on quantitative experts to perform complex data analyses, yet interpretation of these results often becomes a bottleneck due to communication barriers across disciplines. Large Language Models (LLMs) have the potential to act as intermediaries that translate analytical outputs into accessible scientific narratives, but their ability to reliably interpret outputs from real-world biomedical data analyses across disciplines remains unclear. In this study, we investigate how state-of-the-art LLMs behave when integrated into real bioinformatics analysis workflows as report-generation assistants for interdisciplinary teams. We evaluated LLM-generated summaries using both automated and human evaluation frameworks to ensure holistic evaluation. Automated assessment employed multiple choice questions designed using Bloom's taxonomy to assess multiple levels of understanding, while human evaluation tasked scientists to score summaries for factual consistency, lack of harmfulness, comprehensiveness, and coherence. All generally produced readable and largely safe summaries, confirming their value for first-pass translation of technical analyses, however frequently misinterpreted visualisations, produced verbose summaries and rarely offered novel insights beyond what was already contained in the analytics. Our findings suggest that LLMs are best suited for easing interdisciplinary communication rather than replacing domain expertise and human oversight remains essential to guarantee accuracy, interpretative depth, and the generation of genuinely novel scientific insights.

Authors

  • Yu
  • L.; Kim
  • D.; Cao
  • Y.; Shu
  • M. W. S.; Shen
  • M.; Liang
  • X.; Gu
  • J.; Jayakumar
  • R.; Ding
  • W.; Yang
  • F.; Zhang
  • X.; Kim
  • J.; Yang
  • P.; Yang
  • J. Y. H.

Categories