OptimCLM: Optimizing clinical language models for predicting patient outcomes via knowledge distillation, pruning and quantization.
Journal:
International journal of medical informatics
Published Date:
Dec 18, 2024
Abstract
BACKGROUND: Clinical Language Models (CLMs) possess the potential to reform traditional healthcare systems by aiding in clinical decision making and optimal resource utilization. They can enhance patient outcomes and help healthcare management through predictive clinical tasks. However, their real-world deployment is limited due to high computational cost at inference, in terms of both time and space complexity.