Combining glass box and black box evaluations in the identification of heart disease risk factors and their temporal relations from clinical records.
Journal:
Journal of biomedical informatics
Published Date:
Dec 1, 2015
Abstract
BACKGROUND: The determination of risk factors and their temporal relations in natural language patient records is a complex task which has been addressed in the i2b2/UTHealth 2014 shared task. In this context, in most systems it was broadly decomposed into two sub-tasks implemented by two components: entity detection, and temporal relation determination. Task-level ("black box") evaluation is relevant for the final clinical application, whereas component-level evaluation ("glass box") is important for system development and progress monitoring. Unfortunately, because of the interaction between entity representation and temporal relation representation, glass box and black box evaluation cannot be managed straightforwardly at the same time in the setting of the i2b2/UTHealth 2014 task, making it difficult to assess reliably the relative performance and contribution of the individual components to the overall task.
Authors
Keywords
Aged
Algorithms
Cardiovascular Diseases
Cohort Studies
Comorbidity
Computer Security
Confidentiality
Data Mining
Diabetes Complications
Electronic Health Records
Female
France
Humans
Incidence
Longitudinal Studies
Male
Middle Aged
Narration
Natural Language Processing
Pattern Recognition, Automated
Risk Assessment
Vocabulary, Controlled