From code sharing to sharing of implementations: Advancing reproducible AI development for medical imaging through federated testing.
Journal:
Journal of medical imaging and radiation sciences
Published Date:
Aug 29, 2024
Abstract
BACKGROUND: The reproducibility crisis in AI research remains a significant concern. While code sharing has been acknowledged as a step toward addressing this issue, our focus extends beyond this paradigm. In this work, we explore "federated testing" as an avenue for advancing reproducible AI research and development especially in medical imaging. Unlike federated learning, where a model is developed and refined on data from different centers, federated testing involves models developed by one team being deployed and evaluated by others, addressing reproducibility across various implementations.