Mobile Health (mHealth) Viral Diagnostics Enabled with Adaptive Adversarial Learning.
Journal:
ACS nano
PMID:
33226787
Abstract
Deep-learning (DL)-based image processing has potential to revolutionize the use of smartphones in mobile health (mHealth) diagnostics of infectious diseases. However, the high variability in cellphone image data acquisition and the common need for large amounts of specialist-annotated images for traditional DL model training may preclude generalizability of smartphone-based diagnostics. Here, we employed adversarial neural networks with conditioning to develop an easily reconfigurable virus diagnostic platform that leverages a dataset of smartphone-taken microfluidic chip photos to rapidly generate image classifiers for different target pathogens on-demand. Adversarial learning was also used to augment this real image dataset by generating 16,000 realistic synthetic microchip images, through style generative adversarial networks (StyleGAN). We used this platform, termed martphone-based athogen tection esource ultiplier using dversarial etworks (SPyDERMAN), to accurately detect different intact viruses in clinical samples and to detect viral nucleic acids through integration with CRISPR diagnostics. We evaluated the performance of the system in detecting five different virus targets using 179 patient samples. The generalizability of the system was confirmed by rapid reconfiguration to detect SARS-CoV-2 antigens in nasal swab samples ( = 62) with 100% accuracy. Overall, the SPyDERMAN system may contribute to epidemic preparedness strategies by providing a platform for smartphone-based diagnostics that can be adapted to a given emerging viral agent within days of work.
Authors
Keywords
Antigens, Viral
Communicable Disease Control
COVID-19
COVID-19 Testing
CRISPR-Cas Systems
Deep Learning
Disaster Planning
Humans
Image Processing, Computer-Assisted
Metal Nanoparticles
Neural Networks, Computer
Platinum
Point-of-Care Testing
Public Health
Reproducibility of Results
Signal Processing, Computer-Assisted
Smartphone
Telemedicine