Deep Learning Model for Cosmetic Gel Classification Based on a Short-Time Fourier Transform and Spectrogram.

Journal: ACS applied materials & interfaces
PMID:

Abstract

Cosmetics and topical medications, such as gels, foams, creams, and lotions, are viscoelastic substances that are applied to the skin or mucous membranes. The human perception of these materials is complex and involves multiple sensory modalities. Traditional panel-based sensory evaluations have limitations due to individual differences in sensory receptors and factors such as age, race, and gender. Therefore, this study proposes a deep-learning-based method for systematically analyzing and effectively identifying the physical properties of cosmetic gels. Time-series friction signals generated by rubbing the gels were measured. These signals were preprocessed through short-time Fourier transform (STFT) and continuous wavelet transform (CWT), respectively, and the frequency factors that change over time were distinguished and analyzed. The deep learning model employed a ResNet-based convolution neural network (CNN) structure with optimization achieved through a learning rate scheduler. The optimized STFT-based 2D CNN model outperforms the CWT-based 2D and 1D CNN models. The optimized STFT-based 2D CNN model also demonstrated robustness and reliability through k-fold cross-validation. This study suggests the potential for an innovative approach to replace traditional expert panel evaluations and objectively assess the user experience of cosmetics.

Authors

  • Jae Ho Sim
    Materials and Components Research Division, Superintelligence Creative research Laboratory, Electronics and Telecommunications Research Institute (ETRI), Daejeon 34129, Republic of Korea.
  • Jengsu Yoo
    Materials and Components Research Division, Superintelligence Creative research Laboratory, Electronics and Telecommunications Research Institute (ETRI), Daejeon 34129, Republic of Korea.
  • Myung Lae Lee
    Materials and Components Research Division, Superintelligence Creative research Laboratory, Electronics and Telecommunications Research Institute (ETRI), Daejeon 34129, Republic of Korea.
  • Sang Heon Han
    Tera Leader, Daejeon 34013, Republic of Korea.
  • Seok Kil Han
    Tera Leader, Daejeon 34013, Republic of Korea.
  • Jeong Yu Lee
    Basic Research & Innovation Division, R&I Center, AmorePacific Corporation, Yongin-si, Gyeonggi-do 17074, Republic of Korea.
  • Sung Won Yi
    Basic Research & Innovation Division, R&I Center, AmorePacific Corporation, Yongin-si, Gyeonggi-do 17074, Republic of Korea.
  • Jin Nam
    Basic Research & Innovation Division, R&I Center, AmorePacific Corporation, Yongin-si, Gyeonggi-do 17074, Republic of Korea.
  • Dong Soo Kim
    Department of Creative Convergence Engineering, Hanbat National University, Daejeon 34158, Republic of Korea.
  • Yong Suk Yang
    Materials and Components Research Division, Superintelligence Creative research Laboratory, Electronics and Telecommunications Research Institute (ETRI), Daejeon 34129, Republic of Korea.