On the Relationship Between Double Descent of CNNs and Shape/Texture Bias Under Learning Process
Journal:
arXiv
Published Date:
Mar 4, 2025
Abstract
The double descent phenomenon, which deviates from the traditional
bias-variance trade-off theory, attracts considerable research attention;
however, the mechanism of its occurrence is not fully understood. On the other
hand, in the study of convolutional neural networks (CNNs) for image
recognition, methods are proposed to quantify the bias on shape features versus
texture features in images, determining which features the CNN focuses on more.
In this work, we hypothesize that there is a relationship between the
shape/texture bias in the learning process of CNNs and epoch-wise double
descent, and we conduct verification. As a result, we discover double
descent/ascent of shape/texture bias synchronized with double descent of test
error under conditions where epoch-wise double descent is observed.
Quantitative evaluations confirm this correlation between the test errors and
the bias values from the initial decrease to the full increase in test error.
Interestingly, double descent/ascent of shape/texture bias is observed in some
cases even in conditions without label noise, where double descent is thought
not to occur. These experimental results are considered to contribute to the
understanding of the mechanisms behind the double descent phenomenon and the
learning process of CNNs in image recognition.
