Experimental Design on a Budget for Sparse Linear Models and Applications.

Journal: JMLR workshop and conference proceedings
Published Date:

Abstract

Budget constrained optimal design of experiments is a well studied problem. Although the literature is very mature, not many strategies are available when these design problems appear in the context of sparse linear models commonly encountered in high dimensional machine learning. In this work, we study this budget constrained design where the underlying regression model involves a -regularized linear function. We propose two novel strategies: the first is motivated geometrically whereas the second is algebraic in nature. We obtain tractable algorithms for this problem which also hold for a more general class of sparse linear models. We perform a detailed set of experiments, on benchmarks and a large neuroimaging study, showing that the proposed models are effective in practice. The latter experiment suggests that these ideas may play a small role in informing enrollment strategies for similar scientific studies in the future.

Authors

  • Sathya N Ravi
    University of Illinois at Chicago.
  • Vamsi K Ithapu
    University of Wisconsin Madison.
  • Sterling C Johnson
    Wisconsin Alzheimer's Institute, University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin, USA.
  • Vikas Singh
    University of Wisconsin-Madison.

Keywords

No keywords available for this article.