Two-group classification with high-dimensional correlated data: a factor model approach

A. Pedro Duarte Silva*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

9 Citations (Scopus)

Abstract

A class of linear classification rules, specifically designed for high-dimensional problems, is proposed. The new rules are based on Gaussian factor models and are able to incorporate successfully the information contained in the sample correlations. Asymptotic results, that allow the number of variables to grow faster than the number of observations, demonstrate that the worst possible expected error rate of the proposed rules converges to the error of the optimal Bayes rule when the postulated model is true, and to a slightly larger constant when this model is a reasonable approximation to the data generating process. Numerical comparisons suggest that, when combined with appropriate variable selection strategies, rules derived from one-factor models perform comparably, or better, than the most successful extant alternatives under the conditions they were designed for. The proposed methods are implemented as an R package named HiDimDA, available from the CRAN repository.
Original languageEnglish
Pages (from-to)2975-2990
Number of pages16
JournalComputational Statistics and Data Analysis
Volume55
Issue number11
DOIs
Publication statusPublished - 1 Nov 2011

Keywords

  • Discriminant Analysis
  • Expected misclassification rates
  • High dimensionality
  • Microarray classification

Fingerprint

Dive into the research topics of 'Two-group classification with high-dimensional correlated data: a factor model approach'. Together they form a unique fingerprint.

Cite this