Feature selection for high-dimensional data: a fast correlation-based filter solution
Lei Yu, Huan Liu · 2003
Feature selection, as a preprocessing step to machine learning, has been effective in reducing dimensionality, removing irrelevant data, increasing learning accuracy, and improving comprehensibility. However, the recent increase of dimensionality of data poses a severe challenge to many existing feature selection methods with respect to efficiency and effectiveness. In this work, we introduce a novel concept, predominant correlation, and propose a fast filter method which can identify relevant features as well as redundancy among relevant features without pairwise correlation analysis. The efficiency and effectiveness of our method is demonstrated through extensive comparisons with other methods using real-world data of high dimensionality. 1.
Cited by 2,185 works.
Authors
References
- C4.5: Programs for Machine Learning
- Numerical recipes in C
- Data Mining: Practical Machine Learning Tools and Techniques
- UCI Repository of machine learning databases
- Wrappers for feature subset selection
- A Comparative Study on Feature Selection in Text Categorization
- Data mining
- Multi-Interval Discretization of Continuous-Valued Attributes for Classification Learning
- Selection of relevant features and examples in machine learning
- Estimating attributes: Analysis and extensions of RELIEF