Evolutionary instance selection for text classification

Chih Fong Tsai, Zong Yao Chen, Shih Wen Ke

Research output: Contribution to journalArticlepeer-review

21 Scopus citations

Abstract

Text classification is usually based on constructing a model through learning from training examples to automatically classify text documents. However, as the size of text document repositories grows rapidly, the storage requirement and computational cost of model learning become higher. Instance selection is one solution to solve these limitations whose aim is to reduce the data size by filtering out noisy data from a given training dataset. In this paper, we introduce a novel algorithm for these tasks, namely a biological-based genetic algorithm (BGA). BGA fits a "biological evolution" into the evolutionary process, where the most streamlined process also complies with the reasonable rules. In other words, after long-term evolution, organisms find the most efficient way to allocate resources and evolve. Consequently, we can closely simulate the natural evolution of an algorithm, such that the algorithm will be both efficient and effective. The experimental results based on the TechTC-100 and Reuters-21578 datasets show the outperformance of BGA over five state-of-the-art algorithms. In particular, using BGA to select text documents not only results in the largest dataset reduction rate, but also requires the least computational time. Moreover, BGA can make the k-NN and SVM classifiers provide similar or slightly better classification accuracy than GA.

Original languageEnglish
Pages (from-to)104-113
Number of pages10
JournalJournal of Systems and Software
Volume90
Issue number1
DOIs
StatePublished - 2014

Keywords

  • Genetic algorithms
  • Instance selection
  • Text classification

Fingerprint

Dive into the research topics of 'Evolutionary instance selection for text classification'. Together they form a unique fingerprint.

Cite this