Using Diversity in Preparing Ensembles of Classifiers Based on Different Feature Subsets to Minimize Generalization Error
![Thumbnail](/themes/edepositireland/images/white_rectangle.jpeg)
File Type:
PDFItem Type:
Technical ReportDate:
2001-04Citation:
Zenobi, Gabriele; Cunningham, Padraig. 'Using Diversity in Preparing Ensembles of Classifiers Based on Different Feature Subsets to Minimize Generalization Error'. - Dublin, Trinity College Dublin, Department of Computer Science, TCD-CS-2001-11, 2001, pp15Download Item:
Abstract:
It is well known that ensembles of predictors produce better accuracy
than a single predictor provided there is diversity in the ensemble. This
diversity manifests itself as disagreement or ambiguity among the ensemble
members. In this paper we focus on ensembles of classifiers based on different
feature subsets and we present a process for producing such ensembles that
emphasizes diversity (ambiguity) in the ensemble members. This emphasis on
diversity produces ensembles with low generalization errors from ensemble
members with comparatively high generalization error. We compare this with
ensembles produced focusing only on the error of the ensemble members
(without regard to overall diversity) and find that the ensembles based on
ambiguity have lower generalization error. Further, we find that the ensemble
members produced focusing on ambiguity have less features on average that
those based on error only. We suggest that this indicates that these ensemble
members are local learners.
Author: Zenobi, Gabriele; Cunningham, Padraig
Publisher:
Trinity College Dublin, Department of Computer ScienceType of material:
Technical ReportCollections
Series/Report no:
Computer Science Technical ReportTCD-CS-2001-11
Availability:
Full text availableKeywords:
Computer ScienceMetadata
Show full item recordLicences: