The Evaluation of Adaptive and User-Adaptive Systems: A Review
![Thumbnail](/themes/edepositireland/images/white_rectangle.jpeg)
File Type:
PDFItem Type:
Journal ArticleDate:
2011Citation:
Catherine Mulwa, Séamus Lawless, Mary Sharp and Vincent Wade, The Evaluation of Adaptive and User-Adaptive Systems: A Review, International Journal of Knowledge and Web Intelligence, 2, 2/3, 2011, 138 - 156Download Item:
Abstract:
A current problem with the research of adaptive systems is the inconsistency of evaluation applied to the adaptive systems. However, evaluating an adaptive system is a difficult task due to the complexity of such systems. Evaluators need to ensure correct evaluation methods and measurement metrics are used. This paper reviews a variety of evaluation techniques applied in adaptive and user-adaptive systems. More specifically, it focuses on the user-centred evaluation of adaptive systems such as personalised recommender systems and adaptive information retrieval systems. The review tackles the question of `How have user-centred evaluations of adaptive and user-adaptive systems been conducted and how can these evaluation practices be improved?? Based on the analysed results of the: (a) evaluation approaches, (b) user-centred evaluation techniques, and (c) evaluation metrics, we propose an evaluation framework for end-user experience in evaluating adaptive systems (EFEx).
Sponsor
Grant Number
Science Foundation Ireland (SFI)
07/CE/I1142
Author's Homepage:
http://people.tcd.ie/selawleshttp://people.tcd.ie/msharp
http://people.tcd.ie/vwade
Description:
PUBLISHEDSponsor:
Science Foundation Ireland (SFI)Type of material:
Journal ArticleCollections
Series/Report no:
International Journal of Knowledge and Web Intelligence2
2/3
Availability:
Full text availableKeywords:
Computer Science and Engineering, adaptive information retrieval systems, user-adaptive systems, user-centred evaluationsSubject (TCD):
Intelligent Content & CommunicationsMetadata
Show full item recordLicences: