-------- Original-Nachricht -------- Betreff: [isworld] CFP: Principled Design and Evaluation of Adaptive Systems (UMUAI Special Issue) Datum: Thu, 20 Aug 2009 14:24:12 -0400 Von: Alfred Kobsa kobsa@uci.edu Antwort an: Alfred Kobsa kobsa@uci.edu An: AISWORLD Information Systems World Network isworld@lyris.isworld.org

========================================= CALL FOR PAPERS

Special Issue on Principled Design and Evaluation of Adaptive Systems

User Modeling and User-Adapted Interaction: The Journal of Personalization Research (An international journal published by Springer Verlag)

Web site: http://www.easy-hub.org/umuai/

=========================================

The importance and benefits of involving users in the design and evaluation of adaptive systems has been advocated for a long time. In fact, user studies have become an integral part of papers published in the UMUAI journal, and indeed most papers published in the major conferences in the area. Although this is most definitely indicative of increasing maturity in the field, we are far from having solved all related outstanding issues:

* Most papers report summative evaluations, aiming to establish the extent to which the use of an adaptation method has improved the system. Often more scientific insight can be gained from formative evaluations that inform and guide the development process of adaptive systems.

* Most papers report on a single evaluation activity, often assessing the system as a whole only. More principled and rigorous forms of evaluation are possible, in which different system layers or components are evaluated separately, and more is learned about what causes success (or, more importantly in some cases, failure).

* Certain success criteria have received a lot more attention than others. For example, for recommender systems, the focus has often been on recall and precision, rather than serendipity, privacy and trust. A more holistic approach to evaluation is needed, including the consideration of trade-offs between criteria. Metrics and methods for evaluating new criteria are also needed.

This special issue aims to create a new point of reference for the evaluation of adaptive systems, bringing future evaluations to the next level. Rather than just encouraging evaluation studies, the goal of this special issue is to reflect the current body of knowledge on evaluation methods and methodologies for different types of user adaptive systems. We expect contributions will address the following core categories:

* Papers describing novel methods that can be used for the user- centred design and formative evaluation of adaptive systems.

* Papers demonstrating the value and benefit of success criteria used in the evaluation of adaptive systems, validating concrete evaluation metrics, or considering trade-offs between different criteria.

* Papers describing frameworks for the principled design and evaluation of adaptive systems, that may provide guidance and serve as the theoretical underpinnings of future studies.

All papers in the issue will undergo stringent peer-review. Papers proposing a new evaluation method, framework, or criteria will need to validate these proposals, for example through case studies and / or surveys.

Authors will be expected to position their work in relation to a framework for the principled design and evaluation of adaptive systems, which will be summarized by the editors in an introductory article. This framework has been developed over the course of several international workshops (see http://www.easy- hub.org/workshops/) and preliminary material for prospective contributors to the special issue has been made available on the issue's web site (see http://www.easy-hub.org/umuai/layered.dot). To provide a coherent point of reference, authors are also expected to cross-reference their accepted submissions to each other, where applicable, in a second round of editing.

Articles that describe a traditional global summative evaluation of an adaptive system should be submitted to the regular track of UMUAI rather than this special issue (contact the editors if in doubt).

HOW TO SUBMIT

Submissions to the special issue should follow the UMUAI formatting guidelines and submission instructions available at:

http://www.umuai.org/paper_submission.html

Each submission should note that it is intended for the Special Issue on Principled Design and Evaluation of Adaptive Systems.

Potential authors are asked to submit a tentative title and short abstract (which can be altered for the actual submission) to assist in the formation of a panel of appropriate reviewers.

UMUAI is an archival journal that publishes mature and substantiated research results on the (dynamic) adaptation of computer systems to their human users, and the role that a model of the system about the user plays in this context. Many articles in UMUAI are quite comprehensive and describe the results of several years of work. Consequently, UMUAI gives "unlimited" space to authors (so long as what they write is important). Authors whose paper exceeds 40 pages in journal format (including illustrations and references) are however requested to supply a short justification upon submission that explains why a briefer discussion of their research results would not be advisable.

IMPORTANT DATES

Deadline for submission of title and abstract: January 4, 2010 Deadline for paper submissions: February 1, 2010

REVIEW PROCESS

Submissions will undergo the normal review process, and will be reviewed by three established researchers selected from a panel of reviewers formed for the special issue. Barring unforeseen problems, authors can expect to be notified regarding the review results within three months of submission.

GUEST EDITORS

Stephan Weibelzahl School of Computing National College of Ireland Dublin sweibelzahl at ncirl.ie http://www.weibelzahl.de/

Alexandros Paramythis Institute for Information Processing and Microprocessor Technology (FIM) Johannes Kepler University Linz alpar at fim.uni-linz.ac.at http://www.fim.uni-linz.ac.at/staff/paramythis/

Judith Masthoff Computing Science University of Aberdeen j.masthoff at abdn.ac.uk http://www.csd.abdn.ac.uk/~jmasthof/

The AISWorld LISTSERV is a service of the Association for Information Systems (http://www.aisnet.org). To unsubscribe, redirect, or change subscription options please go to http://lyris.isworld.org/. You are subscribed to AISworld as: neumann@wu-wien.ac.at. Each Sender assumes responsibility that his or her message conforms to the AISWorld LISTSERV policy and conditions of use available at http://lyris.isworld.org/isworldlist.htm.