Improving credibility evaluations on Wikipedia

Lucassen, T. & Schmettow, M. (2011). Improving credibility evaluations on Wikipedia. In Wiering, C. H., Pieters, J. M., Boer, H., Intervention Design and Evaluation in Psychology.

In this chapter, ongoing research on trust in Wikipedia is used as a case study to illustrate the design process of a support tool for Wikipedia, following the ASCE-model. This research is performed from a cognitive perspective and aims at users actively evaluating the credibility of information on Wikipedia on an article basis rather than passively relying on their trust in the source of the information (Wikipedia as a whole).

Article in “Quest” magazine

Popular-science magazine “Quest” has published a short story on my research! Here it is.

Adaptive attention allocation support: Effects of system conservativeness and human competence

Van Maanen, P.-P., Lucassen, T., & van Dongen, K. (2011). Adaptive attention allocation support: Effects of system conservativeness and human competence. In Schmorrow, D. and Fidopiastis, C., editors, Foundations of Augmented Cognition. Directing the Future of Adaptive Systems, volume 6780 of Lecture Notes in Computer Science, chapter 74, pages 647-656. Springer Berlin / Heidelberg, Berlin, Heidelberg.

Naval tactical picture compilation is a task for which allocation of attention to the right information at the right time is crucial. Performance on this task can be improved if a support system assists the human operator. However, there is evidence that benefits of support systems are highly dependent upon the systems’ tendency to support. This paper presents a study into the effects of different levels of support conservativeness (i.e., tendency to support) and human competence on performance and on the human’s trust in the support system. Three types of support are distinguished: fixed, liberal and conservative support. In fixed support, the system calculates an estimated optimal decision and suggests this to the human. In the liberal and conservative support types, the system estimated the important information in the problem space in order to make a correct decision and directs the human’s attention to this information. In liberal support, the system attempts to direct the human’s attention using only the assessed task requirements, whereas in conservative support, the this attempt is done provided that it has been estimated that the human is not already paying attention (more conservative). Overall results do not confirm our hypothesis that adaptive conservative support leads to the best performances. Furthermore, especially high-competent humans showed more trust in a system when delivered support was adapted to their specific needs.

(Full text)

Item in University of Twente alumni magazine

The following item about this press release was published in the alumni magazine of the University of Twente.

Large article in Reformatorisch Dagblad

The Reformatorisch Dagblad (national newspaper) has published a large article about my research. In the printed version, it spanned across 2 pages! Access the online version here.

Researching trust in Wikipedia

Lucassen, T. & Schraagen, J. M. (2011). Researching trust in Wikipedia. In Chi Sparks, Arnhem, The Netherlands.

As the use of collaborative online encyclopedias such as Wikipedia grows, so does the need for research on how users evaluate its credibility. In this paper we compare three experimental approaches to study trust in Wikipedia, namely think aloud, eye-tracking, and online questionnaires. The advantages and disadvantages of each method are discussed. We conclude that it is best to use multiple methods when researching information trust, as each single one of the discussed methods alone does not give all possible information.

(Full text / Poster)

Reference blindness: The influence of references on trust in Wikipedia

Lucassen, T., Noordzij, M. L., & Schraagen, J. M. (2011). Reference blindness: The influence of references on trust in Wikipedia. In ACM WebSci ’11.

In this study we show the influence of references on trust in information. We changed the contents of reference lists of Wikipedia articles in such a way that the new references were no longer in any sense related to the topic of the arti- cle. Furthermore, the length of the reference list was varied. College students were asked to evaluate the credibility of these articles. Only 6 out of 23 students noticed the manipulation of the references; 9 out of 23 students noticed the variations in length. These numbers are remarkably low, as 17 students indicated they considered references an important indicator of credibility. The findings suggest a highly heuristic manner of credibility evaluation. Systematic evaluation behavior was also observed in the experiment, but only of participants with low trust in Wikipedia in general.

(Full text / Poster)

Radio interview with Sander de Heer, Radio 2

My 3rd radio appearance, again on national radio is prime-time in the morning with Sander de Heer in his show De Heer Ontwaakt op Radio 2.

Radio interview on Radio 2 (MP3)

News item in De Pers

I came across this news item on my research in the free national newspaper De Pers:

Article in NRC Handelsblad

Here is an article about my research in NRC Handelsblad (national newspaper).