Our user test toolkit for knowledge translation research

 

One method we utilize in all projects for gathering feedback is user testing.  This entails observing people from our target audience as they engage with a prototype of our product, and listening to them “think-aloud”. The main goal of this method is to gain a deeper understanding of users’ experiences, to observe users’ problems, to collect their suggestions, and to improve the product based on analysis of this structured observation and feedback rather than guesswork.

Template and instructions for use

For each new project we tailor a user test package that our co-researchers can use. This includes instructions and materials. One example can be found here: SURE user test package 2012

To cite there resources, please refer to Rosenbaum SE. User test toolkit for knowledge translation 2022. Available from: https://www.cochrane.no/nb/our-user-test-package

User testing: Relevant publications from staff at Cochrane Norway

  • Rosenbaum, S; Moberg, J; Chesire, F; Mugisha, M; Ssenyonga, R; Ochieng, MA; Simbi, CMC; Nakyejwe, E; Ngatia, B; Rada, G. (2024). "Teaching critical thinking about health information and choices in secondary schools: human-centred design of digital resources." F1000Research 12: 481.
  • Deliv C, Devane D, Putnam El, Healy P. Hall A, Rosenbaum S, Toomey E (2023). "Development of a video-based evidence synthesis knowledge translation resource: Drawing on a user-centred design approach." Digital Health 9: 20552076231170696.
  • Alderighi C, Rasoini R, Formoso G, Celani MG, Rosenbaum, SE. (2022). "Feasibility of contextualizing the Informed Health Choices learning resources in Italy: A pilot study in a primary school in Florence." F1000Research 11: 1167.
  • Munthe-Kaas, H; Nøkleby, H; Rosenbaum, S (2022). "User experiences of structured stakeholder engagement to consider transferability: The TRANSFER approach." Campbell systematic reviews 18(4): cl2. 1284.
  • Meneses-Echavez, JF; Rosenbaum, S; Rada, G; Flottorp, S; Moberg, J; Alonso-Coello, P (2021). "Users’ experiences with an interactive Evidence to Decision (iEtD) framework: a qualitative analysis." BMC medical informatics and decision making21(1): 169.
  • Nsangi, A; Semakula, D; Rosenbaum, SE; Oxman, AD; Oxman, M; Morelli, A; Austvoll-Dahlgren, A; Kaseje, M; Mugisha, M; Uwitonze, AM. (2020). "Development of the informed health choices resources in four countries to teach primary school children to assess claims about treatment effects: a qualitative study employing a user-centred approach." Pilot and Feasibility Studies 6(1): 18.
  • Rosenbaum, SE; Moberg, J; Glenton, C; Schünemann, HJ; Lewin, S; Akl, E; Mustafa, RA; Morelli, A; Vogel, JP; Alonso‐Coello, P. (2018). "Developing evidence to decision frameworks and an interactive evidence to decision tool for making and using decisions and recommendations in health care." Global Challenges 2(9): 1700081.
  • Mijumbi-Deve, R; Rosenbaum, SE; Oxman, AE; Lavis, JN; Sewankambo, NK. (2017). "Policymaker experiences with rapid response briefs to address health-system and technology questions in Uganda." Health Research Policy and Systems 15(1): 37.
  • Rosenbaum SE, Glenton C, Wiysonge CS, Abalos E, Migniini L, Young T, et al. Evidence summaries tailored for health policymakers in low and middle-income countries. WHO Bulletin, 2011; 89 (1)
  • Rosenbaum SE, Glenton C, Nylund HK, Oxman AD. User testing and stakeholder feedback contributed to the development of understandable and useful Summary of Findings tables for Cochrane reviews. Journal of Clinical Epidemiology, 2010 Jun;63(6):607-19.
  • Glenton C, Santesso N, Rosenbaum S, Nilsen ES, Rader T, Ciapponi A, Dilkes H (2010). "Presenting the results of Cochrane Systematic Reviews to a consumer audience: a qualitative study." Medical Decision Making 30(5): 566–577.
  • Rosenbaum SE, Glenton C, Cracknell J. User experiences of evidence-based online resources for health professionals: user testing of The Cochrane Library. BMC Medical Informatics and Decision Making, 2008;8:34