Raynor, DK orcid.org/0000-0003-0306-5275 and Bryant, D (2013) European Public Assessment Report (EPAR) summaries for the public: are they fit for purpose? A user-testing study. BMJ Open, 3 (9). ARTN e003185. e003185-e003185. ISSN 2044-6055
Abstract
OBJECTIVES: Apply 'user testing' methodology to test the readability of a European Public Assessment Report (EPAR) summary-which describes how the decision was made by the European Medicines Agency to approve a medicine. DESIGN: User testing uses mixed methods (questionnaire and semistructured interview), applied iteratively, to assess document performance-can people find and understand key points of information. SETTING AND PARTICIPANTS: Testing was undertaken with 40 members of the public in four consecutive rounds of 10. Inclusion criteria, matched across rounds, included range of ages and educational attainment. TESTED DOCUMENTS: In round 1 we tested 19 key points of information in a printed version of the EPAR summary for Bondronat (a cancer medicine). This was then revised to address the findings, and tested in round 2. In round 3 we tested the summary on-screen, and in round 4, tested a revised on-screen version, after addressing findings from both rounds 1 and 3. PRIMARY OUTCOME MEASURE: The target followed European guidance for medicine leaflets: for each point of information 90% of participants should be able to find, and of those, 90% able to show understanding of the point. RESULTS: For the original EPAR summary, 6 of the 19 points of information reached the target (both paper-based and on-screen). After revisions to format and content, using good practice in information writing and design, 14 and 16 points, respectively, met the target. The problems related to both finding (dependent on layout, headings and design) and understanding (words and sentences used, as well as design). We devised a new heading structure, increased use of bullet points, replaced difficult and technical words and divided long sentences. CONCLUSIONS: People had difficulty finding and understanding key messages in the summary, but user testing identified the problems, and application of good practice resulted in a revised format which performed well.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 3.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/3.0/ |
Keywords: | Public Health; Therapeutics |
Dates: |
|
Institution: | The University of Leeds |
Academic Units: | The University of Leeds > Faculty of Medicine and Health (Leeds) > School of Healthcare (Leeds) > Pharmacy (Leeds) |
Depositing User: | Symplectic Publications |
Date Deposited: | 24 Jul 2018 11:22 |
Last Modified: | 24 Jul 2018 11:22 |
Status: | Published |
Publisher: | BMJ Publishing Group |
Identification Number: | 10.1136/bmjopen-2013-003185 |
Related URLs: | |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:128038 |