Short answer
Shift from informal 'research summaries' to structured 'evidence logs' that document exactly how many sources were screened and why specific insights were selected over others.
- Field
- User-Centred Design
- Source
- BMJ (2021)
- Method
- Expert consensus and systematic literature review of reporting methodology.
- Sample
- 26 international methodology experts
- Evidence
- Strong effect
Structured documentation frameworks reduce cognitive bias and information gaps by forcing the explicit disclosure of selection criteria and data synthesis methods. This user-centred design research insight is drawn from a 2021 study published in BMJ. Using Expert consensus and systematic literature review of reporting methodology. with 26 international methodology experts, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Shift from informal 'research summaries' to structured 'evidence logs' that document exactly how many sources were screened and why specific insights were selected over others.
Standardized reporting structures increase the transparency and replicability of evidence-based design decisions
Structured documentation frameworks reduce cognitive bias and information gaps by forcing the explicit disclosure of selection criteria and data synthesis methods.
BMJ · 2021
Key Findings
- 01Checklist-based reporting significantly reduces the risk of reporting bias
- 02Explicitly stating inclusion and exclusion criteria increases the reliability of the final synthesis
- 03Visual flow diagrams (PRISMA flow) improve reader comprehension of the data filtering process
Application
Design takeaway
Shift from informal 'research summaries' to structured 'evidence logs' that document exactly how many sources were screened and why specific insights were selected over others.
How to apply
When presenting a competitive audit to stakeholders, include a 'Search and Selection' slide showing the total number of apps reviewed, the criteria for selection, and the specific reasons for excluding certain competitors.
Project actions
- 01Use a flow diagram in your portfolio to show how you narrowed down 50 ideas to 3 final concepts
- 02Create a table of 'Inclusion/Exclusion' criteria for your secondary research phase
- 03Cite the PRISMA method to justify your research rigor in your design report
Method & Evidence
Strengths & Limitations
Limitations
Students often lack the time to do a full systematic review; focus on the 'Checklist' and 'Flow Diagram' aspects rather than the full 27-item technicality.
Think critically
How might your design change if you were forced to include the data you initially wanted to ignore?
Design Principles
"Transparency in process validates the integrity of the outcome."
In UX research, stakeholders often question the validity of secondary research or competitive audits. Utilizing a standardized reporting framework like PRISMA ensures that design decisions are grounded in a rigorous, repeatable process rather than cherry-picked data points, thereby increasing executive buy-in and product strategy confidence.
What This Means for Your Design
When you do a literature review or look at other products, don't just show the ones you like. Show your 'working out'—how many you looked at and why you picked these specific ones.
How to use in your project
- 1.Reference PRISMA 2020 when explaining your secondary research methodology in the 'Analysis' or 'Investigation' section.
Add to My Project
Quick Cite
Paragraph starter
To ensure a transparent and unbiased synthesis of existing solutions, this investigation followed the PRISMA 2020 reporting guidelines for screening and selecting secondary sources.
Source
BMJ
PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews
journal · 2021
View sourceQuestions About This Research
- What does the research say about standardized reporting structures increase the transparency and replicability of evidence-based design decisions?
- Shift from informal 'research summaries' to structured 'evidence logs' that document exactly how many sources were screened and why specific insights were selected over others. Evidence: BMJ (2021).
- Why does "Standardized reporting structures increase the transparency and replicability of evidence-based design decisions" matter for design?
- In UX research, stakeholders often question the validity of secondary research or competitive audits. Utilizing a standardized reporting framework like PRISMA ensures that design decisions are grounded in a rigorous, repeatable process rather than cherry-picked data points, thereby increasing executive buy-in and product strategy confidence.
- How can designers apply this research?
- Shift from informal 'research summaries' to structured 'evidence logs' that document exactly how many sources were screened and why specific insights were selected over others.
- What were the main findings?
- Checklist-based reporting significantly reduces the risk of reporting bias. Explicitly stating inclusion and exclusion criteria increases the reliability of the final synthesis. Visual flow diagrams (PRISMA flow) improve reader comprehension of the data filtering process
- What research method was used?
- Expert consensus and systematic literature review of reporting methodology. with 26 international methodology experts.
- How strong is the evidence?
- Evidence strength is rated Strong effect, based on a 2021 journal from BMJ.
- What should I do differently in my next project?
- When presenting a competitive audit to stakeholders, include a 'Search and Selection' slide showing the total number of apps reviewed, the criteria for selection, and the specific reasons for excluding certain competitors.
- What are the limitations?
- The framework is high-effort and may be overkill for rapid, low-stakes tactical UX testing; it is best suited for foundational research.