Short answer
Always explicitly document and report the number of participants, group size, number of sessions, duration, and rationale for using focus groups in your design research to enhance credibility and utility.
- Field
- Modelling
- Source
- Methods in Ecology and Evolution (2018)
- Method
- Structured literature review
- Sample
- 170 articles reviewed
- Evidence
- Strong effect
A review of conservation research using focus group discussions found significant gaps in methodological reporting, hindering the utility and replicability of findings. This modelling research insight is drawn from a 2018 study published in Methods in Ecology and Evolution. Using Structured literature review with 170 articles reviewed, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Always explicitly document and report the number of participants, group size, number of sessions, duration, and rationale for using focus groups in your design research to enhance credibility and utility.
Structured reporting of focus group methodology increases research utility and replicability
A review of conservation research using focus group discussions found significant gaps in methodological reporting, hindering the utility and replicability of findings.
Methods in Ecology and Evolution · 2018
Key Findings
- 01A significant number of studies (67%) were published between 2011 and 2017, indicating increasing use of FGDs.
- 02FGDs were rarely used as a stand-alone technique.
- 03Median number of participants per focus group was 10 (range 3-21).
- 04Median number of focus group meetings per study was 7.
- 05Median duration of FGD sessions was 90 minutes.
Application
Design takeaway
Always explicitly document and report the number of participants, group size, number of sessions, duration, and rationale for using focus groups in your design research to enhance credibility and utility.
How to apply
When conducting focus groups for a design project, create a detailed research plan and report that includes: the total number of participants, the number of participants per group, the number of focus group sessions conducted, the duration of each session, the recruitment criteria, and the specific rationale for choosing FGDs over other methods.
Project actions
- 01Create a 'Methods' section in your project report that clearly outlines all aspects of your focus group methodology.
- 02Use a template or checklist to ensure you don't miss any key reporting details for your qualitative research.
- 03Practice articulating the 'why' behind your chosen research methods.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Comprehensive review of a large number of articles (170).
- +Identifies specific, actionable gaps in reporting.
- +Provides clear guidelines for improvement.
Limitations
This study is about conservation, not directly UX. However, the principles of good qualitative research reporting are universal. The study doesn't tell us *why* researchers failed to report details, only that they did.
Reliability & validity
The study itself demonstrates good internal validity by systematically reviewing articles based on defined criteria. Its findings highlight how poor reporting in the reviewed articles compromises the reliability (replicability) and external validity (generalizability) of those original studies.
Think critically
How might the lack of methodological detail in published research affect the cumulative knowledge base in a field? What are the ethical implications of poorly reported qualitative research?
Design Principles
"Methodological Transparency Enhances Credibility."
Clear and comprehensive reporting of research methods is crucial for establishing the credibility and trustworthiness of findings. Without detailed methodological information, designers and researchers cannot properly evaluate the validity of the study or replicate its procedures, leading to a lack of confidence in applying the insights.
What This Means for Your Design
When you do focus groups for your design project, you need to write down exactly how you did them – how many people, how many groups, how long each group met, and why you chose focus groups. If you don't, your results might not be trusted or useful to others.
How to use in your project
- 1.When presenting research findings from focus groups, ensure the information architecture of your report or presentation clearly separates 'Methodology' from 'Findings' and includes all necessary details.
Add to My Project
Quick Cite
Paragraph starter
Nyumba et al. (2018) highlight that comprehensive reporting of focus group methodology, including participant numbers, group sizes, and session details, is crucial for the credibility and utility of research findings.
Source
Methods in Ecology and Evolution
The use of focus group discussion methodology: Insights from two decades of application in conservation
journal · 2018
View sourceQuestions About This Research
- What does the research say about structured reporting of focus group methodology increases research utility and replicability?
- Always explicitly document and report the number of participants, group size, number of sessions, duration, and rationale for using focus groups in your design research to enhance credibility and utility. Evidence: Methods in Ecology and Evolution (2018).
- Why does "Structured reporting of focus group methodology increases research utility and replicability" matter for design?
- Clear and comprehensive reporting of research methods is crucial for establishing the credibility and trustworthiness of findings. Without detailed methodological information, designers and researchers cannot properly evaluate the validity of the study or replicate its procedures, leading to a lack of confidence in applying the insights.
- How can designers apply this research?
- Always explicitly document and report the number of participants, group size, number of sessions, duration, and rationale for using focus groups in your design research to enhance credibility and utility.
- What were the main findings?
- A significant number of studies (67%) were published between 2011 and 2017, indicating increasing use of FGDs.. FGDs were rarely used as a stand-alone technique.. Median number of participants per focus group was 10 (range 3-21).. Median number of focus group meetings per study was 7.
- What research method was used?
- Structured literature review with 170 articles reviewed.
- How strong is the evidence?
- Evidence strength is rated Strong effect, based on a 2018 journal from Methods in Ecology and Evolution.
- What should I do differently in my next project?
- When conducting focus groups for a design project, create a detailed research plan and report that includes: the total number of participants, the number of participants per group, the number of focus group sessions conducted, the duration of each session, the recruitment criteria, and the specific rationale for choosing FGDs over other methods.
- What are the limitations?
- The review focused specifically on conservation research, so direct applicability to all UX/ID contexts might require careful consideration of domain-specific nuances. The study itself is a review, not an empirical study of design outcomes.