Short answer

Designers should implement a structured, iterative focus group methodology, starting with exploratory sessions to refine designs and progressing to confirmatory sessions for validation, to ensure user-centricity and efficacy.

Field: User-Centred Design
Source: Communications of the Association for Information Systems (2010)
Method: Qualitative research, Focus Groups
Evidence: Strong effect

Employing exploratory focus groups (EFGs) in iterative cycles allows for continuous refinement of artifact designs before field testing. This user-centred design research insight is drawn from a 2010 study published in Communications of the Association for Information Systems. Using Qualitative research, focus groups, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Designers should implement a structured, iterative focus group methodology, starting with exploratory sessions to refine designs and progressing to confirmatory sessions for validation, to ensure user-centricity and efficacy.

Study

User-Centred DesignHigh ImpactStrong effect

Iterative Focus Groups Accelerate Artifact Design Refinement

Employing exploratory focus groups (EFGs) in iterative cycles allows for continuous refinement of artifact designs before field testing.

Communications of the Association for Information Systems · 2010

Key Findings

01Traditional focus groups require adaptation for design research goals.
02Exploratory Focus Groups (EFGs) are effective for iterative artifact design refinement.
03Confirmatory Focus Groups (CFGs) are useful for evaluating artifact utility in field use.
04Multiple CFGs with mixed data collection methods provide rigorous evaluation.

Application

Design takeaway

How to apply

When developing a new product or system, conduct multiple rounds of focus groups. Use the first set to gather initial reactions and suggestions for improvement, then revise the design and conduct another set to see if the changes were effective, repeating as necessary before final testing.

Project actions

01Plan your focus group questions carefully to elicit specific feedback on design elements.
02Consider how you will record and analyze the qualitative data from the focus groups.

Method & Evidence

AimHow can focus groups be adapted to effectively support the iterative refinement and evaluation of artifact designs within a design research context?

MethodQualitative research, Focus Groups

ProcedureThe study proposes and demonstrates two types of focus groups: Exploratory Focus Groups (EFGs) for artifact refinement and Confirmatory Focus Groups (CFGs) for field use evaluation. EFGs are used iteratively to gather feedback and propose improvements, while CFGs are employed later to validate utility in the application environment, collecting both qualitative and quantitative data across multiple sessions.

ContextDesign research, particularly in the healthcare field, for artifact development.

Variables

IVType of focus group (Exploratory vs. Confirmatory), Iteration number

DVDesign improvements, User satisfaction, Perceived utility of the artifact

CVParticipant demographics, Moderator consistency, Prototype version

Strengths & Limitations

Strengths

+Provides rich qualitative data on user perceptions and suggestions.
+Facilitates group interaction, which can spark new ideas and reveal shared concerns.

Limitations

Focus groups can be influenced by group dynamics, and findings may not be generalizable to all users. Ensuring a diverse and representative sample is challenging.

Reliability & validity

Reliability can be improved by using standardized moderation scripts and consistent participant recruitment criteria across sessions. Validity is enhanced by triangulating focus group findings with other data sources (e.g., user testing, surveys) and ensuring the participant sample accurately reflects the target user group.

Think critically

How might the social dynamics within a focus group influence the feedback provided, potentially leading to biased or less honest responses?

Design Principles

"Iterative user feedback loops are crucial for effective design refinement and validation."

This approach ensures that user feedback is integrated early and often, leading to more robust and user-aligned designs. By systematically evaluating and improving an artifact through multiple EFG sessions, designers can mitigate potential usability issues and enhance overall user satisfaction.

What This Means for Your Design

To make a new design better, talk to users in small groups multiple times. First, ask them what they think and how to improve it. Then, make changes based on their ideas and ask another group, or the same group, again. This helps fix problems early.

How to use in your project

1.Describe how you used focus groups to gather feedback and make design decisions.
2.Explain the difference between exploratory and confirmatory feedback in your project.

Add to My Project

Quick Cite

Paragraph starter

Iterative focus groups were employed to refine the artifact design. Initially, exploratory focus groups (EFGs) were conducted to gather user feedback and identify areas for improvement. Based on the insights gained from the EFGs, design modifications were implemented. Subsequent focus group sessions, potentially confirmatory in nature, were utilized to validate the effectiveness of these changes and ensure the artifact met user needs prior to further development or field testing.

Source

Communications of the Association for Information Systems

Focus Groups for Artifact Refinement and Evaluation in Design Research

journal · 2010

View source

Questions About This Research

What does the research say about iterative focus groups accelerate artifact design refinement?: Designers should implement a structured, iterative focus group methodology, starting with exploratory sessions to refine designs and progressing to confirmatory sessions for validation, to ensure user-centricity and efficacy. Evidence: Communications of the Association for Information Systems (2010).
Why does "Iterative Focus Groups Accelerate Artifact Design Refinement" matter for design?: This approach ensures that user feedback is integrated early and often, leading to more robust and user-aligned designs. By systematically evaluating and improving an artifact through multiple EFG sessions, designers can mitigate potential usability issues and enhance overall user satisfaction.
How can designers apply this research?: Designers should implement a structured, iterative focus group methodology, starting with exploratory sessions to refine designs and progressing to confirmatory sessions for validation, to ensure user-centricity and efficacy.
What were the main findings?: Traditional focus groups require adaptation for design research goals.. Exploratory Focus Groups (EFGs) are effective for iterative artifact design refinement.. Confirmatory Focus Groups (CFGs) are useful for evaluating artifact utility in field use.. Multiple CFGs with mixed data collection methods provide rigorous evaluation.
What research method was used?: Qualitative research, Focus Groups.
How strong is the evidence?: Evidence strength is rated Strong effect, based on a 2010 journal from Communications of the Association for Information Systems.
What should I do differently in my next project?: When developing a new product or system, conduct multiple rounds of focus groups. Use the first set to gather initial reactions and suggestions for improvement, then revise the design and conduct another set to see if the changes were effective, repeating as necessary before final testing.
What are the limitations?: The effectiveness of focus groups can depend on moderator skill and participant representativeness. The specific adaptations discussed are within the context of computer science and information systems design research.