Short answer

Designers should critically evaluate the tools they use for concept selection, recognizing that tools focused solely on ranking might inadvertently steer teams away from truly innovative, albeit initially less familiar, concepts.

Field: Modelling
Source: Journal of Mechanical Design (2018)
Method: Comparative experimental study
Evidence: Moderate effect

While intended to streamline decision-making, concept selection tools in design projects might inadvertently suppress the novelty of ideas by prioritizing perceived quality over true innovation. This modelling research insight is drawn from a 2018 study published in Journal of Mechanical Design. Using Comparative experimental study, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Designers should critically evaluate the tools they use for concept selection, recognizing that tools focused solely on ranking might inadvertently steer teams away from truly innovative, albeit initially less familiar, concepts.

Study

ModellingHigh ImpactModerate effect

Concept selection tools may hinder, not help, creative idea development in design projects.

While intended to streamline decision-making, concept selection tools in design projects might inadvertently suppress the novelty of ideas by prioritizing perceived quality over true innovation.

Journal of Mechanical Design · 2018

Key Findings

01Average idea quality (AQL) increased significantly by the detailed design stage.
02Average idea novelty (ANV) did not change significantly throughout the project.
03The type of concept selection tool used did not significantly impact the change in idea quality or novelty.
04Teams tended to select ideas ranked highly by the tools only if those ideas met their pre-existing expectations, suggesting cognitive biases influence decision-making.

Application

Design takeaway

How to apply

When using concept selection tools, actively encourage teams to explore and justify ideas that might initially score lower on traditional metrics but possess high novelty potential.

Project actions

01When using concept selection tools, consider adding a separate stage for evaluating the novelty of ideas.
02Be aware of your own biases when ranking concepts; try to justify why a less conventional idea might be valuable.

Method & Evidence

AimTo investigate the impact of concept selection tools (Concept Selection Matrix and Tool for Assessing Semantic Creativity) on the average quality and novelty of ideas selected by student design teams.

MethodComparative experimental study

ProcedureStudent teams utilized either a Concept Selection Matrix (CSM) or a Tool for Assessing Semantic Creativity (TASC) over an 8-week design project. The average quality and novelty of their selected ideas were assessed at multiple decision points.

ContextEngineering design education

Variables

IVType of concept selection tool (CSM vs. TASC)

DVAverage quality of ideas (AQL), Average novelty of ideas (ANV)

CVProject duration (8 weeks), Student teams, Decision points

Strengths & Limitations

Strengths

+Directly addresses a gap in research regarding concept selection tools and creativity.
+Compares two distinct types of selection tools.

Limitations

The study was conducted in an academic environment, so the results might differ in a professional setting. The specific tools used and how students interpreted them could also influence the outcomes.

Reliability & validity

The study's validity might be influenced by the specific metrics used to define 'quality' and 'novelty' and the consistency of their application across teams. Reliability would depend on whether similar results would be obtained if the experiment were repeated with different student cohorts.

Think critically

To what extent do concept selection tools, by their very nature of providing structured evaluation, inherently favour incremental improvements over radical innovation?

Design Principles

"Prioritize methods that balance evaluation with exploration to ensure both quality and novelty in design outcomes."

Understanding how tools influence creative output is crucial for educators and practitioners. If standard selection methods lead to less novel outcomes, designers need to be aware of this potential pitfall and explore alternative strategies to foster genuine innovation.

What This Means for Your Design

Using tools to pick the best design idea might actually make the ideas less new and exciting, because people tend to pick what they already expect, not what's truly different.

How to use in your project

1.Reference this study when discussing the limitations of your chosen concept selection method, especially if your project aims for high novelty.

Add to My Project

Quick Cite

Paragraph starter

The selection of design concepts is a critical phase, and while tools like the Concept Selection Matrix are common, research suggests they may not always foster novelty. A study by Zheng et al. (2018) found that concept selection tools did not significantly increase the novelty of ideas in student design projects, and teams' decisions were influenced by pre-existing expectations, indicating potential cognitive biases that could limit truly innovative outcomes.

Source

Journal of Mechanical Design

How Concept Selection Tools Impact the Development of Creative Ideas in Engineering Design Education

journal · 2018

View source

Questions About This Research

What does the research say about concept selection tools may hinder, not help, creative idea development in design projects?: Designers should critically evaluate the tools they use for concept selection, recognizing that tools focused solely on ranking might inadvertently steer teams away from truly innovative, albeit initially less familiar, concepts. Evidence: Journal of Mechanical Design (2018).
Why does "Concept selection tools may hinder, not help, creative idea development in design projects." matter for design?: Understanding how tools influence creative output is crucial for educators and practitioners. If standard selection methods lead to less novel outcomes, designers need to be aware of this potential pitfall and explore alternative strategies to foster genuine innovation.
How can designers apply this research?: Designers should critically evaluate the tools they use for concept selection, recognizing that tools focused solely on ranking might inadvertently steer teams away from truly innovative, albeit initially less familiar, concepts.
What were the main findings?: Average idea quality (AQL) increased significantly by the detailed design stage.. Average idea novelty (ANV) did not change significantly throughout the project.. The type of concept selection tool used did not significantly impact the change in idea quality or novelty.. Teams tended to select ideas ranked highly by the tools only if those ideas met their pre-existing expectations, suggesting cognitive biases influence decision-making.
What research method was used?: Comparative experimental study.
How strong is the evidence?: Evidence strength is rated Moderate effect, based on a 2018 journal from Journal of Mechanical Design.
What should I do differently in my next project?: When using concept selection tools, actively encourage teams to explore and justify ideas that might initially score lower on traditional metrics but possess high novelty potential.
What are the limitations?: The study was conducted within an educational setting, and the findings may not directly translate to professional design practice without further investigation. The specific implementation and understanding of the tools by student teams could also be a factor.