Short answer
Advocate for and implement research practices that are both rigorous and adaptable, while also ensuring that the systems supporting research (e.g., funding, publication, recognition) are updated to reward these beneficial approaches.
- Field
- Innovation & Design
- Source
- Social Psychological Bulletin (2023)
- Method
- Qualitative reflection and discussion
- Evidence
- Moderate effect
While Open Science principles like data sharing and pre-registration are beneficial, their widespread adoption is limited by institutional reward systems that don't fully support these practices and by solutions that don't account for diverse research methodologies. This innovation & design research insight is drawn from a 2023 study published in Social Psychological Bulletin. Using Qualitative reflection and discussion, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Advocate for and implement research practices that are both rigorous and adaptable, while also ensuring that the systems supporting research (e.g., funding, publication, recognition) are updated to reward these beneficial approaches.
Open Science adoption is hindered by misaligned incentives and a one-size-fits-all approach.
While Open Science principles like data sharing and pre-registration are beneficial, their widespread adoption is limited by institutional reward systems that don't fully support these practices and by solutions that don't account for diverse research methodologies.
Social Psychological Bulletin · 2023
Key Findings
- 01Incentive structures within academic institutions often do not align with Open Science goals, hindering adoption.
- 02Some Open Science solutions are not universally applicable across different scientific practices and subfields.
- 03Open Science has not adequately supported diversity, equity, and inclusion goals within psychological science.
- 04Increased focus on larger samples, data sharing, and pre-registration are positive developments.
Application
Design takeaway
Advocate for and implement research practices that are both rigorous and adaptable, while also ensuring that the systems supporting research (e.g., funding, publication, recognition) are updated to reward these beneficial approaches.
How to apply
When proposing or implementing new research methodologies in design, consider how institutional policies, project constraints, and team dynamics might support or hinder their adoption. Be prepared to adapt methodologies to specific contexts.
Project actions
- 01When discussing your research methods, consider mentioning any challenges you faced in implementing them due to external factors.
- 02Reflect on how your chosen research methods align with the broader goals of your design project and the field.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Provides a nuanced, insider perspective on the challenges of implementing new research paradigms.
- +Highlights the importance of considering systemic factors beyond individual researcher effort.
Limitations
The study is based on personal reflections, which can be subjective. The findings are specific to psychology and may not fully apply to design research.
Reliability & validity
The qualitative nature of the reflections means findings are not statistically generalizable. Validity relies on the credibility of the researchers' shared experiences.
Think critically
To what extent do the findings regarding incentive structures in academic psychology apply to the commercial design industry?
Design Principles
"Systemic alignment is necessary for the successful adoption of innovative practices."
Understanding the barriers to adopting innovative research practices is crucial for fostering a more credible and efficient design research landscape. Design practitioners need to be aware of how systemic factors can impede the implementation of beneficial methodologies.
What This Means for Your Design
Even good ideas like sharing research data can be hard to do if your job doesn't reward it, or if the way you're asked to share doesn't work for your specific type of research.
How to use in your project
- 1.Discuss how the principles of Open Science, such as transparency and reproducibility, can inform your design process and documentation.
- 2.Analyze how institutional or project-specific constraints might influence your choice and implementation of research methods.
Add to My Project
Quick Cite
Paragraph starter
The adoption of innovative research practices, such as those promoted by Open Science, is often influenced by systemic factors. As seen in reflections on psychological research, misaligned institutional incentives and a lack of methodological flexibility can impede progress. Therefore, when implementing research within a design project, it is crucial to consider not only the technical merits of a method but also its compatibility with existing structures and its adaptability to the specific design context to ensure successful and meaningful application.
Source
Social Psychological Bulletin
Hits and misses in the last decade of open science: Researchers from different subfields and career stages offer personal reflections and suggestions
journal · 2023
View sourceQuestions About This Research
- What does the research say about open science adoption is hindered by misaligned incentives and a one-size-fits-all approach?
- Advocate for and implement research practices that are both rigorous and adaptable, while also ensuring that the systems supporting research (e.g., funding, publication, recognition) are updated to reward these beneficial approaches. Evidence: Social Psychological Bulletin (2023).
- Why does "Open Science adoption is hindered by misaligned incentives and a one-size-fits-all approach." matter for design?
- Understanding the barriers to adopting innovative research practices is crucial for fostering a more credible and efficient design research landscape. Design practitioners need to be aware of how systemic factors can impede the implementation of beneficial methodologies.
- How can designers apply this research?
- Advocate for and implement research practices that are both rigorous and adaptable, while also ensuring that the systems supporting research (e.g., funding, publication, recognition) are updated to reward these beneficial approaches.
- What were the main findings?
- Incentive structures within academic institutions often do not align with Open Science goals, hindering adoption.. Some Open Science solutions are not universally applicable across different scientific practices and subfields.. Open Science has not adequately supported diversity, equity, and inclusion goals within psychological science.. Increased focus on larger samples, data sharing, and pre-registration are positive developments.
- What research method was used?
- Qualitative reflection and discussion.
- How strong is the evidence?
- Evidence strength is rated Moderate effect, based on a 2023 journal from Social Psychological Bulletin.
- What should I do differently in my next project?
- When proposing or implementing new research methodologies in design, consider how institutional policies, project constraints, and team dynamics might support or hinder their adoption. Be prepared to adapt methodologies to specific contexts.
- What are the limitations?
- The reflections are personal and may not represent all researchers' experiences. The focus is on psychological science, and findings may not directly translate to all design disciplines.