Short answer

Before implementing changes, conduct a thorough 'root cause analysis' of the existing system to ensure that reforms address fundamental problems rather than just symptoms.

Field: User-Centred Design
Source: Journal of Basic Writing (2020)
Method: Mixed-methods research (qualitative and quantitative analysis)
Sample: 2 students and 1 teacher
Evidence: Strong effect

Superficial changes to outdated educational systems fail to address their fundamental flaws and can continue to negatively impact users. This user-centred design research insight is drawn from a 2020 study published in Journal of Basic Writing. Using Mixed-methods research (qualitative and quantitative analysis) with 2 students and 1 teacher, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Before implementing changes, conduct a thorough 'root cause analysis' of the existing system to ensure that reforms address fundamental problems rather than just symptoms.

Study

User-Centred DesignHigh ImpactStrong effect

Legacy Educational Systems Perpetuate Harm Despite Surface-Level Reforms

Superficial changes to outdated educational systems fail to address their fundamental flaws and can continue to negatively impact users.

Journal of Basic Writing · 2020

Key Findings

01Reforms to the legacy Basic Writing system significantly altered its 'branches' but did not address its 'roots'.
02The system, despite reforms, continued to cause harm to students.
03Efforts to gain college credit for work done within the system were unsuccessful, highlighting systemic resistance to change.

Application

Design takeaway

Before implementing changes, conduct a thorough 'root cause analysis' of the existing system to ensure that reforms address fundamental problems rather than just symptoms.

How to apply

When evaluating an existing product or system, look beyond its current features and consider its historical development, underlying assumptions, and long-term impact on its users.

Project actions

01When analyzing an existing product or system for your design project, consider its history and why it was designed the way it was.
02Think about how the system's original design might still be causing problems for users, even if some parts have been updated.

Method & Evidence

AimTo what extent do superficial reforms of legacy educational systems address their underlying issues and mitigate harm to users?

MethodMixed-methods research (qualitative and quantitative analysis)

ProcedureA postmortem examination of an eliminated zero-credit course and writing test placement system was conducted, combining historical analysis, assessment validity inquiry, and a case study of resistance to the system. The study also examined the authors' own experiences and efforts for reform.

Sample2 students and 1 teacher

ContextHigher education (specifically, a university's basic writing program)

Variables

IVNature of reforms to legacy systems (superficial vs. fundamental)

DVUser harm and system effectiveness

CVHistorical context of the system, specific user group

Strengths & Limitations

Strengths

+Combines multiple research methods for a comprehensive analysis.
+Includes the direct experiences of users (students) in the research.

Limitations

The specific context of educational systems might differ from other design domains. The qualitative nature of some findings may be subject to interpretation.

Reliability & validity

The study's validity is supported by its mixed-methods approach and the inclusion of historical context. Reliability might be enhanced by a larger sample size and more standardized quantitative measures.

Think critically

How can designers proactively identify and address the 'roots' of a system's problems, rather than just its 'branches', during the design process?

Design Principles

"Systemic reform requires addressing foundational issues, not just superficial elements."

Designers and engineers must look beyond cosmetic updates and critically examine the core principles and historical context of existing systems. A deep understanding of user impact, even in non-traditional design fields like education, is crucial for creating truly effective and equitable solutions.

What This Means for Your Design

Just changing the paint on an old house doesn't fix a rotten foundation; the house can still fall down. Similarly, changing small parts of a bad system might not fix the main problems and can still hurt people.

How to use in your project

1.Use this research to justify a need for a redesign by showing how the current system's legacy issues negatively impact users.

Add to My Project

Quick Cite

Paragraph starter

This research highlights that superficial reforms to legacy systems can perpetuate harm by failing to address foundational issues. For instance, the study of a university's basic writing program revealed that while 'branches' of the system were trimmed, its 'roots' remained, continuing to negatively impact students. This underscores the importance of a deep, user-centered analysis of existing systems to ensure that design interventions address root causes rather than merely symptoms, thereby preventing unintended negative consequences for users.

Source

Journal of Basic Writing

"Root and Branch": Resisting a Basic Writing Legacy System

journal · 2020

View source

Questions About This Research

What does the research say about legacy educational systems perpetuate harm despite surface-level reforms?: Before implementing changes, conduct a thorough 'root cause analysis' of the existing system to ensure that reforms address fundamental problems rather than just symptoms. Evidence: Journal of Basic Writing (2020).
Why does "Legacy Educational Systems Perpetuate Harm Despite Surface-Level Reforms" matter for design?: Designers and engineers must look beyond cosmetic updates and critically examine the core principles and historical context of existing systems. A deep understanding of user impact, even in non-traditional design fields like education, is crucial for creating truly effective and equitable solutions.
How can designers apply this research?: Before implementing changes, conduct a thorough 'root cause analysis' of the existing system to ensure that reforms address fundamental problems rather than just symptoms.
What were the main findings?: Reforms to the legacy Basic Writing system significantly altered its 'branches' but did not address its 'roots'.. The system, despite reforms, continued to cause harm to students.. Efforts to gain college credit for work done within the system were unsuccessful, highlighting systemic resistance to change.
What research method was used?: Mixed-methods research (qualitative and quantitative analysis) with 2 students and 1 teacher.
How strong is the evidence?: Evidence strength is rated Strong effect, based on a 2020 journal from Journal of Basic Writing.
What should I do differently in my next project?: When evaluating an existing product or system, look beyond its current features and consider its historical development, underlying assumptions, and long-term impact on its users.
What are the limitations?: The study is specific to a particular educational context and may not be generalizable to all legacy systems. The sample size is small.