Short answer

When designing educational tools or systems, consider how they can support both measurable outcomes and the development of less quantifiable, yet equally important, skills and learning experiences.

Field
Innovation & Design
Source
Teaching in Higher Education (2020)
Method
Critical review and theoretical analysis
Evidence
Strong effect

The increasing reliance on data and metrics in higher education is reshaping teaching practices, prioritizing quantifiable performance over broader educational goals. This innovation & design research insight is drawn from a 2020 study published in Teaching in Higher Education. Using Critical review and theoretical analysis, researchers explored how this design variable affects real-world outcomes. The key design takeaway: When designing educational tools or systems, consider how they can support both measurable outcomes and the development of less quantifiable, yet equally important, skills and learning experiences.

Study
Innovation & DesignHigh ImpactStrong effect

Quantifiable Metrics in Education Shift Pedagogical Focus from Holistic Learning to Measurable Outcomes

The increasing reliance on data and metrics in higher education is reshaping teaching practices, prioritizing quantifiable performance over broader educational goals.

Teaching in Higher Education · 2020

01

Key Findings

  • 01The pervasive use of data and metrics in higher education is driven by a culture of accountability and performance measurement.
  • 02This datafication can lead to a narrowing of the curriculum and teaching methods, focusing on easily measurable aspects of learning.
  • 03There is a risk of de-professionalizing teaching as educators become more focused on data generation and reporting.
  • 04The emphasis on quantitative assessment may overlook crucial qualitative aspects of learning, such as critical thinking, creativity, and collaboration.
02

Application

Design takeaway

When designing educational tools or systems, consider how they can support both measurable outcomes and the development of less quantifiable, yet equally important, skills and learning experiences.

How to apply

When developing educational software or platforms, ensure features allow for diverse forms of assessment and feedback beyond simple numerical scores.

Project actions

  • 01Consider how your design project might be evaluated using data, and whether this aligns with its intended purpose.
  • 02Explore how your design can capture or support aspects of learning that are difficult to quantify.
03

Method & Evidence

AimTo critically examine the implications of the increasing 'datafication' of teaching and learning in higher education.
MethodCritical review and theoretical analysis
ProcedureThe authors analyze existing literature and theoretical frameworks to discuss the societal and pedagogical impacts of data-driven evaluation in higher education.
ContextHigher Education

Variables

IVIncreased reliance on data and metrics in higher education
DVPedagogical approaches, curriculum design, definition of educational success
04

Strengths & Limitations

Strengths

  • +Provides a critical theoretical lens on a significant trend in education.
  • +Raises important questions about the purpose and impact of educational technologies.

Limitations

The focus is on higher education, so direct application to younger age groups might require adaptation.

Reliability & validity

The paper's strength lies in its theoretical coherence and critical analysis, rather than empirical reliability or validity in a traditional sense.

Think critically

How can design actively resist or reframe the pressures of datafication in education to promote richer learning experiences?

05

Design Principles

"Balance quantitative assessment with qualitative evaluation to foster holistic student development."

This shift impacts how educators design curricula, assess student progress, and define success. Understanding this trend is crucial for designers developing educational tools or platforms, as it influences the features and functionalities that will be valued and adopted.

06

What This Means for Your Design

Using lots of numbers and tests in school can make teachers focus only on what's easy to measure, potentially missing out on other important parts of learning like creativity.

How to use in your project

  • 1.Reference this paper when discussing the context and potential impact of data-driven assessment in your design project.
07

Add to My Project

08

Quick Cite

Paragraph starter

The increasing emphasis on datafication in educational settings, as highlighted by Williamson, Bayne, and Shay (2020), suggests a critical need for design interventions that balance measurable outcomes with holistic learning experiences. This trend necessitates careful consideration of how design choices can either reinforce a narrow, data-driven approach or support a more comprehensive educational philosophy.

09

Source

Teaching in Higher Education

The datafication of teaching in Higher Education: critical issues and perspectives

journal · 2020

View source

Questions About This Research

What does the research say about quantifiable metrics in education shift pedagogical focus from holistic learning to measurable outcomes?
When designing educational tools or systems, consider how they can support both measurable outcomes and the development of less quantifiable, yet equally important, skills and learning experiences. Evidence: Teaching in Higher Education (2020).
Why does "Quantifiable Metrics in Education Shift Pedagogical Focus from Holistic Learning to Measurable Outcomes" matter for design?
This shift impacts how educators design curricula, assess student progress, and define success. Understanding this trend is crucial for designers developing educational tools or platforms, as it influences the features and functionalities that will be valued and adopted.
How can designers apply this research?
When designing educational tools or systems, consider how they can support both measurable outcomes and the development of less quantifiable, yet equally important, skills and learning experiences.
What were the main findings?
The pervasive use of data and metrics in higher education is driven by a culture of accountability and performance measurement.. This datafication can lead to a narrowing of the curriculum and teaching methods, focusing on easily measurable aspects of learning.. There is a risk of de-professionalizing teaching as educators become more focused on data generation and reporting.. The emphasis on quantitative assessment may overlook crucial qualitative aspects of learning, such as critical thinking, creativity, and collaboration.
What research method was used?
Critical review and theoretical analysis.
How strong is the evidence?
Evidence strength is rated Strong effect, based on a 2020 journal from Teaching in Higher Education.
What should I do differently in my next project?
When developing educational software or platforms, ensure features allow for diverse forms of assessment and feedback beyond simple numerical scores.
What are the limitations?
The paper is primarily theoretical and does not present empirical data from specific case studies.