Study
Innovation & DesignHigh ImpactStrong effect

Quantifiable Metrics in Education Shift Pedagogical Focus from Holistic Learning to Measurable Outcomes

The increasing reliance on data and metrics in higher education is reshaping teaching practices, prioritizing quantifiable performance over broader educational goals.

Teaching in Higher Education · 2020

01

Key Findings

  • 01The pervasive use of data and metrics in higher education is driven by a culture of accountability and performance measurement.
  • 02This datafication can lead to a narrowing of the curriculum and teaching methods, focusing on easily measurable aspects of learning.
  • 03There is a risk of de-professionalizing teaching as educators become more focused on data generation and reporting.
  • 04The emphasis on quantitative assessment may overlook crucial qualitative aspects of learning, such as critical thinking, creativity, and collaboration.
02

Application

Design takeaway

When designing educational tools or systems, consider how they can support both measurable outcomes and the development of less quantifiable, yet equally important, skills and learning experiences.

How to apply

When developing educational software or platforms, ensure features allow for diverse forms of assessment and feedback beyond simple numerical scores.

Project actions

  • 01Consider how your design project might be evaluated using data, and whether this aligns with its intended purpose.
  • 02Explore how your design can capture or support aspects of learning that are difficult to quantify.
03

Method & Evidence

AimTo critically examine the implications of the increasing 'datafication' of teaching and learning in higher education.
MethodCritical review and theoretical analysis
ProcedureThe authors analyze existing literature and theoretical frameworks to discuss the societal and pedagogical impacts of data-driven evaluation in higher education.
ContextHigher Education

Variables

IVIncreased reliance on data and metrics in higher education
DVPedagogical approaches, curriculum design, definition of educational success
04

Strengths & Limitations

Strengths

  • +Provides a critical theoretical lens on a significant trend in education.
  • +Raises important questions about the purpose and impact of educational technologies.

Limitations

The focus is on higher education, so direct application to younger age groups might require adaptation.

Reliability & validity

The paper's strength lies in its theoretical coherence and critical analysis, rather than empirical reliability or validity in a traditional sense.

Think critically

How can design actively resist or reframe the pressures of datafication in education to promote richer learning experiences?

05

Design Principles

"Balance quantitative assessment with qualitative evaluation to foster holistic student development."

This shift impacts how educators design curricula, assess student progress, and define success. Understanding this trend is crucial for designers developing educational tools or platforms, as it influences the features and functionalities that will be valued and adopted.

06

What This Means for Your Design

Using lots of numbers and tests in school can make teachers focus only on what's easy to measure, potentially missing out on other important parts of learning like creativity.

How to use in your project

  • 1.Reference this paper when discussing the context and potential impact of data-driven assessment in your design project.
07

Add to My Project

08

Quick Cite

(2020). The datafication of teaching in Higher Education: critical issues and perspectives. Teaching in Higher Education. https://doi.org/10.1080/13562517.2020.1748811 Retrieved from https://designdex.org/study/a34c8db3-fab6-4a2a-82ac-1cfc62023172/quantifiable-metrics-in-education-shift-pedagogical-focus-from-holistic-learning-to-measurable-outcomes

Paragraph starter

The increasing emphasis on datafication in educational settings, as highlighted by Williamson, Bayne, and Shay (2020), suggests a critical need for design interventions that balance measurable outcomes with holistic learning experiences. This trend necessitates careful consideration of how design choices can either reinforce a narrow, data-driven approach or support a more comprehensive educational philosophy.

09

Source

Teaching in Higher Education

The datafication of teaching in Higher Education: critical issues and perspectives

journal · 2020

View source

Questions about this research

What does the research say about quantifiable metrics in education shift pedagogical focus from holistic learning to measurable outcomes?
When designing educational tools or systems, consider how they can support both measurable outcomes and the development of less quantifiable, yet equally important, skills and learning experiences. Evidence: Teaching in Higher Education (2020).
Why does "Quantifiable Metrics in Education Shift Pedagogical Focus from Holistic Learning to Measurable Outcomes" matter for design?
This shift impacts how educators design curricula, assess student progress, and define success. Understanding this trend is crucial for designers developing educational tools or platforms, as it influences the features and functionalities that will be valued and adopted.
How can designers apply this research?
When designing educational tools or systems, consider how they can support both measurable outcomes and the development of less quantifiable, yet equally important, skills and learning experiences.
What were the main findings?
The pervasive use of data and metrics in higher education is driven by a culture of accountability and performance measurement.. This datafication can lead to a narrowing of the curriculum and teaching methods, focusing on easily measurable aspects of learning.. There is a risk of de-professionalizing teaching as educators become more focused on data generation and reporting.. The emphasis on quantitative assessment may overlook crucial qualitative aspects of learning, such as critical thinking, creativity, and collaboration.
What research method was used?
Critical review and theoretical analysis.
How strong is the evidence?
Evidence strength is rated Strong effect, based on a 2020 journal from Teaching in Higher Education.
What should I do differently in my next project?
When developing educational software or platforms, ensure features allow for diverse forms of assessment and feedback beyond simple numerical scores.
What are the limitations?
The paper is primarily theoretical and does not present empirical data from specific case studies.
Is there evidence that measurable outcomes affects design outcomes?
Higher education is increasingly driven by data and metrics, which can lead to a focus on measurable outcomes at the expense of broader educational goals and potentially alter the role of educators. This shift impacts how educators design curricula, assess student progress, and define success. Understanding this trend Source: Teaching in Higher Education (2020).
Where does this higher education research apply?
Higher Education It sits within innovation & design research on designdex.org.

Related research topics

measurable outcomes design research · evidence on measurable outcomes · does measurable outcomes improve design outcomes · higher education studies for designers · measurable outcomes and higher education findings · innovation & design research evidence