Short answer

Designers and developers of digital tools should integrate developmental evaluation, actively seeking and incorporating end-user feedback throughout the entire product lifecycle to ensure the tool is both useful and usable, thereby maximizing its market potential.

Field: Innovation & Markets
Source: Bulletin of the American Meteorological Society (2018)
Method: Developmental Evaluation
Evidence: Strong effect

Systematically evaluating web-based data and analysis tools using developmental evaluation frameworks ensures they meet user needs and the intended purpose, thereby increasing their market relevance and adoption. This innovation & markets research insight is drawn from a 2018 study published in Bulletin of the American Meteorological Society. Using Developmental evaluation, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Designers and developers of digital tools should integrate developmental evaluation, actively seeking and incorporating end-user feedback throughout the entire product lifecycle to ensure the tool is both useful and usable, thereby maximizing its market potential.

Study

Innovation & MarketsHigh ImpactStrong effect

Developmental Evaluation of Web-Based Climate Tools Boosts Usability and Market Relevance

Bulletin of the American Meteorological Society · 2018

Key Findings

01The absence or underreporting of evaluation in the development of web-based climate data and analysis tools raises questions about their utility and adoption.
02Developmental evaluation, which involves end-user feedback throughout the development cycle, can uncover subtle but critical improvements needed for application usability and usefulness.
03End-user feedback is essential for ensuring that tools meet their intended rationale and are effectively utilized by their target audience.

Application

Design takeaway

How to apply

When developing any new web-based application, establish a feedback mechanism with target users from the early stages and use this input to guide iterative design and feature development.

Project actions

01When designing a digital product, plan for regular user testing and feedback sessions.
02Document how user feedback directly influenced design decisions in your project.

Method & Evidence

AimHow can developmental evaluation frameworks be applied to web-based climate data and analysis tools to improve their usability and ensure they meet the rationale for their development?

MethodDevelopmental Evaluation

ProcedureThe researchers applied developmental evaluation to the SCENIC web interface, a tool providing climate data and analysis for natural resource management. This involved gathering end-user feedback throughout the development process to inform iterative improvements.

ContextDevelopment of web-based climate data and analysis tools for natural resource research and management.

Variables

IVApplication of developmental evaluation (presence/absence, intensity)

DVUsability, usefulness, fulfillment of rationale, user adoption

CVType of web-based tool, target user group, specific domain (climate data)

Strengths & Limitations

Strengths

+Emphasizes a practical, iterative approach to evaluation.
+Highlights the importance of end-user involvement in tool development.

Limitations

The study focused on a specific type of tool (climate data), so results might differ for tools in other domains.

Reliability & validity

The validity of the findings relies on the thoroughness of the developmental evaluation process and the representativeness of the end-users involved. Reliability would be enhanced by using standardized feedback collection methods and consistent analysis of user input.

Think critically

To what extent can the principles of developmental evaluation be applied to physical products, and what would be the equivalent of 'end-user feedback' in that context?

Design Principles

"Continuous user-centered evaluation is paramount for the successful development and market adoption of digital products."

In today's data-driven landscape, the success of digital products hinges on their ability to effectively serve their target audience. Applying rigorous evaluation methods, especially those that involve end-users throughout the development process, is crucial for identifying and rectifying usability issues and ensuring the tool's value proposition aligns with market demands.

What This Means for Your Design

When you build a website or app, don't just guess what people want. Ask them as you build it, and keep asking them, to make sure it's actually useful and easy to use.

How to use in your project

1.Reference this study when discussing the importance of user testing and iterative design in your design project's development process.

Add to My Project

Quick Cite

Paragraph starter

The development of effective digital tools necessitates a robust evaluation strategy, as highlighted by research emphasizing developmental evaluation. This approach, which integrates end-user feedback throughout the design and development lifecycle, is crucial for ensuring that applications are not only functional but also genuinely usable and aligned with their intended purpose. By actively involving users, designers can uncover subtle yet critical usability issues and validate the tool's value proposition, ultimately leading to greater adoption and market success.

Source

Bulletin of the American Meteorological Society

A Call for the Evaluation of Web-Based Climate Data and Analysis Tools

journal · 2018

View source

Questions About This Research

What does the research say about developmental evaluation of web-based climate tools boosts usability and market relevance?: Designers and developers of digital tools should integrate developmental evaluation, actively seeking and incorporating end-user feedback throughout the entire product lifecycle to ensure the tool is both useful and usable, thereby maximizing its market potential. Evidence: Bulletin of the American Meteorological Society (2018).
Why does "Developmental Evaluation of Web-Based Climate Tools Boosts Usability and Market Relevance" matter for design?: In today's data-driven landscape, the success of digital products hinges on their ability to effectively serve their target audience. Applying rigorous evaluation methods, especially those that involve end-users throughout the development process, is crucial for identifying and rectifying usability issues and ensuring the tool's value proposition aligns with market demands.
How can designers apply this research?: Designers and developers of digital tools should integrate developmental evaluation, actively seeking and incorporating end-user feedback throughout the entire product lifecycle to ensure the tool is both useful and usable, thereby maximizing its market potential.
What were the main findings?: The absence or underreporting of evaluation in the development of web-based climate data and analysis tools raises questions about their utility and adoption.. Developmental evaluation, which involves end-user feedback throughout the development cycle, can uncover subtle but critical improvements needed for application usability and usefulness.. End-user feedback is essential for ensuring that tools meet their intended rationale and are effectively utilized by their target audience.
What research method was used?: Developmental Evaluation.
How strong is the evidence?: Evidence strength is rated Strong effect, based on a 2018 journal from Bulletin of the American Meteorological Society.
What should I do differently in my next project?: When developing any new web-based application, establish a feedback mechanism with target users from the early stages and use this input to guide iterative design and feature development.
What are the limitations?: The specific findings are context-dependent on the SCENIC application and its user base; generalizability to all web-based tools may vary.