Short answer

When introducing a new technology or system, create a clear set of evaluation criteria and, if possible, a tool to help potential users compare it against existing solutions.

Field
Innovation & Design
Source
University of Minnesota Digital Conservancy (University of Minnesota) (2009)
Method
Survey and development of evaluation tools
Sample
38 companies
Evidence
Strong effect

Developing clear criteria and decision-support tools can significantly streamline the selection process for novel technological solutions. This innovation & design research insight is drawn from a 2009 study published in University of Minnesota Digital Conservancy (University of Minnesota). Using Survey and development of evaluation tools with 38 companies, researchers explored how this design variable affects real-world outcomes. The key design takeaway: When introducing a new technology or system, create a clear set of evaluation criteria and, if possible, a tool to help potential users compare it against existing solutions.

Study
Innovation & DesignHigh ImpactStrong effect

Structured evaluation frameworks accelerate adoption of new monitoring technologies

Developing clear criteria and decision-support tools can significantly streamline the selection process for novel technological solutions.

University of Minnesota Digital Conservancy (University of Minnesota) · 2009

01

Key Findings

  • 01A significant portion of commercial monitoring system providers responded to a targeted questionnaire.
  • 02Structured evaluation criteria can be developed to compare diverse technological solutions.
  • 03Decision-support tools can aid stakeholders in making informed choices among complex options.
02

Application

Design takeaway

When introducing a new technology or system, create a clear set of evaluation criteria and, if possible, a tool to help potential users compare it against existing solutions.

How to apply

When designing a new product or system, consider how potential clients will evaluate it. Develop a clear comparison matrix or a simple scoring system that highlights your solution's advantages.

Project actions

  • 01When researching existing solutions for your design project, look for patterns in how they are evaluated or marketed.
  • 02Consider creating a simple comparison table for your proposed solution against alternatives.
03

Method & Evidence

AimHow can structured evaluation criteria and decision-support tools facilitate the selection and adoption of new monitoring technologies in critical infrastructure projects?
MethodSurvey and development of evaluation tools
ProcedureA questionnaire was developed and distributed to commercial companies offering bridge monitoring systems. Responses were analyzed to summarize available systems, and criteria were developed to evaluate these systems. A decision-support tool (in Microsoft Excel) was created to assist bridge owners in selecting the most appropriate system based on specific bridge needs.
Sample38 companies
ContextInfrastructure health monitoring (specifically bridges)

Variables

IVStructured evaluation criteria and decision-support tools
DVAdoption rate or selection of monitoring systems
CVType of infrastructure (bridges), commercial availability of systems
04

Strengths & Limitations

Strengths

  • +Addresses a practical need in infrastructure management.
  • +Employs a survey methodology to gather data from industry professionals.
  • +Develops tangible tools (criteria and Excel program) for practical application.

Limitations

The survey relied on self-reported data from companies, which may be subject to bias. The decision-support tool's utility is limited to the specific criteria it incorporates.

Reliability & validity

Reliability could be improved by using more standardized questions and potentially follow-up interviews. Validity is supported by the direct application to a real-world problem and the development of practical tools.

Think critically

To what extent does the 'clarity' of a system's benefits, as presented through evaluation frameworks, outweigh its actual technical superiority in driving adoption?

05

Design Principles

"Standardize evaluation metrics and develop decision-support tools to facilitate the adoption of innovative solutions."

In fields with complex and critical systems, such as infrastructure, the introduction of new technologies can be hindered by a lack of standardized evaluation methods. This research highlights the importance of creating structured approaches to assess and compare emerging solutions, thereby facilitating their integration into practice.

06

What This Means for Your Design

Making it easier for people to choose your new product by giving them clear reasons why it's good and a simple way to compare it to others.

How to use in your project

  • 1.Use the concept of structured evaluation to justify the selection of specific materials, components, or manufacturing processes in your design project.
07

Add to My Project

08

Quick Cite

Paragraph starter

The selection of innovative technologies, such as advanced monitoring systems for infrastructure, can be significantly streamlined through the development of structured evaluation frameworks. This research demonstrates that by surveying commercial providers and establishing clear criteria, alongside a decision-support tool, potential users can make more informed and efficient choices, accelerating the adoption of beneficial innovations.

09

Source

University of Minnesota Digital Conservancy (University of Minnesota)

Bridge Health Monitoring and Inspections – A Survey of Methods

journal · 2009

View source

Questions About This Research

What does the research say about structured evaluation frameworks accelerate adoption of new monitoring technologies?
When introducing a new technology or system, create a clear set of evaluation criteria and, if possible, a tool to help potential users compare it against existing solutions. Evidence: University of Minnesota Digital Conservancy (University of Minnesota) (2009).
Why does "Structured evaluation frameworks accelerate adoption of new monitoring technologies" matter for design?
In fields with complex and critical systems, such as infrastructure, the introduction of new technologies can be hindered by a lack of standardized evaluation methods. This research highlights the importance of creating structured approaches to assess and compare emerging solutions, thereby facilitating their integration into practice.
How can designers apply this research?
When introducing a new technology or system, create a clear set of evaluation criteria and, if possible, a tool to help potential users compare it against existing solutions.
What were the main findings?
A significant portion of commercial monitoring system providers responded to a targeted questionnaire.. Structured evaluation criteria can be developed to compare diverse technological solutions.. Decision-support tools can aid stakeholders in making informed choices among complex options.
What research method was used?
Survey and development of evaluation tools with 38 companies.
How strong is the evidence?
Evidence strength is rated Strong effect, based on a 2009 journal from University of Minnesota Digital Conservancy (University of Minnesota).
What should I do differently in my next project?
When designing a new product or system, consider how potential clients will evaluate it. Develop a clear comparison matrix or a simple scoring system that highlights your solution's advantages.
What are the limitations?
The effectiveness of the decision-support tool is dependent on the accuracy and completeness of the data provided by companies and the specific needs articulated by the bridge owner.