Short answer
When designing or recommending new tools or processes, focus on how they will be integrated and adapted within the existing organizational network, not just their inherent technical capabilities.
- Field
- Innovation & Design
- Source
- London School of Economics and Political Science Theses Online (London School of Economics and Political Science) (2004)
- Method
- In-depth case study
- Evidence
- Moderate effect
Organisations often fail to adopt IT evaluation methods, even when these methods promise improved cost and benefit management, due to complex socio-technical dynamics rather than a lack of perceived value. This innovation & design research insight is drawn from a 2004 study published in London School of Economics and Political Science Theses Online (London School of Economics and Political Science). Using In-depth case study, researchers explored how this design variable affects real-world outcomes. The key design takeaway: When designing or recommending new tools or processes, focus on how they will be integrated and adapted within the existing organizational network, not just their inherent technical capabilities.
IT Evaluation Methods Underutilized Despite Clear Benefits
Organisations often fail to adopt IT evaluation methods, even when these methods promise improved cost and benefit management, due to complex socio-technical dynamics rather than a lack of perceived value.
London School of Economics and Political Science Theses Online (London School of Economics and Political Science) · 2004
Key Findings
- 01Diffusion theory alone is insufficient to explain the underutilization of IT evaluation methods.
- 02Actor-Network Theory (ANT) provides a more robust framework, revealing that the adoption process is a dynamic 'mutual translation' where both the method and its surrounding actors are transformed.
- 03Negotiation and improvisation are key elements in the practical application of IT evaluation methods within organizations.
Application
Design takeaway
When designing or recommending new tools or processes, focus on how they will be integrated and adapted within the existing organizational network, not just their inherent technical capabilities.
How to apply
When introducing a new design process or tool, anticipate resistance and actively plan for the negotiation and adaptation required for its successful integration. Map out the key actors and their potential influence.
Project actions
- 01When researching the adoption of a design tool, consider the social and organizational factors involved, not just its technical features.
- 02Use theories like Actor-Network Theory to analyze how a tool interacts with different people and systems within an organization.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Utilizes a robust theoretical framework (ANT) to explain complex adoption processes.
- +Provides an in-depth, qualitative understanding of real-world implementation challenges.
Limitations
A single case study might not represent all organizational contexts. The specific IT evaluation method studied may have unique characteristics.
Reliability & validity
The validity of the findings relies heavily on the depth of the case study and the appropriate application of theoretical frameworks. Reliability might be a concern due to the qualitative nature and single case study approach.
Think critically
If IT evaluation methods are so beneficial, why is their adoption so challenging? What does this imply about the nature of innovation and change within organizations?
Design Principles
"The adoption of any new design tool or methodology is contingent upon its successful translation and integration within the existing socio-technical ecosystem of the organization."
Understanding the reasons behind the underutilization of valuable tools is crucial for successful implementation in design practice. It highlights that technical merit alone is insufficient; the social and organizational context plays a significant role in the adoption and effectiveness of any new process or tool.
What This Means for Your Design
Even if a new tool or method seems really good on paper, companies don't always use it. This is because people and how they work together are complicated, and the tool has to change to fit in, and the company has to change too.
How to use in your project
- 1.When discussing the implementation of a design tool or process in your project, reference this study to explain potential challenges related to organizational adoption and the importance of considering the socio-technical context.
Add to My Project
Quick Cite
Paragraph starter
The underutilization of IT evaluation methods, despite their apparent benefits, highlights the complex socio-technical dynamics involved in the adoption of new tools. Research suggests that successful integration requires a process of 'mutual translation' where both the method and the organization adapt, involving negotiation and improvisation by key actors, rather than a straightforward technical implementation.
Source
London School of Economics and Political Science Theses Online (London School of Economics and Political Science)
Understanding the use of IT evaluation methods in organisations
journal · 2004
View sourceQuestions About This Research
- What does the research say about it evaluation methods underutilized despite clear benefits?
- When designing or recommending new tools or processes, focus on how they will be integrated and adapted within the existing organizational network, not just their inherent technical capabilities. Evidence: London School of Economics and Political Science Theses Online (London School of Economics and Political Science) (2004).
- Why does "IT Evaluation Methods Underutilized Despite Clear Benefits" matter for design?
- Understanding the reasons behind the underutilization of valuable tools is crucial for successful implementation in design practice. It highlights that technical merit alone is insufficient; the social and organizational context plays a significant role in the adoption and effectiveness of any new process or tool.
- How can designers apply this research?
- When designing or recommending new tools or processes, focus on how they will be integrated and adapted within the existing organizational network, not just their inherent technical capabilities.
- What were the main findings?
- Diffusion theory alone is insufficient to explain the underutilization of IT evaluation methods.. Actor-Network Theory (ANT) provides a more robust framework, revealing that the adoption process is a dynamic 'mutual translation' where both the method and its surrounding actors are transformed.. Negotiation and improvisation are key elements in the practical application of IT evaluation methods within organizations.
- What research method was used?
- In-depth case study.
- How strong is the evidence?
- Evidence strength is rated Moderate effect, based on a 2004 journal from London School of Economics and Political Science Theses Online (London School of Economics and Political Science).
- What should I do differently in my next project?
- When introducing a new design process or tool, anticipate resistance and actively plan for the negotiation and adaptation required for its successful integration. Map out the key actors and their potential influence.
- What are the limitations?
- The study is a single case study, limiting the generalizability of specific findings. The focus is on IT evaluation methods, which may not directly translate to other types of design tools or processes.