Short answer
When designing or evaluating information systems, consider the historical context of 'success' and adopt a multi-dimensional approach that includes technical, user, and business impact.
- Field
- Innovation & Design
- Source
- Journal of the Association for Information Systems (2012)
- Method
- Historical analysis and commentary
- Evidence
- Moderate effect
The definition and measurement of information system success have evolved significantly over the past six decades, reflecting changes in organizational roles, stakeholder expectations, and perceived benefits. This innovation & design research insight is drawn from a 2012 study published in Journal of the Association for Information Systems. Using Historical analysis and commentary, researchers explored how this design variable affects real-world outcomes. The key design takeaway: When designing or evaluating information systems, consider the historical context of 'success' and adopt a multi-dimensional approach that includes technical, user, and business impact.
Information System Success Metrics Evolved Over 60 Years
The definition and measurement of information system success have evolved significantly over the past six decades, reflecting changes in organizational roles, stakeholder expectations, and perceived benefits.
Journal of the Association for Information Systems · 2012
Key Findings
- 01The concept of 'IS success' has shifted from a focus on technical quality and system usage to encompass broader impacts like organizational benefits and user satisfaction.
- 02Organizational expectations and the perceived value of information systems have grown exponentially, leading to more complex and multi-faceted evaluation criteria.
- 03There is a persistent gap between research advancements in IS success evaluation and its adoption in organizational practice.
Application
Design takeaway
When designing or evaluating information systems, consider the historical context of 'success' and adopt a multi-dimensional approach that includes technical, user, and business impact.
How to apply
When initiating a new design project involving information systems, conduct a brief review of how similar systems have been evaluated in the past and what the current organizational priorities are for success.
Project actions
- 01When defining success for your design project, consider how 'success' has been defined for similar products or systems in the past.
- 02Think about who the stakeholders are for your project and what 'success' means to each of them.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Provides a valuable historical perspective on a critical aspect of system design and implementation.
- +Highlights the dynamic and evolving nature of 'success' in the field of information systems.
Limitations
The historical eras are a simplification; real-world adoption and evaluation may not follow such neat divisions.
Reliability & validity
The reliability of the historical analysis depends on the comprehensiveness of the literature reviewed. Validity is enhanced by the authors' expertise and the consensus within the field regarding these evolutionary trends.
Think critically
Given that practice often lags behind research in defining IS success, what are the practical challenges designers face in implementing more advanced or nuanced success metrics in their projects?
Design Principles
"Information system success is a dynamic construct that requires continuous re-evaluation based on evolving organizational contexts and stakeholder expectations."
Understanding this historical evolution is crucial for design practitioners to ensure that the information systems they develop align with current and future organizational needs and stakeholder expectations. It highlights the dynamic nature of 'success' and the need for adaptable evaluation frameworks.
What This Means for Your Design
What makes a computer system 'good' for a company has changed a lot over the years, and we need to keep up with those changes when we design them.
How to use in your project
- 1.Reference this study when discussing the evolution of design criteria or the importance of aligning design goals with organizational objectives.
Add to My Project
Quick Cite
Paragraph starter
The evaluation of information system success has undergone significant transformation over the past six decades, moving from a focus on technical aspects to a more comprehensive consideration of organizational benefits and user satisfaction. This evolution underscores the need for design projects to adopt flexible and context-aware definitions of success that account for changing stakeholder expectations and strategic priorities.
Source
Journal of the Association for Information Systems
The Past, Present, and Future of “IS Success”
journal · 2012
View sourceQuestions About This Research
- What does the research say about information system success metrics evolved over 60 years?
- When designing or evaluating information systems, consider the historical context of 'success' and adopt a multi-dimensional approach that includes technical, user, and business impact. Evidence: Journal of the Association for Information Systems (2012).
- Why does "Information System Success Metrics Evolved Over 60 Years" matter for design?
- Understanding this historical evolution is crucial for design practitioners to ensure that the information systems they develop align with current and future organizational needs and stakeholder expectations. It highlights the dynamic nature of 'success' and the need for adaptable evaluation frameworks.
- How can designers apply this research?
- When designing or evaluating information systems, consider the historical context of 'success' and adopt a multi-dimensional approach that includes technical, user, and business impact.
- What were the main findings?
- The concept of 'IS success' has shifted from a focus on technical quality and system usage to encompass broader impacts like organizational benefits and user satisfaction.. Organizational expectations and the perceived value of information systems have grown exponentially, leading to more complex and multi-faceted evaluation criteria.. There is a persistent gap between research advancements in IS success evaluation and its adoption in organizational practice.
- What research method was used?
- Historical analysis and commentary.
- How strong is the evidence?
- Evidence strength is rated Moderate effect, based on a 2012 journal from Journal of the Association for Information Systems.
- What should I do differently in my next project?
- When initiating a new design project involving information systems, conduct a brief review of how similar systems have been evaluated in the past and what the current organizational priorities are for success.
- What are the limitations?
- The study is a commentary and historical review, not an empirical study of current practices across all organizations. The 'five eras' are a conceptual framework for analysis.