Short answer

When implementing large-scale agile, critically evaluate the principles behind frameworks and explore custom adaptations that align with your specific organizational needs and context.

Field
Innovation & Design
Source
IEEE Transactions on Software Engineering (2021)
Method
Systematic Literature Review
Evidence
Moderate effect

A systematic review of large-scale agile software development frameworks reveals that successful adoption hinges on understanding the nuances of principles, practices, and custom adaptations, rather than solely focusing on commercial offerings. This innovation & design research insight is drawn from a 2021 study published in IEEE Transactions on Software Engineering. Using Systematic literature review, researchers explored how this design variable affects real-world outcomes. The key design takeaway: When implementing large-scale agile, critically evaluate the principles behind frameworks and explore custom adaptations that align with your specific organizational needs and context.

Study
Innovation & DesignHigh ImpactModerate effect

Large-Scale Agile Frameworks: A Comparative Analysis for Strategic Adoption

A systematic review of large-scale agile software development frameworks reveals that successful adoption hinges on understanding the nuances of principles, practices, and custom adaptations, rather than solely focusing on commercial offerings.

IEEE Transactions on Software Engineering · 2021

01

Key Findings

  • 01There is a tendency to emphasize the practices of commercial frameworks over their underlying principles.
  • 02Custom-built agile methods developed within organizations are often overlooked in favor of commercial solutions.
  • 03Successful adoption of large-scale agile methods is influenced by a set of identified challenges and success factors.
02

Application

Design takeaway

When implementing large-scale agile, critically evaluate the principles behind frameworks and explore custom adaptations that align with your specific organizational needs and context.

How to apply

Before selecting a large-scale agile framework, conduct a thorough analysis of your organization's culture, existing processes, and specific goals. Compare the core principles of different frameworks and assess whether a commercial solution or a tailored approach would be more effective.

Project actions

  • 01When researching different design methodologies, look for studies that compare them based on core principles, not just features.
  • 02Consider how your chosen methodology can be adapted to your specific project needs, rather than assuming a one-size-fits-all solution.
03

Method & Evidence

AimTo systematically compare major large-scale agile software development methods (SAFe, LeSS, Scrum-at-Scale, DAD, Spotify model) based on their principles, practices, tools, and metrics, and to identify challenges and success factors for practitioners.
MethodSystematic Literature Review
ProcedureThe researchers conducted a systematic review of existing literature on large-scale agile software development methods. They analyzed and compared the principles, practices, tools, and metrics of prominent frameworks, including commercial and custom-built approaches, and synthesized findings on challenges and success factors.
ContextSoftware Engineering and Organizational Design

Variables

IVType of large-scale agile method (e.g., SAFe, LeSS, Scrum-at-Scale, DAD, Spotify model, custom-built)
DVEffectiveness of implementation, challenges encountered, success factors identified
CVOrganizational context, team size, project complexity, industry sector
04

Strengths & Limitations

Strengths

  • +Provides a standardized comparison of multiple large-scale agile methods.
  • +Includes both commercial and custom-built approaches.
  • +Identifies theoretical and practical issues in the current literature.

Limitations

The research is based on existing literature, which might not capture all real-world nuances or the latest developments in agile frameworks. The effectiveness of custom-built methods can vary greatly depending on the organization.

Reliability & validity

The reliability of this systematic literature review depends on the comprehensiveness of the search strategy and the rigor of the inclusion/exclusion criteria. Validity is enhanced by the standardized comparison approach across multiple methods.

Think critically

To what extent does the emphasis on commercial large-scale agile frameworks hinder genuine innovation and adaptation within organizations, and what are the risks associated with prioritizing practices over principles?

05

Design Principles

"Principle-driven adaptation over practice-driven adoption."

Designers and engineers implementing agile methodologies at an organizational scale need to move beyond surface-level adoption of popular frameworks. A deeper understanding of the underlying principles and the potential for tailored or custom solutions is crucial for effective and sustainable implementation.

06

What This Means for Your Design

When trying to use agile methods for a whole company, it's better to understand the main ideas behind them and see if you can create your own version that fits your company, instead of just copying a popular, pre-made system.

How to use in your project

  • 1.Reference this study when discussing the selection and implementation of design methodologies, particularly when comparing different frameworks or justifying the adaptation of a standard approach.
07

Add to My Project

08

Quick Cite

Paragraph starter

A systematic literature review by Edison, Wang, and Conboy (2021) highlights the importance of understanding the underlying principles of large-scale agile frameworks, such as SAFe and LeSS, rather than solely focusing on their prescribed practices. The study found that a tendency exists to prioritize commercial framework features over core agile tenets, and that custom-built solutions developed within organizations are often overlooked. This suggests that for effective implementation, designers should critically evaluate the foundational principles of any chosen methodology and consider its adaptability to specific organizational contexts.

09

Source

IEEE Transactions on Software Engineering

Comparing Methods for Large-Scale Agile Software Development: A Systematic Literature Review

journal · 2021

View source

Questions About This Research

What does the research say about large-scale agile frameworks: a comparative analysis for strategic adoption?
When implementing large-scale agile, critically evaluate the principles behind frameworks and explore custom adaptations that align with your specific organizational needs and context. Evidence: IEEE Transactions on Software Engineering (2021).
Why does "Large-Scale Agile Frameworks: A Comparative Analysis for Strategic Adoption" matter for design?
Designers and engineers implementing agile methodologies at an organizational scale need to move beyond surface-level adoption of popular frameworks. A deeper understanding of the underlying principles and the potential for tailored or custom solutions is crucial for effective and sustainable implementation.
How can designers apply this research?
When implementing large-scale agile, critically evaluate the principles behind frameworks and explore custom adaptations that align with your specific organizational needs and context.
What were the main findings?
There is a tendency to emphasize the practices of commercial frameworks over their underlying principles.. Custom-built agile methods developed within organizations are often overlooked in favor of commercial solutions.. Successful adoption of large-scale agile methods is influenced by a set of identified challenges and success factors.
What research method was used?
Systematic Literature Review.
How strong is the evidence?
Evidence strength is rated Moderate effect, based on a 2021 journal from IEEE Transactions on Software Engineering.
What should I do differently in my next project?
Before selecting a large-scale agile framework, conduct a thorough analysis of your organization's culture, existing processes, and specific goals. Compare the core principles of different frameworks and assess whether a commercial solution or a tailored approach would be more effective.
What are the limitations?
The review's findings are based on existing literature, which may have its own biases or gaps. The empirical evidence for some methods might be limited or skewed towards specific organizational types.