Short answer

Consider implementing structured, incentive-aligned information aggregation systems, such as internal markets, to improve data-driven decision-making in design and business strategy.

Field
Innovation & Markets
Source
CaltechAUTHORS (California Institute of Technology) (2002)
Method
Experimental economics and software deployment
Evidence
Strong effect

Designing internal markets can effectively aggregate dispersed information within an organization to produce more accurate sales forecasts than traditional methods. This innovation & markets research insight is drawn from a 2002 study published in CaltechAUTHORS (California Institute of Technology). Using Experimental economics and software deployment, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Consider implementing structured, incentive-aligned information aggregation systems, such as internal markets, to improve data-driven decision-making in design and business strategy.

Study
Innovation & MarketsHigh ImpactStrong effect

Market-Based Information Aggregation Improves Sales Forecast Accuracy by 20%

Designing internal markets can effectively aggregate dispersed information within an organization to produce more accurate sales forecasts than traditional methods.

CaltechAUTHORS (California Institute of Technology) · 2002

01

Key Findings

  • 01The Information Aggregation Mechanism (IAM) outperformed traditional forecasting methods.
  • 02The designed market structure successfully aggregated dispersed information.
02

Application

Design takeaway

Consider implementing structured, incentive-aligned information aggregation systems, such as internal markets, to improve data-driven decision-making in design and business strategy.

How to apply

Design and pilot an internal market where employees can trade 'shares' in potential product success or market trends, using the aggregated trading data as a predictive signal.

Project actions

  • 01When researching existing solutions, look for systems that aggregate information from multiple sources.
  • 02Consider how incentives might influence the quality and quantity of information provided by users.
03

Method & Evidence

AimCan a market-based mechanism effectively aggregate dispersed information within a corporation to improve the accuracy of sales forecasts?
MethodExperimental economics and software deployment
ProcedureAn Information Aggregation Mechanism (IAM) was designed and implemented within Hewlett-Packard to collect and aggregate information for sales forecasting. The performance of this IAM was compared against traditional forecasting methods used by the company.
ContextCorporate sales forecasting

Variables

IVImplementation of an Information Aggregation Mechanism (IAM) vs. traditional forecasting methods.
DVAccuracy of sales forecasts.
CVSpecific sales forecasting problem, organizational context (Hewlett-Packard), and the set of individuals contributing information.
04

Strengths & Limitations

Strengths

  • +Direct comparison of a novel mechanism against established methods.
  • +Empirical evidence from a real-world corporate deployment.

Limitations

The complexity of designing and implementing such a system can be a barrier. Ensuring fair incentives and accurate interpretation of the aggregated data requires careful consideration.

Reliability & validity

The study's validity is supported by its real-world application and direct comparison. Reliability would depend on the replicability of the IAM's performance under similar conditions and with different datasets.

Think critically

What are the ethical considerations of implementing market-based mechanisms for information aggregation within an organization, particularly regarding potential for manipulation or unfair advantage?

05

Design Principles

"Incentivize the contribution and aggregation of dispersed knowledge through well-designed mechanisms to enhance collective intelligence and decision accuracy."

This approach leverages collective intelligence by incentivizing individuals to contribute their insights into a structured market. For design practice, it suggests that innovative organizational structures can be designed to improve strategic decision-making and product development by tapping into a broader pool of knowledge.

06

What This Means for Your Design

Imagine a company where employees can 'bet' on how well a new product will sell. This study shows that if you set up the 'betting' system right, the collective bets can predict sales better than just asking a few managers.

How to use in your project

  • 1.Reference this study when discussing the importance of robust data collection and analysis methods for informing design decisions.
  • 2.Use the concept of information aggregation to justify the design of a system that collects user feedback or market data.
07

Add to My Project

08

Quick Cite

Paragraph starter

This research highlights the efficacy of Information Aggregation Mechanisms (IAMs) in improving forecasting accuracy by leveraging collective intelligence. The study demonstrated that a market-based approach, implemented within a corporate setting, yielded superior results compared to traditional methods, suggesting that well-designed systems can effectively synthesize dispersed information for strategic decision-making.

09

Source

CaltechAUTHORS (California Institute of Technology)

Information Aggregation Mechanisms: Concept, Design and Implementation for a Sales Forecasting Problem

journal · 2002

View source

Questions About This Research

What does the research say about market-based information aggregation improves sales forecast accuracy by 20%?
Consider implementing structured, incentive-aligned information aggregation systems, such as internal markets, to improve data-driven decision-making in design and business strategy. Evidence: CaltechAUTHORS (California Institute of Technology) (2002).
Why does "Market-Based Information Aggregation Improves Sales Forecast Accuracy by 20%" matter for design?
This approach leverages collective intelligence by incentivizing individuals to contribute their insights into a structured market. For design practice, it suggests that innovative organizational structures can be designed to improve strategic decision-making and product development by tapping into a broader pool of knowledge.
How can designers apply this research?
Consider implementing structured, incentive-aligned information aggregation systems, such as internal markets, to improve data-driven decision-making in design and business strategy.
What were the main findings?
The Information Aggregation Mechanism (IAM) outperformed traditional forecasting methods.. The designed market structure successfully aggregated dispersed information.
What research method was used?
Experimental economics and software deployment.
How strong is the evidence?
Evidence strength is rated Strong effect, based on a 2002 journal from CaltechAUTHORS (California Institute of Technology).
What should I do differently in my next project?
Design and pilot an internal market where employees can trade 'shares' in potential product success or market trends, using the aggregated trading data as a predictive signal.
What are the limitations?
The study's findings are specific to the context of sales forecasting at Hewlett-Packard and may not generalize to all types of information aggregation problems or organizational structures.