Short answer

When seeking validation for a new venture idea, prioritize feedback from seasoned experts, especially if your innovation is rooted in research and development. Be aware that this method may be less effective for ideas in sectors like software or consumer web.

Field: Innovation & Markets
Source: RePEc: Research Papers in Economics (2015)
Method: Empirical analysis of historical data
Sample: 652 ventures
Evidence: Strong effect

Subjective evaluations from experienced professionals can predict the commercialization success of early-stage startup ideas, particularly those with documented intellectual capital in research-and-development-intensive fields. This innovation & markets research insight is drawn from a 2015 study published in RePEc: Research Papers in Economics. Using Empirical analysis of historical data with 652 ventures, researchers explored how this design variable affects real-world outcomes. The key design takeaway: When seeking validation for a new venture idea, prioritize feedback from seasoned experts, especially if your innovation is rooted in research and development. Be aware that this method may be less effective for ideas in sectors like software or consumer web.

Study

Innovation & MarketsHigh ImpactStrong effect

Early Expert Evaluation of Startup Ideas Predicts Commercial Success in R&D-Intensive Sectors

RePEc: Research Papers in Economics · 2015

Key Findings

01Startup ideas receiving more positive expert evaluations are significantly more likely to achieve commercialization.
02This predictive relationship is strongest for venture ideas with documented intellectual capital in R&D-intensive sectors (e.g., life sciences, medical devices).
03Expert evaluations did not effectively predict commercial potential in non-R&D-intensive sectors (e.g., consumer web, enterprise software).
04Industry-specific and scientific expertise was not critical for the collective predictive ability of the experts.

Application

Design takeaway

How to apply

When pitching a new product or service concept, gather feedback from a panel of industry veterans. Focus on the clarity and perceived value of your intellectual capital and R&D efforts.

Project actions

01When presenting your design concept, consider how you will gather and interpret feedback from potential users or industry experts.
02Think about how the sector your design operates in might influence the success of your concept.

Method & Evidence

AimTo empirically investigate whether ex-ante assessments of early-stage startup ideas can predict their subsequent commercialization success, and to identify factors influencing this predictive power.

MethodEmpirical analysis of historical data

ProcedureThe study analyzed data from 652 ventures over an 8-year period within an entrepreneurship program. Standardized summaries of venture ideas were evaluated by experienced entrepreneurs and executives, and these evaluations were correlated with the ventures' eventual commercialization outcomes.

Sample652 ventures

ContextStartup evaluation and commercialization within an entrepreneurship program.

Variables

IVSubjective evaluations of startup ideas by experienced professionals.

DVCommercialization success of the startup idea.

CVIndustry sector (R&D-intensive vs. non-R&D-intensive), documented intellectual capital.

Strengths & Limitations

Strengths

+Large sample size of ventures.
+Longitudinal data collection over 8 years.
+Focus on a specific, structured entrepreneurship program.

Limitations

The 'experts' in your own project might be biased or have limited knowledge of your specific design area. The definition of 'success' for your project might be different from commercialization.

Reliability & validity

The study's reliability is supported by the large sample size and longitudinal data. Validity is enhanced by focusing on a specific program's structured evaluation process, though generalizability might be a concern.

Think critically

To what extent can subjective expert opinion truly predict objective market success, and what are the potential biases inherent in such evaluations?

Design Principles

"Leverage expert consensus for early-stage validation in R&D-intensive innovation contexts."

This research offers valuable insights for venture capitalists, incubators, and startup founders by suggesting that structured expert feedback can serve as a useful, albeit imperfect, predictor of market viability. It highlights the importance of focusing such evaluations on sectors where innovation is more tangible and measurable.

What This Means for Your Design

If experienced people think your new business idea is good, it's more likely to become a real, successful business, especially if it's a high-tech idea. It's less reliable for things like apps or websites.

How to use in your project

1.Reference this study when discussing the validation of your design concept, particularly if you have gathered expert opinions or are working in an R&D-intensive field.

Add to My Project

Quick Cite

Paragraph starter

This research indicates that early-stage evaluations by experienced professionals can predict commercial success, particularly in R&D-intensive sectors. This suggests that seeking structured, expert feedback on design concepts, especially those involving significant innovation or technical development, can provide valuable insights into their market potential.

Source

RePEc: Research Papers in Economics

Are “Better” Ideas More Likely to Succeed? An Empirical Analysis of Startup Evaluation

journal · 2015

View source

Questions About This Research

What does the research say about early expert evaluation of startup ideas predicts commercial success in r&d-intensive sectors?: When seeking validation for a new venture idea, prioritize feedback from seasoned experts, especially if your innovation is rooted in research and development. Be aware that this method may be less effective for ideas in sectors like software or consumer web. Evidence: RePEc: Research Papers in Economics (2015).
Why does "Early Expert Evaluation of Startup Ideas Predicts Commercial Success in R&D-Intensive Sectors" matter for design?: This research offers valuable insights for venture capitalists, incubators, and startup founders by suggesting that structured expert feedback can serve as a useful, albeit imperfect, predictor of market viability. It highlights the importance of focusing such evaluations on sectors where innovation is more tangible and measurable.
How can designers apply this research?: When seeking validation for a new venture idea, prioritize feedback from seasoned experts, especially if your innovation is rooted in research and development. Be aware that this method may be less effective for ideas in sectors like software or consumer web.
What were the main findings?: Startup ideas receiving more positive expert evaluations are significantly more likely to achieve commercialization.. This predictive relationship is strongest for venture ideas with documented intellectual capital in R&D-intensive sectors (e.g., life sciences, medical devices).. Expert evaluations did not effectively predict commercial potential in non-R&D-intensive sectors (e.g., consumer web, enterprise software).. Industry-specific and scientific expertise was not critical for the collective predictive ability of the experts.
What research method was used?: Empirical analysis of historical data with 652 ventures.
How strong is the evidence?: Evidence strength is rated Strong effect, based on a 2015 journal from RePEc: Research Papers in Economics.
What should I do differently in my next project?: When pitching a new product or service concept, gather feedback from a panel of industry veterans. Focus on the clarity and perceived value of your intellectual capital and R&D efforts.
What are the limitations?: The study's findings may be specific to the context of the entrepreneurship program studied and may not generalize to all startup ecosystems. The definition of 'commercialization' could vary.