Selecting ideas for new product development : comparison of monadic test and adaptive concept screening under the G theory framework

Geng CUI*, Ling PENG, Laurent Pierre FLORES

*Corresponding author for this work

Research output: Journal PublicationsJournal Article (refereed)

Abstract

Purpose – New product concept screening, i.e., selecting a few viable innovative concepts from numerous candidates, involves high stakes and is complicated and resource intensive. Over the years, there has been heated debate about the relative merit of monadic (sequential) tests vs that of preference-based paired comparisons. The paper aims to discuss these issues. Design/methodology/approach – This study proposes the Generalizability Theory as a framework to assess and compare the performance of traditional monadic test with the Adaptive Concept Screening (ACS) in terms of their testing results and psychometric quality. Findings – Using 50 yogurt concepts and two independent groups of respondents, the results indicate that ACS requires a significant smaller sample of respondents to achieve a necessary minimum G coefficient for decision making. Moreover, ACS offers a more discriminating and reliable solution for early stage concept screening as manifested by a higher G coefficient and greater percentage of variance due to the selected concepts given the same sampling design. Practical implications – The results lend strong support to ACS as a more cost-effective method for screening new product concepts and the Generalizability Theory as a systematic framework for assessing concept testing methods. Originality/value – This study adopts the Generalizability Theory framework to assess the validity of new product concept screening method.
Original languageEnglish
Pages (from-to)380-396
Number of pages17
JournalEuropean Journal of Innovation Management
Volume18
Issue number3
DOIs
Publication statusPublished - Aug 2015

Fingerprint

Product development
Screening
New product development
Testing
Decision making
Sampling
Costs

Keywords

  • New product development
  • Product innovation

Cite this

@article{5173419c7a2d4cca95f581d87e145412,
title = "Selecting ideas for new product development : comparison of monadic test and adaptive concept screening under the G theory framework",
abstract = "Purpose – New product concept screening, i.e., selecting a few viable innovative concepts from numerous candidates, involves high stakes and is complicated and resource intensive. Over the years, there has been heated debate about the relative merit of monadic (sequential) tests vs that of preference-based paired comparisons. The paper aims to discuss these issues. Design/methodology/approach – This study proposes the Generalizability Theory as a framework to assess and compare the performance of traditional monadic test with the Adaptive Concept Screening (ACS) in terms of their testing results and psychometric quality. Findings – Using 50 yogurt concepts and two independent groups of respondents, the results indicate that ACS requires a significant smaller sample of respondents to achieve a necessary minimum G coefficient for decision making. Moreover, ACS offers a more discriminating and reliable solution for early stage concept screening as manifested by a higher G coefficient and greater percentage of variance due to the selected concepts given the same sampling design. Practical implications – The results lend strong support to ACS as a more cost-effective method for screening new product concepts and the Generalizability Theory as a systematic framework for assessing concept testing methods. Originality/value – This study adopts the Generalizability Theory framework to assess the validity of new product concept screening method.",
keywords = "New product development, Product innovation",
author = "Geng CUI and Ling PENG and FLORES, {Laurent Pierre}",
year = "2015",
month = "8",
doi = "10.1108/EJIM-04-2014-0046",
language = "English",
volume = "18",
pages = "380--396",
journal = "European Journal of Innovation Management",
issn = "1460-1060",
publisher = "Emerald Group Publishing Ltd.",
number = "3",

}

Selecting ideas for new product development : comparison of monadic test and adaptive concept screening under the G theory framework. / CUI, Geng; PENG, Ling; FLORES, Laurent Pierre.

In: European Journal of Innovation Management, Vol. 18, No. 3, 08.2015, p. 380-396.

Research output: Journal PublicationsJournal Article (refereed)

TY - JOUR

T1 - Selecting ideas for new product development : comparison of monadic test and adaptive concept screening under the G theory framework

AU - CUI, Geng

AU - PENG, Ling

AU - FLORES, Laurent Pierre

PY - 2015/8

Y1 - 2015/8

N2 - Purpose – New product concept screening, i.e., selecting a few viable innovative concepts from numerous candidates, involves high stakes and is complicated and resource intensive. Over the years, there has been heated debate about the relative merit of monadic (sequential) tests vs that of preference-based paired comparisons. The paper aims to discuss these issues. Design/methodology/approach – This study proposes the Generalizability Theory as a framework to assess and compare the performance of traditional monadic test with the Adaptive Concept Screening (ACS) in terms of their testing results and psychometric quality. Findings – Using 50 yogurt concepts and two independent groups of respondents, the results indicate that ACS requires a significant smaller sample of respondents to achieve a necessary minimum G coefficient for decision making. Moreover, ACS offers a more discriminating and reliable solution for early stage concept screening as manifested by a higher G coefficient and greater percentage of variance due to the selected concepts given the same sampling design. Practical implications – The results lend strong support to ACS as a more cost-effective method for screening new product concepts and the Generalizability Theory as a systematic framework for assessing concept testing methods. Originality/value – This study adopts the Generalizability Theory framework to assess the validity of new product concept screening method.

AB - Purpose – New product concept screening, i.e., selecting a few viable innovative concepts from numerous candidates, involves high stakes and is complicated and resource intensive. Over the years, there has been heated debate about the relative merit of monadic (sequential) tests vs that of preference-based paired comparisons. The paper aims to discuss these issues. Design/methodology/approach – This study proposes the Generalizability Theory as a framework to assess and compare the performance of traditional monadic test with the Adaptive Concept Screening (ACS) in terms of their testing results and psychometric quality. Findings – Using 50 yogurt concepts and two independent groups of respondents, the results indicate that ACS requires a significant smaller sample of respondents to achieve a necessary minimum G coefficient for decision making. Moreover, ACS offers a more discriminating and reliable solution for early stage concept screening as manifested by a higher G coefficient and greater percentage of variance due to the selected concepts given the same sampling design. Practical implications – The results lend strong support to ACS as a more cost-effective method for screening new product concepts and the Generalizability Theory as a systematic framework for assessing concept testing methods. Originality/value – This study adopts the Generalizability Theory framework to assess the validity of new product concept screening method.

KW - New product development

KW - Product innovation

UR - http://commons.ln.edu.hk/sw_master/3783

UR - https://www.scopus.com/inward/record.uri?eid=2-s2.0-84937579073&doi=10.1108%2fEJIM-04-2014-0046&partnerID=40&md5=0dfdc9122ad04da205bc14b3d852c088

U2 - 10.1108/EJIM-04-2014-0046

DO - 10.1108/EJIM-04-2014-0046

M3 - Journal Article (refereed)

VL - 18

SP - 380

EP - 396

JO - European Journal of Innovation Management

JF - European Journal of Innovation Management

SN - 1460-1060

IS - 3

ER -