A framework for optimizing the cost and performance of concept testing

Ling PENG, Chunyu LI, Xiang WAN

Research output: Journal PublicationsJournal Article (refereed)

4 Citations (Scopus)

Abstract

To anticipate the likely market demand better and identify the best customers to target with potential new products early in their development, concept tests need to provide adequate data quality for the objectives of measurement. Generalisability theory provides a framework where a generalisability study can be conducted to identify each possible aspect of a measurement as a factor that may be a potential source of variability. When a limited budget is available, optimising measurement designs involves a trade-off between the accuracy of the data (i.e. generalisability coefficients) and cost considerations. Building on previous and ongoing research, this study presents a multivariate optimisation procedure to achieve the most cost-efficient measurement design under the pre-specified generalisability coefficient constraint. We used the available online concept testing data to illustrate how to optimise the measurement cost by sampling along the facets that contribute to the total error variance in different iso-generalisability designs. The findings may help to facilitate decision making for the sampling of respondents, concepts, items, and occasions in the design of concept test. However, the optimisation framework may be applied more generally to improve the effectiveness and efficiency of other customer tests in marketing.
Original languageEnglish
Pages (from-to)1000-1013
Number of pages14
JournalJournal of Marketing Management
Volume28
Issue number7/8
DOIs
Publication statusPublished - 1 Jul 2012

Fingerprint

Testing
Costs
Coefficients
Sampling
Factors
Data quality
New products
Marketing
Decision making
Market demand
Trade-offs

Keywords

  • concept testing
  • cost optimisation
  • generalisability theory

Cite this

PENG, Ling ; LI, Chunyu ; WAN, Xiang. / A framework for optimizing the cost and performance of concept testing. In: Journal of Marketing Management. 2012 ; Vol. 28, No. 7/8. pp. 1000-1013.
@article{2889330e53b64a4f8a6e7dcdba4de13f,
title = "A framework for optimizing the cost and performance of concept testing",
abstract = "To anticipate the likely market demand better and identify the best customers to target with potential new products early in their development, concept tests need to provide adequate data quality for the objectives of measurement. Generalisability theory provides a framework where a generalisability study can be conducted to identify each possible aspect of a measurement as a factor that may be a potential source of variability. When a limited budget is available, optimising measurement designs involves a trade-off between the accuracy of the data (i.e. generalisability coefficients) and cost considerations. Building on previous and ongoing research, this study presents a multivariate optimisation procedure to achieve the most cost-efficient measurement design under the pre-specified generalisability coefficient constraint. We used the available online concept testing data to illustrate how to optimise the measurement cost by sampling along the facets that contribute to the total error variance in different iso-generalisability designs. The findings may help to facilitate decision making for the sampling of respondents, concepts, items, and occasions in the design of concept test. However, the optimisation framework may be applied more generally to improve the effectiveness and efficiency of other customer tests in marketing.",
keywords = "concept testing, cost optimisation, generalisability theory",
author = "Ling PENG and Chunyu LI and Xiang WAN",
year = "2012",
month = "7",
day = "1",
doi = "10.1080/0267257X.2011.615336",
language = "English",
volume = "28",
pages = "1000--1013",
journal = "Journal of Marketing Management",
issn = "0267-257X",
publisher = "Taylor and Francis Ltd.",
number = "7/8",

}

A framework for optimizing the cost and performance of concept testing. / PENG, Ling; LI, Chunyu; WAN, Xiang.

In: Journal of Marketing Management, Vol. 28, No. 7/8, 01.07.2012, p. 1000-1013.

Research output: Journal PublicationsJournal Article (refereed)

TY - JOUR

T1 - A framework for optimizing the cost and performance of concept testing

AU - PENG, Ling

AU - LI, Chunyu

AU - WAN, Xiang

PY - 2012/7/1

Y1 - 2012/7/1

N2 - To anticipate the likely market demand better and identify the best customers to target with potential new products early in their development, concept tests need to provide adequate data quality for the objectives of measurement. Generalisability theory provides a framework where a generalisability study can be conducted to identify each possible aspect of a measurement as a factor that may be a potential source of variability. When a limited budget is available, optimising measurement designs involves a trade-off between the accuracy of the data (i.e. generalisability coefficients) and cost considerations. Building on previous and ongoing research, this study presents a multivariate optimisation procedure to achieve the most cost-efficient measurement design under the pre-specified generalisability coefficient constraint. We used the available online concept testing data to illustrate how to optimise the measurement cost by sampling along the facets that contribute to the total error variance in different iso-generalisability designs. The findings may help to facilitate decision making for the sampling of respondents, concepts, items, and occasions in the design of concept test. However, the optimisation framework may be applied more generally to improve the effectiveness and efficiency of other customer tests in marketing.

AB - To anticipate the likely market demand better and identify the best customers to target with potential new products early in their development, concept tests need to provide adequate data quality for the objectives of measurement. Generalisability theory provides a framework where a generalisability study can be conducted to identify each possible aspect of a measurement as a factor that may be a potential source of variability. When a limited budget is available, optimising measurement designs involves a trade-off between the accuracy of the data (i.e. generalisability coefficients) and cost considerations. Building on previous and ongoing research, this study presents a multivariate optimisation procedure to achieve the most cost-efficient measurement design under the pre-specified generalisability coefficient constraint. We used the available online concept testing data to illustrate how to optimise the measurement cost by sampling along the facets that contribute to the total error variance in different iso-generalisability designs. The findings may help to facilitate decision making for the sampling of respondents, concepts, items, and occasions in the design of concept test. However, the optimisation framework may be applied more generally to improve the effectiveness and efficiency of other customer tests in marketing.

KW - concept testing

KW - cost optimisation

KW - generalisability theory

UR - http://commons.ln.edu.hk/sw_master/615

U2 - 10.1080/0267257X.2011.615336

DO - 10.1080/0267257X.2011.615336

M3 - Journal Article (refereed)

VL - 28

SP - 1000

EP - 1013

JO - Journal of Marketing Management

JF - Journal of Marketing Management

SN - 0267-257X

IS - 7/8

ER -