Item Efficiency and DIF Assessment in New Product Concept Testing

Ling PENG, Xiang WAN

Research output: Book Chapters | Papers in Conference ProceedingsConference paper (refereed)Researchpeer-review

Abstract

This paper investigates how item response models can be used to select efficient items for concept testing and assess differential item functioning among major innovations and minor innovations. The results indicate that the six-item scale utilized in the on-line testing performs differently across the performance continuum. Surprisingly the scale as a whole is not effective at identifying the most promising and the least attractive concepts. As for the single item efficiency, believability and importance provide the most information for identifying the poor concepts. Purchase intention, problem solving and uniqueness are super at selecting good concepts. In addition, all six items display large DIF among major and minor innovations, which indicate that items perform significantly different for concept tests of major and minor innovations. Minor innovations are disadvantaged on average across six items. Liking, importance, uniqueness and believability discriminate better for major innovations, while problem solving item is more effective for minor innovations. This research provides an alternative methodology for item analysis other than classical test theory.
Original languageEnglish
Title of host publicationMarketing in Transition: Scarcity, Globalism, & Sustainability
Subtitle of host publicationProceedings of the 2009 World Marketing Congress
PublisherSpringer, Cham
Pages319-324
ISBN (Electronic)9783319186863
ISBN (Print)9783319186870
DOIs
Publication statusPublished - 2009
EventThe 14th Biennial World Marketing Congress 2009 -
Duration: 1 Jul 20091 Jul 2009

Publication series

NameDevelopments in Marketing Science: Proceedings of the Academy of Marketing Science
ISSN (Print)2363-6165
ISSN (Electronic)2363-6173

Conference

ConferenceThe 14th Biennial World Marketing Congress 2009
Period1/07/091/07/09
OtherAcademy of Marketing Science

Fingerprint

Innovation
Differential item functioning
Testing
New products
Problem solving
Uniqueness
Liking
Methodology
Purchase intention

Cite this

PENG, L., & WAN, X. (2009). Item Efficiency and DIF Assessment in New Product Concept Testing. In Marketing in Transition: Scarcity, Globalism, & Sustainability: Proceedings of the 2009 World Marketing Congress (pp. 319-324). (Developments in Marketing Science: Proceedings of the Academy of Marketing Science). Springer, Cham. https://doi.org/10.1007/978-3-319-18687-0_118
PENG, Ling ; WAN, Xiang. / Item Efficiency and DIF Assessment in New Product Concept Testing. Marketing in Transition: Scarcity, Globalism, & Sustainability: Proceedings of the 2009 World Marketing Congress. Springer, Cham, 2009. pp. 319-324 (Developments in Marketing Science: Proceedings of the Academy of Marketing Science).
@inproceedings{87dadb7cfd9b4e43a708dbad9309e71b,
title = "Item Efficiency and DIF Assessment in New Product Concept Testing",
abstract = "This paper investigates how item response models can be used to select efficient items for concept testing and assess differential item functioning among major innovations and minor innovations. The results indicate that the six-item scale utilized in the on-line testing performs differently across the performance continuum. Surprisingly the scale as a whole is not effective at identifying the most promising and the least attractive concepts. As for the single item efficiency, believability and importance provide the most information for identifying the poor concepts. Purchase intention, problem solving and uniqueness are super at selecting good concepts. In addition, all six items display large DIF among major and minor innovations, which indicate that items perform significantly different for concept tests of major and minor innovations. Minor innovations are disadvantaged on average across six items. Liking, importance, uniqueness and believability discriminate better for major innovations, while problem solving item is more effective for minor innovations. This research provides an alternative methodology for item analysis other than classical test theory.",
author = "Ling PENG and Xiang WAN",
year = "2009",
doi = "10.1007/978-3-319-18687-0_118",
language = "English",
isbn = "9783319186870",
series = "Developments in Marketing Science: Proceedings of the Academy of Marketing Science",
publisher = "Springer, Cham",
pages = "319--324",
booktitle = "Marketing in Transition: Scarcity, Globalism, & Sustainability",

}

PENG, L & WAN, X 2009, Item Efficiency and DIF Assessment in New Product Concept Testing. in Marketing in Transition: Scarcity, Globalism, & Sustainability: Proceedings of the 2009 World Marketing Congress. Developments in Marketing Science: Proceedings of the Academy of Marketing Science, Springer, Cham, pp. 319-324, The 14th Biennial World Marketing Congress 2009, 1/07/09. https://doi.org/10.1007/978-3-319-18687-0_118

Item Efficiency and DIF Assessment in New Product Concept Testing. / PENG, Ling; WAN, Xiang.

Marketing in Transition: Scarcity, Globalism, & Sustainability: Proceedings of the 2009 World Marketing Congress. Springer, Cham, 2009. p. 319-324 (Developments in Marketing Science: Proceedings of the Academy of Marketing Science).

Research output: Book Chapters | Papers in Conference ProceedingsConference paper (refereed)Researchpeer-review

TY - GEN

T1 - Item Efficiency and DIF Assessment in New Product Concept Testing

AU - PENG, Ling

AU - WAN, Xiang

PY - 2009

Y1 - 2009

N2 - This paper investigates how item response models can be used to select efficient items for concept testing and assess differential item functioning among major innovations and minor innovations. The results indicate that the six-item scale utilized in the on-line testing performs differently across the performance continuum. Surprisingly the scale as a whole is not effective at identifying the most promising and the least attractive concepts. As for the single item efficiency, believability and importance provide the most information for identifying the poor concepts. Purchase intention, problem solving and uniqueness are super at selecting good concepts. In addition, all six items display large DIF among major and minor innovations, which indicate that items perform significantly different for concept tests of major and minor innovations. Minor innovations are disadvantaged on average across six items. Liking, importance, uniqueness and believability discriminate better for major innovations, while problem solving item is more effective for minor innovations. This research provides an alternative methodology for item analysis other than classical test theory.

AB - This paper investigates how item response models can be used to select efficient items for concept testing and assess differential item functioning among major innovations and minor innovations. The results indicate that the six-item scale utilized in the on-line testing performs differently across the performance continuum. Surprisingly the scale as a whole is not effective at identifying the most promising and the least attractive concepts. As for the single item efficiency, believability and importance provide the most information for identifying the poor concepts. Purchase intention, problem solving and uniqueness are super at selecting good concepts. In addition, all six items display large DIF among major and minor innovations, which indicate that items perform significantly different for concept tests of major and minor innovations. Minor innovations are disadvantaged on average across six items. Liking, importance, uniqueness and believability discriminate better for major innovations, while problem solving item is more effective for minor innovations. This research provides an alternative methodology for item analysis other than classical test theory.

U2 - 10.1007/978-3-319-18687-0_118

DO - 10.1007/978-3-319-18687-0_118

M3 - Conference paper (refereed)

SN - 9783319186870

T3 - Developments in Marketing Science: Proceedings of the Academy of Marketing Science

SP - 319

EP - 324

BT - Marketing in Transition: Scarcity, Globalism, & Sustainability

PB - Springer, Cham

ER -

PENG L, WAN X. Item Efficiency and DIF Assessment in New Product Concept Testing. In Marketing in Transition: Scarcity, Globalism, & Sustainability: Proceedings of the 2009 World Marketing Congress. Springer, Cham. 2009. p. 319-324. (Developments in Marketing Science: Proceedings of the Academy of Marketing Science). https://doi.org/10.1007/978-3-319-18687-0_118