Item Efficiency and DIF Assessment in New Product Concept Testing

Ling PENG, Xiang WAN

Research output: Book Chapters | Papers in Conference ProceedingsConference paper (refereed)Researchpeer-review


This paper investigates how item response models can be used to select efficient items for concept testing and assess differential item functioning among major innovations and minor innovations. The results indicate that the six-item scale utilized in the on-line testing performs differently across the performance continuum. Surprisingly the scale as a whole is not effective at identifying the most promising and the least attractive concepts. As for the single item efficiency, believability and importance provide the most information for identifying the poor concepts. Purchase intention, problem solving and uniqueness are super at selecting good concepts. In addition, all six items display large DIF among major and minor innovations, which indicate that items perform significantly different for concept tests of major and minor innovations. Minor innovations are disadvantaged on average across six items. Liking, importance, uniqueness and believability discriminate better for major innovations, while problem solving item is more effective for minor innovations. This research provides an alternative methodology for item analysis other than classical test theory.

Original languageEnglish
Title of host publicationMarketing in Transition: Scarcity, Globalism, & Sustainability
Subtitle of host publicationProceedings of the 2009 World Marketing Congress
PublisherSpringer, Cham
Number of pages6
ISBN (Electronic)9783319186863
ISBN (Print)9783319186870
Publication statusPublished - 2015
EventThe 14th Biennial World Marketing Congress 2009 -
Duration: 1 Jul 20091 Jul 2009

Publication series

NameDevelopments in Marketing Science: Proceedings of the Academy of Marketing Science
ISSN (Print)2363-6165
ISSN (Electronic)2363-6173


ConferenceThe 14th Biennial World Marketing Congress 2009
OtherAcademy of Marketing Science

Bibliographical note

Publisher Copyright:
© 2015, Academy of Marketing Science.


  • Classical Test Theory
  • Differential Item Functioning
  • Item Response Model
  • Item Response Theory
  • Purchase Intention


Dive into the research topics of 'Item Efficiency and DIF Assessment in New Product Concept Testing'. Together they form a unique fingerprint.

Cite this