Evaluation of evaluation studies using qualitative research methods in the social work literature (1990-2003) : evidence that constitutes a wake-up call

Daniel T. L. SHEK, Vera M. Y. TANG, X. Y. HAN

Research output: Journal PublicationsJournal Article (refereed)Researchpeer-review

145 Citations (Scopus)

Abstract

Objective: This study examines the quality of evaluation studies using qualitative research methods in the social work literature in terms of a number of criteria commonly adopted in the field of qualitative research. 

Method: Using qualitative and evaluation as search terms, relevant qualitative evaluation studies from 1990 to 2003 indexed by Social Work Abstracts were examined, and their quality was evaluated. 

Results: The review shows that the quality of published evaluation studies using qualitative research methods in the social work field is not high and that many of the reviewed studies are not sensitive to the following issues: philosophical base of the study, auditability, bias, truth value, consistency, and critical interpretations of the data. 

Conclusions: Social workers using findings arising from published evaluation studies using qualitative research methods in social work should be cautious and social workers conducting qualitative evaluation studies should be sensitive to the issue of quality. Adequate training for social workers on qualitative evaluation should also be carried out.

Original languageEnglish
Pages (from-to)180-194
Number of pages15
JournalResearch on Social Work Practice
Volume15
Issue number3
DOIs
Publication statusPublished - 1 May 2005
Externally publishedYes

Fingerprint

Qualitative Research
Social Work
qualitative method
research method
qualitative research
social work
evaluation
evidence
social worker
literature
interpretation
trend
Values

Keywords

  • Criteriology
  • Evaluation
  • Evaluative criteria
  • Qualitative research
  • Social work literature

Cite this

@article{056f33b00e1848ef8fea38544ea6f91c,
title = "Evaluation of evaluation studies using qualitative research methods in the social work literature (1990-2003) : evidence that constitutes a wake-up call",
abstract = "Objective: This study examines the quality of evaluation studies using qualitative research methods in the social work literature in terms of a number of criteria commonly adopted in the field of qualitative research. Method: Using qualitative and evaluation as search terms, relevant qualitative evaluation studies from 1990 to 2003 indexed by Social Work Abstracts were examined, and their quality was evaluated. Results: The review shows that the quality of published evaluation studies using qualitative research methods in the social work field is not high and that many of the reviewed studies are not sensitive to the following issues: philosophical base of the study, auditability, bias, truth value, consistency, and critical interpretations of the data. Conclusions: Social workers using findings arising from published evaluation studies using qualitative research methods in social work should be cautious and social workers conducting qualitative evaluation studies should be sensitive to the issue of quality. Adequate training for social workers on qualitative evaluation should also be carried out.",
keywords = "Criteriology, Evaluation, Evaluative criteria, Qualitative research, Social work literature",
author = "SHEK, {Daniel T. L.} and TANG, {Vera M. Y.} and HAN, {X. Y.}",
year = "2005",
month = "5",
day = "1",
doi = "10.1177/1049731504271603",
language = "English",
volume = "15",
pages = "180--194",
journal = "Research on Social Work Practice",
issn = "1049-7315",
publisher = "SAGE Publications Inc.",
number = "3",

}

Evaluation of evaluation studies using qualitative research methods in the social work literature (1990-2003) : evidence that constitutes a wake-up call. / SHEK, Daniel T. L.; TANG, Vera M. Y.; HAN, X. Y.

In: Research on Social Work Practice, Vol. 15, No. 3, 01.05.2005, p. 180-194.

Research output: Journal PublicationsJournal Article (refereed)Researchpeer-review

TY - JOUR

T1 - Evaluation of evaluation studies using qualitative research methods in the social work literature (1990-2003) : evidence that constitutes a wake-up call

AU - SHEK, Daniel T. L.

AU - TANG, Vera M. Y.

AU - HAN, X. Y.

PY - 2005/5/1

Y1 - 2005/5/1

N2 - Objective: This study examines the quality of evaluation studies using qualitative research methods in the social work literature in terms of a number of criteria commonly adopted in the field of qualitative research. Method: Using qualitative and evaluation as search terms, relevant qualitative evaluation studies from 1990 to 2003 indexed by Social Work Abstracts were examined, and their quality was evaluated. Results: The review shows that the quality of published evaluation studies using qualitative research methods in the social work field is not high and that many of the reviewed studies are not sensitive to the following issues: philosophical base of the study, auditability, bias, truth value, consistency, and critical interpretations of the data. Conclusions: Social workers using findings arising from published evaluation studies using qualitative research methods in social work should be cautious and social workers conducting qualitative evaluation studies should be sensitive to the issue of quality. Adequate training for social workers on qualitative evaluation should also be carried out.

AB - Objective: This study examines the quality of evaluation studies using qualitative research methods in the social work literature in terms of a number of criteria commonly adopted in the field of qualitative research. Method: Using qualitative and evaluation as search terms, relevant qualitative evaluation studies from 1990 to 2003 indexed by Social Work Abstracts were examined, and their quality was evaluated. Results: The review shows that the quality of published evaluation studies using qualitative research methods in the social work field is not high and that many of the reviewed studies are not sensitive to the following issues: philosophical base of the study, auditability, bias, truth value, consistency, and critical interpretations of the data. Conclusions: Social workers using findings arising from published evaluation studies using qualitative research methods in social work should be cautious and social workers conducting qualitative evaluation studies should be sensitive to the issue of quality. Adequate training for social workers on qualitative evaluation should also be carried out.

KW - Criteriology

KW - Evaluation

KW - Evaluative criteria

KW - Qualitative research

KW - Social work literature

UR - http://www.scopus.com/inward/record.url?scp=17444404904&partnerID=8YFLogxK

U2 - 10.1177/1049731504271603

DO - 10.1177/1049731504271603

M3 - Journal Article (refereed)

VL - 15

SP - 180

EP - 194

JO - Research on Social Work Practice

JF - Research on Social Work Practice

SN - 1049-7315

IS - 3

ER -