Accessing embedded program in untestable mobile environment : experience of a trustworthiness approach

Karl R. P. H. LEUNG, Joseph K.-Y. NG, Wing Lok YEUNG

Research output: Journal PublicationsJournal Article (refereed)Researchpeer-review

Abstract

Comparing actual output with the expected output of some controlled input is a fundamental principle of program correctness testing. However, in some situations, the input is uncontrollable or even undetectable during testing, it is impossible to decide the expected output or the test oracle. Or in some situations, the output may be indeterministic or unpredictable, hence it is impossible to compare the output with the expected one. We encountered these problems and could not conduct normal program testing when we developed programs to extract network data from various mobile stations in the Mobile Location Estimation System project. Instead we analyzed the program output and challenge it against the intrinsic properties, the environment, the program itself, and the application results to find evidence that the output is suitable to be used for the planned purposes. In short, we accessed the trustworthiness of the programs. In the development of our mobile software, it was common that different programs of the same specification had to be developed for mobile stations of different models. These different implementations provided another source of reference for trustworthiness assessment. Our experience of applying the trustworthiness approach to developing software for extracting network data from mobile stations is reported in this paper.
Original languageEnglish
Pages (from-to)962-968
Number of pages7
JournalJournal of Systems and Software
Volume79
Issue number7
DOIs
Publication statusPublished - 1 Jul 2006

Fingerprint

Testing
Specifications

Bibliographical note

Paper presented at the 11th Asia-Pacific Software Engineering Conference (APSEC 2004), Nov 30-Dec 03, 2004, Busan, South Korea.

Keywords

  • Untestable environment; Mobile embedded software testing

Cite this

LEUNG, Karl R. P. H. ; NG, Joseph K.-Y. ; YEUNG, Wing Lok. / Accessing embedded program in untestable mobile environment : experience of a trustworthiness approach. In: Journal of Systems and Software. 2006 ; Vol. 79, No. 7. pp. 962-968.
@article{a2ed8590e78e4322aa2d10e69776a6df,
title = "Accessing embedded program in untestable mobile environment : experience of a trustworthiness approach",
abstract = "Comparing actual output with the expected output of some controlled input is a fundamental principle of program correctness testing. However, in some situations, the input is uncontrollable or even undetectable during testing, it is impossible to decide the expected output or the test oracle. Or in some situations, the output may be indeterministic or unpredictable, hence it is impossible to compare the output with the expected one. We encountered these problems and could not conduct normal program testing when we developed programs to extract network data from various mobile stations in the Mobile Location Estimation System project. Instead we analyzed the program output and challenge it against the intrinsic properties, the environment, the program itself, and the application results to find evidence that the output is suitable to be used for the planned purposes. In short, we accessed the trustworthiness of the programs. In the development of our mobile software, it was common that different programs of the same specification had to be developed for mobile stations of different models. These different implementations provided another source of reference for trustworthiness assessment. Our experience of applying the trustworthiness approach to developing software for extracting network data from mobile stations is reported in this paper.",
keywords = "Untestable environment; Mobile embedded software testing",
author = "LEUNG, {Karl R. P. H.} and NG, {Joseph K.-Y.} and YEUNG, {Wing Lok}",
note = "Paper presented at the 11th Asia-Pacific Software Engineering Conference (APSEC 2004), Nov 30-Dec 03, 2004, Busan, South Korea.",
year = "2006",
month = "7",
day = "1",
doi = "10.1016/j.jss.2005.06.041",
language = "English",
volume = "79",
pages = "962--968",
journal = "Journal of Systems and Software",
issn = "0164-1212",
publisher = "Elsevier Inc.",
number = "7",

}

Accessing embedded program in untestable mobile environment : experience of a trustworthiness approach. / LEUNG, Karl R. P. H.; NG, Joseph K.-Y.; YEUNG, Wing Lok.

In: Journal of Systems and Software, Vol. 79, No. 7, 01.07.2006, p. 962-968.

Research output: Journal PublicationsJournal Article (refereed)Researchpeer-review

TY - JOUR

T1 - Accessing embedded program in untestable mobile environment : experience of a trustworthiness approach

AU - LEUNG, Karl R. P. H.

AU - NG, Joseph K.-Y.

AU - YEUNG, Wing Lok

N1 - Paper presented at the 11th Asia-Pacific Software Engineering Conference (APSEC 2004), Nov 30-Dec 03, 2004, Busan, South Korea.

PY - 2006/7/1

Y1 - 2006/7/1

N2 - Comparing actual output with the expected output of some controlled input is a fundamental principle of program correctness testing. However, in some situations, the input is uncontrollable or even undetectable during testing, it is impossible to decide the expected output or the test oracle. Or in some situations, the output may be indeterministic or unpredictable, hence it is impossible to compare the output with the expected one. We encountered these problems and could not conduct normal program testing when we developed programs to extract network data from various mobile stations in the Mobile Location Estimation System project. Instead we analyzed the program output and challenge it against the intrinsic properties, the environment, the program itself, and the application results to find evidence that the output is suitable to be used for the planned purposes. In short, we accessed the trustworthiness of the programs. In the development of our mobile software, it was common that different programs of the same specification had to be developed for mobile stations of different models. These different implementations provided another source of reference for trustworthiness assessment. Our experience of applying the trustworthiness approach to developing software for extracting network data from mobile stations is reported in this paper.

AB - Comparing actual output with the expected output of some controlled input is a fundamental principle of program correctness testing. However, in some situations, the input is uncontrollable or even undetectable during testing, it is impossible to decide the expected output or the test oracle. Or in some situations, the output may be indeterministic or unpredictable, hence it is impossible to compare the output with the expected one. We encountered these problems and could not conduct normal program testing when we developed programs to extract network data from various mobile stations in the Mobile Location Estimation System project. Instead we analyzed the program output and challenge it against the intrinsic properties, the environment, the program itself, and the application results to find evidence that the output is suitable to be used for the planned purposes. In short, we accessed the trustworthiness of the programs. In the development of our mobile software, it was common that different programs of the same specification had to be developed for mobile stations of different models. These different implementations provided another source of reference for trustworthiness assessment. Our experience of applying the trustworthiness approach to developing software for extracting network data from mobile stations is reported in this paper.

KW - Untestable environment; Mobile embedded software testing

UR - http://commons.ln.edu.hk/sw_master/4096

U2 - 10.1016/j.jss.2005.06.041

DO - 10.1016/j.jss.2005.06.041

M3 - Journal Article (refereed)

VL - 79

SP - 962

EP - 968

JO - Journal of Systems and Software

JF - Journal of Systems and Software

SN - 0164-1212

IS - 7

ER -