A Roadmap of Explainable Artificial Intelligence: Explain to Whom, When, What and How?

Ziming WANG, Changwu HUANG*, Xin YAO*

*Corresponding author for this work

Research output: Journal PublicationsJournal Article (refereed)

Abstract

Explainable artificial intelligence (XAI) has gained significant attention, especially in AI-powered autonomous and adaptive systems (AASs). However, a discernible disconnect exists among research efforts across different communities. The machine learning community often overlooks "explaining to whom,"while the human-computer interaction community has examined various stakeholders with diverse explanation needs without addressing which XAI methods meet these requirements. Currently, no clear guidance exists on which XAI methods suit which specific stakeholders and their distinct needs. This hinders the achievement of the goal of XAI: providing human users with understandable interpretations. To bridge this gap, this article presents a comprehensive XAI roadmap. Based on an extensive literature review, the roadmap summarizes different stakeholders, their explanation needs at different stages of the AI system lifecycle, the questions they may pose, and existing XAI methods. Then, by utilizing stakeholders' inquiries as a conduit, the roadmap connects their needs to prevailing XAI methods, providing a guideline to assist researchers and practitioners to determine more easily which XAI methodologies can meet the specific needs of stakeholders in AASs. Finally, the roadmap discusses the limitations of existing XAI methods and outlines directions for future research.

Original languageEnglish
Pages (from-to)1-40
JournalACM Transactions on Autonomous and Adaptive Systems
Volume19
Issue number4
Early online date5 Nov 2024
DOIs
Publication statusPublished - Nov 2024

Bibliographical note

Invited article as part of ACM TAAS Editor’s Special Collection to inaugurate the ACM TAAS continuous theme on “Trustworthy and Socio-dependable Autonomous and Adaptive Systems.”

Funding

This work was supported by the National Natural Science Foundation of China (Grant No. 62250710682), the Guangdong Provincial Key Laboratory (Grant No. 2020B121201001), and the Program for Guangdong Introducing Innovative and Entrepreneurial Teams (Grant No.2017ZT07X386).

Keywords

  • Explainability
  • Explainable artificial intelligence
  • Human-computer interaction
  • Transparency
  • Trustworthy artificial intelligence

Fingerprint

Dive into the research topics of 'A Roadmap of Explainable Artificial Intelligence: Explain to Whom, When, What and How?'. Together they form a unique fingerprint.

Cite this