Abstract
Explainable artificial intelligence (XAI) has gained significant attention, especially in AI-powered autonomous and adaptive systems (AASs). However, a discernible disconnect exists among research efforts across different communities. The machine learning community often overlooks "explaining to whom,"while the human-computer interaction community has examined various stakeholders with diverse explanation needs without addressing which XAI methods meet these requirements. Currently, no clear guidance exists on which XAI methods suit which specific stakeholders and their distinct needs. This hinders the achievement of the goal of XAI: providing human users with understandable interpretations. To bridge this gap, this article presents a comprehensive XAI roadmap. Based on an extensive literature review, the roadmap summarizes different stakeholders, their explanation needs at different stages of the AI system lifecycle, the questions they may pose, and existing XAI methods. Then, by utilizing stakeholders' inquiries as a conduit, the roadmap connects their needs to prevailing XAI methods, providing a guideline to assist researchers and practitioners to determine more easily which XAI methodologies can meet the specific needs of stakeholders in AASs. Finally, the roadmap discusses the limitations of existing XAI methods and outlines directions for future research.
Original language | English |
---|---|
Pages (from-to) | 1-40 |
Journal | ACM Transactions on Autonomous and Adaptive Systems |
Volume | 19 |
Issue number | 4 |
Early online date | 5 Nov 2024 |
DOIs | |
Publication status | Published - Nov 2024 |
Bibliographical note
Invited article as part of ACM TAAS Editor’s Special Collection to inaugurate the ACM TAAS continuous theme on “Trustworthy and Socio-dependable Autonomous and Adaptive Systems.”Funding
This work was supported by the National Natural Science Foundation of China (Grant No. 62250710682), the Guangdong Provincial Key Laboratory (Grant No. 2020B121201001), and the Program for Guangdong Introducing Innovative and Entrepreneurial Teams (Grant No.2017ZT07X386).
Keywords
- Explainability
- Explainable artificial intelligence
- Human-computer interaction
- Transparency
- Trustworthy artificial intelligence