Authors: Tassio Ferenzini Martins Sirqueira; Marx Leles Viana; Francisco José Plácido Da Cunha; Ingrid Nunes; Carlos José Pereira De Lucena
Addresses: Pontifical Catholic University of Rio de Janeiro - PUC-Rio, Rio de Janeiro, Brazil; Vianna Junior Institute - FIVJ, Juiz de Fora, Brazil ' Pontifical Catholic University of Rio de Janeiro - PUC-Rio, Rio de Janeiro, Brazil ' Pontifical Catholic University of Rio de Janeiro - PUC-Rio, Rio de Janeiro, Brazil ' Federal University of Rio Grande do Sul - UFRGS, Porto Alegre, Brazil ' Pontifical Catholic University of Rio de Janeiro - PUC-Rio, Rio de Janeiro, Brazil
Abstract: The popularity of applications based on artificial intelligence creates the need for making them able to explain their behaviour and be accountable for their decisions. This is a challenge mainly if applications are distributed, being composed of multiple autonomous agents, forming a Multi-Agent System (MAS). A key means of making these systems explainable is to track agent behaviour, that is, to record the provenance of their actions and reasoning. Although the idea of provenance has been explored in some contexts, it has been little explored in the context of MAS, leaving many open issues that must be understood and addressed. Our goal in this paper is to make a case for the importance of the data provenance to MAS, discussing what questions can be answered regarding MAS behaviour using provenance and, with a case study, demonstrating the benefits that provenance provides to answer these questions. This study involves the use of a framework, namely FProvW3C, which collects and stores the provenance of data produced by MAS. These data can be analysed to answer a wide variety of questions to understand the MAS behaviour. Our case study thus demonstrates that the use of data provenance in MAS is a potential solution to making the agent reasoning process transparent.
Keywords: provenance; multi-agent systems; explainable artificial intelligence.
International Journal of Metadata, Semantics and Ontologies, 2018 Vol.13 No.1, pp.9 - 19
Received: 20 Nov 2017
Accepted: 06 Jun 2018
Published online: 30 Nov 2018 *