Identifying OM4AnI’s Effectiveness in the Context of Explainable AI

Scatterplots are widely used in Explainable Artificial Intelligence (XAI) to investigate misclassifications and patterns across instances. However, a significant limitation of scatterplots is overplotting, especially when working with large datasets. Although several quality metrics have been proposed to measure the degree of overplotting, none have been demonstrated to be effective in the context of XAI. This paper aims to evaluate the effectiveness of a quality metric, called OM4AnI, in XAI scenarios. We begin by summarizing two visual patterns—cluster-based and regression-based patterns—that support three common XAI tasks: feature importance, feature dependency, and model accuracy. We also introduce how to select the parameters of OM4AnI based on these patterns. We construct two case studies to identify the effectiveness of OM4AnI using public datasets: Census Income dataset and MNIST dataset. OM4AnI is applied to both scenarios under various visual conditions (e.g., marker size and rendering order) to assess its effectiveness. The results demonstrate that OM4AnI serves as an effective quality metric for these two common XAI scenarios, paving the way for adapting other quality metrics to be scalable within XAI contexts.