Explainable Artificial Intelligence and Machine Learning for Responsible Decision-Making: A Comparative Study of Model Accuracy, Transparency, and Fairness
DOI:
https://doi.org/10.68033/ijaimda.1.2.28-42Keywords:
Explainable Artificial Intelligence, Machine Learning; Responsible Decision-Making, ; Model Accuracy, Transparency, Algorithmic Fairness, Model Interpretability, SHAP, LIME, Ethical Artificial IntelligenceAbstract
Explainable Artificial Intelligence (XAI) has emerged as an important research area in developing transparent, accountable, and trustworthy machine learning systems. Although machine learning models can achieve high predictive accuracy, their complex decision-making processes may limit interpretability and create challenges concerning fairness, accountability, and responsible implementation. This study aims to comparatively evaluate artificial intelligence and machine learning models based on three critical dimensions: predictive accuracy, transparency, and fairness. The proposed research examines interpretable algorithms, including Logistic Regression and Decision Trees, alongside complex models such as Random Forest, Gradient Boosting, and other ensemble learning techniques. Explainability methods, particularly SHapley Additive exPlanations (SHAP) and Local Interpretable Model-Agnostic Explanations (LIME), are considered for interpreting model predictions and identifying influential features. Model performance will be assessed using accuracy, precision, recall, F1-score, and area under the receiver operating characteristic curve, while transparency and fairness will be evaluated through explanation quality, interpretability, and appropriate group fairness metrics. The study also investigates potential trade-offs between predictive performance, model complexity, and equitable outcomes. Drawing on established research in explainable AI, explanation evaluation, and algorithmic fairness, the research proposes a comparative framework for identifying models suitable for responsible decision-making. The findings are expected to support researchers, developers, and organizations in selecting machine learning approaches that balance predictive effectiveness with transparency, fairness, and accountability.
References
[1] Becker, B., & Kohavi, R. (1996). Adult [Dataset]. UCI Machine Learning Repository. https://doi.org/10.24432/C5XW20
[2] Ribeiro, M. T., Singh, S., & Guestrin, C. (2016). “Why should I trust you?”: Explaining the predictions of any classifier. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 1135–1144). Association for Computing Machinery. https://doi.org/10.1145/2939672.29397 DOI: https://doi.org/10.1145/2939672.2939778
[3] Lundberg, S. M., & Lee, S.-I. (2017). A unified approach to interpreting model predictions. In Advances in Neural Information Processing Systems 30 (pp. 4765–4774). Curran Associates, Inc.
DOI: https://arxiv.org/abs/1705.07874
[4] Arrieta, A. B., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., García, S., Gil-López, S., Molina, D., Benjamins, R., Chatila, R., & Herrera, F. (2020). Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI. Information Fusion, 58, 82–115. DOI: https://doi.org/10.1016/j.inffus.2019.12.012
https://www.sciencedirect.com/science/article/abs/pii/S1566253519308103?via%3Dihub
[5] Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., & Galstyan, A. (2021). A survey on bias and fairness in machine learning. ACM Computing Surveys, 54(6), Article 115. https://doi.org/10.1145/3457607 DOI: https://doi.org/10.1145/3457607
[6] Mitchell, S., Potash, E., Barocas, S., D'Amour, A., & Lum, K. (2021). Algorithmic fairness: Choices, assumptions, and definitions. Annual Review of Statistics and Its Application, 8, 141–163. https://doi.org/10.1146/annurev-statistics-042720-125902 DOI: https://doi.org/10.1146/annurev-statistics-042720-125902
[7] Valdivia, A., Sánchez-Monedero, J., & Casillas, J. (2021). How fair can we go in machine learning? Assessing the boundaries of accuracy and fairness. International Journal of Intelligent Systems, 36(4), 1619–1643. DOI: https://doi.org/10.1002/int.22354 DOI: https://doi.org/10.1002/int.22354
[8] Zhou, J., Gandomi, A. H., Chen, F., & Holzinger, A. (2021). Evaluating the quality of machine learning explanations: A survey on methods and metrics. Electronics, 10(5), Article 593.
DOI: https://doi.org/10.3390/electronics10050593 DOI: https://doi.org/10.3390/electronics10050593
[9] Pessach, D., & Shmueli, E. (2022). A review on fairness in machine learning. ACM Computing Surveys, 55(3), Article 51, 1–44. https://doi.org/10.1145/3494672 DOI: https://doi.org/10.1145/3494672
[10] Wang, X., & Yin, M. (2022). Effects of explanations in AI-assisted decision making: Principles and comparisons. ACM Transactions on Interactive Intelligent Systems, 12(4), Article 27, 1–36.
DOI: https://doi.org/10.1145/3519266 DOI: https://doi.org/10.1145/3519266
[11] Das, S., Stanton, R., & Wallace, N. (2023). Algorithmic fairness. Annual Review of Financial Economics, 15, 565–593. https://doi.org/10.1146/annurev-financial-110921-125930 DOI: https://doi.org/10.1146/annurev-financial-110921-125930
[12] Breidbach, C. F. (2024). Responsible algorithmic decision-making. Organizational Dynamics, 53(2), Article 101031. https://doi.org/10.1016/j.orgdyn.2024.101031 DOI: https://doi.org/10.1016/j.orgdyn.2024.101031
[13] Das Jui, T., & Rivas, P. (2024). Fairness issues, current approaches, and challenges in machine learning models. International Journal of Machine Learning and Cybernetics, 15, 3095–3125. https://doi.org/10.1007/s13042-023-02083-2 DOI: https://doi.org/10.1007/s13042-023-02083-2
[14] Lalor, J. P., Abbasi, A., Oketch, K., Yang, Y., & Forsgren, N. (2024). Should fairness be a metric or a model? A model-based framework for assessing bias in machine learning pipelines. ACM Transactions on Information Systems, 42(4), Article 99. https://doi.org/10.1145/3641276 DOI: https://doi.org/10.1145/3641276
[15] Tursunalieva, A., Alexander, D. L. J., Dunne, R., Li, J., Riera, L., & Zhao, Y. (2024). Making sense of machine learning: A review of interpretation techniques and their applications. Applied Sciences, 14(2), Article 496. https://doi.org/10.3390/app14020496 DOI: https://doi.org/10.3390/app14020496
[16] Mersha, M., Lam, K., Wood, J., AlShami, A. K., & Kalita, J. (2024). Explainable artificial intelligence: A survey of needs, techniques, applications, and future direction. Neurocomputing, 599, Article 128111. https://doi.org/10.1016/j.neucom.2024.128111 DOI: https://doi.org/10.1016/j.neucom.2024.128111
[17] Ridley, M. (2025). Human-centered explainable artificial intelligence: An Annual Review of Information Science and Technology (ARIST) paper. Journal of the Association for Information Science and Technology, 76(1), 98–120. https://doi.org/10.1002/asi.24889 DOI: https://doi.org/10.1002/asi.24889
[18] Salih, A. M., Raisi-Estabragh, Z., Boscolo Galazzo, I., Radeva, P., Petersen, S. E., Lekadir, K., & Menegaz, G. (2025). A perspective on explainable artificial intelligence methods: SHAP and LIME. Advanced Intelligent Systems, 7(1), Article 2400304. https://doi.org/10.1002/aisy.202400304 DOI: https://doi.org/10.1002/aisy.202400304
[19] Pujari, J. J., Nayak, R., Putheti, S., Bikku, T., Shanmugasundaram, P., et al. (2026). Advances in explainable artificial intelligence evaluation and ethics from 2023 to 2025. Discover Artificial Intelligence, 6, Article 739. https://doi.org/10.1007/s44163-026-01473-z DOI: https://doi.org/10.1007/s44163-026-01473-z
[20] Perdana, A. (2026). Technical fairness and social legitimacy: A conceptual mapping of algorithmic fairness, procedural justice, and explainable AI. AI and Ethics, 6, Article 491. https://doi.org/10.1007/s43681-026-01342-6 DOI: https://doi.org/10.1007/s43681-026-01342-6