Systematic Literature Review: Integrasi Explainable AI dalam Decision Support System untuk Manajemen Risiko dan Krisis
DOI:
https://doi.org/10.55123/jumintal.v5i1.8113Keywords:
Explainable AI, Decision Support System, Risk Management, Crisis Management, XAIAbstract
The growing complexity of risks and crisis situations across various sectors has encouraged the development of Artificial Intelligence-based Decision Support Systems (DSS) to support more accurate, responsive, and data-driven decision-making. These systems are considered valuable because they can help decision-makers analyze uncertainty, recognize potential threats, predict possible impacts, and determine appropriate actions in complex conditions. However, the use of black-box AI models creates serious challenges, particularly regarding transparency, accountability, interpretability, and user trust. Therefore, this study focuses on examining the trend of Explainable Artificial Intelligence (XAI) integration in DSS for risk and crisis management, identifying the XAI methods commonly applied, and revealing research gaps that still need further attention. The study applies a Systematic Literature Review (SLR) method using the PRISMA approach, involving 47 selected articles obtained from Scopus, IEEE Xplore, ScienceDirect, and Google Scholar databases, published between 2020 and 2025. The findings show that XAI plays an important role in improving transparency, interpretability, and trust in AI-based DSS, with SHAP and LIME being the most frequently used methods. Nevertheless, gaps remain, especially limited XAI implementation in real-time crisis scenarios and insufficient human-centered design approaches. This study contributes a conceptual framework integrating DSS, XAI, and risk management.
Downloads
References
Arrieta, A. B., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., García, S., Gil-López, S., Molina, D., Benjamins, R., Chatila, R., & Herrera, F. (2020). Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI. Information Fusion, 58, 82–115. https://doi.org/10.1016/j.inffus.2019.12.012
Badhon, B., Chakrabortty, R. K., Anavatti, S. G., & Vanhoucke, M. (2025). IRAF-BRB: An explainable AI framework for enhanced interpretability in project risk assessment. Expert Systems with Applications, 285, 127979. https://doi.org/10.1016/j.eswa.2025.127979
Černevičienė, J., & Kabasinskas, A. (2024). Explainable artificial intelligence (XAI) in finance: A systematic literature review. Artificial Intelligence Review, 57, Article 216. https://doi.org/10.1007/s10462-024-10854-8
Du, M., Liu, N., & Hu, X. (2020). Techniques for interpretable machine learning. Communications of the ACM, 63(1), 68–77. https://doi.org/10.1145/3359786
Gunning, D., Stefik, M., Choi, J., Miller, T., Stumpf, S., & Yang, G.-Z. (2021). DARPA's explainable AI (XAI) program: A retrospective. Applied AI Letters, 2(4), e61. https://doi.org/10.1002/ail2.61
Kostopoulos, G., Davrazos, G., & Kotsiantis, S. (2024). Explainable Artificial Intelligence-based Decision Support Systems: A recent review. Electronics, 13(14), 2842. https://doi.org/10.3390/electronics13142842
Kovari, A. (2024). AI for decision support: Balancing accuracy, transparency, and trust across sectors. Information, 15(11), 725. https://doi.org/10.3390/info15110725
Linardatos, P., Papastefanopoulos, V., & Kotsiantis, S. (2021). Explainable AI: A review of machine learning interpretability methods. Entropy, 23(1), 18. https://doi.org/10.3390/e23010018
Lundberg, S. M., Erion, G., Chen, H., DeGrave, A., Prutkin, J. M., Nair, B., Katz, R., Himmelfarb, J., Bansal, N., & Lee, S. I. (2020). From local explanations to global understanding with explainable AI for trees. Nature Machine Intelligence, 2(1), 56–67. https://doi.org/10.1038/s42256-019-0138-9
Mohseni, S., Zarei, N., & Ragan, E. D. (2021). A multidisciplinary survey and framework for design and evaluation of explainable AI systems. ACM Transactions on Interactive Intelligent Systems, 11(3–4), Article 24. https://doi.org/10.1145/3387166
Republik Indonesia. (2022). Undang-Undang Nomor 27 Tahun 2022 tentang Pelindungan Data Pribadi. Lembaran Negara Republik Indonesia Tahun 2022 Nomor 196.
Saranya, A., & Subhashini, R. (2023). A systematic review of Explainable Artificial Intelligence models and applications: Recent developments and future trends. Decision Analytics Journal, 7, 100230. https://doi.org/10.1016/j.dajour.2023.100230
Sokol, K., & Flach, P. (2020). Explainability fact sheets: A framework for systematic assessment of explainable approaches. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency (pp. 56–67). Association for Computing Machinery. https://doi.org/10.1145/3351095.3372870
Soori, M., Ghaleh Jough, F. K., Dastres, R., & Arezoo, B. (2024). AI-based decision support systems in Industry 4.0, a review. Journal of Economy and Technology, 2, 1–14. https://doi.org/10.1016/j.ject.2024.08.005
Tomsett, R., Harborne, D., Chakraborty, S., Gurram, P., & Preece, A. (2020). Sanity checks for saliency metrics. Proceedings of the AAAI Conference on Artificial Intelligence, 34(4), 6021–6029. https://doi.org/10.1609/aaai.v34i04.5819
Vilone, G., & Longo, L. (2021). Notions of explainability and evaluation approaches for explainable artificial intelligence. Information Fusion, 76, 89–106. https://doi.org/10.1016/j.inffus.2021.05.009
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Muhammad Damas Fatih, Hamzah Alghifari, Pariyadi Pariyadi, Mohammad Alfiza Rayesa
This work is licensed under a Creative Commons Attribution 4.0 International License.
