Mitigating Bias in Artificial Intelligence: Methods and Challenges

Saja Salim Mohammed, Israa Alsaadi and Hind Ibrahim, Sarah Ali Abdulkareem and Hasinah Maizan

References:

1. X. Ferrer, T. Van Nuenen, J. M. Such, M. Coté, and N. Criado, "Bias and discrimination in AI: a cross-disciplinary perspective," IEEE Technol. Soc. Mag., vol. 40, no. 2, pp. 72-80, 2021.
2. A. W. Fazil, M. Hakimi, and A. K. Shahidzay, "A comprehensive review of bias in ai algorithms," Nusant. Hasana J., vol. 3, no. 8, pp. 1-11, 2023.
3. S. O’Connor and H. Liu, "Gender bias perpetuation and mitigation in AI technologies: challenges and opportunities," AI Soc., vol. 39, no. 4, pp. 2045-2057, 2024.
4. P. S. Varsha, "How can we manage biases in artificial intelligence systems–A systematic literature review," Int. J. Inf. Manag. Data Insights, vol. 3, no. 1, p. 100165, 2023.
5. D. Varona and J. L. Suárez, "Discrimination, bias, fairness, and trustworthy AI," Appl. Sci., vol. 12, no. 12, p. 5826, 2022.
6. T. B. Modi, "Artificial Intelligence Ethics and Fairness: A study to address bias and fairness issues in AI systems, and the ethical implications of AI applications," Rev. Rev. Index J. Multidiscip., vol. 3, no. 2, pp. 24-35, 2023.
7. J. Dastin, "Amazon scraps secret AI recruiting tool that showed bias against women," in Ethics of Data and Analytics, Auerbach Publications, 2022, pp. 296-299.
8. J. Buolamwini and T. Gebru, "Gender shades: Intersectional accuracy disparities in commercial gender classification," in Conference on Fairness, Accountability and Transparency, PMLR, 2018, pp. 77-91.
9. M. Karimi-Haghighi and C. Castillo, "Enhancing a recidivism prediction tool with machine learning: effectiveness and algorithmic fairness," in Proceedings of the Eighteenth International Conference on Artificial Intelligence and Law, 2021, pp. 210-214.
10. N. Mehrabi, F. Morstatter, N. Saxena, K. Lerman, and A. Galstyan, "A survey on bias and fairness in machine learning," ACM Comput. Surv., vol. 54, no. 6, pp. 1-35, 2021.
11. R. K. E. Bellamy et al., "AI Fairness 360: An extensible toolkit for detecting and mitigating algorithmic bias," IBM J. Res. Dev., vol. 63, no. 4/5, pp. 1-4, 2019.
12. S. S. Mohammed and J. M. Al-Tuwaijari, "Skin disease classification system based on metaheuristic algorithms," in AIP Conference Proceedings, AIP Publishing, 2023.
13. D. Pessach and E. Shmueli, "Algorithmic fairness," in Machine Learning for Data Science Handbook: Data Mining and Knowledge Discovery Handbook, Springer, 2023, pp. 867-886.
14. V. Vakkuri, K.-K. Kemell, and P. Abrahamsson, "Ethically aligned design: an empirical evaluation of the resolvedd-strategy in software and systems development context," in 2019 45th Euromicro Conference on Software Engineering and Advanced Applications (SEAA), IEEE, 2019, pp. 46-50.
15. J. Whittlestone, R. Nyrup, A. Alexandrova, K. Dihal, and S. Cave, "Ethical and societal implications of algorithms, data, and artificial intelligence: a roadmap for research," London Nuff. Found., 2019.
16. E. Ntoutsi et al., "Bias in data-driven artificial intelligence systems—An introductory survey," Wiley Interdiscip. Rev. Data Min. Knowl. Discov., vol. 10, no. 3, p. e1356, 2020.
17. J. Kleinberg, S. Mullainathan, and M. Raghavan, "Inherent trade-offs in the fair determination of risk scores," arXiv Prepr. arXiv1609.05807, 2016, [Online]. Available: https://arxiv.org/abs/1609.05807.
18. K. Crenshaw, "Demarginalizing the intersection of race and sex: a black feminist critique of antidiscrimination doctrine, feminist theory and antiracist politics," Droit et société, vol. 108, p. 465, 2021.
19. M. Sadek, E. Kallina, T. Bohné, C. Mougenot, R. A. Calvo, and S. Cave, "Challenges of responsible AI in practice: scoping review and recommended actions," AI Soc., pp. 1-17, 2024.
20. W. S. Nsaif et al., "Chatbot development: Framework, platform, and assessment metrics," Eurasia Proc. Sci. Technol. Eng. Math., vol. 27, pp. 50-62, 2024.
21. A. S. Tejani, Y. S. Ng, Y. Xi, and J. C. Rayan, "Understanding and mitigating bias in imaging artificial intelligence," RadioGraphics, vol. 44, no. 5, p. e230067, 2024.
22. S. Akter et al., "Algorithmic bias in data-driven innovation in the age of AI," Int. J. Inf. Manag., vol. 60, p. 102387, 2021.
23. F. Osasona, O. O. Amoo, A. Atadoga, T. O. Abrahams, O. A. Farayola, and B. S. Ayinla, "Reviewing the ethical implications of AI in decision making processes," Int. J. Manag. Entrep. Res., vol. 6, no. 2, pp. 322-335, 2024.
24. E. Ferrara, "Fairness and bias in artificial intelligence: A brief survey of sources, impacts, and mitigation strategies," Sci, vol. 6, no. 1, p. 3, 2023.
25. G. M. Johnson, "Algorithmic bias: on the implicit biases of social technology," Synthese, vol. 198, no. 10, pp. 9941-9961, 2021.
26. R. Schwartz, L. Down, A. Jonas, and E. Tabassi, "A proposal for identifying and managing bias in artificial intelligence," Draft NIST Spec. Publ., vol. 1270, 2021.
27. P. Chen, L. Wu, and L. Wang, "AI fairness in data management and analytics: A review on challenges, methodologies and applications," Appl. Sci., vol. 13, no. 18, p. 10258, 2023.
28. W. S. Nsaif et al., "Conversational agents: An exploration into Chatbot evolution, architecture, and important techniques," Eurasia Proc. Sci. Technol. Eng. Math., vol. 27, pp. 246-262, 2024.
29. R. Agarwal et al., "Addressing algorithmic bias and the perpetuation of health inequities: An AI bias aware framework," Health Policy Technol., vol. 12, no. 1, p. 100702, 2023.
30. T. P. Pagano et al., "Bias and unfairness in machine learning models: a systematic review on datasets, tools, fairness metrics, and identification and mitigation methods," Big Data Cogn. Comput., vol. 7, no. 1, p. 15, 2023.
31. A. Fabris, A. Esuli, A. Moreo, and F. Sebastiani, "Measuring fairness under unawareness of sensitive attributes: A quantification-based approach," J. Artif. Intell. Res., vol. 76, pp. 1117-1180, 2023.
32. A. Agarwal, H. Agarwal, and N. Agarwal, "Fairness Score and process standardization: framework for fairness certification in artificial intelligence systems," AI Ethics, vol. 3, no. 1, pp. 267-279, 2023.
33. M. S. Farahani and G. Ghasemi, "Artificial intelligence and inequality: challenges and opportunities," Qeios, vol. 7, pp. 1-14, 2024.
34. M. Zajko, "Conservative AI and social inequality: conceptualizing alternatives to bias through social theory," AI Soc., vol. 36, no. 3, pp. 1047-1056, 2021.
35. K. S. Chadha, "Bias and Fairness in Artificial Intelligence: Methods and Mitigation Strategies," International Journal for Research Publication and Seminar, pp. 36-49, 2024.
36. M. N. Khreisat, D. Khilani, M. A. Rusho, E. A. Karkkulainen, A. C. Tabuena, and A. D. Uberas, "Ethical implications of AI integration in educational decision making: Systematic review," Educ. Adm. Theory Pract., vol. 30, no. 5, pp. 8521-8527, 2024.
37. N. Naik et al., "Legal and ethical consideration in artificial intelligence in healthcare: who takes responsibility?," Front. Surg., vol. 9, p. 862322, 2022.
38. K. Patel, "Ethical reflections on data-centric AI: balancing benefits and risks," Int. J. Artif. Intell. Res. Dev., vol. 2, no. 1, pp. 1-17, 2024.
39. R. Bahta, "Investigating the Complexities and Interdependencies of Algorithmic Biases in Healthcare Artificial Intelligence," 2024.
40. A. Hasan, S. Brown, J. Davidovic, B. Lange, and M. Regan, "Algorithmic bias and risk assessments: Lessons from practice," Digit. Soc., vol. 1, no. 2, p. 14, 2022.
41. J. Huang, G. Galal, M. Etemadi, and M. Vaidyanathan, "Evaluation and mitigation of racial bias in clinical machine learning models: scoping review," JMIR Med. Inform., vol. 10, no. 5, p. e36388, 2022.
42. I. Mishkhal, N. Abdullah, H. H. Saleh, N. I. R. Ruhaiyem, and F. H. Hassan, "Facial Swap Detection Based on Deep Learning: Comprehensive Analysis and Evaluation," Iraqi Journal for Computer Science and Mathematics, vol. 6, no. 1, article 8, 2025, [Online]. Available: https://doi.org/10.52866/2788-7421.1229.
43. R. R. Fletcher, A. Nakeshimana, and O. Olubeko, "Addressing fairness, bias, and appropriate use of artificial intelligence and machine learning in global health," Front. Artif. Intell., vol. 3, p. 561802, 2021.
44. V. Shah and S. R. Konda, "Neural Networks and Explainable AI: Bridging the Gap between Models and Interpretability," Int. J. Comput. Sci. Technol., vol. 5, no. 2, pp. 163-176, 2021.
45. P. Thunki, S. R. B. Reddy, M. Raparthi, S. Maruthi, S. B. Dodda, and P. Ravichandran, "Explainable AI in Data Science-Enhancing Model Interpretability and Transparency," African J. Artif. Intell. Sustain. Dev., vol. 1, no. 1, pp. 1-8, 2021.
46. A. S. Albahri et al., "A systematic review of trustworthy and explainable artificial intelligence in healthcare: Assessment of quality, bias risk, and data fusion," Inf. Fusion, vol. 96, pp. 156-191, 2023.
47. M. Suffian and A. Bogliolo, "Investigation and Mitigation of Bias in Explainable AI," in CEUR Workshop Proceedings, 2022, pp. 89-94.
48. M. DeCamp and C. Lindvall, "Latent bias and the implementation of artificial intelligence in medicine," J. Am. Med. Inform. Assoc., vol. 27, no. 12, pp. 2020-2023, 2020.
49. L. Belenguer, "AI bias: exploring discriminatory algorithmic decision-making models and the application of possible machine-centric solutions adapted from the pharmaceutical industry," AI Ethics, vol. 2, no. 4, pp. 771-787, 2022.
50. H. Saleh and I. Hussein, "Enabling Smart Mobility with Connected and Intelligent Vehicles: The E-VANET Framework," in Proceedings of International Conference on Applied Innovation in IT, vol. 12, no. 2, Anhalt University of Applied Sciences, 2024.
51. P. Rouzrokh et al., "Mitigating bias in radiology machine learning: 1. Data handling," Radiol. Artif. Intell., vol. 4, no. 5, p. e210290, 2022.
52. J. W. Gichoya et al., "AI pitfalls and what not to do: mitigating bias in AI," Br. J. Radiol., vol. 96, no. 1150, p. 20230023, 2023.
53. M. Wan, D. Zha, N. Liu, and N. Zou, "In-processing modeling techniques for machine learning fairness: A survey," ACM Trans. Knowl. Discov. Data, vol. 17, no. 3, pp. 1-27, 2023.
54. S. Siddique, M. A. Haque, R. George, K. D. Gupta, D. Gupta, and M. J. H. Faruk, "Survey on machine learning biases and mitigation techniques," Digital, vol. 4, no. 1, pp. 1-68, 2023.
55. B. Koçak et al., "Bias in artificial intelligence for medical imaging: fundamentals, detection, avoidance, mitigation, challenges, ethics, and prospects," Diagn. Interv. Radiol., 2024.
56. I. Banerjee, "Bias in radiology artificial intelligence: causes, evaluation and mitigation," in Medical Imaging 2024: Image Processing, SPIE, 2024, p. 129260O.
57. L. H. Nazer et al., "Bias in artificial intelligence algorithms and recommendations for mitigation," PLOS Digit. Health, vol. 2, no. 6, p. e0000278, 2023.
58. M. Nauta et al., "From anecdotal evidence to quantitative evaluation methods: A systematic review on evaluating explainable ai," ACM Comput. Surv., vol. 55, no. 13s, pp. 1-42, 2023.
59. G. Curto and F. Comim, "SAF: Stakeholders’ Agreement on Fairness in the Practice of Machine Learning Development," Sci. Eng. Ethics, vol. 29, no. 4, p. 29, 2023.
60. B. Richardson and J. E. Gilbert, "A framework for fairness: A systematic review of existing fair AI solutions," arXiv Prepr. arXiv2112.05700, 2021, [Online]. Available: https://arxiv.org/abs/2112.05700.
61. S. Shrestha and S. Das, "Exploring gender biases in ML and AI academic research through systematic literature review," Front. Artif. Intell., vol. 5, p. 976838, 2022.
62. A. Limantė, "Bias in Facial Recognition Technologies Used by Law Enforcement: Understanding the Causes and Searching for a Way Out," Nord. J. Hum. Rights, vol. 42, no. 2, pp. 115-134, 2024.
63. T. Santiago, "AI bias: How does AI influence the executive function of business leaders?," Muma Bus. Rev., vol. 3, no. 16, pp. 181-192, 2019.
64. A. C. Timmons et al., "A call to action on assessing and mitigating bias in artificial intelligence applications for mental health," Perspect. Psychol. Sci., vol. 18, no. 5, pp. 1062-1096, 2023.
65. E. Ferrara, "The butterfly effect in artificial intelligence systems: Implications for AI bias and fairness," Mach. Learn. with Appl., vol. 15, p. 100525, 2024.
66. J. M. Alvarez et al., "Policy advice and best practices on bias and fairness in AI," Ethics Inf. Technol., vol. 26, no. 2, p. 31, 2024.
67. M. Soleimani, A. Intezari, and D. J. Pauleen, "Mitigating cognitive biases in developing AI-assisted recruitment systems: A knowledge-sharing approach," Int. J. Knowl. Manag., vol. 18, no. 1, pp. 1-18, 2022.
68. D. Dhinakaran, S. M. Sankar, D. Selvaraj, and S. E. Raja, “Privacy-Preserving Data in IoT-based Cloud Systems: A Comprehensive Survey with AI Integration,” arXiv Prepr. arXiv2401.00794, 2024.
69. S. Leavy, B. O’Sullivan, and E. Siapera, "Data, power and bias in artificial intelligence," arXiv Prepr. arXiv2008.07341, 2020, [Online]. Available: https://arxiv.org/abs/2008.07341.
70. B. Li et al., "Trustworthy AI: From principles to practices," ACM Comput. Surv., vol. 55, no. 9, pp. 1-46, 2023.
71. O. Akinrinola, C. C. Okoye, O. C. Ofodile, and C. E. Ugochukwu, "Navigating and reviewing ethical dilemmas in AI development: Strategies for transparency, fairness, and accountability," GSC Adv. Res. Rev., vol. 18, no. 3, pp. 50-58, 2024.
72. E. Ferrara, "Fairness and bias in artificial intelligence: A brief survey of sources, impacts, and mitigation strategies," Sci, vol. 6, no. 1, p. 3, 2023.