Proceedings of International Conference on Applied Innovation in IT
2023/11/30, Volume 11, Issue 2, pp.67-73

Demographic Bias in Medical Datasets for Clinical AI


Bojana Velichkovska, Sandra Petrushevska, Bisera Runcheva and Marija Kalendar


Abstract: Numerous studies have detailed instances of demographic bias in medical data and artificial intelligence (AI) systems used in medical setting. Moreover, these studies have also shown how these biases can significantly impact the access to and quality of care, as well as quality of life for patients belonging in certain under-represented groups. These groups are then being marginalised because of stigma based on demographic information such as race, gender, age, ability, and so on. Since the performance of AI models is highly dependent on the quality of data used to train the algorithms, it is a necessary precaution to analyse any potential bias inadvertently existent in the data, in order to mitigate the consequences of using biased data in creating medical AI systems. For that reason, we propose a machine learning (ML) analysis which receives patient biosignals as input information and analyses them for two types of demographic bias, namely gender and age bias. The analysis is performed using several ML algorithms (Logistic Regression, Decision Trees, Random Forest, and XGBoost). The trained models are evaluated with a holdout technique and by observing the confusion matrixes and the classification reports. The results show that the models are capable of detecting bias in data. This makes the proposed approach one way to identify bias in data, especially throughout the process of building AI-based medical systems. Consequently, the proposed pipeline can be used as a mitigation technique for bias analysis in data.

Keywords: Artificial Intelligence, Machine Learning, Gender Bias, Age Bias, Demographic Bias, Medical Datasets.

DOI: 10.25673/112995

Download: PDF

References:

  1. J.A. Sabin, “Tackling implicit bias in health care,” N. Engl. J. Med. 2022, vol. 387, pp. 105-107, July 2022.
  2. J.R. Marcelin, D.S. Siraj, R. Victor, S. Kotadia, and Y.A. Maldonado, “The impact of unconscious bias in healthcare: how to recognize and mitigate it,” The Journal of Infectious Diseases, vol. 220, issue Supplement_2, pp. S62-S73, September 2019.
  3. J.C. Lester, S.C. Taylor, and M.M. Chren, “Under‐representation of skin of colour in dermatology images: not just an educational issue,” British Journal of Dermatology, vol. 180, no. 6, pp. 1521-1522, June 2019.
  4. American Cancer Society, “Cancer Facts and Figures 2023,”. [Online]. Available: https://www.cancer.org/ content/dam/cancer-org/research/cancer-facts-and-statistics/annual-cancer-facts-and-figures/2023/2023-cancer-facts-and-figures.pdf, [Accessed on Sep. 24, 2023].
  5. J.F. Dovidio, S. Eggly, T.L. Albrecht, N. Hagiwara, and L.A. Penner, “Racial biases in medicine and healthcare disparties,” TPM, vol. 23, no. 4, pp. 489-510, December 2016.
  6. L. VanPuymbrouck, C. Friedman, and H.A. Feldner, “Explicit and implicit disability attitudes of healthcare providers,” Rehabilitation Psychology, vol. 65, no. 2, February 2020.
  7. A. Dugravot, A. Fayosse, J. Dumurgier, K. Bouillon, T.B. Rayana, A. Schnitzler, Prof. M. Kivimaki, S. Sabia, and Prof. A. Singh-Manoux, “Social inequalities in multimorbidity, frailty, disability, and transitions to mortality: a 24-year follow-up of the Whitehall II cohort study,” The Lancet Public Health, vol. 5, issue 1, pp. E42-E50, January 2020.
  8. H.R. Burstin, S.R. Lipsitz, and T.A. Brennan, “Socioeconomic status and risk for substandard medical care,” JAMA., vol. 268, issue 17, pp. 2383-7, November 1992.
  9. A. Samulowitz, I. Gremyr, E. Eriksson, and G. Hensing, “”Brave men” and “emotional women”: A theory-guided literature review on gender bias in health care and gendered norms towards patients with chronic pain,” Pain Res. Manag., vol. 2018, pp. 6358624, February 2018.
  10. D. Westergaard, P. Moseley, F.К. Hemmingsen Sørup , P. Baldi, and S. Brunak, “Population-wide analysis of differences in disease progression patterns in men and women,” Nat. Commun., vol. 10, no. 1, pp. 666, February 2019.
  11. B.N. Greenwood, S. Carnahan, and L. Huang, “Patient–physician gender concordance and increased mortality among female heart attack patients,” Proc. Natl. Acad. Sci. U S A, vol. 115, no. 34, pp. 8569-8574, August 2018.
  12. A. Ben-Harush, S. Shiovitz-Ezra, I. Doron, S. Alon, A. Leibovitz, H. Golander, Y. Haron, and L. Ayalon, “Ageism among physicians, nurses, and social workers: findings from a qualitative study,” Eur. J. Ageing, vol. 14, no. 1, pp. 39-48, March 2017.
  13. Z. Obermeyer, B. Powers, C. Vogeli, and S. Mullainathan, “Dissecting racial bias in an algorithm used to manage the health of populations,” Science, vol. 366, no. 6464, pp. 447-453, October 2019.
  14. L. Seyyed-Kalantari, G. Liu, M. McDermott, I.Y. Chen, and M. Ghassemi, “CheXclusion: Fairness gaps in deep chest X-ray classifiers,” Pac. Symp. Biocomput., vol. 26, pp. 232-243, 2021.
  15. R. Lutz, Incident Number 110. In McGregor, S. (ed.) Artificial Intelligence Incident Database, Responsible AI Collaborative, 2023.
  16. A.J. Larrazabal, N. Nieto, V. Peterson, D.H. Milone, and E. Ferrante, “Gender imbalance in medical imaging datasets produces biased classifiers for computer-aided diagnosis,” Proc. Natl. Acad. Sci. U S A, vol. 117, no. 23, pp. 12592-12594, May 2020.
  17. Sklearn, “Classification report,”. [Online]. Available: https://scikit-learn.org/stable/modules/generated/ sklearn.metrics.classification_report.html, [Accessed on Sep. 24, 2023].
  18. Sklearn, “Confusion matrix,”. [Online]. Available: https://scikit-learn.org/stable/modules/generated/sklearn.metrics.confusion_matrix.html?fbclid=IwAR2TABvX6ymzxMD1Db7cV-wzNOFI6WzifcZHQez4FrVj0f6iCWv9RZON8es, [Accessed on Sep. 24, 2023].
  19. K. Prabhavathi, K.T. Selvi, K.N. Poornima, and A. Sarvanan, “Role of Biological Sex in Normal Cardiac Function and in its Disease Outcome – A Review,” Journal of Clinical and Diagnostic Research, vol. 8, no. 8, pp. BE01–BE04, August 2014.
  20. A. LoMauro, and A. Aliverti, “Sex differences in respiratory function,” Breathe (Sheff), vol. 14, no. 2, pp. 131-140, June 2018.
  21. R. Maranon, and J.F. Reckelhoff, “Sex and Gender Differences in Control of Blood Pressure,” Clinical Science, vol. 125, no.7, pp. 311-318, October 2013.
  22. C.E. Boeke, M.E. Pauly, H.H. Stock, S. Pavlis, and J. B. Jackson, “The association of gender, age, body mass index, and vital signs in healthy plateletapheresis donors,” Transfusion and Apheresis Science, vol. 41, no.3, pp. 175-178, December 2009.
  23. M. Erbilek, M. Fairhurst, and M.C.D.C. Abreu, “Age Prediction from Iris Biometrics,” IET, December 2013.
  24. M. Rajput, and G. Sable, “Deep Learning Based Gender and Age Estimation from Human Iris,”, SSRN Electronic Journal, June 2019.
  25. B. Velichkovska, H. Gjoreski, D. Denkovski, M. Kalendar, B. Mamandipoor, L.A. Celi, and V. Osmani, “Vital signs as a source of racial bias,” medRxiv, February 2022.
  26. H.C. Lee, Y. Park, S.B. Yoon, S.M. Yang, D. Park, and C.W. Jung, “VitalDB, a high-fidelity multi-parameter vital signs database in surgical patients,” Sci. Data, vol. 9, no. 1, pp. 279, June 2022.
  27. Tsfresh, “tsfresh,”. [Online]. Available: https://tsfresh.readthedocs.io/en/latest/, [Accessed on Sep. 24, 2023].
  28. Sklearn, “Logistic regression,”. [Online]. Available: https://scikit-learn.org/stable/modules/generated/ sklearn.linear_model.LogisticRegression.html, [Accessed on Sep. 24, 2023].
  29. Sklearn, “Decision Trees,”. [Online]. Available: https://scikit-learn.org/stable/modules/tree.html# decision-trees, [Accessed on Sep. 24, 2023].
  30. Sklearn, “Random Forest,”. [Online]. Available: https://scikit-learn.org/stable/modules/generated/ sklearn.ensemble.RandomForestClassifier.html, [Accessed on Sep. 24, 2023].
  31. XGBoost, “XGBoost Documentation,”. [Online]. Available: https://xgboost.readthedocs.io/en/stable/?fbclid=IwAR0s6F9c8B3SFqZ6hvn81OhByL0e-a00h06g8rnRSUEzrUkYdGqXPd-1Yq4, [Accessed on Sep. 24, 2023].
  32. J.F. Reckelhoff, “Gender differences in the regulation of blood pressure,” Hypertension, vol. 37, no. 5, pp. 1199-1208, May 2001.
  33. J.L. Lapum, M. Verkuyl, W. Garcia, O. St-Amant, and An. Tan, Vital sign measurement across the lifespan, 1st Canadian ed., Ryerson University, 2018, pp. 123-124.
  34. M.R. Hamczyk, R.M. Nevado, A. Barettino, V. Fuster, and V. Andrés, “Biological versus chronological aging,” J. Am. Coll. Cardiol., vol. 75, no. 8, pp. 919-930, March 2020.

    HOME

       - Call for Papers
       - Paper Submission
       - For authors
       - Important Dates
       - Conference Committee
       - Editorial Board
       - Reviewers
       - Last Proceedings


    PROCEEDINGS

       - Volume 12, Issue 1 (ICAIIT 2024)        - Volume 11, Issue 2 (ICAIIT 2023)
       - Volume 11, Issue 1 (ICAIIT 2023)
       - Volume 10, Issue 1 (ICAIIT 2022)
       - Volume 9, Issue 1 (ICAIIT 2021)
       - Volume 8, Issue 1 (ICAIIT 2020)
       - Volume 7, Issue 1 (ICAIIT 2019)
       - Volume 7, Issue 2 (ICAIIT 2019)
       - Volume 6, Issue 1 (ICAIIT 2018)
       - Volume 5, Issue 1 (ICAIIT 2017)
       - Volume 4, Issue 1 (ICAIIT 2016)
       - Volume 3, Issue 1 (ICAIIT 2015)
       - Volume 2, Issue 1 (ICAIIT 2014)
       - Volume 1, Issue 1 (ICAIIT 2013)


    PAST CONFERENCES

       ICAIIT 2024
         - Photos
         - Reports

       ICAIIT 2023
         - Photos
         - Reports

       ICAIIT 2021
         - Photos
         - Reports

       ICAIIT 2020
         - Photos
         - Reports

       ICAIIT 2019
         - Photos
         - Reports

       ICAIIT 2018
         - Photos
         - Reports

    ETHICS IN PUBLICATIONS

    ACCOMODATION

    CONTACT US

 

DOI: http://dx.doi.org/10.25673/115729


        

         Proceedings of the International Conference on Applied Innovations in IT by Anhalt University of Applied Sciences is licensed under CC BY-SA 4.0


                                                   This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License


           ISSN 2199-8876
           Publisher: Edition Hochschule Anhalt
           Location: Anhalt University of Applied Sciences
           Email: leiterin.hsb@hs-anhalt.de
           Phone: +49 (0) 3496 67 5611
           Address: Building 01 - Red Building, Top floor, Room 425, Bernburger Str. 55, D-06366 Köthen, Germany

        site traffic counter

Creative Commons License
Except where otherwise noted, all works and proceedings on this site is licensed under Creative Commons Attribution-ShareAlike 4.0 International License.