Publication:
Representation of intensivists' race/ethnicity, sex, and age by artificial intelligence: a cross-sectional study of two text-to-image models.

cris.virtualsource.author-orcid95931ae7-b5ea-4129-9ca1-b2097da37724
datacite.rightsopen.access
dc.contributor.authorGisselbaek, Mia
dc.contributor.authorSuppan, Mélanie
dc.contributor.authorMinsart, Laurens
dc.contributor.authorKöselerli, Ekin
dc.contributor.authorNainan Myatra, Sheila
dc.contributor.authorMatot, Idit
dc.contributor.authorBarreto Chang, Odmara L
dc.contributor.authorSaxena, Sarah
dc.contributor.authorBerger-Estilita, Joana
dc.date.accessioned2024-12-11T14:19:52Z
dc.date.available2024-12-11T14:19:52Z
dc.date.issued2024-11-11
dc.description.abstractBackground Integrating artificial intelligence (AI) into intensive care practices can enhance patient care by providing real-time predictions and aiding clinical decisions. However, biases in AI models can undermine diversity, equity, and inclusion (DEI) efforts, particularly in visual representations of healthcare professionals. This work aims to examine the demographic representation of two AI text-to-image models, Midjourney and ChatGPT DALL-E 2, and assess their accuracy in depicting the demographic characteristics of intensivists.Methods This cross-sectional study, conducted from May to July 2024, used demographic data from the USA workforce report (2022) and intensive care trainees (2021) to compare real-world intensivist demographics with images generated by two AI models, Midjourney v6.0 and ChatGPT 4.0 DALL-E 2. A total of 1,400 images were generated across ICU subspecialties, with outcomes being the comparison of sex, race/ethnicity, and age representation in AI-generated images to the actual workforce demographics.Results The AI models demonstrated noticeable biases when compared to the actual U.S. intensive care workforce data, notably overrepresenting White and young doctors. ChatGPT-DALL-E2 produced less female (17.3% vs 32.2%, p < 0.0001), more White (61% vs 55.1%, p = 0.002) and younger (53.3% vs 23.9%, p < 0.001) individuals. While Midjourney depicted more female (47.6% vs 32.2%, p < 0.001), more White (60.9% vs 55.1%, p = 0.003) and younger intensivist (49.3% vs 23.9%, p < 0.001). Substantial differences between the specialties within both models were observed. Finally when compared together, both models showed significant differences in the Portrayal of intensivists.Conclusions Significant biases in AI images of intensivists generated by ChatGPT DALL-E 2 and Midjourney reflect broader cultural issues, potentially perpetuating stereotypes of healthcare worker within the society. This study highlights the need for an approach that ensures fairness, accountability, transparency, and ethics in AI applications for healthcare.
dc.description.sponsorshipInstitut für Medizinische Lehre, Assessment und Evaluation, Forschung / Evaluation
dc.identifier.doi10.48620/77412
dc.identifier.pmid39529104
dc.identifier.publisherDOI10.1186/s13054-024-05134-4
dc.identifier.urihttps://boris-portal.unibe.ch/handle/20.500.12422/189625
dc.language.isoen
dc.publisherBioMed Central
dc.relation.ispartofCritical Care
dc.relation.issn1466-609X
dc.relation.issn1364-8535
dc.subjectArtificial intelligence (AI)
dc.subjectBias
dc.subjectDemographic representation
dc.subjectEquity and inclusion (DEI)
dc.subjectIntensive care
dc.titleRepresentation of intensivists' race/ethnicity, sex, and age by artificial intelligence: a cross-sectional study of two text-to-image models.
dc.typearticle
dspace.entity.typePublication
dspace.file.typetext
oaire.citation.issue1
oaire.citation.startPage363
oaire.citation.volume28
oairecerif.author.affiliationInstitut für Medizinische Lehre, Assessment und Evaluation, Forschung / Evaluation
unibe.contributor.roleauthor
unibe.contributor.roleauthor
unibe.contributor.roleauthor
unibe.contributor.roleauthor
unibe.contributor.roleauthor
unibe.contributor.roleauthor
unibe.contributor.roleauthor
unibe.contributor.roleauthor
unibe.contributor.rolecorresponding author
unibe.description.ispublishedpub
unibe.refereedtrue
unibe.subtype.articlejournal

Files

Original bundle
Now showing 1 - 1 of 1
Name:
s13054-024-05134-4.pdf
Size:
1.17 MB
Format:
Adobe Portable Document Format
File Type:
text
License:
https://creativecommons.org/licenses/by-nc-nd/4.0
Content:
published

Collections