The visual representation of Amazonian peoples. A study on the biases of Generative Artificial Intelligence
Main Article Content
Abstract
Generative Artificial Intelligence (GAI) can create works by constantly learning from documents, data and alternative representations. However, some critics point out that its training starts from accessible materials that, in themselves, present numerous elements of subjectivity. Following in the wake of studies critical of the IAG, this research analyzes the images generated by the DALL-E and Runway platforms on the representation of Amazonian indigenous peoples to identify bias. Four hundred images were analyzed in terms of number of people, gender, age, geographic location and composition characteristics. The main results show that more than half of the images from both platforms presented images in which the geographic space could not be determined, and no image depicted an urban environment. These findings evidence biases towards Amazonian peoples, which may perpetuate symbolic constructions determined by the simplification, stereotyping and distortion of these people.
Article Details
Funding data
-
Ministerio de Ciencia e Innovación
Grant numbers PID2023-153339NA-100
References
Banks, Marcus y David Zeitlyn. 2015. Visual Methods in Social Research. London: SAGE.
Bazán-Gil, Virginia. 2023. “Artificial Intelligence Applications in Media Archives”. Profesional de la Informacion 32 (5). https://doi.org/10.3145/epi.2023.sep.17
Belhadi, Ahmed, Sachin Kamble, Samuel Fosso Wamba y Maciel M. Queiroz. 2022. “Building Supply-Chain Resilience: An Artificial Intelligence-Based Technique and Decision-Making Framework”. International Journal of Production Research 60 (14): 4487–4507. https://doi.org/10.1080/00207543.2021.1950935
Betker, James, Gabriel Goh, Li Jing, Tim Brooks, Jiao Wang, Lin Li, Long Ouyang, et al. 2023. “Improving Image Generation with Better Captions”. OpenAI. https://cdn.openai.com/papers/dall-e-3.pdf
Cao, Yang, Siyu Li, Yiting Liu, Zhiling Yan, Yifei Dai, Philip S. Yu, and Sun Lichao. 2023. “A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT”. arXiv. https://doi.org/10.48550/arxiv.2303.04226
Cochran, William G. 1977. Sampling Techniques. 3.ª ed. Nueva York: John Wiley & Sons.
Conwell, Colin y Tomer Ullman. 2023. “A Comprehensive Benchmark of Human-like Relational Reasoning for Text-to-Image Foundation Models”. Trabajo presentado en el Workshop on Understanding Foundation Models at ICLR 2023. https://osf.io/sm68h
Cowls, Josh, Andreas Tsamados, Mariarosaria Taddeo y Luciano Floridi. 2023. “The AI Gambit: Leveraging Artificial Intelligence to Combat Climate Change—Opportunities, Challenges, and Recommendations”. AI & Society 38 (1): 283–307. https://doi.org/10.1007/s00146-021-01294-x
Creswell, John W. 2009. Research Design: Qualitative, Quantitative and Mixed Approaches. 3.ª ed. Thousand Oaks, CA: SAGE.
Dancy, C. L. y P. K. Saucier. 2021. “AI and Blackness: Toward Moving Beyond Bias and Representation”. IEEE Transactions on Technology and Society 3 (1): 31–40. https://doi.org/10.1109/tts.2021.3125998
Davis-Delano, L. R., J. J. Folsom, V. McLaurin, A. E. Eason y S. A. Fryberg. 2021. “Representations of Native Americans in U.S. Culture? A Case of Omissions and Commissions”. The Social Science Journal. https://doi.org/10.1080/03623319.2021.1975086
Dhamija, P. y S. Bag. 2020. “Role of Artificial Intelligence in Operations Environment: A Review and Bibliometric Analysis”. The TQM Journal 32 (4): 869–96. https://doi.org/10.1108/TQM-10-2019-0243
Elasri, M., O. Elharrouss, S. Al-Maadeed y H. Tairi. 2022. “Image Generation: A Review”. Neural Processing Letters 54 (5): 4609–46. https://doi.org/10.1007/s11063-022-10777-x
Espinosa, Oscar. 2021. “La Amazonía y sus pueblos indígenas: desafíos en el contexto del bicentenario”. En 2021: Las elecciones y el bicentenario ¿Oportunidades desperdiciadas o aprovechadas?, editado por M. Tanaka, 97–102. Lima, Perú: Fondo Editorial PUCP.
______. 2009a. “Los pueblos indígenas de la Amazonia Peruana y el uso político de los medios de comunicación”. América Latina Hoy 19: 123–68. https://doi.org/10.14201/alh.2258
______. 2009b. “¿Salvajes opuestos al progreso?: aproximaciones históricas y antropológicas a las movilizaciones indígenas en la Amazonía peruana”. Anthropologica del Departamento de Ciencias Sociales 27: 123–68. https://doi.org/10.18800/anthropologica.200901.006
Esposito, P., P. Atighehchian, A. Germanidis y D. Ghadiyaram. 2023. “Mitigating Stereotypical Biases in Text to Image Generative Systems”. arXiv. http://arxiv.org/abs/2310.06904
Fletcher, R. R., A. Nakeshimana y O. Olubeko. 2021. “Addressing Fairness, Bias, and Appropriate Use of Artificial Intelligence and Machine Learning in Global Health”. Frontiers in Artificial Intelligence 3. https://doi.org/10.3389/frai.2020.561802
Fountain, Jane E. 2022. “The Moon, the Ghetto and Artificial Intelligence: Reducing Systemic Racism in Computational Algorithms”. Government Information Quarterly 39 (2). https://doi.org/10.1016/j.giq.2021.101645
Franganillo, Jorge. 2022. “Contenido generado por inteligencia artificial: oportunidades y amenazas”. Anuario ThinkEPI 16. https://doi.org/10.3145/thinkepi.2022.e16a24
García-Peñalvo, Francisco J., F. Llorens-Largo y J. Vidal. 2024. “The New Reality of Education in the Face of Advances in Generative Artificial Intelligence”. RIED-Revista Iberoamericana de Educación a Distancia 27 (1): 9–39. https://doi.org/10.5944/ried.27.1.37716
García-Ull, Francisco J. y M. M. Lázaro. 2023. “Gender Stereotypes in AI-Generated Images”. Profesional de la Información 32 (5). https://doi.org/10.3145/epi.2023.sep.05
Getchell, K. M., S. Carradini, P. W. Cardon, C. Fleischmann, H. Ma, J. Aritz y J. Stapp. 2022. “Artificial Intelligence in Business Communication: The Changing Landscape of Research and Teaching”. Business and Professional Communication Quarterly 85 (1): 7–33. https://doi.org/10.1177/23294906221074311
Gomes, L. B., Silva, D. R. Q., & Casagrande, C. A. 2020. “A representação dos povos indígenas contemporâneos nos livros didáticos”. Arquivos Analíticos de Políticas Educativas 28 (75): 1–13. https://doi.org/10.14507/epaa.28.4754
Gorska, Anna M. y Dariusz Jemielniak. 2023. “The Invisible Women: Uncovering Gender Bias in AI-Generated Images of Professionals”. Feminist Media Studies. https://doi.org/10.1080/14680777.2023.2263659
Gunkel, David J. 2023. “Duty Now and for the Future: Communication, Ethics and Artificial Intelligence”. Journal of Media Ethics 38 (4): 198–210. https://doi.org/10.1080/23736992.2023.2264854
Guzmán Zamora, F. y Miquel Rodrigo Alsina. 2019. “El ‘Baguazo’ en el discurso periodístico peruano. Un análisis crítico de los medios durante el conflicto amazónico de 2009”. Estudios Sobre El Mensaje Periodístico 25 (2): 853–67. https://doi.org/10.5209/esmp.64813
Hall, Stuart. 1997. Representation: Cultural Representations and Signifying Practices. Thousand Oaks, CA: Sage.
Hernández Sampieri, Roberto, Carlos Fernández Collado y María del Pilar Baptista Lucio. 2014. Metodología de la investigación. 6.ª ed. Ciudad de México: McGraw-Hill Interamericana.
Jain, H., R. Dhupper, A. Shrivastava, D. Kumar y M. Kumari. 2023. “AI-Enabled Strategies for Climate Change Adaptation: Protecting Communities, Infrastructure, and Businesses from the Impacts of Climate Change”. Computational Urban Science 3 (1): 25–17. https://doi.org/10.1007/s43762-023-00100-2
Jobin, Anna, Marcello Ienca y Effy Vayena. 2019. “The Global Landscape of AI Ethics Guidelines”. Nature Machine Intelligence 1 (9): 389–99. https://doi.org/10.1038/s42256-019-0088-2
Kasirzadeh, Atoosa e Iason Gabriel. 2023. “In Conversation with Artificial Intelligence: Aligning Language Models with Human Values”. Philosophy & Technology 36 (2). https://doi.org/10.1007/s13347-023-00606-x
Kress, Gunther R. y Theo van Leeuwen. 2021 . Reading Images: The Grammar of Visual Design. 3.ª ed. Londres: Routledge.
Krippendorff, Klaus. 2018. Content Analysis: An Introduction to Its Methodology. 4.ª ed. Thousand Oaks, CA: Sage Publishing.
Lencina, R., R. Pereyra y E. Alonso. 2023. “Sobre la «arena de lucha» mediática en torno a las poblaciones indígenas en Argentina”. Desde el Sur 15 (2): e0025. https://doi.org/10.21142/des-1502-2023-0025
Lopezosa, Carlos, Lluís Codina, Carles Pont-Sorribes y Mari Vállez. 2023. “Use of Generative Artificial Intelligence in the Training of Journalists: Challenges, Uses and Training Proposal”. Profesional de la Información 32 (4). https://doi.org/10.3145/epi.2023.jul.08
Marinucci, L., C. Mazzuca y A. Gangemi. 2023. “Exposing Implicit Biases and Stereotypes in Human and Artificial Intelligence: State of the Art and Challenges with a Focus on Gender”. AI & Society 38 (2): 747–61. https://doi.org/10.1007/s00146-022-01474-3
Mbalaka, B. 2023. “Epistemically Violent Biases in Artificial Intelligence Design: The Case of DALLE-E 2 and Starry AI”. Digital Transformation and Society 2 (4): 376–402. https://doi.org/10.1108/dts-01-2023-0003
Mehrabi, N., F. Morstatter, N. Saxena, K. Lerman y A. Galstyan. 2019. “A Survey on Bias and Fairness in Machine Learning”. arXiv. http://arxiv.org/abs/1908.09635
Metz, Cade. 4 de abril de 2023. “Instant Videos Could Represent the Next Leap in A.I. Technology”. The New York Times. https://www.nytimes.com/2023/04/04/technology/runway-ai-videos.html
Miranda Beltrán, S. y J. A. Ortiz Bernal. 2020. “Los paradigmas de la investigación: un acercamiento teórico para reflexionar desde el campo de la investigación educativa”. RIDE Revista Iberoamericana para la Investigación y el Desarrollo Educativo 11 (21). https://doi.org/10.23913/ride.v11i21.717
Morales, R. A., D. Kumar Sunuwar y C. Veran. 2021. “Building Global Indigenous Media Networks: Envisioning Sustainable and Regenerative Futures around Indigenous Peoples’ Meaningful Representation”. Humanities 10 (3). https://doi.org/10.3390/h10030104
Nguyen, A., H. N. Ngo, Y. Hong, B. Dang y B. P. T. Nguyen. 2023. “Ethical Principles for Artificial Intelligence in Education”. Education and Information Technologies 28 (4): 4221–41. https://doi.org/10.1007/s10639-022-11316-w
Olier, J. S. y C. Spadavecchia. 2022. “Stereotypes, Disproportions, and Power Asymmetries in the Visual Portrayal of Migrants in Ten Countries: An Interdisciplinary AI-Based Approach”. Humanities and Social Sciences Communications 9 (1). https://doi.org/10.1057/s41599- 022-01430-y
OpenAI. 2023. DALL·E 3 System Card. https://cdn.openai.com/papers/DALL_E_3_System_Card.pdf
______. 2024. “DALL·E 2”. Consultado el 18 de febrero de 2024. https://openai.com/index/dall-e-2/
Peters, Uwe. 2022. “Algorithmic Political Bias in Artificial Intelligence Systems”. Philosophy & Technology 35 (2). https://doi.org/10.1007/s13347-022-00512-8
Purschke, Christoph. 2021. “Cultural Representation in Luxembourgish Street Naming Practices”. Linguistics Vanguard 7 (s5). https://doi.org/10.1515/lingvan-2021-0003
QuestionPro. s.f. “Calculadora de tamaño de muestra”. Consultado el 19 de marzo de 2024. https://www.questionpro.com/es/calculadora-de-muestra.html
Ricoy, Carmen. 2006. “Contribución sobre los paradigmas de investigación”. Educação. Revista do Centro de Educação 31 (1): 11–22.
Rose, Gillian. 2016. Visual Methodologies: An Introduction to Researching with Visual Materials. 4.ª ed. Londres: SAGE.
Rubio, G. A. E. 2022. “Los Barí y los Uwa en la prensa. Una apuesta para la educación intercultural”. Revista Boletín Redipe 11 (2): 74–86. https://doi.org/10.36260/rbr.v11i2.1669
Runway. s.f. “Content Moderation Guidelines”. Consultado el 18 de marzo de 2024. https://help.runwayml.com/hc/en-us/articles/21745792516371
Runway AI. 2024. “Runway (Text-to-Image)”. Consultado el 21 de febrero de 2024. https://runwayml.com/ai-tools/text-to-image/
Ryan, Mark y Bernd Carsten Stahl. 2021. “Artificial Intelligence Ethics Guidelines for Developers and Users: Clarifying Their Content and Normative Implications”. Journal of Information, Communication and Ethics in Society 19 (1): 61–86. https://doi.org/10.1108/ JICES-12-2019-0138
Saura Sánchez, José. 2008. “El discurso mediático y sus consecuencias para la interculturalidad”. Discurso & Sociedad 2 (4): 816–838.
Thomas, Ryan J. y T. J. Thomson. 2023. “What Does a Journalist Look Like? Visualizing Journalistic Roles Through AI”. Digital Journalism. https://doi.org/10.1080/21670811.2023.2229883
Van Dijk, Teun A. 2009. Discurso y poder. Barcelona: Gedisa.
Vicente, Lucía y Helena Matute. 2023. “Humans Inherit Artificial Intelligence Biases”. Scientific Reports 13 (1). https://doi.org/10.1038/s41598-023-42384-8
Walker, R., J. Dillard-Wright y F. Iradukunda. 2023. “Algorithmic Bias in Artificial Intelligence Is a Problem—And the Root Issue Is Power”. Nursing Outlook 71 (5). https://doi.org/10.1016/j.outlook.2023.102023
Wang, Y., Y. Pan, M. Yan, Z. Su y T. H. Luan. 2023. “A Survey on ChatGPT: AI-Generated Contents, Challenges, and Solutions”. IEEE Open Journal of the Computer Society 4: 280–302. https://doi.org/10.1109/OJCS.2023.3300321
Weber, Robert Philip. 1990. Basic Content Analysis. 2.ª ed. Thousand Oaks, CA: Sage.
Yanev, Martin. 2023. Building AI Applications with ChatGPT APIs. Birmingham: Packt Publishing Ltd.
https://orcid.org/0009-0000-0733-9873