Exploring Historical Biases in ChatGPT: Regional Variation in AI-Generated Responses about Conwy Castle

Iarovoi, Dmitrii and Teh, Phoey Lee (2026) Exploring Historical Biases in ChatGPT: Regional Variation in AI-Generated Responses about Conwy Castle. In: 8th International Conference on Emerging Technologies in Computing (iCETiC 2025), 10-11 July 2025, Newport.

[img] Text
WURO_Exploring Historical Biases.pdf
Restricted to Repository staff only until 27 August 2027.
Available under License Creative Commons Attribution.

Download (684kB) | Request a copy

Abstract

This study investigates historical bias in responses from ChatGPT, specifically examining how output varies according to geographical context. Simulating a scenario in which a visitor to a heritage site uses a mobile version of ChatGPT, we posed a historical question about Conwy Castle, framed for four regional identities: Wales, England, France, and Ireland. A total of 1,000 responses were generated via the ChatGPT-4.1 API and analysed using cosine similarity and word classification. The key findings reveal significant narrative divergence: responses framed for Welsh users were substantially more likely to affirm a change in historical perspective (a ‘Yes’ response in 36.3% of cases), compared with those for English users (a ‘No’ response in 41.3% of cases). While overall semantic similarity between the original and region-specific answers remained high (mean scores ranging from 0.783 to 0.812), the qualitative shifts in framing indicate a consistent pattern of regional bias. These results highlight the critical need for scrutiny when deploying large language models (LLMs) in heritage contexts, where they can subtly influence the interpretation of contested histories.

Item Type: Conference or Workshop Item (Paper)
Divisions: Applied Science, Computing and Engineering
Depositing User: Emma Harrison
Date Deposited: 10 Nov 2026 09:15
Last Modified: 10 Nov 2026 09:15
URI: https://wrexham.repository.guildhe.ac.uk/id/eprint/18486

Actions (login required)

Edit Item Edit Item