Skip to Main Content

ChatGPT and Generative Artificial Intelligence (AI): Potential for bias based on prompt

Potential for bias in ChatGPT’s output based on the prompt

The issue

When doing research using traditional Library resources (such as the catalogue or databases), you may find resources by combining keywords, Boolean operators, and using facets that filter data. The output is usually a list of resources that you need to look through and identify those that are most relevant to your research question.

By contrast, ChatGPT takes prompts using natural language and the responses tend to be less focused on identifying specific resources and more on summarizing information. For this reason, special attention should be paid to the wording used in the prompt, as it could bias the type of reply obtained.

Example: Potential for bias in ChatGPT's output based on the prompt

In the following examples, similar related questions were asked of ChatGPT, each with different wording:

  1. In this example, there is bias in the prompt itself, by assuming that socially assistive robots are an effective treatment for older adults with dementia. Accordingly, ChatGPT’s reply lists reasons why this is the case.
    ChatGPT screen capture 1. Transcript available.
  2. The second prompt is more neutral, asking about whether or not socially assistive robots are an effective treatment for older adults with dementia, rather than assuming that they are. While the prompt itself is general in nature and open to both pros and cons, the response is generally more in favour of positive applications of socially assistive robots.
    ChatGPT screen capture 2. Transcript available.
  3. The third prompt is more balanced, asking specifically for both benefits and drawbacks. In this way, we ensure that ChatGPT’s response considers both sides of the question equally.
    ChatGPT screen capture 3. Transcript available.

Considerations

  • ChatGPT generated output for all three prompts. However, the replies changed depending on how the original question was formulated.
  • When using ChatGPT, it is important to consider bias in the prompt’s wording, as well as the impact that may have in the resulting output.
  • Trying different prompts is one way to obtain additional perspectives on a topic.
  • Even if the wording of the prompt is neutral, attention should be paid to the output generated by ChatGPT.
  • The responses generated in the above examples are not specifically based on scholarly or peer reviewed resources. While this text can be used as a starting point, additional research would be needed to identify specific resources that support or disprove the claims suggested by ChatGPT.

Screen capture transcripts: potential for bias in ChatGPT's output based on the prompt

ChatGPT screen capture 1 transcript

[Prompt]

Explain why socially assistive robots are an effective treatment for older adults with dementia.

[Reply]

Socially assistive robots (SARs) are a type of robot designed to provide social and emotional support to people. They are being increasingly used as a treatment option for older adults with dementia, and there are several reasons why they can be effective:

  1. Enhancing social interaction: SARs can engage older adults with dementia in social interaction, which is known to improve cognitive function and mental well-being. SARs can provide companionship, play games, or engage in conversation, which can help older adults feel less lonely and more connected to the world around them.
  2. Reducing agitation and anxiety: Many older adults with dementia experience agitation and anxiety, which can be distressing for both them and their caregivers. Studies have shown that SARs can help to reduce these symptoms, as they provide a calming and predictable presence that can help to soothe older adults with dementia.
  3. Providing cognitive stimulation: SARs can be programmed to provide cognitive stimulation, which can help to maintain cognitive function in older adults with dementia. For example, SARs can be used to play memory games, or to provide reminders for daily tasks, such as taking medication.
  4. Improving mood and quality of life: By providing social interaction, reducing agitation and anxiety, and providing cognitive stimulation, SARs can help to improve the overall mood and quality of life of older adults with dementia. This can lead to improved well-being and greater independence, which can be particularly important for older adults who may be struggling to cope with the challenges of dementia.

In summary, socially assistive robots can be an effective treatment option for older adults with dementia because they can provide social interaction, reduce agitation and anxiety, provide cognitive stimulation, and improve mood and quality of life.

ChatGPT screen capture 2 transcript

[Prompt]

Are socially assistive robots an effective treatment for older adults with dementia?

[Reply]

There is growing evidence to suggest that socially assistive robots (SARs) can be an effective treatment for older adults with dementia. Studies have shown that SARs can help to improve social interaction, reduce agitation and anxiety, provide cognitive stimulation, and improve overall mood and quality of life for people with dementia.
For example, one study published in the journal "Alzheimer's & Dementia" found that using a SAR called "Paro" (a robotic baby seal) improved the mood and reduced anxiety in older adults with dementia. Another study published in the journal "International Psychogeriatrics" found that SARs could help to reduce agitation and improve social interaction in people with dementia.
It's important to note that SARs are not a replacement for human caregivers or medical treatment for dementia. However, they can be a useful addition to a care plan, particularly in cases where older adults may be socially isolated or have difficulty engaging in traditional forms of therapy.
Overall, while more research is needed to fully understand the potential benefits of SARs for older adults with dementia, current evidence suggests that they can be an effective and valuable treatment option.

ChatGPT screen capture 3 transcript

[Prompt]

What are the benefits and drawbacks of socially assistive robots as a treatment for older adults with dementia?

[Reply]

There are both benefits and drawbacks to using socially assistive robots (SARs) as a treatment for older adults with dementia. Here are some of the main advantages and disadvantages:
Benefits:

  1. Social interaction: SARs can provide older adults with dementia with companionship and social interaction, which can help to reduce loneliness and feelings of isolation.
  2. Cognitive stimulation: SARs can be programmed to provide cognitive stimulation, such as playing games or providing reminders for daily tasks, which can help to maintain cognitive function and prevent cognitive decline.
  3. Reduced agitation and anxiety: Studies have shown that SARs can help to reduce agitation and anxiety in people with dementia, providing a calming and predictable presence that can help to soothe older adults with dementia.
  4. Improved mood and quality of life: By providing social interaction, reducing agitation and anxiety, and providing cognitive stimulation, SARs can help to improve the overall mood and quality of life of older adults with dementia.

Drawbacks:

  1. Cost: SARs can be expensive, which may limit their availability for older adults who cannot afford them or whose care is covered by insurance.
  2. Technical issues: SARs can experience technical issues, such as malfunctioning or requiring maintenance, which may disrupt their use in treatment.
  3. Ethics and privacy concerns: The use of SARs raises ethical and privacy concerns regarding the collection and use of personal data of older adults, as well as the possibility of emotional attachment to a machine that may not be able to reciprocate the same emotional response.
  4. Limitations in social interaction: SARs may not be able to fully replicate the complexity and nuance of social interactions between humans, which may limit their ability to provide older adults with dementia with a sense of genuine companionship.

In conclusion, while socially assistive robots can provide many benefits as a treatment for older adults with dementia, there are also drawbacks to their use that need to be considered. It is important for caregivers and healthcare providers to weigh the benefits and drawbacks carefully before introducing SARs into a care plan for a person with dementia.