Identifying Ethical Considerations for AI Agents in Mental Health Support: A Collaborative Moral Imagination Workshop

Presentation Time: 08:30 AM - 11:30 AM

Abstract Keywords: Legal, Ethical, Social and Regulatory Issues, Artificial Intelligence, Large Language Models (LLMs), Education and Training
Working Group: Ethical, Legal, and Social Issues Working Group
Primary Track: Policy
Programmatic Theme: Consumer Health Informatics

Artificial intelligence (AI) chatbots are increasingly used by people as a replacement for, or a supplement to, mental health support historically provided by a professional. These chatbots offer convenience and availability but are also accompanied by risks of harm. This workshop would employ Moral Imagination, an approach that has been used successfully with technology teams at Google and other technology-focused venues. Moral Imagination is a method of values clarification and consequences envisioned through group exercises that help participants think through the potential ethical and societal impacts of their work while clarifying and communicating their own underlying values. This Moral Imagination workshop, tailored to an AMIA audience, will consist of interactive activities, group discussions, and facilitated role-playing scenarios, allowing participants to experience the Moral Imagination method first-hand and learn to apply it in real-world, forward-thinking challenges that may be encountered in the development and deployment of AI agents for mental health support.

Speakers:
Ben Zevenbergen, DPhil
Google, LLC

Connor Sullivan, BA
Google, LLC

Justin Tauscher, PhD
University of Washington

Diane M Korngiebel, DPhil
Google, LLC

Alisa Busch, MD, MS
McLean Hospital/Mass General Brigham Healthcare/Havard Medical School

Trevor Cohen, MBChB, PhD
Biomedical Informatics and Medical Education, University of Washington

Authors:
Ben Zevenbergen, DPhil - Google, LLC; Diane M Korngiebel, DPhil - Google, LLC; Alisa Busch, MD, MS - McLean Hospital/Mass General Brigham Healthcare/Havard Medical School; Trevor Cohen, MBChB, PhD - Biomedical Informatics and Medical Education, University of Washington; Connor Sullivan, BA - Google, LLC; Justin Tauscher, PhD - University of Washington;

---