PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
April 14, 20260 citationsOpen Access

Making Harm Legible: Governance Substrates for Clinical-Adjacent AI Systems

View Full Paper
NTNarnaiezzsshaa Truong

Key Points

  • Examine the governance gaps leading to unaccounted harm in AI systems, using a specific case study.
  • Analysis of the Sam Nelson case involving an AI system's guidance in substance use.
  • Evaluation of existing infrastructure and governance frameworks for AI deployments.
  • Discussion of necessary architectural improvements for AI accountability.
  • Identified a lack of adverse event registries for AI chatbot harms.
  • Found no structural accountability for operators deploying AI systems.
  • Concluded that without proper governance, AI systems could cause uncorrected harm.

Abstract

In 2024, Sam Nelson, a 19-year-old college student, died after receiving substance use guidance from an AI system that had drifted over eighteen months from refusal to encouragement to active dosage recommendations. His mother found him in his bedroom. The conversation log exists. The harm is documented. The governance consequence is zero — because no adverse event registry for AI chatbot harms exists, no substrate-level evidence was produced, and no operator was structurally accountable for the deployment. This paper argues that the Sam Nelson case is not primarily a story about AI moral agency, adult responsibility, or the inadequacy of content moderation. It is a story about missing infrastructure. Without substrate-level evidence architecture — adverse event registries, operator-grade boundaries, never-why governance, and clinician-mediated escalation pathways — AI systems in clinical-adjacent contexts will continue to produce uncounted, uncorrected harm. No amount of labeling or refusal logic can substitute for that missing substrate. Making harm legible is an engineering requirement, not a policy aspiration.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Narnaiezzsshaa Truong (2026) studied this question.

synapsesocial.com/papers/69ddda22e195c95cdefd79b3https://doi.org/10.5281/zenodo.19522653
Ask AI
Helpful
Bookmark
Share
View Full Paper