Summary
Regulates artificial intelligence companion chatbots by requiring user notice that the user is interacting with artificial output, protections for minors, and protocols for detecting and responding to suicidal ideation or self-harm.
Healthcare Implications
Applies to consumer-facing companion bots that may be used for emotional support or mental-health-adjacent interactions. Developers and health-facing platforms should add disclosure, escalation, and minor-protection workflows to reduce risk.
Operational Implications
- Must disclose AI nature; reminders every 3 hours for adults, every hour for minors.
- Crisis-detection protocol for suicidal ideation, self-harm, and eating disorders; must refer to crisis resources; prevent generation of self-harm content; publish protocol details and annual referral counts on website.
- For minors: no sexually explicit content; engagement-maximization restrictions including prohibitions on excessive praise, romantic mimicry, simulated emotional distress, isolation prompts, withholding-from-parents prompts, discouraging breaks, and soliciting purchases. Private right of action.