Summary
Operative law under New York General Business Law Article 47, enacted through the 2025 state budget, requiring disclosure for personalized algorithmic pricing and establishing safeguards for AI companions, including crisis-response protocols and clear notices that users are interacting with AI.
Healthcare Implications
Direct implications for mental health and digital wellness tools that function as AI companions: systems must detect suicidal ideation/self-harm cues and route users to crisis services, which shapes how mental-health and wellness apps marketed in NY design, monitor, and govern AI companion features.
Operational Implications
- AI companion operators must implement protocol to detect suicidal ideation, self-harm, and physical/financial harm to others; must refer users to crisis service providers.
- Notification at start of every AI companion interaction and at least every 3 hours during continuing interactions; must state that user is interacting with AI and not a human, and that it is unable to feel human emotion. Civil penalties up to $15,000 per day; AG enforcement.