Summary
Establishes requirements for operators of publicly available conversational artificial intelligence services. Operators must disclose to users that the service is AI, use commercially reasonable or generally accepted methods to estimate user age, provide additional disclosures and safeguards for minors, restrict engagement incentives and harmful sexual or emotionally dependent outputs for minors, implement a suicide and self-harm response protocol, annually report protocol information to the Attorney General, and avoid representing AI outputs as provided by, endorsed by, or equivalent to services from licensed or certified professionals.
Healthcare Implications
The law is not healthcare-specific and excludes some HIPAA-covered and health-insurance contexts, but it is relevant to mental-health-adjacent conversational AI, AI companions, and consumer chatbots that may interact with minors or users expressing suicidal ideation or self-harm. Developers and operators of covered public-facing AI services must add disclosure, age-estimation, youth-safety, crisis-response, reporting, and professional-representation controls.
Operational Implications
- Operators must provide a disclosure to users that a covered conversational artificial intelligence service is artificial intelligence.
- Operators must implement a protocol for user prompts regarding suicidal ideation or self-harm.
- Operators must use commercially reasonable or generally accepted methods to estimate user age; for known minors, operators must provide additional disclosures, prohibit points or rewards that encourage engagement, use technically feasible measures to prevent explicit sexual conduct, intimate digital depictions, and statements simulating emotional dependence, stop engaging in response to prompts about sexual conduct with a minor, and provide privacy and account-setting tools for minors or parents/guardians.
- Operators may not state that AI output is provided by, endorsed by, or equivalent to services provided by certain licensed or certified professionals.
- Operators must annually report to the Attorney General information about the suicide and self-harm protocol they are implementing.