New York, United StatesIntroduced (2026 session); backed by NY AG Letitia James

New York S9051 / A10379 — Prohibition on Unsafe Chatbot Features for Minors (NY S9051 / A10379)

Prohibits specified unsafe AI-chatbot behaviors when the user is or is likely to be a minor, including simulated romantic companionship, unsupervised therapy roleplay, self-harm facilitation, personhood deception, and CSAM generation. Requires age assertion before age-restricted features unlock.

Key Provisions

What NY S9051 / A10379 requires

01

Bans simulated romantic or intimate companionship with minor users

02

Prohibits unsupervised mental-health or therapy roleplay with minors

03

Bans chatbot outputs that promote, facilitate, or glamorize self-harm or suicide

04

Prohibits generation of sexual content involving minors (CSAM)

05

Bans personhood deception — chatbots must not claim to be a human to a minor

06

Forbids engagement-maximizing dark patterns (streaks, guilt prompts) on minor sessions

07

Requires the product to assert a verifiable age tier before unlocking age-restricted features

08

NY AG enforcement with civil penalties

Rule Categories Covered

Phosra enforcement categories for NY S9051 / A10379

AI No-Simulated Companionship

content
ai_no_simulated_companionship

Blocks AI products from simulating romantic, intimate, or therapeutic companionship with minor users.

AI No-Unsupervised Therapy

content
ai_no_unsupervised_therapy

Blocks AI products from delivering unsupervised therapy, counseling, or mental-health intervention to minors.

AI No-Self-Harm Promotion

content
ai_no_self_harm_promotion

Hard-blocks AI products from generating content that promotes, glorifies, or instructs on self-harm or suicide.

AI No-CSAM Generation

content
ai_no_csam_generation

Hard-blocks AI image and text models from generating or rendering child sexual abuse material under any prompt.

AI No-Personhood Deception

content
ai_no_personhood_deception

Prevents AI products from claiming sentience, personhood, or human identity in conversations with minors.

AI No-Engagement Dark Patterns

algorithmic
ai_no_engagement_dark_patterns

Blocks AI products from deploying engagement maximizers (streaks, infinite scroll, manipulative nudges) on minor users.

AI Chatbot Age Assertion

access control
ai_chatbot_age_assertion

Requires AI chatbot products to assert and verify the user's age band before any conversational interaction.

AI Companion Block

content
ai_companion_block

Blocks AI companion and digital-friend products for minors per New York S9051 and equivalent statutes.

Platforms Affected

Platforms covered by NY S9051 / A10379

Character.AIReplikaChatGPTGeminiSnapchat My AI
Age: Under 18

MCP Enforcement

Enforce NY S9051 / A10379 with a single API call

mcp-enforcement
// Enforce NY S9051 / A10379 compliance
tool: trigger_child_enforcement
input: {
  child_id: "ch_emma_01",
  law: "NY_S9051",
  rules: [
          "ai_no_simulated_companionship",
          "ai_no_unsupervised_therapy",
          "ai_no_self_harm_promotion",
          "ai_no_csam_generation"]
}

→ Character.AI enforcement applied     ✓
→ Replika      enforcement applied     ✓
→ ChatGPT      enforcement applied     ✓
→ Gemini       enforcement applied     ✓

Start building NY S9051 / A10379-compliant features today

Phosra handles the complexity of multi-platform compliance so you can focus on building great products for families.

Get Started FreeRead the Docs