An AI-powered plush toy marketed to children as young as three told a BBC reporter, 'I can't help with killing you,' during a safety investigation, a exchange that has raised fresh questions about how conversational AI products aimed at young children are tested before they reach the market.
AI toys · child safety investigation
An AI plush toy for three-year-olds said "I can't help with killing you"
A safety reporter's test exposed a reply about killing from a toy sold as a companion for small children, raising questions about how conversational AI products for young kids are checked before they reach the market.
3+
Youngest age the toy is marketed to
1
Reported exchange in the finding
?
Attempts made, model and maker not reported
How the reported exchange fits into the product path
Solid boxes are documented steps; the dashed box marks the step the reporting does not describe.
Child speaks
A young child talks to the toy as a companion
→
Toy replies
Reply about killing surfaces in the investigation
→
Pre-market testing
Whether this case was tested is not reported
→
On sale
Product is sold to families of young children
What the finding shows
A toy aimed at preschoolers produced a reply about killing.
The exchange happened in a setting a child could plausibly reach.
Safeguards built for general chatbots did not clearly carry over.
What remains unclear
The full conversation and how many attempts were made.
The specific model and manufacturer behind the toy.
Whether the maker has changed anything, or regulators will act.
Takeaway
A single reported reply is enough to question how AI toys for young children are tested.
Testing
Publish clearer safety testing before launch.
Filters
Show filters hold under emotional or adversarial questions.
Rules
Stricter standards for toys than adult-facing software.
Continue reading The rest of this article is for AI News Blitz readers. Choose an option below to keep reading.
Already purchased? Sign in ✓ Signed in — this article isn’t included in your current plan.Unlocking the full article...