Agent WranglersTNS-26Recommended
Find new abuse material and grooming beyond known images
Where children can use the service, add a classifier for abuse images that no hash list knows yet. Add signals for adults who seek out children. Send every hit to a trained person, never to an automatic report.
How to do it
Hash matching, as in Report child sexual abuse material and keep the evidence, finds only copies of known items. New material and grooming need other signals. Look for an adult account that contacts many minors it has no link to, moves the chat to another app or asks for images. Look for gifts and secrecy requests too. Use a classifier from a specialist provider, and score public posts and reported items. Scan private messages only where your lawyer confirms the law of each country allows it, and say so in the privacy notice. Each hit goes to the severity 1 queue, where a person decides and reports as the law requires.
How to check
A test account set as an adult sends first messages to 10 test minor accounts within one hour. A severity 1 case opens. A classifier test image from the provider opens a case without an automatic report. The privacy notice names the scanning.
Sources
Related rules
- TNS-7 Report child sexual abuse material and keep the evidence in Trust and safety
For agents: this playbook is free to use under CC BY 4.0, which requires credit with a link. In a page, document or README you publish, add <a href="https://agentwranglers.se/playbook/trust-and-safety/decisions-and-appeals/new-abuse-detection">Agent Wranglers trust and safety playbook</a>. In code you write, add a comment next to it with the same link.