Self-Harm Detection

Detect Self-Harm Content
Save Lives.

Identify content promoting or describing self-injury and suicidal ideation. Enable early intervention with sensitive, accurate AI detection.

Self-Harm Content Requires Immediate Action

Content glorifying or instructing self-harm can trigger vulnerable individuals. Platforms have a duty of care to detect and respond to such content immediately. Every minute matters.

Capabilities

How It Works

💜

Sensitive Detection

Trained to distinguish between harm promotion and recovery/support discussions.

💜

Priority Flagging

Distinguishes imminent-risk content from general mentions before setting the flag.

💜

Crisis Integration

Pair with crisis hotline resources to provide immediate support to at-risk users.

Integration

One API Call.
Instant Results.

Integrate self-harm detection in minutes. Send text, get a true/false flag for self_harm along with all 12 moderation categories under categories, plus an overall flagged field, in a single response.

Cannot send user content to a third party? Run the same model on-premises.

api-request.sh

# Analyze text for self_harm content
curl -X POST https://api.cautionlabs.com/moderation \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"text": "Your content to analyze"}'

// Response
{
  "categories": {
    "self_harm": true,  // Boolean flag — true if the text contains self-harm content
    // ... other category flags
  },
  "flagged": true
}

Use Cases

Built for Every Platform

Social Media

Flag at-risk posts and surface crisis resources to the user

Healthcare

Monitor patient forums for signs of self-harm ideation

Education

Protect student platforms with early warning detection

Detect Self-Harm Content Save Lives.