Quarantine first
Uploads land in quarantine. A queue job runs the checks and the policy engine decides. Approved images are resized to the sizes the app needs and served from the CDN.
Reporting duty
A hash match does not trigger a report on its own. A human views it first, then a confirmed match is reported to the authorities in the US and Canada.
What it talks to
- API on Cloudflare Workers: One API for the whole product. It checks who the member is and what they may see, then calls the right module.
- Postgres with vector search: Stores profiles, hubs, plans, pulses and moderation outcomes, plus the embeddings used to find people and plans that fit.
- Moderation pipeline: Classifies messages, photos, voice and reports, applies written rules through an action ladder, sends reasons and routes appeals.
- Human review on demand: Vendor reviewers who handle appeals, uncertain cases and child-abuse hash matches, plus a case-management tool for reasons, appeals and transparency numbers.
Designed for
- Nothing is visible until it passes
- Copies of removed images are caught by hash
- No AI-generated images of members in Phase 1
Where it appears in a request
- A photo upload: The pipeline hash-checks the photo against known child-abuse material and runs an AI image classifier.