Software Engineer, Trust & Safety
Gamma · San Francisco, United States · 2mo ago
Why this role matters now
AI has dramatically lowered the barrier for bad actors. Generating convincing phishing pages, spinning up realistic-looking fraudulent accounts, and producing abusive content at scale no longer requires specialized skill—a motivated attacker with access to widely available models can do it. The volume and sophistication of platform abuse is increasing faster than traditional approaches can keep up with.
At the same time, AI is transforming what's possible on the defensive side. A small, sharp T&S team equipped with frontier models can now build detection, triage, and response systems that would have required a team five times the size just a couple of years ago. AI-assisted content scanning, automated investigation workflows, and intelligent alert prioritization mean that a lean team can protect millions of users—if they build the right infrastructure.
About the role
Gamma is tackling one of the most critical challenges for any fast-growing AI platform: keeping millions of users safe while preserving the creative freedom that makes the product magical. As a Trust & Safety Engineer, you'll architect the systems that protect our platform from phishing, abuse, fraud, and malicious content, all while ensuring Gamma stays fast, reliable, and delightful to use.
You'll join a small, high-impact team building the foundation for trust at scale. You'll design infrastructure that serves millions, ship improvements daily, and build the internal tools that let our support teams act quickly on threats. You'll collaborate across engineering, product, and design to define how Gamma approaches safety for the long term.
Our team has a strong in-office culture and works in person 4–5 days per week in San Francisco. We love working together to stay creative and connected, with flexibility to work from home when focus matters most.
What you'll do
Own detection and prevention systems for fraud, abuse, spam, and malicious content across millions of daily users
Design and build scalable trust infrastructure including rate limiting, content scanning, anomaly detection, and account security
Build tools that empower internal support teams to investigate and act on suspicious or malicious activity
Investigate and resolve complex security incidents with limited context
Partner with engineering and product to balance security with user experience
Shape Gamma's long-term trust and safety strategy and technical roadmap
Leverage AI/LLM-based detection to stay ahead of AI-generated abuse—phishing, fraud, and malicious content that's increasingly indistinguishable from legitimate activity
Build automated triage and investigation workflows that let a small team operate at the scale of a much larger one
What you'll bring
5+ years as a software engineer with a focus on abuse, spam, or fraud prevention
Strong systems thinking and experience building highly available web APIs, with proficiency in at least one programming language and comfort working across a modern web stack
Hands-on experience implementing trust features like rate limiting, content detection, and fraud prevention
Experience with event streaming systems (Redis, Kafka, or similar)
Passion for security, user protection, and solving problems at scale
Nice to have
Experience with AI/LLMs for content moderation, or familiarity with TypeScript, Prisma, Apollo GraphQL, or AWS
Experience building AI-assisted moderation pipelines or using frontier models for automated abuse detection and response
Familiarity with the evolving AI threat landscape—how generative models are being used for phishing, social engineering, and content abuse at scale
Compensation range:
The base salary for this full-time position, which spans multiple internal levels depending on qualifications, ranges between $180K - $310K plus benefits & equity.
Final offer amounts are determined by multiple factors, including but not limited to experience and expertise in the requirements listed above.
If you're interested in this role but you don't meet every requirement, we encourage you to apply anyway! We're always excited about meeting great people.