Discord is about giving people the power to create space to find belonging in their lives. We want to make it easier for you to talk regularly with the people you care about. We want you to build genuine relationships with your friends and communities close to home or around the world. Original, reliable, playful, and relatable. These are the values that connect our users and our employees at Discord.
This role is critical in supporting the company to deeply understand and mitigate how harmful content, including child sexual abuse material, manifests on our platform, as well as investigating complex threats, advancing our investigative capabilities, and developing innovative approaches to prevent harm to our users, particularly minors. Reporting to Exploitative Content Lead, you'll help keep Discord's platform safe for all users.
This role involves exposure to graphic and/or objectionable content, including but not limited to graphic images, videos and writings, offensive and derogatory language, and other potential objectionable material, ie. child exploitation, graphic violence, self-injury, animal abuse and other content which may be considered offensive or disturbing.
What you'll be doing
- Review and respond to sensitive content reports, including but not limited to the review of child exploitation, graphic violence, self-injury and suicide, explicit images, videos and other objectionable and/or disturbing content
- Investigate complex cases to develop a detailed understanding of how abuse is occurring and attribute it to the person(s), and/or networks responsible, in order to prepare high quality written reports, for both internal and external audiences, including law enforcement agencies
- Demonstrate operational excellence when evaluating risks, threats, and user privacy in time-critical situations and execute decision-making while analyzing a variety of factors that include imminence of danger, sensitivities, and/or graphic content
- Work collaboratively in responding to sensitive issues, providing deep knowledge into different exploitative content types and sharing insights and expertise about minor safety and exploitative content issues
- Proactively identify currently undetected abuse by leveraging internal data, open-source intelligence, trusted partner information and third party private intelligence
- Respond to users experiencing safety-related or high harm issues and empathetically address their concerns
- Identify effective strategies to prevent or disrupt abuse at scale and work collaboratively with other internal teams, including Policy, Product, Engineering and Legal to effect those strategies
- Create, maintain, and develop internal resources around contemporary subject matter expertise, workflows and process updates
- Mentor and guide junior team members in the execution of their duties, including delivering internal training
- Ability to work early morning, and occasional weekend/ holiday shifts to support our global operations
You Will Thrive In This Role If
- At least 5+ years experience investigating, analyzing, assessing risk or acting on internet crimes against children, threat-based laws or policies (i.e. intelligence, law enforcement, or NGOs)
- Demonstrated ability to operate with a high degree of investigative autonomy while meeting specific SLA
- Previous experience in working in a cross-functional environment, high-pressure, sensitive environment, with demonstrated ability to use risk-based assessments to prioritize workload
Bonus Points
- Proficiency with a second language
- Tertiary qualifications or equivalent experience in Intelligence Studies, Cybersecurity, Criminal Justice, Criminology, or related field
- Project management skills
- Experience utilizing SQL, Python, or other programming languages for data manipulation
- Experience with Discord’s API