Red team conversational AI models and agents by probing jailbreaks, prompt injections, misuse cases, bias, and multi-turn manipulation. Annotate failures, classify vulnerabilities, apply testing frameworks and benchmarks, and produce reproducible reports, datasets, and attack cases. The role requires native English and Finnish fluency, prior AI or cybersecurity red teaming experience, strong communication, structured analysis, and adaptability across projects.
This role is for one of our clients
Compensation: $48 - $62 per hour
Fluent Language Skills Required: English & Finnish. Native fluency in English and Finnish is required for this position.
Why This Role Exists
We are assembling a red team for this project - human data experts who probe AI models with adversarial inputs, surface vulnerabilities, and generate the red team data that makes AI safer for our customers.
This project involves reviewing AI outputs that touch on sensitive topics such as bias, misinformation, or harmful behaviors. All work is text-based, and participation in higher-sensitivity projects is optional and supported by clear guidelines and wellness resources. Before being exposed to any content, the topics will be clearly communicated.
Requirements
What You’ll Do
- Red team conversational AI models and agents: jailbreaks, prompt injections, misuse cases, bias exploitation, multi-turn manipulation
- Generate high-quality human data: annotate failures, classify vulnerabilities, and flag systemic risks
- Apply structure: follow taxonomies, benchmarks, and playbooks to keep testing consistent
- Document reproducibly: produce reports, datasets, and attack cases customers can act on
Who You Are
- You bring prior red teaming experience (AI adversarial work, cybersecurity, socio-technical probing)
- You’re curious and adversarial: you instinctively push systems to breaking points
- You’re structured: you use frameworks or benchmarks, not just random hacks
- You’re communicative: you explain risks clearly to technical and non-technical stakeholders
- You’re adaptable: thrive on moving across projects and customers
Nice-to-Have Specialties
- Adversarial ML: jailbreak datasets, prompt injection, RLHF/DPO attacks, model extraction
- Cybersecurity: penetration testing, exploit development, reverse engineering
- Socio-technical risk: harassment/disinfo probing, abuse analysis, conversational AI testing
- Creative probing: psychology, acting, writing for unconventional adversarial thinking
What Success Looks Like
- You uncover vulnerabilities automated tests miss
- You deliver reproducible artifacts that strengthen customer AI systems
- Evaluation coverage expands: more scenarios tested, fewer surprises in production
Similar Jobs
36 Minutes Ago
Artificial Intelligence • Cloud • Information Technology • Consulting
Designs and positions HPE Networking solutions for K12, local government, enterprise, and service provider customers. Partners with sales teams, customers, and channel partners to understand needs, develop architectures and proposals, deliver technical presentations and demonstrations, and lead proof-of-concept activities. The role requires strong networking infrastructure experience, communication skills, and regular travel to Utah customer sites while supporting Aruba and Juniper networking technologies.
Top Skills:
Ai-Driven OperationsArubaClearpassCloud-Managed NetworkingHpe NetworkingJuniper NetworksNetwork Automation
Artificial Intelligence • Cloud • Payments • Software • Business Intelligence • Generative AI • Automation
Leads full-cycle enterprise sales for insurance technology and AI-powered SaaS solutions, managing prospecting, discovery, evaluations, proofs of concept, negotiations, and account expansion. Builds strategic account plans, develops executive relationships, explains technical concepts, coordinates cross-functional teams, maintains Salesforce pipeline hygiene, and supports customer retention. This primarily outside-sales role requires frequent U.S. travel of up to 50%.
Top Skills:
APIsArtificial IntelligenceCloud SoftwareLarge Language ModelsProprietary Data FlowsSalesforce CRM
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Leads global Sales operations, including budget management, dashboards, KPI tracking, executive special projects, organizational development, communications, annual planning, and cross-functional alignment. Partners with sales and company leadership to drive operational excellence, consistent priorities, strategic execution, team culture, and measurable business outcomes in a dynamic global environment.
Top Skills:
AIServicenow
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
