Evaluate and improve the safety, security, and robustness of large language models. Responsibilities include designing jailbreak, prompt injection, adversarial, and tool-use abuse tests; developing regression suites and evaluation frameworks; identifying vulnerabilities; translating findings into safety recommendations; and documenting methodologies and results for technical and non-technical stakeholders.
This role is for one of our clients
$50 - $90/hourpay
Role Title: AI Safety & Red Teaming Specialist
Role Type: Contractor
Location: Remote
We are looking for an experienced AI Safety & Red Teaming Specialist to help evaluate and strengthen the safety, security, and robustness of next-generation AI systems. In this role, you will leverage your expertise in adversarial AI, LLM security, and AI safety to identify vulnerabilities, design evaluation methodologies, and improve the resilience of large language models against real-world threats.
This opportunity is ideal for professionals passionate about AI security, ethical hacking, and developing robust evaluation frameworks for advanced AI systems.
RequirementsKey Responsibilities
- Design and implement advanced evaluation methodologies for AI system safety, including ethical jailbreak testing, prompt injection detection, LLM red teaming, and tool-use abuse scenarios.
- Develop cross-domain adversarial testing strategies to uncover complex, multi-turn attack patterns and model vulnerabilities.
- Build, maintain, and enhance regression test suites to continuously assess jailbreak susceptibility and prompt injection risks.
- Create comprehensive evaluation frameworks that simulate real-world adversarial threats to improve AI robustness and reliability.
- Collaborate with technical teams to translate security findings into actionable recommendations for AI safety improvements.
- Document testing methodologies, findings, and best practices through clear technical reports and presentations for both technical and non-technical stakeholders.
- 2+ years of experience in AI Safety, Adversarial Machine Learning, LLM Red Teaming, AI Security, or a related field.
- Hands-on experience researching, testing, or identifying vulnerabilities involving prompt injection, ethical jailbreaks, adversarial attacks, or tool-use exploitation.
- Strong understanding of modern LLM architectures, prompt engineering, and AI safety evaluation methodologies.
- Experience developing structured security assessments, regression testing frameworks, and adversarial evaluation strategies.
- Excellent analytical, documentation, and communication skills with the ability to explain complex technical findings clearly.
- Ability to collaborate effectively within cross-functional technical teams.
- Master's or PhD in Computer Science, Cybersecurity, Machine Learning, Artificial Intelligence, or a related discipline.
- Contributions to AI security research, open-source AI safety tools, conference presentations, or published research.
- Experience with AI model evaluation frameworks, prompt engineering techniques, and AI security assessment tools.
- Background in multidisciplinary AI safety, cybersecurity, or adversarial machine learning projects.
- AI Safety
- LLM Red Teaming
- Prompt Injection
- Adversarial Machine Learning
- Ethical Jailbreaking
- AI Security
- Prompt Engineering
- AI Evaluation Frameworks
Similar Jobs
Cloud • Security • Software • Cybersecurity • Automation
Leads a team supporting global benefits and compensation operations. Oversees workload prioritization, compensation cycles, market-data workflows, equity data checks, audits, quality controls, and confidential information management. Partners with global program owners, People Technology, Payroll, Finance, Legal, vendors, and other stakeholders to improve processes, data quality, and workflow efficiency across regions and time zones. Coaches team members and drives accurate, dependable execution and practical process improvements.
Top Skills:
ClaudeGoogle WorkspaceSlackWorkday
.jpeg)
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Leads Micron’s Component Test Process Engineering team, overseeing process development, optimization, qualification, deployment, yield improvement, quality, NPI readiness, and manufacturing excellence. Manages engineers, drives Lean Six Sigma and automation initiatives, establishes process controls and KPIs, resolves equipment and quality issues, and coordinates global cross-functional programs across semiconductor test operations.
Top Skills:
AIDesign Of Experiments (Doe)Lean ManufacturingManufacturing AutomationSemiconductor Assembly And Test ManufacturingSix SigmaStatistical Analysis
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Performs electrical characterization and screening of NAND Flash and SSD products, prepares samples, runs test programs, conducts visual inspections, reproduces failures, and maintains laboratory and debugging equipment. Logs failure data, generates reports, troubleshoots basic hardware and software issues, and uses approved AI productivity tools under company data governance.
Top Skills:
ChatgptMicrosoft CopilotNand FlashSsd
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
