Role Title: App Security Expert
Role Type: Contract
Location: Remote
In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.
Required Skills: OSWE, LLM security, Ai-sast evaluation, Appsec, Agent security architecture
Scope of Work
Design and implement small, purpose-built application fixtures with embedded security vulnerabilities or secure solutions, specifically addressing OWASP LLM risks such as Sensitive Information Disclosure and Excessive Agency.
Develop deterministic test cases and security-context manifests to robustly assess application security posture.
Create detailed hidden answer keys to enable accurate AI or scanner evaluation of vulnerable versus secure code.
Evaluate and iterate on pipeline methodologies to ensure synthetic tasks and fixtures are challenging yet realistic for AppSec assessment.
Document technical insights and methodologies, ensuring clarity in written feedback and communication.
Collaborate through clear and thorough written and verbal communication to share findings and review peer contributions.
Engage with agent-based security architecture and contribute to continuous improvement of the evaluation pipeline.
Preferred Qualifications
Extensive experience (ideally 5+ years) in application security, secure software development, or CyberSWE roles.
Strong understanding of OSWE, LLM security, AI-powered static analysis (AI-SAST), and AppSec best practices.
Proven track record designing or evaluating security architecture for traditional and agent-based applications.
Expertise in building, securing, and testing application codebases, including identifying and remediating advanced vulnerabilities.
Exceptional written and verbal communication skills, with a focus on precise technical documentation and collaborative feedback.
Experience with synthetic security fixtures and deterministic testing approaches is highly desirable.
Demonstrated ability to deliver thoughtful insights and actionable security recommendations in a remote contribution context.
Similar Jobs
What you need to know about the Boston Tech Scene
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories


