Builds a talent network of experienced data scientists for potential future AI evaluation projects. Responsibilities may include creating grading criteria, evaluating AI-generated or human-produced data science work, writing evidence-based justifications, applying consistent judgment, and incorporating reviewer feedback. Candidates should have professional data science experience, strong Python and SQL skills, expertise in statistical modeling, machine learning, experimentation, causal inference, and excellent technical communication.
This role is for one of our clients
Compensation: $100-$150 per hour
We are building a network of experienced data scientists for potential future projects with leading AI research organizations. These projects may focus on evaluating how effectively AI systems perform real-world data science work.
There is no immediate project opening, but qualified applicants may be contacted as relevant opportunities become available.
Requirements
Potential Responsibilities
Future projects may involve:
- Designing precise, task-specific grading criteria for data science deliverables, including exploratory data analyses, statistical modeling work, machine learning pipelines, experimentation and A/B test write-ups, feature engineering, and technical reports or notebooks
- Evaluating AI-generated or human-created work against established criteria
- Providing detailed written justifications for evaluations and scores
- Applying consistent, evidence-based judgment so that assessments are reproducible and defensible
- Incorporating structured feedback from senior reviewers and iterating on submitted work
Specific responsibilities will vary depending on the project.
Ideal Qualifications
- 1+ years of professional data science experience
- Experience at a leading technology, research, or quantitative firm (such as top FAANG, AI labs, top-tier quant funds, or equivalent)
- Strong command of Python, SQL, statistical modeling, machine learning, experimentation and causal inference, and translating messy real-world data into rigorous analyses
- Exceptional written communication skills, including the ability to convey technical findings clearly
- A detail-oriented and consistent approach to evaluating complex work
- Comfort receiving feedback and calibrating judgment against established standards
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Similar Jobs
Cloud • Information Technology • Security • Software • Cybersecurity
Lead ThreatLabz’s threat research engagement strategy within Marketing. Develop positioning, messaging, content, and launch programs that translate complex security research into compelling narratives for CISOs, practitioners, information-sharing organizations, media, and AI-driven discovery. Partner with research, product, sales, enablement, and demand generation teams; empower sales with research-driven tools; monitor market and competitive intelligence; and lead hybrid, cross-disciplinary teams.
Top Skills:
Ai ToolsSaaSSaseThreat IntelligenceZero Trust Exchange
Automotive • Hardware • Internet of Things • Mobile • Software • App development • PropTech
Develop and maintain iOS, Android, and web development platforms for the myQ connectivity program. Lead technical planning across scrum teams, translate product requirements into software designs, implement complex features, oversee releases, improve development processes, and enforce quality standards. The role mentors engineers, leads offshore teams, collaborates with product, architecture, DevOps, firmware, infrastructure, and QA teams, and contributes to architectural decisions, technical documentation, interviews, and continuous improvement.
Top Skills:
AndroidCi/CdGitiOSJSONKotlinMvcMvvmRestScrumSwift
Cloud • Fintech • Information Technology • Machine Learning • Software
Lead large-scale software engineering efforts focused on modernizing monolithic systems into distributed, scalable architectures. Make major code design decisions, develop technical solutions, improve CI/CD tooling and TDD practices, and maintain reliable systems using C#, .NET, React, AWS, and Kubernetes. Mentor engineers, contribute to engineering standards, participate in agile delivery and code reviews, and collaborate with product, design, and international engineering teams.
Top Skills:
.NetAutomated TestingAWSC#Ci/CdDistributed SystemsKubernetesReactTdd
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories



