Builds a talent network of experienced data scientists for potential future AI evaluation projects. Responsibilities may include creating grading criteria, evaluating AI-generated or human-produced data science work, writing evidence-based justifications, applying consistent judgment, and incorporating reviewer feedback. Candidates should have professional data science experience, strong Python and SQL skills, expertise in statistical modeling, machine learning, experimentation, causal inference, and excellent technical communication.
This role is for one of our clients
Compensation: $100-$150 per hour
We are building a network of experienced data scientists for potential future projects with leading AI research organizations. These projects may focus on evaluating how effectively AI systems perform real-world data science work.
There is no immediate project opening, but qualified applicants may be contacted as relevant opportunities become available.
Requirements
Potential Responsibilities
Future projects may involve:
- Designing precise, task-specific grading criteria for data science deliverables, including exploratory data analyses, statistical modeling work, machine learning pipelines, experimentation and A/B test write-ups, feature engineering, and technical reports or notebooks
- Evaluating AI-generated or human-created work against established criteria
- Providing detailed written justifications for evaluations and scores
- Applying consistent, evidence-based judgment so that assessments are reproducible and defensible
- Incorporating structured feedback from senior reviewers and iterating on submitted work
Specific responsibilities will vary depending on the project.
Ideal Qualifications
- 1+ years of professional data science experience
- Experience at a leading technology, research, or quantitative firm (such as top FAANG, AI labs, top-tier quant funds, or equivalent)
- Strong command of Python, SQL, statistical modeling, machine learning, experimentation and causal inference, and translating messy real-world data into rigorous analyses
- Exceptional written communication skills, including the ability to convey technical findings clearly
- A detail-oriented and consistent approach to evaluating complex work
- Comfort receiving feedback and calibrating judgment against established standards
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Similar Jobs
Manufacturing
Leads finance for the Connected Products business, building planning, forecasting, reporting, governance, revenue, costing, inventory, and performance-management capabilities. Partners with technology, commercial, and executive leaders on investments, resource allocation, growth strategies, and returns. Oversees forecasting cycles, establishes financial infrastructure, influences senior stakeholders, and develops a high-performing finance team through organizational change.
Top Skills:
IotOracle EpmSaaSSAP
Healthtech • Information Technology • Security • Software • Cybersecurity
Manage commercial sales across the Northeastern United States, targeting medium and large accounts in non-healthcare industries. Responsibilities include exceeding quotas, developing account strategies, engaging senior decision-makers, managing demonstrations and evaluations, partnering with resellers and internal teams, maintaining Salesforce and Clari forecasts, and expanding existing customer relationships. The role requires extensive enterprise sales experience, IAM solution knowledge, executive selling skills, and strong negotiation and organizational abilities.
Top Skills:
ClariIdentity And Access Management (Iam)Salesforce
eCommerce • Healthtech • Kids + Family • Retail • Social Media
Own the full DME insurance billing cycle, including eligibility verification, benefit investigations, claim submission, denial management, appeals, EOB resolution, and aged-account collections. Explain billing and benefits to patients, maintain coding and regulatory compliance, collaborate on workflow improvements, and use Brightree, NikoHealth, and AI-enabled tools to improve reimbursement accuracy and speed.
Top Skills:
AcaAdvancedmdBrightreeCmsCptEpicErisaHcpcsHipaaIcd-10KareoNikohealth
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
