Design realistic, specialty-specific clinical case scenarios and gold-standard attending-level responses, evaluate and grade AI-generated outputs using structured rubrics, provide detailed written feedback to improve model clinical reasoning, and participate in onboarding, calibration, and review sessions in a fully remote, asynchronous contractor role (~20 hours/week).
This role is for one of our clients
Compensation: $130-$300 per hour
We are partnering with a leading AI research lab to develop high-quality healthcare reasoning data for training next-generation AI models. As a Clinical AI Specialist, you will contribute your medical expertise to design realistic clinical scenarios, evaluate AI-generated outputs, and help improve how advanced models reason about patient care in real-world settings.
Requirements
What You’ll Do
- Design clinically accurate and realistic case scenarios based on your specialty, including diagnostic reasoning, treatment planning, risk stratification, and guideline-based care
- Develop “gold standard” responses at an attending-physician level to guide AI model learning
- Evaluate and grade AI-generated outputs using structured rubrics and evidence-based medical standards
- Provide detailed written feedback to enhance model accuracy, safety, and clinical reasoning
- Participate in onboarding sessions, office hours, and specialty-specific calibration discussions
Who You Are
- Attending Physicians: Board-certified with a current, active, and unrestricted medical license
- Resident Physicians: Final year of residency (recent graduates must be board-eligible)
- Fellows: Board-certified/board-eligible in primary specialty with an active, unrestricted license
- Strong understanding of evidence-based medicine and clinical guidelines within your specialty
- Excellent analytical and written communication skills
Engagement Details
- Fully remote, asynchronous work environment
- Standard commitment of ~20 hours per week (with potential to increase based on performance and demand)
- Flexible schedule—work at your convenience
- Ongoing engagement with monthly performance reviews
- Start date: Rolling, following onboarding completion
Compensation
- Rates vary by specialty and experience level
- Final compensation details will be shared during the offer stage
- Payments are processed weekly via supported global payment platforms
Additional Information
- Engagement is on an independent contractor basis
- Work must not involve sharing confidential or proprietary information from any affiliated organization
- Projects may be extended, modified, or concluded based on business needs and individual performance
- At this time, visa sponsorship is not available for certain work authorization categories
Onboarding Process
Upon acceptance, you will receive onboarding materials along with an invitation to attend orientation and office hours sessions before beginning your first assignment.
Similar Jobs
Information Technology • Consulting
Own clinical quality for member-facing AI products by partnering with product, engineering, and clinical teams. Design clinical AI evaluations, define quality thresholds and rubrics, assess accuracy, omissions, hallucinations, medication-safety risks, and translate clinical reasoning into prompts and decision logic. Monitor evolving evidence and standards of care, validate product launches, and communicate findings to technical and clinical audiences.
Top Skills:
Clinical AiContext EngineeringLlmsMachine LearningPrompt Engineering
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Design, build, test, launch, and operate full-stack services automating responses to legal, regulatory, and civil requests. Develop backend systems, internal web tools, and integrations across microservice and event-driven architectures. Collaborate with Counsel, Compliance, and Operations while handling sensitive customer data. Participate in on-call, incident response, code reviews, modernization efforts, and responsible use of AI-powered development tools.
Top Skills:
Ai AgentsAuroraAWSBuildkiteClaudeDatadogDynamoDBGooseGradleGrpcHTTPJavaJSONKafkaKotlinLlmsMcpMicroservicesMySQLProtocol BuffersReactRedisRuby On RailsSidekiqTypescript
Big Data • Fintech • Mobile • Payments • Financial Services
Build and operate backend systems supporting post-transaction card account accuracy, issue resolution, and customer communications. Break down projects, deliver work in phases, collaborate with product and cross-functional teams, monitor system metrics, support availability and on-call operations, and contribute to code reviews and interviews. The role requires backend development experience, distributed systems knowledge, and proficiency in Python or Kotlin, AWS, MySQL, and Kubernetes.
Top Skills:
AWSKotlinKubernetesMySQLPython
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
