Top Tech Jobs & Startup Jobs in Boston, MA

Evaluate and review finance workflows and task designs for realism and accuracy in real assets, project finance, infrastructure, energy, mining, and natural resources. Identify missing assumptions, ambiguous instructions, impractical constraints, and edge cases. Provide concise, structured written feedback and recommendations, collaborate with other experts, and participate in synchronous review sessions as needed.

Work with research and engineering teams to design realistic marketing tasks, create reference solutions, and evaluate AI/LLM outputs with structured rubrics. Maintain evaluation guidelines, ensure dataset quality, and collaborate with SMEs to improve AI model performance on marketing challenges.

Evaluate and review AI-generated mechanical engineering content for technical accuracy and real-world applicability; provide expert answers and feedback; recommend standards and references; share design, manufacturing, and testing insights; identify errors and collaborate with subject-matter experts to improve AI model quality. Part-time, remote, contractor (~10 hrs/week).

Design task-specific grading criteria for B2B sales deliverables and evaluate AI-generated and human work against those rubrics. Provide detailed, evidence-based written justifications, refine rubrics with senior reviewers, and ensure consistent, reproducible evaluations across large volumes of work.

Review and evaluate quantitative finance tasks for technical accuracy and real-world realism. Identify missing assumptions, unrealistic constraints, edge cases, and data or backtesting issues. Provide concise, structured written feedback and actionable recommendations. Collaborate with other experts to calibrate evaluations and maintain consistent quality standards throughout a high-engagement, remote contractor sprint.

Design evaluation rubrics and scoring frameworks for marketing deliverables, assess AI-generated and human-created marketing work with evidence-based judgments, provide written justifications, and iterate with stakeholders to improve consistency and scoring quality.

Conduct 20-minute structured interviews with subject-matter experts, evaluate domain expertise and communication using a rubric, verify availability and work authorization, provide evidence-based hiring recommendations (Advance/Hold/Pass), coordinate scheduling, document outcomes, and collaborate with the program team to ensure consistent evaluation standards. Approximately 10 hours/week, fully remote with U.S. Eastern Time overlap.

Review, create, and evaluate professional operational finance deliverables (P&L reconciliations, month-end close, AP/P2P, three-statement models, pro forma analysis, covenant and partnership accounting). Analyze complex documents, assess AI-generated financial work for technical accuracy and completeness, and produce executive-ready summaries with assumptions, variances, impacts, and recommendations.

Design and author realistic, multi-step software engineering benchmarks in Python; create reproducible reference solutions and validation checks; evaluate AI-generated code, identify failures, and improve benchmark quality; review peers tasks and collaborate with AI researchers to refine evaluation methodologies.

Evaluate finance workflows and tasks for realism, technical accuracy, and practical applicability in trading, derivatives, and crypto markets. Identify ambiguous assumptions, unrealistic constraints, missing edge cases, and provide concise, actionable feedback. Collaborate with domain experts to maintain consistency and ensure high-quality assessments throughout a fast-paced, remote sprint engagement.