Top Tech Jobs & Startup Jobs in Boston, MA

Evaluate AI model outputs, perform audit-based reviews, apply and refine guidelines, identify performance trends and failure modes, document findings, and collaborate with cross-functional teams to improve model evaluation and data quality.

Audit and monitor data labeling outputs, provide actionable feedback, support onboarding and training of annotators, enforce and improve guidelines, escalate workflow issues, and document findings to maintain high-quality human-in-the-loop AI data processes.

Audit and ensure quality of data labeling work for ML using human-in-the-loop processes. Provide feedback, train and support annotators, monitor workflows, identify recurring issues, and help improve guidelines and processes.

Evaluate AI outputs, perform audit-based reviews, identify patterns and failure modes, apply and improve annotation/evaluation guidelines, document findings, and communicate insights to cross-functional teams to improve model performance and evaluation frameworks.

Evaluate AI model outputs, perform audit-based reviews to identify patterns and failure modes, apply and refine guidelines, document findings, and collaborate with leads and cross-functional teams to improve model evaluation and data quality.

Leads English-to-Bosnian Cyrillic localization quality for UI, marketing, product, legal, informational, and support content. Owns client alignment, arbitration, quality audits, reviewer coaching, style guide analysis, monthly reporting, and continuous improvement. Serves as the primary linguistic contact for the client Language Manager and ensures consistent quality standards across the review community.

Join Welo Data’s Swahili contributor network for potential remote AI projects involving text, image, or audio annotation; search, advertising, or chatbot evaluation; prompt creation; and cultural and linguistic accuracy review. Applicants must be native or near-native Swahili speakers based in Kenya, Tanzania, or the Democratic Republic of Congo, with English proficiency, digital-tool comfort, and strong attention to detail. Projects vary in duration and compensation, with details provided before participation.

Reviews, validates, and curates Hindi written and audio content according to SOPs, checklists, and client guidelines. The role checks content and metadata, applies approved corrections, documents defects in internal tools, escalates complex issues, manages queues to meet throughput and SLA targets, and follows security requirements. It also involves repetitive high-volume work, team meetings, calibration sessions, training, and incorporating feedback to improve accuracy.

Own Serbian Cyrillic localization quality for UI, marketing, product, legal, support, and informational content. Lead client alignment, arbitration, quality audits, reviewer coaching, roundtables, reporting, and style guide improvements. Serve as the primary linguistic contact for the client’s Language Manager and drive consistency across the language community.

Own English-to-Kazakh localization quality for UI, marketing, product, legal, informational, and support content. Serve as the primary client-facing linguistic expert, interpret quality standards, manage arbitration and escalations, coach reviewers, facilitate alignment sessions, analyze quality data, publish monthly reports, and propose style guide improvements. Requires native-level Kazakh, professional English, strong localization quality assurance experience, stakeholder management, and expertise with RQE, LQE, error rubrics, and severity mapping.