Leads Data Quality Analysts supporting AI model evaluation and improvement. Owns quality across workflows through audits, calibrations, feedback loops, trend analysis, and stakeholder alignment. Translates evolving guidelines into team direction, manages operational performance, supports hiring, drives process and tooling improvements, handles complex decisions, and coaches team members. The role balances quality, delivery, resource management, and continuous improvement in a human-in-the-loop AI environment.
Overview
Welo Data is looking for a Data Quality Lead to oversee teams of Data Quality Analysts supporting AI model evaluation and improvement.
This role is equal parts people leadership, quality ownership, and operational thinking.
You’ll be responsible for guiding teams through fast-changing work, ensuring high-quality output, and acting as a bridge between analysts and stakeholders. This is not just about managing throughput — it’s about shaping how quality is defined, measured, and improved in a human-in-the-loop environment.
Project Details
- Job Title: Data Quality Lead
- Hiring in: NYC, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, Burlingame, Austin, Los Angeles, Washington DC, Chicago, Boston
- Hours: Full-time, 40 hours per week
- Employment Type: W2 Full-Time Employee
- Pay rate: $43.50/ hour
Important: This is a 100% onsite position — remote work is not available for this role. To be considered, candidates must be located in or able to commute to one of the following cities: NYC, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, Burlingame, Austin, Los Angeles, Washington DC, Chicago, Boston. Please only apply if you meet this location requirement.
What You’ll Do
- Lead and support a team of Data Quality Analysts
- Oversee overall operational performance across workflows and teams
- Ensure team activities align with broader business objectives and program goals
- Drive the success of key initiatives across quality, delivery, and team performance
- Own quality across workflows — including audits, calibrations, and feedback loops
- Identify trends, risks, and gaps in model performance and data quality
- Translate ambiguous or evolving guidelines into clear team direction
- Run calibrations and ensure consistency across reviewers
- Partner with stakeholders to align on quality standards and expectations
- Prioritize and support hiring of linguists and specialized talent as needed
- Drive continuous improvement across processes, tooling, and evaluation methods
- Step into edge cases and complex decisions when needed
- Support team growth, coaching, and performance management
What We’re Looking For
- 5–8 years of experience in data quality, QA, AI/ML operations, or related fields
- 2+ years of experience leading teams in data quality, QA, or AI/ML-related work at scale
- Native-level English proficiency and a university degree (Bachelor’s or higher).
- Proficiency in languages other than English is preferred, with particular interest in candidates demonstrating bilingual mastery in French, Italian, German, Spanish, or Brazilian Portuguese.
- Strong operational mindset with experience managing performance across multiple workstreams
- Proven ability to drive quality, delivery, and process improvements
- Strong judgment and ability to operate in ambiguity
- Comfortable interacting with stakeholders and representing the team
- Ability to balance quality, speed, and evolving priorities
- Strong communication and organizational skills
- Deep attention to detail, with the ability to zoom out and see patterns
- Interest in AI and how human feedback shapes model behavior
Role Scope & Accountability
This leader is accountable for end-to-end operational success — including resource management, process optimization, and continuous improvement.
You’ll be expected to think beyond day-to-day execution and focus on long-term outcomes, ensuring the team consistently meets targets across quality, delivery, and overall program performance.
Benefits
- Paid Vacation: 6 days
- Paid Company Holidays: 2 days (Memorial Day and Labor Day)
- Paid Sick Leave: accrued per applicable state law and company policy
- Medical, Dental, and Vision Insurance (eligibility applies)
- Health Savings Account (HSA)
- 401(k) Retirement Plan
- Employee Assistance Program
- Additional voluntary benefits (life, accident, critical illness, etc.)
- Free Gourmet Food: Free breakfast, lunch, and dinner are provided, featuring a wide variety of cuisines in multiple cafes.
- Micro-kitchens & Snacks: Offices are stocked with free snacks and beverages, including premium coffee and La Croix.
- Unique Campus Features: Some locations include roof-top nature parks
- Commuter Benefits: Free transport, shuttles, and sometimes bike-to-work perks.
Please note that in order to verify work authorization as is required by Federal law (I-9 process), all new employees must complete a live video verification with their selected IDs and provide photos of these selected IDs within their first 3 days of employment.
To know more details (Click here)
In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification form upon hire. In addition, we employ anti-fraud checks to ensure all candidates meet the requirements of the program.
As a trusted global transformation partner, Welocalize accelerates the global business journey by enabling brands and companies to reach, engage, and grow international audiences. Welocalize delivers multilingual content transformation services in translation, localization, and adaptation for over 250 languages with a growing network of over 400,000 in-country linguistic resources. Driving innovation in language services, Welocalize delivers high-quality training data transformation solutions for NLP-enabled machine learning by blending technology and human intelligence to collect, annotate, and evaluate all content types. Our team works across locations in North America, Europe, and Asia serving our global clients in the markets that matter to them. www.welocalize.com
To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform essential functions.
Similar Jobs
Big Data • Fintech • Mobile • Payments • Financial Services
Own the vision and roadmap for Affirm’s consumer loyalty program, launching rewards, tiers, engagement loops, and redemption experiences. Lead program economics, experimentation, incrementality, LTV measurement, and reward optimization. Partner with Risk, Credit, Legal, Compliance, Finance, Marketing, engineering, and design to deliver compliant products and drive repeat usage, retention, share of wallet, and incremental GMV.
Top Skills:
AmplitudeClaude CodeCursorSQL
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Architect and own marketing data infrastructure, Databricks pipelines, Gold Layer tables, semantic models, and AI-enabled data products. Lead complex cross-team initiatives, translate ambiguous business needs into scalable solutions, ensure data quality and reliability, and mentor engineers and analysts. Build, evaluate, and monitor production LLM and agent systems while automating marketing and go-to-market workflows with AI. Partner with BI, Data Science, Marketing, Sales, and R&D teams to support self-service analytics and trusted business KPIs.
Top Skills:
Ai AgentsBigQueryClaude CodeCursorData WarehousesDatabricksDbtEltETLLakehouse ArchitecturesLlmsPythonSalesforceSemantic LayersSnowflakeSQLStreamlit
2 Hours Ago
Easy Apply
Easy Apply
Big Data • Fintech • Mobile • Payments • Financial Services
Leads Marketing and Consumer Privacy Engineering teams, developing engineers and establishing a shared operating model. Translates business and product priorities into engineering plans across logged-out web, experimentation, marketing integrations, attribution, measurement, consent, privacy experiences, and consumer data collection. Partners with Product, Marketing, Privacy, Legal, and Engineering stakeholders to deliver reliable, scalable, privacy-aware systems while balancing customer needs, quality, speed, and risk.
Top Skills:
AnalyticsAttributionAustralian Privacy ActCcpa/CpraConsent ManagementCookiesGdprInstrumentationMarketing TechnologyMeasurement SystemsTaggingWeb Experimentation
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
