Welo Global
Project Perseus | Data Labeling Associate - Arabic Speakers (Human-in-the-Loop AI)
Be an Early Applicant
Evaluate AI outputs and audit model behavior, apply and refine guidelines, identify failure modes and trends, document findings, and collaborate with leads and cross-functional teams to improve evaluation frameworks and data quality.
Overview
Welo Data is looking for sharp, curious, and detail-oriented individuals to join our team as Data Labeling Associate.
This is not a traditional annotation role.
You’ll be working directly with cutting-edge AI systems — evaluating outputs, identifying gaps, and helping improve how these systems behave in real-world scenarios. The work sits at the intersection of data quality, model evaluation, and human judgment, where your ability to think critically matters just as much as following guidelines.
We’re looking for people who are naturally curious about AI, comfortable forming opinions, and confident in contributing to conversations with teammates, leads, and stakeholders.
Project Details
- Job Title: Data Labeling Associate
- Hiring in: NYC, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, Burlingame, Austin, Los Angeles, Washington DC, Chicago, Boston
- Hours: Full-time, 40 hours per week
- Employment Type: W2 Full-Time Employee
- Work Authorization: Must be authorized to work in the U.S. (no visa sponsorship)
- Pay Rate: $34/hour
- Contract Duration: 1-year contract with possibility of extension
Important: This is a 100% onsite position — remote work is not available for this role. To be considered, candidates must be located in or able to commute to one of the following cities: New York City, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, Burlingame, Austin, Los Angeles, Washington DC, Chicago, Boston. Please only apply if you meet this location requirement.
What You’ll Do
- Evaluate AI model outputs and provide structured, high-quality feedback
- Perform audit-based reviews of data and model behavior — identifying patterns, edge cases, and failure modes
- Apply guidelines thoughtfully — and flag when they don’t reflect real-world scenarios
- Contribute to improving evaluation frameworks, not just executing them
- Identify trends in model performance and communicate insights clearly
- Participate in team discussions, calibrations, and stakeholder syncs
- Partner with leads and cross-functional teams to refine quality standards
- Document findings in a clear, concise, and actionable way
What We’re Looking For
- Native-level language proficiency and a university degree (Bachelor’s or higher).
- B2 or superior level of English.
- 1–2 years of professional writing experience with strong, structured writing skills
- Ability to apply complex writing rules and guidelines consistently
- Strong understanding of safety considerations in GenAI data delivery, with 2+ years of relevant experience
- Strong critical thinking and attention to detail
- Ability to make sound judgment calls in ambiguous situations
- Naturally curious about AI, technology, and how systems behave
- Comfortable speaking up, asking questions, and contributing ideas
- Strong written and verbal communication skills
- Ability to stay consistent while working with evolving guidelines
- Experience in data quality, QA, annotation, or analysis is helpful — but not required
Benefits
- Paid Vacation: 6 days
- Paid Company Holidays: 2 days (Memorial Day and Labor Day)
- Paid Sick Leave: accrued per applicable state law and company policy
- Medical, Dental, and Vision Insurance (eligibility applies)
- Health Savings Account (HSA)
- 401(k) Retirement Plan
- Employee Assistance Program
- Additional voluntary benefits (life, accident, critical illness, etc.)
- Free Gourmet Food: Free breakfast, lunch, and dinner are provided, featuring a wide variety of cuisines in multiple cafes.
- Micro-kitchens & Snacks: Offices are stocked with free snacks and beverages, including premium coffee and La Croix.
- Unique Campus Features: Some locations include roof-top nature parks
- Commuter Benefits: Free transport, shuttles, and sometimes bike-to-work perks.
Please note that in order to verify work authorization as is required by Federal law (I-9 process), all new employees must complete a live video verification with their selected IDs and provide photos of these selected IDs within their first 3 days of employment.
To know more details (Click here)
In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification form upon hire. In addition, we employ anti-fraud checks to ensure all candidates meet the requirements of the program.
As a trusted global transformation partner, Welocalize accelerates the global business journey by enabling brands and companies to reach, engage, and grow international audiences. Welocalize delivers multilingual content transformation services in translation, localization, and adaptation for over 250 languages with a growing network of over 400,000 in-country linguistic resources. Driving innovation in language services, Welocalize delivers high-quality training data transformation solutions for NLP-enabled machine learning by blending technology and human intelligence to collect, annotate, and evaluate all content types. Our team works across locations in North America, Europe, and Asia serving our global clients in the markets that matter to them. www.welocalize.com
To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform essential functions.
Similar Jobs
Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Investigates and processes commercial insurance claims, determines policy coverage, assesses damages and losses, establishes reserves, negotiates settlements, and maintains accurate claim documentation. The role involves frequent communication with insureds, claimants, agents, and internal teams, along with coordination with appraisal, subrogation, and fraud investigation units. Candidates need strong customer service, organizational, communication, and technology skills, with licensing potentially required across multiple states.
AdTech • Artificial Intelligence • Big Data • Machine Learning • Marketing Tech • Mobile • Software
Design, build, and operate high-throughput, low-latency ad-serving infrastructure processing millions of requests per second. Optimize GPU-powered TensorRT inference, feature stores, model serving, benchmarking, experimentation tooling, and system reliability. Partner with machine learning engineers to productionize models and own systems through design, deployment, observability, capacity planning, incident response, and optimization.
Top Skills:
Big DataFeature StoresGoGpusMachine LearningTensorrt
Artificial Intelligence • Enterprise Web • Information Technology • Productivity • Sales • Software • Database
Own and expand Apollo’s partnerships with foundation model companies, agent harnesses, and AI-native platforms. Identify new integration surfaces, drive partner certification and compliance, develop monetization strategies, and coordinate multi-party partnerships. Collaborate with R&D to design and launch MCP servers, plugins, skills, and agent tools while tracking fast-changing AI ecosystem developments and shaping Apollo’s partnership strategy.
Top Skills:
Agent ToolsApi DocumentationAPIsFoundation ModelsIntegration ArchitectureMcpPlugins
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
