Evaluate search results for relevance and usefulness, answer simple quality questions, follow client guidelines, complete online tasks to improve AI/search systems, pass training and client exam, and sign an NDA.
OVERVIEW
Welo Data is looking for English speakers to join a remote project as a Search Quality Rater. In this role, you will help improve how search engines understand and deliver useful results to users.
What you’ll do:
Review search results and evaluate how helpful and relevant they are to the user’s query
Answer simple true/false questions about the quality of content
Rate whether search results meet the user’s needs using clear guidelines
Complete straightforward online tasks that contribute to improving AI systems
No specialized technical experience is required - we provide the guidelines and support you need to succeed!
Please click here for a short demo of these types of tasks: What Does a Search Quality Rater Do? (youtube.com)
Why this work matters:
Your feedback helps train and improve AI technology, making search engines smarter and more useful for people around the world.
Schedule & Support:
Fully remote position
Set your own schedule and complete tasks when it’s convenient for you
Support is available from the project management team during business hours (Monday–Friday, 9:00 AM – 5:30 PM Pacific)
Project Details
Job Title: Search Quality Rater
Location: Remote, US-based
Hours: Minimum 10 hours per week, up to 29 hours per week; set your own schedule
Start date: ASAP
Employment Type: W2 Part-Time Employee, payment every 2 weeks
Longevity of project: 12 months with possibility of extension.
This work is based on project needs. Weekly hours may vary.
Benefits:
Paid Sick Time
Employee Assistance Program
Following eligibility requirements:
Medical Insurance
Dental Insurance
Vision Insurance
HSA
Voluntary Life Insurance
Accident, Critical Illness,Hospital Indemnity Insurance
401(k) Retirement Plan
Currently hiring in: Alabama, Florida, Georgia, Indiana, Kansas, Kentucky, Montana, New Hampshire, North Carolina, Ohio, Oklahoma, Pennsylvania ,South Carolina, Tennessee, Texas, Utah, Virginia, West Virginia, Wisconsin.
Applicants must be of at least 18 years of age to apply.
Requirements
- Fluency in English
- Strong understanding of popular culture in the United States
- Must be dedicated only to "Search Quality rating program" and NOT other search or ads rating programs
- Must not have current or previous experience with "Ads quality rating"
- Web-savvy and able to work in a fast-paced environment
- Excellent online research skills
- Reliable computer system and internet connection
- Reliable anti-virus software (as you will be surfing the web as part of the work)
- Ability to follow instructions in English and comply with the project conventions and rules expected by the client
- Must sign a Non-Disclosure Agreement to protect client confidentiality
- Must pass learning modules and a required quality test designed by our client before starting work
Recruitment process
- Application & Initial Screening: Submit your interest through our Careers Page and answer a few brief project-related questions.
- Candidate Portal Registration: Keep an eye on your inbox! You’ll receive an invite to create your profile on our internal platform, where you will complete your final application steps.
- Skill & Language Evaluation: Take a quick assessment to showcase your linguistic expertise.
- Project Guidance: Access our exclusive "Know-How" guides and project documentation to set you up for success.
- Client Exam: Complete a client entrance exam to ensure you're ready for the live project.
- Onboarding & Launch: Once verified (ID & Tax only), you’ll be officially onboarded. Set your own schedule and start working!
In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification form upon hire. In addition, we employ anti-fraud checks to ensure all candidates meet the requirements of the program.
If you are currently working or have previous experience as an "Ads Quality Rater", unfortunately, you will not be able to work on our Search Quality Rating project.
However, we often have an open Ads Rating job posting. Please check our careers page here to apply: https://jobs.lever.co/welocalize
Similar Jobs
Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
Lead SRE work to keep Circle highly available and performant: respond to incidents, own monitoring/alerting/log management, manage and optimize MySQL/Postgres/ClickHouse/Redis databases, maintain server infrastructure and deployment pipelines, collaborate with engineering teams, and build internal SRE tooling and automation.
Top Skills:
AWSClickhouseKubernetesLlm-Based Tools (Copilots)MySQLPostgresRedis
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
Provide advanced litigation paralegal support across high-volume, multi-jurisdiction dockets: manage matter tracking, discovery and trial prep, subpoena and third-party request responses, small claims matters, deadline calendaring, outside counsel coordination, and build process/tooling improvements to scale the Litigation team.
Top Skills:
E-Discovery PlatformsGenerative Ai
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
The Senior Analytics Engineer will design and implement scalable data solutions for Finance Analytics, reconcile data accuracy, and collaborate across teams to enhance financial datasets and reporting workflows.
Top Skills:
AirflowDatabricksDbtGitLookerMatplotlibPlotlyPythonSnowflakeSQLTableau
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

.png)