Review text prompts and AI-generated videos to identify mismatches, visual or behavioral errors, and tag incorrect prompt text. Add concise annotations, perform self-QA, participate in calibration, document recurring model failures, and meet throughput and quality targets using structured annotation platforms.
About the Role
We are hiring full-time Generative AI Analysts in the United States to support evaluation and quality review of AI-generated videos. In this role, you will review text prompts, watch corresponding video outputs, and identify mismatches, inconsistencies, and visual errors.
This role is best suited for candidates with strong attention to detail, excellent visual comprehension, and the ability to follow structured guidelines consistently. Candidates should be comfortable reviewing video content, comparing visual outputs against written prompts, and writing clear, concise annotations. A solid understanding of US driving and road rules is especially important, as some tasks may involve roadway scenarios, vehicle behavior, and basic robotics behavior in real-world environments.
Project Details
- Job Title: Generative AI Analyst
- Location: Remote, USA
- Hours: 40 hours per week
- Employment Type: W2 Full-Time Employee
- Pay Rate: $28.80/hour
What You’ll Do
- Review text prompts and corresponding AI-generated video clips to identify mismatches, inconsistencies, and visual errors.
- Tag specific parts of the prompt that do not match the video by identifying only the incorrect prompt text, rather than the full sentence unless needed.
- Add visual or behavioral errors as annotation instances in annotation platform.
- Write brief, clear descriptions for each error instance.
- Avoid duplicate annotations by ensuring errors already captured as prompt mismatches are not added again as separate instances.
- Evaluate video content for actions, context, motion, scene consistency, object behavior, and prompt alignment.
- Apply project guidelines consistently across repetitive, detail-oriented tasks.
- Use critical thinking and judgment to handle ambiguous scenarios and determine the most accurate ground truth.
- Identify recurring or systematic errors across tasks and document examples for review.
- Perform self-QA on completed work and correct errors before submission.
- Participate in calibration sessions to align interpretation of guidelines and reduce annotator-to-annotator variance.
- Incorporate feedback from quality reviews into subsequent work.
- Support throughput and quality targets while maintaining accuracy at scale.
Requirements:
- Experience in video annotation, multimedia annotation, content quality review, data labeling, computer vision labeling, Generative AI evaluation, or a closely related field.
- Work Authorization is required for the role.
- Strong attention to detail and ability to identify subtle errors, mismatches, and inconsistencies between prompts and videos.
- Solid understanding of US driving rules, road behavior, traffic scenarios, and roadway conventions.
- Good reading comprehension and ability to accurately compare written prompts against visual outputs.
- Strong written communication skills in English, with the ability to describe errors clearly and concisely.
- Ability to follow detailed guidelines consistently and maintain high accuracy across repetitive tasks.
- Critical thinking and sound judgment when reviewing ambiguous or complex scenarios.
- Basic understanding of robotics behavior in real-world environments.
- Comfortable working in structured annotation platforms or similar tools.
- Ability to maintain focus and quality while reviewing multimedia content for extended periods.
Ways to Stand Out from the Crowd
- Prior experience evaluating AI-generated video, synthetic media, autonomous driving data, robotics scenarios, or traffic-related visual content.
- Familiarity with US traffic rules, road signage, lane behavior, vehicle interactions, pedestrian behavior, and common driving scenarios.
- Experience with QA, audit, or second-pass review workflows, including calibration, sampling, defect tracking, or error taxonomy development.
- Ability to identify recurring model failure patterns across tasks or batches.
Please note that in order to verify work authorization as is required by Federal law (I-9 process), all new employees must complete a live video verification with their selected IDs and provide photos of these selected IDs within their first 3 days of employment.
To know more details (Click here)
In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification form upon hire. In addition, we employ anti-fraud checks to ensure all candidates meet the requirements of the program.
As a trusted global transformation partner, Welocalize accelerates the global business journey by enabling brands and companies to reach, engage, and grow international audiences. Welocalize delivers multilingual content transformation services in translation, localization, and adaptation for over 250 languages with a growing network of over 400,000 in-country linguistic resources. Driving innovation in language services, Welocalize delivers high-quality training data transformation solutions for NLP-enabled machine learning by blending technology and human intelligence to collect, annotate, and evaluate all content types. Our team works across locations in North America, Europe, and Asia serving our global clients in the markets that matter to them. www.welocalize.com
To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform essential functions.
Similar Jobs
Cloud • Information Technology • Security • Software • Cybersecurity
Drive partner-facing technical pre-sales for Global Systems Integrators: demonstrate Zscaler use cases, run workshops and POVs, develop joint solution offers, onboard and enable partners, and advocate partner needs across sales, engineering, and product to close transformational cloud security deals.
Top Skills:
AuthenticationCcnpCisspCloud SecurityNetworkingSaaSZero TrustZscaler Zero Trust Exchange
Cloud • Information Technology • Security • Software • Cybersecurity
Sell Zscaler's data security portfolio (DLP, CASB, DSPM) to commercial accounts. Act as the specialist for customers and partners, build account-based strategies, collaborate with solution engineers and sales leadership, and close complex deals with stakeholders from technical practitioners to C-suite.
Top Skills:
CasbCloud-NativeDlpDspmZero Trust Exchange
.png)
Artificial Intelligence • Big Data • Healthtech • Machine Learning • Software • Biotech
Field-based HEOR liaison responsible for communicating and refining health economic, outcomes, and real-world evidence to payers. Support AMCP dossiers, value frameworks, and payer-focused education; partner with Market Access, Medical Affairs, and Commercial teams; identify data gaps, inform research priorities, and represent evidence at regional and national meetings. Requires travel for external engagements and internal collaboration.
Top Skills:
Ngs
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
