The Generative AI Analyst will create prompts and responses for varied topics, lead labeling tasks, update guidelines, and train teams on LLM best practices.
OVERVIEW
We are seeking a Generative AI Analyst to support a high-impact machine learning project. This role focuses on creating high-quality prompts and responses across diverse topics, leading labeling initiatives with internal and external partners, and developing clear guidelines to ensure consistency and accuracy in large language model datasets. The ideal candidate is a strong communicator with native-level U.S. English, experienced in working with data and comfortable training teams on best practices for LLM development. This position is fully remote and suited for someone motivated to work with cutting-edge AI technologies.
Project Details
Job Title: Generative AI Analyst
Location: Remote
Hours: 40 hours weekly
Language: English (US)
Start date: April 2026
Employment Type: Full-time W-2 employee with benefits – 5 days a week
Pay rate: $27.38/hour
If you reside in California, please apply to the California-specific posting for the applicable rate
Location: Remote
Hours: 40 hours weekly
Language: English (US)
Start date: April 2026
Employment Type: Full-time W-2 employee with benefits – 5 days a week
Pay rate: $27.38/hour
If you reside in California, please apply to the California-specific posting for the applicable rate
Must have valid work authorization in the US (Welo Data does not sponsor VISAs at this time).
Key Responsibilities
- Creatively writing prompts and responses to a variety of diverse topics
- Perform LLM annotation and evaluation tasks (ranking, scoring, labeling, tagging)
- Evaluate model outputs for accuracy, relevance, and instruction-following
- Identify and document issues such as hallucinations and inconsistencies
- Participating in and/or supporting labeling workflows, including hands-on annotation and collaboration with internal or external teams
- Training teams on best practices for creating Large Language Models/Data sets
Requirements
- Hands-on experience performing data annotation or evaluation tasks (e.g., labeling, ranking, scoring, or tagging LLM outputs)
- Native or near-native English with excellent writing skills
- Strong attention to detail and ability to follow guidelines consistently
- Self-driven, motivated and enthusiastic to work on state-of-art machine learning tools
- 4 year Accredited College degree or equivalent experience
- College Degree or experience in Linguistics, English Literature, Creative Writing, Journalism, and domain knowledge (Law/Medical/Math/Coding/etc.)
- Experience working in annotation platforms or structured labeling environments is a plus
- Deep understanding of Large Language Models/RLHF
- Experience in labeling/tagging of frames/tasks/prompts to prepare for DNN
- QA/testing experience
Ways to stand out from the crowd:
Please note that in order to verify work authorization as is required by Federal law (I-9 process), all new employees must complete a live video verification with their selected IDs and provide photos of these selected IDs within their first 3 days of employment.
To know more details (Click here)
In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification form upon hire. In addition, we employ anti-fraud checks to ensure all candidates meet the requirements of the program.
As a trusted global transformation partner, Welocalize accelerates the global business journey by enabling brands and companies to reach, engage, and grow international audiences. Welocalize delivers multilingual content transformation services in translation, localization, and adaptation for over 250 languages with a growing network of over 400,000 in-country linguistic resources. Driving innovation in language services, Welocalize delivers high-quality training data transformation solutions for NLP-enabled machine learning by blending technology and human intelligence to collect, annotate, and evaluate all content types. Our team works across locations in North America, Europe, and Asia serving our global clients in the markets that matter to them. www.welocalize.com
To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform essential functions.
Top Skills
Python
Similar Jobs
Machine Learning • Natural Language Processing
The Generative AI Analyst will create prompts and responses for machine learning projects, lead labeling initiatives, and provide training on best practices for LLM datasets.
Top Skills:
Large Language ModelsMachine LearningPython
Artificial Intelligence • Cloud • Consumer Web • eCommerce • Information Technology • Software
As a Lead Infrastructure Engineer, you'll enhance database reliability, automate infrastructure, collaborate on initiatives, and participate in on-call duties.
Top Skills:
AlertmanagerAmazon EcsAnsibleBashChefDockerElkGoKubernetesLightstepNew RelicNomadPHPPrometheusPuppetRubySentryTerraform
eCommerce • Fashion • Other • Retail • Sales • Wearables • Design
Leverage HR proficiency to manage employee lifecycle, provide guidance on employee relations, support talent management, lead organizational change, and ensure operational HR excellence.
Top Skills:
ExcelMicrosoft PowerpointMicrosoft TeamsMicrosoft VisioMicrosoft WordWorkday
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
