Surge AI Logo

Surge AI

Research Scientist

Posted One Month Ago
Remote
Hiring Remotely in United States
Entry level
Remote
Hiring Remotely in United States
Entry level
Research data strategies for large language model development, including designing data slices to identify model failure modes, modeling annotator behavior, and optimizing instruction clarity and reward-signal reliability. Develop metrics and evaluation frameworks to assess dataset quality, diversity, alignment impact, and downstream model performance. Collaborate with AI research teams and test data-centric methodologies in production environments.
The summary above was generated by AI
About Us

Our mission is to raise AGI with the richness of human intelligence — curious, witty, imaginative, and full of unexpected brilliance.

Surge was founded by engineers and researchers who dreamed of building the next generation of AI. Our platform powers the most capable models in the world, in partnership with the AI models you use every day.

At Surge, we believe the path to AGI isn't just about scaling compute—it's about embracing the unlimited ceiling of human intelligence and creativity in the data that shapes these systems. Our platform combines elite human expertise with cutting-edge tools for scalable oversight, from building rich RL environments to conducting rigorous evaluations that go beyond benchmarks. We've run a profitable business from day one without raising venture funding.

The Role

As a Research Scientist focused on data, you’ll work at the cutting edge of LLM development by designing the datasets that shape how frontier models behave. You’ll partner directly with AI research teams to experiment with new data collection strategies, evaluate dataset quality, and uncover insights that improve alignment, safety, and model performance.

This is a research-driven, impact-heavy role: you’ll have the opportunity to test ideas quickly in live production environments, shape data-centric methodologies for some of the world’s top AI labs, and help define how high-quality data fuels the next generation of AI systems.

What We’re Looking for
  • Deep Curiosity About Data – Obsession with understanding how the structure, quality, and selection of data influence LLM performance

  • Bias Toward Insight and Iteration – You think critically but move fast, designing lightweight experiments to generate actionable results

  • Desire to Shape AI Development – Drive to build the foundational data layer that defines how the next generation of AI systems behave

What You'll Do
  • Research data collection strategies and designing high-impact data slices that uncover model failure modes

  • Model annotator behavior and designing experiments to optimize instruction clarity and reward signal reliability

  • Develop metrics and frameworks for evaluating dataset quality, diversity, and impact on downstream model alignment

Similar Jobs

Yesterday
In-Office or Remote
160K-250K Annually
Entry level
160K-250K Annually
Entry level
Artificial Intelligence • Generative AI
Conduct breakthrough research in AI forecasting, research, and epistemics. Researchers tackle ambiguous problems, run experiments, productionize results, and connect research to product and customer deliverables. The role requires strong quantitative ability, modern AI knowledge, coding-agent proficiency, pragmatic judgment, and rapid execution in a startup environment. Preferred experience includes LLM agents, epistemic research, forecasting, judgment, truth evaluation, and creating AI benchmarks, datasets, or evaluation tasks.
Top Skills: Ai SystemsBenchmarksCoding AgentsDatasetsLarge Language Models (Llms)Llm Agents
3 Days Ago
Remote
United States
200K-200K Annually
Senior level
200K-200K Annually
Senior level
Angel or VC Firm
Lead research into novel AI architectures, learning algorithms, reasoning, knowledge representation, and evaluation methodologies. Define and execute ambitious research programs, design experiments, develop large-scale content evaluation systems, mentor research engineers, and communicate findings through technical publications. The role combines scientific leadership with hands-on innovation focused on language models, factuality, evidence quality, source reliability, and trustworthy AI systems.
Top Skills: Ai EvaluationAi Software DevelopmentArtificial IntelligenceKnowledge RepresentationLarge Language ModelsMachine LearningOpen-Weight Language Models
3 Days Ago
Remote
United States
146K-234K Annually
Senior level
146K-234K Annually
Senior level
Aerospace • Information Technology • Security • Cybersecurity • Defense
Conduct advanced research spanning RF communications, digital signal processing, compressive sensing, machine learning, and resilient network systems. Develop and deploy ML pipelines for RF and time-series data using modern frameworks and MLOps practices. Lead projects from concept through demonstration, publish technical findings, and communicate results to stakeholders. Work may support 5G, non-terrestrial networks, cybersecurity, electronic warfare, SIGINT, radar, and other national security applications.
Top Skills: 5GSparkAutoencodersCC++Ci/CdCnnsCompressive SensingDeep LearningDigital Signal ProcessingDockerGansGitKerasLinuxLstmsMachine LearningMatlabMlflowNon-Terrestrial NetworksNumpyPandasPythonPyTorchReinforcement LearningRf CommunicationsRnnsScikit-LearnSoftware-Defined NetworkingTensorFlowTransformersWeights & Biases

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account