Shift Technology Logo

Shift Technology

Data Scientist / Engineer

Posted 3 Days Ago
Easy Apply
In-Office
Boston, MA, USA
80K-110K Annually
Senior level
Easy Apply
In-Office
Boston, MA, USA
80K-110K Annually
Senior level
As a Data Scientist/Engineer, you will build and productionize data pipelines, design LLM-based solutions, and integrate Agentic AI technologies. Your role involves evaluating decision-making frameworks, ensuring responsible AI practices, and engaging with clients for feedback on prototypes and roadmaps.
The summary above was generated by AI

Shift is the leading AI platform for insurance.  Shift combines generative, agentic, and predictive AI to transform underwriting, claims, and fraud and risk - driving operational efficiency, exceptional customer experiences and measurable business impact.  Trusted by the world's leading insurers, Shift delivers AI when and where it matters most, at scale and with proven results.

Our culture is built on innovation, trust, and a drive to transform the insurance industry through our SaaS platform. We come from more than 50 different countries and cultures and together we are creating the future of insurance.

About the Team

  • This role is part of our Data Science team which is the largest team in our organization consisting of over 200+ Data Scientists throughout the world.
  • Our Data Scientists work in a full lifecycle role and on a broad range of subjects acquiring extensive technical and professional experience in data science, data engineering, coding, business understanding and client engagement.
  • Our company is small enough that each person’s achievements has an impact on our overall performance, yet big enough to be a world leader and innovator in our domain.
  • As a member of the data science team, you will be working alongside our technical experts and your role will be key to rolling out our enterprise level solutions to our clients.

Key Responsibilities

  • Your role will be to actively contribute to the US- Insurance roadmap and clients, and working on various data types such as structured data, free text, documents and images. 
  • Build and productionize data pipelines (structured, text, documents, images) optimized for LLMs and multi-modal models.
  • Design, develop and deploy LLM-based solutions (RAG, embeddings, instruction tuning) for subrogation, claims handling, document understanding, and related use cases.
  • Experiment with the latest in Agentic AI technologies (Langchain/Langgraph, OpenAI Agent SDK, MCP, A2A) and develop MVP for the next generation of autonomous subrogation solutions.
  • Develop "Chain-of-Thought" and "ReAct" prompting strategies to ensure the agent can justify its liability percentages based on the Comparative Negligence laws of different jurisdictions.
  • Create custom "tools" for the agent, allowing it to query internal databases, call external weather APIs, or calculate impact force based on telemetry data.
  • Establish rigorous evaluation frameworks (LLM-as-a-judge) to ensure the agent’s decisions are unbiased, legally sound, and explainable.
  • Ensure responsible-AI practices: privacy, hallucination mitigation, explainability and compliance.
  • Lead client workshops, present prototypes, gather feedback and help define roadmap priorities.

WHAT WE ARE LOOKING FOR

We are looking for candidates with diverse skills to help us build excellent technology solutions for our clients and be proficient in the following skills:

  • Expert proficiency in production-level object-oriented programming (OOP) for building scalable and reliable systems.
  • Proven hands-on experience with Large Language Models (LLMs) and generative AI techniques (including RAG, embeddings, prompt engineering, and model tuning), leveraging frameworks such as OpenAI/Anthropic or open-source variants.
  • Solid foundation in ML fundamentals with practical experience in the full machine learning lifecycle, including model evaluation, monitoring, versioning, and deployment in production environments.
  • Experience designing and implementing robust data pipelines for document, OCR, and multi-modal data workflows.
  • Agentic Frameworks: Experience with integrating frameworks like LangChain/LangGraph, OpenAI Agent SDK, CrewAI, A2A/MCP with Databricks or Azure-hosted models (e.g., DBRX, OpenAI GPT-5.3, Anthropic Claude, Google Gemini).
  • Demonstrated ability to effectively engage with clients, translate complex business needs into clear, actionable technical solutions, and manage stakeholder expectations.

Highly Desired Skills

  • Databricks Ecosystem: Deep expertise in Mosaic AI (formerly MosaicML), Unity Catalog, and Delta Lake.  Good understanding of Spark data architecture is a plus.
  • Experience using MLflow for the full lifecycle: from experiment tracking and prompt engineering in the AI Playground to model evaluation.

 #LI-MG1

#LI-HYBRID

The range listed is for base compensation.  Your actual base salary will vary based on factors including location and individual qualifications objectively assessed during the interview process. 

In addition to base salary, your total rewards package will include additional components such as incentive pay, equity, and benefits.  If you're interviewing for this role, speak with your Talent Acquisition Partner to learn more about the specific details for this position.

US Base Salary Pay Range
$80,000$110,000 USD

To support our permanent, full time employees at every stage of their careers and lives, we provide a competitive total rewards and benefits package. Here are the global benefits we’d like to highlight:

  • Flexible remote and hybrid working options
  • Competitive Salary and a variable component tied to personal and company performance
  • Multiple Learning and Development opportunities, including Focus Fridays, a half-day each month to focus on learning and personal growth
  • Generous PTO and paid holidays
  • Mental health benefits 
  • 2 MAD Days per year (Make A Difference Days for paid volunteering)

Additional benefits may be offered by country, based on your eligibility - ask your recruiter for more information. Intern and Apprentice positions may receive some of these benefits - ask your recruiter for more details.

At Shift we strive to be a diverse and inclusive workforce. We welcome applications from and hire people who will contribute to the diversity of our company, without regard to race, color, religion, marital status, age, national or ethnic origin, physical or mental disability, medical condition, pregnancy, genetic information, gender identity or expression, sexual orientation, or other non-merit criteria.

Shift Technology is committed to providing reasonable accommodations for qualified individuals with disabilities in our application and employment process. Should you require accommodation, please email [email protected] and we will work with you to meet your accessibility needs.

Please be aware of scammers and only trust correspondence that comes from emails ending in "shift-technology.com". We will never do initial outreach to you via Whatsapp/Text/SMS, never ask for banking information or personal identification numbers (ex. Social Security Number) as part of our recruitment process.

Shift Technology does not accept unsolicited CVs from recruiters or employment agencies in response to the Shift Technology Careers page or a Shift Technology social media post. Any unsolicited CVs, including those submitted directly to hiring managers, are deemed to be the property of Shift Technology.

Top Skills

Azure
Databricks
Generative Ai
Langchain
Langgraph
Large Language Models
Mlflow
Openai
Spark

Shift Technology Boston, Massachusetts, USA Office

75 Federal St, Boston, MA, United States, 02110

Similar Jobs

Yesterday
Easy Apply
Remote or Hybrid
United States
Easy Apply
99K-166K Annually
Senior level
99K-166K Annually
Senior level
Aerospace
This role involves partnering with sales to design data-driven solutions, engaging with customers, and supporting pre-sales engagements.
Top Skills: Data ScienceSolution ArchitectureSystems Engineering
3 Hours Ago
Remote or Hybrid
Waltham, MA, USA
102K-159K Annually
Senior level
102K-159K Annually
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
In this role, you will enhance customer engagement by developing relationships, driving product value, managing onboarding, and gathering feedback for improvements.
Top Skills: AINatural Language ProcessingSaaSWorkflow Automation
5 Hours Ago
Hybrid
Boston, MA, USA
114K-132K Annually
Expert/Leader
114K-132K Annually
Expert/Leader
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
The Engineering Manager will lead software innovation, manage cross-functional teams, oversee project execution, and mentor junior talent to enhance software solutions and client relationships.
Top Skills: AgileAPIsAtddC#.NetCi/CdJavaMicroservicesPythonScrumWaterfall

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account