Rise8 Logo

Rise8

Senior AI/ML Engineer (Generative AI Specialist)

Posted Yesterday
Remote
Hiring Remotely in USA
174K-208K
Senior level
Remote
Hiring Remotely in USA
174K-208K
Senior level
As a Senior AI/ML Engineer, you will lead the design and implementation of secure Generative AI systems, focusing on Large Language Models and MLOps principles, while enhancing team collaboration and driving innovative technical solutions.
The summary above was generated by AI
Your Dream. Our Team.About Rise8

We’re transforming the United States Government and we know that takes a dream team. 

We believe customer experience starts with employee experience, so we take care of our employees. We offer competitive pay and benefits, invest in employee growth, and offer a culture you can’t find anywhere else.

At Rise8, we continuously achieve unreached heights through next-level tech, and on-the-level collaboration. Together, we create continuous impact. We turn breakdowns into breakthroughs, make small steps into giant leaps, and deliver game-changing products through culture-changing process.

We pair Risers with their customer counterparts and practice pairing at every moment to elevate people and teams and deliver results fast and forever. We work in small teams and rotate between them frequently so that we are able to meet new challenges and explore new ideas.

Our methodology is about experimenting and learning, and our culture is empowering. We subscribe to an ethos of kindness. We make a point to bring empathy to each and every project and are guided by a promise and a purpose: to deploy critical outcomes to prod in order to drive relentless progress. Not just an idea. But an outcome. A better world. A world where every day, fewer bad things happen because of bad software.

Rise8 is certified as a Great Place to Work with 100% of employees saying they love working here.

About You
  • You want to make tomorrow better than today. 
  • You have a passion for high-speed security and you care about risk management over compliance.
  • You believe the biggest vulnerability in any system is time. You live to securely reduce cycle time.
  • You enjoy daily decision making and real product delivery.
  • You help ensure project success and client satisfaction. 
  • You enjoy collaborative teams, pairing with team members, and inviting your clients to participate. 
  • You like to work alongside, and learn from, lean and agile leaders. 
  • You are a creative problem solver who is comfortable with uncertainty.
  • You’re a curious and keen learner who thrives on enhancing your (and our) practices and knowledge.

As a Senior AI/ML Engineer at Rise8, you will be the cornerstone of our client's push into applied Generative AI. This is not a research role; it is a deeply technical, hands-on engineering position focused on delivering "outcomes in prod." You will apply your deep experience in building secure, scalable enterprise systems to the new frontier of Large Language Models. You will lead the design and implementation of a production-grade AI platform, building the reusable processes and scalable architecture that will enable enterprise-wide adoption. The ideal candidate is a master engineer who sees documentation and guidelines not as a deliverable, but as a necessary artifact of building something that lasts.

As a Senior AI/ML Engineer at Rise8, you will
  • Architect and Build Production AI Systems: Lead the end-to-end design, build, and deployment of a secure, scalable Generative AI platform on enterprise container platforms like OpenShift, integrating open-source LLMs and internal data sources using Retrieval-Augmented Generation (RAG) architecture.
  • Implement an Evaluation-First MLOps Lifecycle: Engineer a robust, "reusable process" for deploying and managing LLMs. This includes building CI/CD-style pipelines for phased rollouts, creating "golden" datasets for benchmarking, and implementing an Evaluation-Driven Development (EDD) process to continuously measure model accuracy, safety, and performance.
  • Codify and Scale Excellence: Develop the definitive prompt engineering guidelines and architectural patterns for the enterprise. You won't just write documents; you will codify the learnings from your production deployments into clear, actionable playbooks and templates that empower other teams.
  • Drive Technical Innovation: Conduct hands-on research of open-source models (e.g., Llama, Mistral), vector databases, and frameworks (e.g., LangChain, LlamaIndex). You will provide expert recommendations based on practical, proof-of-concept evaluations to ensure we are using the best tools for the job.
  • Embody Senior Engineering Leadership: As a Level 6 engineer, you will exemplify Rise8's core values. You will proactively solve complex problems, mentor other engineers, and communicate compelling technical narratives to both developers and stakeholders, ensuring your work aligns with business objectives and delivers tangible value.
Qualifications 
  • Core Experience: 7-10 years of professional experience designing, building, and deploying secure, scalable enterprise applications, including at least 2 years of recent, hands-on experience working directly with Large Language Models and MLOps principles.
  • Expert-Level Engineering: Demonstrated mastery of Python and its production ecosystem (e.g., FastAPI, Flask). You have a history of building robust APIs and services.
  • Hands-On LLM & RAG Experience: Proven, practical experience building applications with LLM orchestration frameworks (LangChain, LlamaIndex) and an understanding of the underlying architecture, including hands-on work with Vector Databases (e.g., Pinecone, ChromaDB, Weaviate).
  • DevSecOps & MLOps Mindset: Strong familiarity with modern DevSecOps principles and experience adapting them to the Machine Learning lifecycle. You must have experience with containerization (Docker, Kubernetes) and CI/CD pipelines. Experience with enterprise container platforms (OpenShift, Tanzu, or similar) is a significant plus.
  • An Evaluation-First Approach: You believe that testing is the foundation of quality. You have experience with Test-Driven Development (TDD) and a deep understanding of how to apply that mindset to AI through Evaluation-Driven Development (EDD).
  • Problem-Solving and Communication: You are a natural systems thinker who can articulate the root cause of complex problems and translate insights into robust solutions. You can independently present complex technical ideas to diverse audiences.
  • Clearance: Ability to obtain a security clearance for US Government work.
Preferred Qualifications 
  • Experience with MLOps tooling such as MLFlow, Kubeflow, or Weights & Biases.
  • Experience working directly with government clients, especially within a DoD "Software Factory."
  • A portfolio of personal AI projects (e.g., on GitHub) or contributions to open-source AI projects.
  • Experience training, mentoring, or upskilling other engineers.
Salary 

The annual salary range for this role as it is posted is $173,533 - $208,239 regardless of final candidate location within the United States. The final job level and annual salary will be determined based on the education, qualification, knowledge, skills, ability, and experience of the final candidate(s), and calibrated against relevant market data and internal team equity. 

Benefits 
  • Flexible schedule in a 100% distributed workforce 
  • Premium Insurance: We cover up to 100% of the employee premium and up to 80% of the combined dependent premium on our base health plan, depending on pay band. We also cover 100% of the premium for employee and dependent Dental and Vision as well as employee premiums for Life and Disability coverage.
  • Retirement: 401k match at 10% gross pay.
  • Paid time off (PTO): 4 weeks combined accrued vacation and sick leave, 11 Federal holidays, your birthday, jury duty, and bereavement.
  • Education & Training: Accrued budget of up to $3,500 per year for classes, travel, events, and materials.
  • Home Office and Merch: We offer $750 per year for home office technology and equipment as well as $100 per year for Rise8 merch from our Swag Store.
  • Wellness Budget: To encourage and support a well-rounded healthy lifestyle, we cover 100% reimbursement on a variety of wellness activities and products, up to $500 per calendar year. Or Rise8 is part of the the Life Time Corporate Partner program. In lieu of your $500 annual wellness benefit, you can instead get a $75 monthly credit towards a Life Time membership ($900 annual benefit).
  • Equipment: We offer a MacBook Pro

All of Rise8’s work in this area is with Federal Government customers that require our employees involved with their projects be U.S. citizens. As such, this role requires U.S. citizenship. If hired, you would also be required to go through a background investigation.

Rise8 is an Equal Employment Opportunity employer that will consider you for this role regardless of race, color, religion, gender, sexual orientation, marital status, gender identity or expression, national origin, genetics, age, disability status, protected veteran status, or any other characteristic protected by applicable law.

Top Skills

Docker
Fastapi
Flask
Kubeflow
Kubernetes
Langchain
Llamaindex
Mlflow
Openshift
Python
Weights & Biases

Similar Jobs

23 Minutes Ago
Remote or Hybrid
Boston, MA, USA
78-107
Senior level
78-107
Senior level
Healthtech • Software • Analytics • Biotech • Pharmaceutical • Manufacturing
The Oncology Territory Manager will implement marketing and sales strategies, build relationships with key stakeholders, and provide clinical data for oncology products. The role requires developing business plans, analyzing market conditions, and adhering to regulatory compliance.
24 Minutes Ago
Remote or Hybrid
Illinois, USA
127K-217K
Junior
127K-217K
Junior
Automotive • Hardware • Internet of Things • Mobile • Software • App development • PropTech
The Software Product Manager will develop product roadmaps, lead cross-functional teams, implement strategies for product categories, ensure superior user experiences, and support business profitability.
Top Skills: Agile Scrum Methodologies
26 Minutes Ago
Easy Apply
Remote
USA
Easy Apply
146K-215K
Senior level
146K-215K
Senior level
Consumer Web • Healthtech • Professional Services • Social Impact • Software
Lead and scale paid media programs for B2B audience, managing a team and optimizing campaigns to drive demand and acquisition.
Top Skills: Digital MarketingPaid SocialSemSeo

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account