Barbaricum is a rapidly growing government contractor providing leading-edge support to federal customers, with a particular focus on Defense and National Security mission sets. We leverage more than 17 years of support to stakeholders across the federal government, with established and growing capabilities across Intelligence, Analytics, Engineering, Mission Support, and Communications disciplines. Founded in 2008, our mission is to transform the way our customers approach constantly changing and complex problem sets by bringing to bear the latest in technology and the highest caliber of talent.
Headquartered in Washington, DC's historic Dupont Circle neighborhood, Barbaricum also has a corporate presence in Tampa, FL, Bedford, IN, and Dayton, OH, with team members across the United States and around the world. As a leader in our space, we partner with firms in the private sector, academic institutions, and industry associations with a goal of continually building our expertise and capabilities for the benefit of our employees and the customers we support. Through all of this, we have built a vibrant corporate culture diverse in expertise and perspectives with a focus on collaboration and innovation. Our teams are at the frontier of the Nation's most complex and rewarding challenges. Join our team.
Barbaricum is seeking a Generative AI (GenAI) Subject Matter Expert (SME) to lead technical benchmarking, model evaluation, and best practices for implementing LLMs and AI-driven solutions in the DoD. This role focuses on retrieval-augmented generation (RAG), model performance monitoring, and AI-driven document analysis using AWS Bedrock, AWS Sagemaker, and other AI frameworks.
Responsibilities:
- Lead technical research and benchmarking for GenAI and RAG implementations.
- Develop model performance evaluation metrics to optimize AI-driven workflows.
- Provide expert guidance on LLM integration for DoD applications.
- Test, validate, and refine GenAI models, ensuring efficiency and reliability.
- Recommend best practices for unstructured document and content analysis using AI.
Qualifications:
- Must be a U.S. Citizen and reside within the United States.
- AWS certifications highly preferred; AIML and SEC experience is a plus.
- Bachelor’s degree plus 7+ years of experience, or Master’s degree plus 5+ years of experience in AI, Machine Learning, or Data Science.
- Experience with LLMs, Generative AI, RAG, and AI-powered knowledge retrieval.
- Strong expertise in AWS Bedrock, cloud AI services, and AI model benchmarking.
- Proficiency in Python, SQL, and AI evaluation frameworks.
EEO Commitment
All qualified applicants will receive consideration for employment without regard to sex, race, ethnicity, age, national origin, citizenship, religion, physical or mental disability, medical condition, genetic information, pregnancy, family structure, marital status, ancestry, domestic partner status, sexual orientation, gender identity or expression, veteran or military status, or any other basis prohibited by law.
Top Skills
Similar Jobs
What you need to know about the Boston Tech Scene
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
