Berkeley Research Group Logo

Berkeley Research Group

AI Lab Infrastructure Engineer

Reposted 3 Months Ago
Remote
Hiring Remotely in USA
Senior level
Remote
Hiring Remotely in USA
Senior level
Design and implement a virtual access layer to enable remote use of a physical AI lab, building scalable, secure infrastructure to process 100,000+ documents/day with LLMs, optimize GPU/LLM throughput, provide customizable interfaces, implement authentication/access controls, and lead projects from design to production.
The summary above was generated by AI
We do Consulting Differently

Berkeley Research Group's Ai Department is seeking an AI Infrastructure Engineer to lead the development of our Virtual Ai Lab initiative. Following the successful completion of Phase 01 (physical Ai Lab build-out), this role will focus on creating a virtual access layer that makes our high-performance Ai Lab remotely accessible to teams across BRG. The ideal candidate will design and implement scalable infrastructure to support processing 100,000+ documents daily using state-of-the-art LLMs from OpenAI and Anthropic.

About the Role

As an AI Infrastructure Engineer, you will architect and build the virtual access interface for our physical Ai Lab, ensuring secure, scalable, and efficient remote processing capabilities. You will lead the design and implementation of infrastructure that allows BRG teams to leverage our Ai Lab's computational power remotely, while maintaining performance standards for large-scale document processing. Key responsibilities include developing customizable interfaces for different BRG groups, implementing secure access controls, and ensuring optimal resource allocation for concurrent users processing massive datasets through LLMs.

Key Responsibilities

  • Design and implement a virtual access layer for the physical Ai Lab infrastructure
  • Build scalable remote processing capabilities supporting 100,000+ documents per day
  • Create customizable, expandable interfaces for different BRG business units
  • Optimize infrastructure for maximum LLM token throughput (OpenAI/Anthropic)
  • Implement secure authentication and access management systems
  • Ensure high availability and fault tolerance for mission-critical AI workloads
  • Lead infrastructure projects from conception to production deployment

Required:

  • Bachelor's degree in Computer Science, Information Technology, or a related field
  • Minimum six to eight (6-8) years of hands-on experience designing, deploying, and managing scalable cloud infrastructure
  • Strong experience with Infrastructure as Code (IaC) tools and methodologies
  • Experience designing, implementing, and maintaining scalable, secure, and cost-efficient cloud/on-prem solutions
  • Proven ability to manage and lead projects to deliver high-quality, replicable solutions
  • Proficiency in VCS (Git/GitHub), modern coding languages (Python, .NET, Java, etc.), Software Development Life Cycle, and CI/CD practices
  • Experience with API design and implementation for distributed systems
  • Knowledge of GPU infrastructure and optimization for AI workloads
  • Hands-on experience with AWS Services including:
    • EC2/Lambda (apps/functions)
    • SageMaker (ML)
    • S3 (file management)
    • Fargate/ECS/EKS (containerization)
    • CDK/Terraform (IaC)
    • Cost Explorer/Budgets

​Preferred:

  • Experience with LLM deployment and optimization (OpenAI, Anthropic, etc.)
  • Background in building AI/ML infrastructure and platforms
  • Experience with virtual desktop infrastructure (VDI) or remote access solutions
  • Knowledge of distributed computing and job scheduling systems
  • AWS certifications (Solutions Architect, Machine Learning, or similar)
  • Experience with cost management and optimization strategies in the cloud
  • Familiarity with security best practices for AI systems and data handling

About BRG
 
BRG combines world-leading academic credentials with world-tested business expertise purpose-built for agility and connectivity, which sets us apart—and gets you ahead.

At BRG, our top-tier professionals include specialist consultants, industry experts, renowned academics, and leading-edge data scientists. Together, they bring a diversity of proven real-world experience to economics, disputes, and investigations; corporate finance; and performance improvement services that address the most complex challenges for organizations across the globe.

Our unique structure nurtures the interdisciplinary relationships that give us the edge, laying the groundwork for more informed insights and more original, incisive thinking from diverse perspectives that, when paired with our global reach and resources, make us uniquely capable to address our clients’ challenges. We get results because we know how to apply our thinking to your world.

At BRG, we don’t just show you what’s possible. We’re built to help you make it happen.  

BRG is proud to be an Equal Opportunity Employer. Our hiring practices provide equal opportunity for employment without regard to race, religion, color, sex, gender, national origin, age, United States military veteran status, ancestry, sexual orientation, marital status, family structure, medical condition including genetic characteristics or information, veteran status, or mental or physical disability so long as the essential functions of the job can be performed with or without reasonable accommodation, or any other protected category under federal, state, or local law.

Similar Jobs

4 Hours Ago
Remote
USA
Entry level
Entry level
Artificial Intelligence • Hardware • Productivity • Robotics • Software • Automation • Manufacturing
Deploy robotics solutions at customer manufacturing sites by defining ambiguous problems, integrating software, hardware, sensors, and manufacturing processes, and delivering measurable production results. The role includes robot programming and debugging, system architecture, customer collaboration, operator adoption, commissioning, rapid prototyping, and contributing site-specific solutions back to the broader platform. Travel to customer sites is approximately 50% of the time.
Top Skills: 3D ModelingAi ToolsCadComputer VisionGazeboIndustrial Communication ProtocolsIsaacManufacturing DrawingsMatlabMetrology ToolsMicrocontrollersMoveitOmniversePlcsPrompt EngineeringRoboticsRosRos-IndustrialRvizVendor Motion Apis
8 Hours Ago
Remote or Hybrid
Mid level
Mid level
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Develops and implements consultative and technical IT solutions for clients. Responsibilities include level-three escalation support, Microsoft and cloud environment assessments, security reviews, technology roadmaps, risk and modernization recommendations, project scoping and budgeting, and client communication. The role requires coordinating technical resolutions, managing multiple projects, and traveling approximately 15% to client locations in Pennsylvania.
Top Skills: Active DirectoryAntivirusAzure Active DirectoryCloud ApplicationsEndpoint DevicesFirewallsLocal NetworksMicrosoft 365AzureServersSharepointSwitchesVirtualized Environments
8 Hours Ago
Remote or Hybrid
Senior level
Senior level
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Manage and review complex tax returns and consulting for partnership clients, leading client service teams while training and mentoring staff, ensuring excellent client relationships and compliance with tax regulations.
Top Skills: Tax-Related Software

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account